Screenshot-based service recommendation method and related device

Abstract

Embodiments of the present application relate to the technical field of terminals, and provide a screenshot-based service recommendation method and a related device. After a screenshot is taken, an electronic device can intelligently recommend a corresponding service for a user on the basis of content of the screenshot. For example, when the screenshot corresponds to a ticket-grabbing scenario, the electronic device can provide a ticket-grabbing reminder service. For another example, when the screenshot comprises a scannable code, the electronic device can provide a code scanning reminder service and / or a code scanning direct access service. For another example, when the screenshot comprises a large amount of text or key information, the electronic device can provide an AI summary service and / or a content extraction service. For another example, when the screenshot comprises a location, the electronic device can provide a one-step taxi-hailing service and / or a one-step navigation service. In this way, the use scenarios of a screenshot operation can be enriched, and richer service content can be intelligently recommended for the user. Meanwhile, recommended content has a high degree of relevance to the user, thereby improving the probability of the user using the recommended service, and consequently improving the use experience of the user.

Description

Screenshot-based service recommendation methods and related equipment

[0001] This application claims priority to Chinese patent application filed on March 28, 2025, with application number 202510392082.7 and entitled "Method and Related Equipment for Service Recommendation Based on Screenshots", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal technology, and in particular to a service recommendation method and related equipment based on screenshots. Background Technology

[0003] Electronic devices can provide screenshot functionality; upon receiving a screenshot request, the electronic device can capture the content on the screen and save the screenshot.

[0004] Screenshots can include a variety of information, such as text, images, scannable codes, and so on.

[0005] However, in potential implementations, the use cases for screenshots are relatively limited. For example, if a screenshot includes a scannable code, users can find the screenshot in a gallery app and scan the code to perform activities such as adding friends, redeeming group-buying codes, or printing movie tickets. Alternatively, if a screenshot includes text and / or images, users can find the screenshot in a gallery app and view the specific information within it. Summary of the Invention

[0006] This application provides a screenshot-based service recommendation method and related equipment, applicable to the field of terminal technology. After taking a screenshot, the electronic device can intelligently recommend corresponding services to the user based on the screenshot content; for example, in a ticket-grabbing scenario, the electronic device can provide a ticket-grabbing reminder service after taking a screenshot; when the screenshot includes a scannable code, the electronic device can provide a scan reminder service or a direct scan access service, etc.; thereby enriching the use cases of screenshot operations and improving the user experience.

[0007] Firstly, this application proposes a screenshot-based service recommendation method for electronic devices, applicable to both scenario one and scenario two. Scenario one involves reminding the user at a specific time and / or location after recognizing the screenshot content. Scenario two involves supporting a one-step jump to recommended applications after recognizing the screenshot content. Specifically:

[0008] In Scenario 1, the method includes: displaying a first interface; the first interface includes a preset time and / or a preset location; in response to a screenshot operation on the first interface, displaying a thumbnail of the first screenshot and a first control on the first interface; the first control is used to provide a reminder service, and the first control corresponds to the thumbnail of the first screenshot; activating the reminder service based on a trigger operation on the first control; displaying a prompt message when the time of the electronic device reaches or approaches the preset time, and / or the location of the electronic device is at the preset location; wherein the prompt message is used to prompt the user to perform an operation related to the first interface; the time of the electronic device reaching or approaching the preset time includes: the time of the electronic device being equal to the preset time, or the time interval between the time of the electronic device and the preset time being less than a time threshold.

[0009] Scenario 1 corresponds to the embodiments shown in Figures 1-17. Specifically, Scenario 1 can be a ticket-grabbing scenario. The first interface can be, for example, the interface shown in Figure 1a; the preset time can correspond to the ticket sales time information 101; the preset location can be, for example, the address information of the ticket (e.g., the stadium in City A in the interface shown in Figure 1a); the thumbnail of the first screenshot can correspond to the screenshot thumbnail 103 in the interface shown in Figure 1b; the first control can correspond to the ticket-grabbing reminder control 105; the reminder service can be a ticket-grabbing reminder service; when the time approaches the preset time (e.g., the day of ticket sales, 1 hour before, and 10 minutes before), a prompt message is displayed (e.g., the ticket card 801 in the interface shown in Figure 8a, the ticket-grabbing reminder card 901 in the interface shown in Figure 9a, the ticket-grabbing reminder card 1001 in the interface shown in Figure 10a, and the ticket-grabbing reminder card 1101 in the interface shown in Figure 11a). The prompt message is used to prompt the user to perform an operation related to the first interface. This can be understood as follows: In Scenario 1, the prompt message can prompt the user to perform a ticket-grabbing operation when tickets go on sale.

[0010] Alternatively, Scenario 1 could be a QR code reminder scenario. The first interface could be, for example, the interface shown in Figure 14a; the preset time could correspond to the performance time in ticketing information 1401 (e.g., October 6-10 7), the preset location could correspond to the performance location in ticketing information 1401 (e.g., City A Stadium), and the thumbnail of the first screenshot could correspond to the screenshot thumbnail 1405 in the interface shown in Figure 14b; the first control could correspond to the QR code reminder control 1403; the reminder service could be a QR code reminder service; when the time is close to the preset time (e.g., the day of the performance) and the location is at the preset location (e.g., the performance location), a prompt message is displayed (e.g., the QR code reminder card 1501 in the interface shown in Figure 15a and the QR code reminder window 1502 in the interface shown in Figure 15b). The prompt message is used to prompt the user to perform operations related to the first interface, which can be understood as follows: in Scenario 1, the prompt message can be used to display a scannable code when the performance time and performance location are reached.

[0011] It should be noted that this application embodiment only describes Scenario 1 using the scenarios of ticket grabbing and QR code scanning reminders; besides the ticket grabbing scenario, Scenario 1 can also be the scenario of purchasing goods in bulk or making an appointment for medical treatment, etc.; besides the QR code scanning reminder scenario corresponding to the scannable code for tickets, Scenario 1 can also be the QR code scanning reminder scenario corresponding to the scannable codes for food pickup codes, group buying coupons, discount coupons and vouchers, and movie tickets, etc. This application embodiment does not impose any limitations on this.

[0012] In scenario two, the method includes: displaying a second interface of a first application, the second interface including first information for jumping to the second application; the first application is different from the second application; in response to a screenshot operation on the second interface, displaying a thumbnail of the second screenshot and a second control on the second interface; the second control is used to provide application jump service, and the second control corresponds to the first information; and displaying a third interface of the second application according to a trigger operation on the second control; the third interface corresponds to the first information.

[0013] Scenario 2 corresponds to the embodiments shown in Figures 18 and 19. Specifically, Scenario 2 can be a QR code-based direct access scenario. The first application can be, for example, a gallery application or other applications; the second interface can be, for example, the interface shown in Figure 18(a); the first information can correspond to the scannable code 1802, which is a scannable code used for accessing information in a social application. The thumbnail of the second screenshot can correspond to the screenshot thumbnail 1804 in the interface shown in Figure 18(b); the second control can correspond to the QR code-based direct access control 1806. The second application can be, for example, a social application; the third interface can correspond to the floating window 1809 of the social application in the interface shown in Figure 18(d). The third interface corresponding to the first information can be understood as follows: if the first information is a scannable code for a social application, then the third interface is the social application interface.

[0014] Alternatively, scenario two could be a navigation-to-the-scenes scenario. The first application could be, for example, a social application, and the second interface could be, for example, the interface shown in Figure 19a; the first piece of information could correspond to the address information (e.g., a stadium in City A) in the interface shown in Figure 19a, and the address information could be used for information access navigation applications. The thumbnail of the second screenshot could correspond to the screenshot thumbnail 1901 in the interface shown in Figure 19b, and the second control could correspond to the one-step navigation control 1902. The second application could be, for example, a navigation application, and the third interface could correspond to the floating window 1903 of the navigation application in the interface shown in Figure 19c. The correspondence between the third interface and the first piece of information can be understood as follows: if the first piece of information can correspond to the destination location in the navigation application, then the third interface is the navigation application interface.

[0015] It should be noted that this application embodiment only describes Scenario 2 using the scenarios of scanning a user's QR code business card directly and navigation directly. Besides the scenario of scanning a user's QR code business card directly, Scenario 2 can also be a scenario of scanning scannable codes for songs, products, and merchants directly. In addition to the navigation direct access scenario, Scenario 2 can also be a scenario of direct access for ride-hailing, ticketing, music, and merchants, etc. This application embodiment does not impose any limitations on these scenarios.

[0016] Comparing Scenario 1 and Scenario 2, it can be seen that after taking a screenshot, the electronic device can recognize the screenshot content, thereby identifying the user's intention in taking the screenshot. Different screenshot content indicates different services the user wants to use. In this embodiment, the electronic device can provide services that match the user's intention based on the screenshot. This enriches the usage scenarios of screenshot operations, intelligently recommending more diverse service content to users; simultaneously, the recommended content is highly relevant to the user, increasing the probability of the user using the recommended services, thereby improving the user experience.

[0017] In one possible implementation, this method is also applicable to scenario three. Scenario three involves extracting summaries or key information from text information in a screenshot.

[0018] In scenario three, the method includes: displaying a fourth interface, which includes the second information; responding to a screenshot operation on the fourth interface, displaying a thumbnail of the third screenshot and a third control on the fourth interface; the third control is used to provide an information extraction service, which is used to extract the third information from the second information, the third information including text information or summary information of the second information; the third control corresponds to the third screenshot; based on a trigger operation on the third control, displaying a first card on the fourth interface, the first card including the third information, a copy control, and a save control; wherein the copy control is used to copy the third information, and the save control is used to save the third information.

[0019] Scenario 3 corresponds to the embodiments shown in Figures 20 and 21. Specifically, Scenario 3 can be an AI summarization scenario. The fourth interface corresponds to the interface shown in Figure 20a, and the second information is, for example, the text in the interface shown in Figure 20a; the thumbnail of the third screenshot can correspond to the screenshot thumbnail 2001 in the interface shown in Figure 20b, and the third control can correspond to the AI ​​summarization control 2002; the information extraction service can be, for example, an AI summarization service, and the third information can be, for example, the AI ​​summarization information in the AI ​​summarization card 2004; the third control corresponding to the third screenshot can be understood as follows: when the third screenshot is found to contain text, and the number of characters is greater than the character count threshold, the electronic device can display the third control to recommend the AI ​​summarization service. The first card can correspond to the AI ​​summarization card 2004 in the interface shown in Figure 20d, the copy control can correspond to the copy control 2006, and the save control can correspond to the save to notes control 2007.

[0020] Alternatively, scenario three can also be a content extraction scenario. The fourth interface corresponds to the interface shown in Figure 21(a), and the second information is, for example, the text in the interface shown in Figure 21(a); the thumbnail of the third screenshot can correspond to the screenshot thumbnail 2101 in the interface shown in Figure 21(b), and the third control can correspond to the content extraction control 2102; the information extraction service can be, for example, a content extraction service, and the third information can be, for example, the key information in the content extraction card 2103; the third control corresponding to the third screenshot can be understood as follows: when the third screenshot is found to contain text, and the text contains key information, the electronic device can display the third control to recommend the content extraction service. The first card can correspond to the content extraction card 2103 in the interface shown in Figure 21(c), the copy control can correspond to the copy control 2105, and the save control can correspond to the save to notes control 2106.

[0021] In this way, in scenarios with a lot of text or where text cannot be copied (for example, key information in an image cannot be copied), electronic devices can quickly extract AI summary information or key information and provide users with copy and save functions, reducing user operations and improving the user experience.

[0022] In one possible implementation, based on the embodiment shown in Scenario 1, the first interface is a ticketing application interface (as shown in Figure 1a), and the preset time includes the ticket sales start time (e.g., September 10th, 20:00 in sales start time information 101); the reminder service includes a ticket-grabbing reminder service, which is used to prompt the user to grab tickets when the electronic device's time is close to the ticket sales start time (e.g., on the day of ticket sales, 1 hour before ticket sales, and 10 minutes before ticket sales); the first control includes a ticket-grabbing reminder control (e.g., ticket-grabbing reminder control 105); based on the trigger operation of the first control... The system enables a reminder service, including: in response to a trigger operation on the ticket-grabbing reminder control, displaying a second card (e.g., ticket-grabbing reminder card 106 on the interface shown in Figure 1c or Figure 2a) on a first interface, the second card including an add ticket-grabbing reminder control (e.g., add ticket-grabbing reminder control 108); in response to a trigger operation on the add ticket-grabbing reminder control, displaying a third card (e.g., ticket-grabbing reminder card 201 on the interface shown in Figure 2b) on the first interface, the third card including a first prompt message (e.g., prompt message 202); the first prompt message is used to notify the user that a ticket-grabbing reminder has been added.

[0023] This process can be described in the embodiment shown in Figure 2.

[0024] In this way, electronic devices can add reminders to users' ticket-buying activities, reminding users a period of time before the tickets go on sale, so as to prevent users from missing the ticket sales time.

[0025] In one possible implementation, the third card (e.g., the ticket-grabbing reminder card 201 shown in Figure 2b) further includes an automatic ticket-grabbing operation control (e.g., automatic ticket-grabbing operation control 109); after the third card is displayed on the first interface, the system further includes: in response to a trigger operation on the automatic ticket-grabbing operation control, displaying a fourth card (e.g., ticket-grabbing reminder card 204) on the first interface, the fourth card including a second prompt message (e.g., prompt message 205), the second prompt message being used to prompt the user that the automatic ticket-grabbing service has been added; the automatic ticket-grabbing service is used to automatically grab tickets when the electronic device's time reaches the ticket sales opening time.

[0026] This process can be described in the embodiment shown in Figure 2.

[0027] In this way, electronic devices can automatically grab tickets, helping users to grab tickets when they go on sale, simplifying the user's operation and increasing the success rate of grabbing tickets.

[0028] It should be noted that in this embodiment, the technical solution of this application is described by taking the example of an electronic device first enabling the ticket-grabbing reminder service and then enabling the automatic ticket-grabbing service. In practical applications, the electronic device may also enable the automatic ticket-grabbing service first and then enable the ticket-grabbing reminder service (for example, the embodiment shown in Figure 3), or only enable the automatic ticket-grabbing service, or only enable the ticket-grabbing reminder service. Similar to the above scenario, this embodiment will not be described again.

[0029] In one possible implementation, the ticket-grabbing reminder service corresponds to one or more associated services; the associated services are services intelligently recommended by the voice assistant application based on the first screenshot, and the associated services include one or more of the following: setting alarm clock service, hotel reservation service and train ticket reservation service, the preset time in the first interface also includes the performance time (e.g., October 6th to October 7th in the interface shown in Figure 1a), and the preset location includes the performance location (e.g., the stadium in City A).

[0030] The method for setting an alarm clock service includes: during the display of a second card (e.g., ticket-grabbing reminder card 106), a third card (e.g., ticket-grabbing reminder card 201), or a fourth card (e.g., ticket-grabbing reminder card 204), the first interface also displays an alarm clock setting control (e.g., the alarm clock setting control 111 shown in interface c in Figure 1), a hotel booking control (e.g., hotel booking control 112), and a train ticket booking control (e.g., train ticket booking control 113); in response to a trigger operation on the alarm clock setting control, a clock application interface (e.g., b in Figure 4) is displayed. The interface shown in Figure 4(c) or Figure 4(d) is used as an example. Taking the interfaces shown in Figure 4(b) and Figure 4(d) as examples, the clock application interface is used to create a new alarm clock. The clock application interface can be a full-screen interface or a floating window interface. The clock application interface includes the alarm clock time (e.g., 19:50 corresponding to the time wheel 402) and the new control (e.g., the completion control 405). The alarm clock time corresponds to the ticket sales time (e.g., the alarm clock time is 10 minutes before the ticket sales time). The new control is used to create an alarm clock that rings at the alarm clock time.

[0031] This process can be described in the embodiment shown in Figure 4.

[0032] In this way, users can quickly set alarms related to ticket grabbing using the alarm clock setting control; after adding the alarm, the electronic device can ring at the corresponding time to remind the user to grab tickets.

[0033] The method for booking hotel services includes: in response to a trigger operation on a hotel booking control (e.g., hotel booking control 112 in the interface shown in Figure 5a), displaying a hotel booking application interface (e.g., the interface shown in Figure 5b or Figure 5c, which can be a full-screen interface or a floating window interface); the hotel booking application interface includes hotel location (e.g., hotel location 501), check-in time (e.g., check-in time 502), and a hotel search control (e.g., hotel search control 503); wherein, the hotel location corresponds to the performance venue (e.g., both are stadiums in City A), and the check-in time corresponds to the performance time (e.g., the start time of the check-in time is the day before the performance time, and the end time of the check-in time is the day after the performance time); the hotel search control is used to search for hotels that match the hotel location and check-in time.

[0034] This process can be described in the embodiment shown in Figure 5.

[0035] In this way, users can quickly book hotels using the hotel booking control; after booking, users can check in at the corresponding hotel during the performance time specified on the ticket.

[0036] The method for booking train tickets includes: in response to a trigger operation on a ticket booking control (e.g., ticket booking control 113 in the interface shown in Figure 6a), displaying a ticket booking application interface (e.g., the interface shown in Figure 6b or Figure 6c, which can be a full-screen interface or a floating window interface); the ticket booking application interface includes ticket travel information (e.g., ticket travel information 601) and a ticket query control (e.g., ticket query control 602); wherein, the ticket travel information corresponds to the performance location and performance time (e.g., it can be a round-trip ticket from the user's address to the performance location, with the round-trip time being the day before and the day after the performance time respectively); the ticket query control is used to query tickets whose travel itinerary matches the performance location and performance time.

[0037] In this way, users can quickly book tickets using the ticket booking control; after booking tickets, users can travel to their destination according to the performance time on the ticket.

[0038] In this application embodiment, the electronic device can provide users with multiple related services in the ticket-grabbing scenario. Users can quickly set up the relevant controls, thereby simplifying user operations; at the same time, the rich service content further enhances the user experience.

[0039] In one possible implementation, the electronic device can provide users with various ticket-buying reminder services. For example, reminders can be sent on the day tickets go on sale, one hour before sale, or ten minutes before sale. Specifically, the ticket sale time includes the ticket sale date (e.g., September 10th) and the ticket sale time (e.g., 8:00 PM); when the electronic device's time reaches or approaches the preset time, and / or the electronic device's location is at a preset location, a prompt message is displayed, including:

[0040] On the day ticket sales begin: When the electronic device's time reaches the ticket sales date (e.g., the day ticket sales begin), a ticket card (e.g., ticket card 801 in the interface shown in Figure 8a), a train ticket card (e.g., train ticket card 802), and a hotel card (e.g., hotel card 803) are displayed on the desktop; the ticket card is used to launch the ticketing application, the train ticket card is used to launch the application for booking train tickets, and the hotel card is used to launch the application for booking hotels. This process corresponds to the embodiment shown in Figure 8.

[0041] In this way, on the day tickets go on sale, electronic devices can notify users of the ticket-grabbing event through a reminder card on the desktop, and prompt users to book tickets and hotels through related service cards such as ticket booking cards and hotel booking cards; helping users quickly complete services related to the ticket-grabbing scenario and avoid missing the ticket sales time.

[0042] One hour before ticket sales begin: If the time interval between the electronic device's time and the ticket sales start time is less than a first time threshold (e.g., one hour), a fifth card (e.g., the ticket-grabbing reminder card 901 in the interface shown in Figure 9a) is displayed. The fifth card includes a third prompt (e.g., ticket information), a ticket reservation control (e.g., ticket reservation control 902), and / or a hotel reservation control (e.g., hotel reservation control 903). The third prompt is used to remind the user to grab tickets at a preset time. The electronic device's time is earlier than the ticket sales start time (one hour before the ticket sales start time). This process corresponds to the embodiment shown in Figure 9.

[0043] In this way, one hour before tickets go on sale, electronic devices can remind users of upcoming ticket-grabbing events to prevent them from missing the ticket sales time; at the same time, they can prompt users to book train tickets and hotels, helping them quickly complete services related to the ticket-grabbing scenario.

[0044] Ten minutes before ticket sales begin: If the time interval between the electronic device's time and the ticket sales start time is less than a second time threshold (e.g., 10 minutes), a sixth card (e.g., ticket-grabbing reminder card 1001 in the interface shown in Figure 10a, or ticket-grabbing reminder card 1101 in the interface shown in Figure 11a) is displayed. If the electronic device has not added an automatic ticket-grabbing service, the sixth card (e.g., ticket-grabbing reminder card 1001) includes an automatic ticket-grabbing operation control (e.g., automatic ticket-grabbing operation control 1003) to prompt the user to enable the automatic ticket-grabbing service. If the electronic device has added an automatic ticket-grabbing service, the sixth card (e.g., ticket-grabbing reminder card 1101) includes a fourth prompt message (e.g., prompt message 1103), which prompts the user to automatically execute the ticket-grabbing operation after the second time threshold. The electronic device's time is earlier than the ticket sales start time, and the second time threshold is less than the first time threshold. This process corresponds to the embodiment shown in Figure 10.

[0045] In this way, after triggering the ticket-grabbing reminder by taking a screenshot, the electronic device can remind the user to use the automatic ticket-grabbing service multiple times, thereby reducing user operations and increasing the success rate of grabbing tickets.

[0046] In summary, after enabling the ticket-buying reminder service, electronic devices can remind users multiple times through various methods to prevent them from missing the ticket sales opening time.

[0047] In one possible implementation, the method further includes: during the display of the second, third, or fourth card, a voice assistant control is also displayed on the first interface (e.g., the interfaces shown in Figure 1b, Figure 2a, Figure 2b, and Figure 2c all include a voice assistant control 104); the voice assistant control is a control provided by the voice assistant application, used to interact with the user through user commands, which include text input by the user or voice recording; in response to a trigger operation on the voice assistant control, a dialog box is displayed on the first interface (e.g., the dialog box 701 of the voice assistant in the interface shown in Figure 7b); according to the first user command input by the user in the dialog box, a process corresponding to the first user command is executed; wherein, the user command includes a first user command, which is used to instruct the activation of ticket grabbing reminder service, activation of automatic ticket grabbing service, activation of alarm clock setting service, activation of hotel reservation service, and / or activation of train ticket reservation service. The first user command may also include other commands, which are not limited in this embodiment.

[0048] This scenario corresponds to the embodiment shown in Figure 7.

[0049] In this way, before the ticket-grabbing reminder is sent, users can use user commands to control the voice assistant to automatically start services such as ticket-grabbing reminder, automatic ticket grabbing, alarm clock setting, hotel booking, and / or ticket booking, reducing user operations.

[0050] In one possible implementation, the method further includes: during the display of the fifth or sixth card, a dialog box is also displayed (e.g., dialog box 904 of the voice assistant in the interface shown in Figure 9a, dialog box 1002 of the voice assistant in the interface shown in Figure 10a, or dialog box 1102 of the voice assistant in the interface shown in Figure 11a); according to the second user instruction entered by the user in the dialog box, the process corresponding to the second user instruction is executed; wherein, the user instruction includes the second user instruction, which is used to instruct the automatic ticket grabbing service, the hotel reservation service, and / or the train ticket reservation service to be started.

[0051] This scenario can be represented by the embodiments shown in Figures 9-11.

[0052] In this way, during the ticket-grabbing reminder process, users can use user commands to control the voice assistant to automatically activate services such as automatic ticket grabbing, hotel reservation, and / or car reservation, reducing user operations.

[0053] In this embodiment, during the display of the second to sixth cards, the electronic device can provide multiple operation methods. Users can activate the corresponding services by clicking the controls or talking to the voice assistant, thereby improving the flexibility of activating ticket-grabbing reminder services and related services.

[0054] In one possible implementation, after displaying the fifth or sixth card, the method further includes: (in the interface shown in Figure 12a) canceling the display of the dialog box (e.g., the interface shown in Figure 12b) in response to a first exit operation; wherein the first exit operation includes a click operation on a first blank area, a swipe operation from the edge of the screen inward, and / or an upward swipe operation; the first blank area does not include the fifth or sixth card and the dialog box; and (in the interface shown in Figure 12b) canceling the display of the fifth or sixth card (e.g., the interface shown in Figure 12c) in response to a second exit operation; wherein the second exit operation includes an upward swipe operation on the fifth or sixth card, and / or no trigger operation is received within a target time.

[0055] In this way, distributed exit can effectively prevent users from accidentally closing the ticket-grabbing reminder card and failing to check the notification message in time.

[0056] In one possible implementation, after displaying the fourth card (i.e., the automatic ticket grabbing service has been started) on the first interface, the system further includes: displaying a first window (e.g., the automatic ticket grabbing window 1004 in the interface shown in Figure 10c) when the electronic device's time reaches the ticket sales start time; the first window includes a fifth prompt message (e.g., "Trying to grab tickets"); the fifth prompt message indicates that automatic ticket grabbing is in progress; after the ticket grabbing is completed, displaying a second window (e.g., the ticket grabbing result window 1005 in the interface shown in Figure 10d); the second window includes a sixth prompt message (e.g., "Ticket issuance confirmation"); the sixth prompt message indicates that the ticket grabbing was successful and ticket issuance confirmation is required.

[0057] In this way, after triggering the ticket-grabbing reminder by taking a screenshot, the electronic device can remind the user to use the automatic ticket-grabbing service multiple times, thereby reducing user operations and increasing the success rate of grabbing tickets.

[0058] In one possible implementation, after displaying the third card (i.e., adding the ticket-grabbing reminder service) on the first interface, the process further includes: launching a calendar application and displaying the calendar application interface (as shown in Figure 13a, which can be launching the calendar application after exiting the ticketing application and displaying a full-screen interface; or opening a floating window of the calendar application without exiting the ticketing application); the calendar application interface includes a timeline (e.g., timeline 1305) and one or more schedules under the ticket sales date, one or more schedules including the schedule information for the ticket-grabbing reminder (e.g., ticket card 1303); the schedule information for the ticket-grabbing reminder corresponds to the ticket sales time on the timeline. This process corresponds to the embodiment shown in Figure 12.

[0059] This way, users can view the ticket cards using the calendar app to remind them that they need to participate in the ticket-buying activity on that day.

[0060] In one possible implementation, based on the embodiment shown in Scenario 1, the first interface (e.g., the interface shown in Figure 14a) further includes a first scannable code (e.g., a ticket scannable code 1402); the reminder service further includes a scan reminder service, which is used to display the first scannable code when the electronic device's time reaches or approaches a preset time and / or the electronic device's location is at a preset location; the first control includes a scan reminder control (e.g., a scan reminder control 1403 in the interface shown in Figure 14b); the reminder service is activated according to a trigger operation on the first control, including:

[0061] In response to a trigger operation on the QR code reminder control, a seventh card (e.g., QR code reminder card 1406 in the interface shown in Figure 14c) is displayed in the first interface. The seventh card includes a first scanable code, a seventh prompt message (e.g., prompt message 1408), and an add QR code reminder control (add QR code reminder control 1409). The seventh prompt message is used to prompt the user to display the first scanable code when the electronic device's time reaches or approaches a preset time and / or the electronic device's location is at a preset location. In response to a trigger operation on the add QR code reminder control, an eighth prompt message (e.g., the prompt message "QR code reminder added" in the interface shown in Figure 14d) is displayed. The eighth prompt message is used to prompt the user that a QR code reminder has been added.

[0062] In this way, users can quickly enable the QR code reminder service based on the QR code reminder control, and the first scannable code can be quickly displayed when the user uses it.

[0063] In one possible implementation, when the time of the electronic device reaches or approaches a preset time (e.g., 10.06-10.7 in the ticketing information 1401 shown in Figure 14a), and / or the location of the electronic device is at a preset location (the A City Gymnasium in the ticketing information 1401 for 10.06-10.7), a prompt message is displayed, including: when the time of the electronic device reaches the preset time (e.g., October 6th), a QR code reminder card (e.g., QR code reminder card 1501 in the interface shown in Figure 15a) is displayed on the desktop, the QR code reminder card is used to launch the application corresponding to the first scannable code; the QR code reminder card includes the first scannable code; and / or, when the time of the electronic device reaches or approaches the preset time, and / or the location of the electronic device is at a preset location (e.g., the A City Gymnasium), a third window (e.g., QR code reminder window 1502 in the interface shown in Figure 15b) is displayed; the third window includes the first scannable code. This process corresponds to the embodiment shown in Figure 15.

[0064] In this way, when users arrive at the venue at the performance time, their electronic devices can automatically display a scannable code, allowing users to quickly verify their tickets based on the scannable code. Users do not need to open the ticketing app to view the scannable code or search for a screenshot of the scannable code in the gallery app, thus simplifying the user operation.

[0065] In one possible implementation, a first scannable code (e.g., scannable code 1 in Figure 16) is associated with a second scannable code (e.g., scannable codes for multiple items purchased by a user under the same webpage link or application path information, such as scannable code 2 in Figure 16). The third window also includes a switching control (e.g., previous control 1602 or next control 1603). After displaying the third window, the process further includes: in response to a trigger operation on the switching control, switching from the first scannable code to the second scannable code in the third window. This process may correspond to the embodiment shown in Figure 16.

[0066] In this way, when users arrive at the venue at the performance time, the electronic device can display multiple associated scannable codes, allowing users to quickly verify multiple tickets, simplifying user operations and improving the user experience.

[0067] In one possible implementation, based on the embodiment shown in Scenario 2, the first information includes a third scannable code (used to redirect to a webpage link address or an application-specific path), the second control is a direct access control for scanning (e.g., direct access control 1806 in Figure 18), and the second application (e.g., a social application) supports scanning functionality (e.g., the scan function of a social application); according to a trigger operation on the second control, a third interface of the second application is displayed, including: in response to a trigger operation on the direct access control for scanning, launching the second application and displaying a floating window of the second application in the second interface (e.g., in Figure 18). The floating window 1807 of the social application in the interface shown in Figure 18c includes information for indicating the scanning process (e.g., prompt information 1808). After scanning is completed, a third interface is displayed in the floating window of the second application (e.g., the floating window 1809 of the social application in the interface shown in Figure 18d). The third interface corresponds to the third scannable code (which can be understood as the third scannable code being a QR code business card for the user's social application; the third interface is the interface in the floating window of the social application, displaying content related to the QR code business card, such as username, user ID, etc.). This process can correspond to the embodiment shown in Figure 18.

[0068] In this way, the direct access service simplifies the process of users opening social applications and using the scan function, and also simplifies the process of importing images with scannable codes from the gallery application within the scan function. This allows electronic devices to quickly jump to the link interface corresponding to the scannable code, improving the user experience. Furthermore, electronic devices can quickly launch a floating window of the application corresponding to the scan service from within the existing interface, reducing screen switching and preventing the direct access service from interrupting the user's current activity.

[0069] In one possible implementation, based on the embodiment shown in Scenario 2, the first information further includes address information (e.g., the address information in the interface shown in Figure 19a: City A Gymnasium); the second control includes a direct travel control, which includes a one-step navigation control (e.g., the one-step navigation control 1902 in the interface shown in Figure 19b) and a one-step taxi-hailing control (not shown in Figure 19, refer to the one-step navigation control); the second application includes a travel application, which includes a navigation application and a taxi-hailing application; the navigation application corresponds to the one-step navigation control, and the taxi-hailing application corresponds to the one-step taxi-hailing control. Based on the trigger operation for the second control, a third interface of the second application is displayed, including: responding to the trigger operation for the travel direct control (e.g., one-step navigation control 1902), launching the travel application (e.g., navigation application), and displaying a floating window of the travel application in the second interface (e.g., the floating window 1903 of the navigation application in the interface shown in Figure 19c); the floating window of the travel application includes the third interface; the third interface includes the starting location and the ending location, the starting location being the location of the electronic device, and the ending location being address information (e.g., the ending location information 1904 is the stadium in City A). The process of the one-step navigation service can correspond to the embodiment shown in Figure 19, and the process of the one-step ride-hailing service can refer to the embodiment shown in Figure 19, which will not be repeated here.

[0070] In this way, electronic devices can identify a user's intention to use a travel application by taking a screenshot, as well as the destination location during the trip. Based on the direct travel service, the electronic device can quickly launch the travel application and provide multiple driving routes to the destination location, simplifying user operations and improving the user experience.

[0071] In one possible implementation, based on the embodiment shown in Scenario 3, the second information includes text information (e.g., text information in the interface shown in Figure 20a), and the third control includes an AI summary control (e.g., AI summary control 2002 in the interface shown in Figure 20b). According to a trigger operation on the third control, the first card is displayed in the fourth interface, including: in response to a trigger operation on the AI ​​summary control, a prompt window is displayed in the fourth interface (e.g., prompt window 2003 in the interface shown in Figure 20c), the prompt window being used to prompt the user that text information in the corresponding page of the fourth interface is being recognized (i.e., electronic device recognition). The text on the fourth interface in the screen and the text on the current page outside the screen); after recognition is completed, a first card (e.g., AI summary card 2004 in the interface shown in Figure 20 d) is displayed in the fourth interface. The first card includes third information (e.g., AI summary information) and seventh prompt information (e.g., prompt information 2005). The third information is a summary extracted from the second information; the seventh prompt information is used to prompt the user about the number of words on the corresponding page of the fourth interface (e.g., 2000 words in full text) and the reading time (e.g., 5 minutes of reading time). The save control (e.g., save to notes control 2007) is used to save the third information to the note-taking application. This process can correspond to the embodiment shown in Figure 20.

[0072] This reduces the need for users to take long screenshots of the full text and then extract AI summaries from those screenshots, thus reducing user operations. At the same time, the AI ​​summarization service provides copy and save functions for convenient use, thereby improving the user experience.

[0073] In one possible implementation, based on the embodiment shown in Scenario 3, the second information includes text information (e.g., the text in the interface shown in Figure 21a), and the third control includes a content extraction control (e.g., the content extraction control 2102 in the interface shown in Figure 21b). According to a trigger operation on the third control, a first card (e.g., the content extraction card 2103 in the interface shown in Figure 21c) is displayed in the fourth interface, including: in response to a trigger operation on the content extraction control, displaying third information (e.g., a mobile phone number) and a tenth prompt message (e.g., prompt message 2104) in the fourth interface; the third information includes key information from the text information; the key information includes one or more of the following: ID number, address, phone number, social ID, and account password; the tenth prompt message is used to notify the user that the key information has been intelligently extracted. This process may correspond to the interface shown in Figure 21a.

[0074] In this way, in scenarios where text cannot be copied (for example, key information in an image cannot be copied), electronic devices can quickly extract key information and provide users with copy and save functions, reducing user operations and improving the user experience.

[0075] In one possible implementation, based on the embodiments shown in Scenario 1, Scenario 2, and Scenario 3, the method further includes: displaying a fifth interface (e.g., the interface shown in Figure 22a); in response to a screenshot operation on the fifth interface, displaying a thumbnail of the fourth screenshot (e.g., the screenshot thumbnail 2201 in the interface shown in Figure 22b), a fourth control, and a fifth control on the fifth interface; the fourth control and the fifth control are respectively one of a first control, a second control, or a third control (e.g., a one-step navigation control 2204 and a content extraction control 2202); the fourth control and the fifth control are different; based on a trigger operation on the fourth control, activating a service corresponding to the fourth control (e.g., if the fourth control is a one-step navigation control 2204, then the one-step navigation service is activated); or, based on a trigger operation on the fifth control, activating a service corresponding to the fifth control (e.g., if the fifth control is a content extraction control 2202, then the content extraction service is activated). This process may correspond to the embodiment shown in Figure 22.

[0076] In this way, electronic devices can identify multiple user intents based on screenshots, thereby providing users with more accurate services and improving the user experience.

[0077] In one possible implementation, based on the embodiments shown in Scenario 1, Scenario 2, and Scenario 3, the method further includes: displaying a sixth interface; in response to a screenshot operation on the sixth interface, displaying a thumbnail of the fifth screenshot (e.g., screenshot thumbnail 2001 in the interface shown in Figure 23A a) and a sixth control (e.g., any door control 2302) in the sixth interface; in response to a trigger operation on the sixth control, displaying the fifth screenshot (e.g., screenshot 2303 in the interface shown in Figure 23A b) and a side toolbar; the side toolbar includes one or more function icons (e.g., in Figure 2...). The toolbar on the right side of the interface shown in b of Figure 23A includes one or more function icons, including a first function icon (e.g., the collection space control 2306). Based on the trigger operation on the first function icon, the application interface corresponding to the first function icon is displayed (e.g., the collection space application interface shown in d of Figure 23A, which can be full-screen or a floating window; the floating window form can be seen in the interface shown in b of Figure 25). The application interface corresponding to the first function icon includes a thumbnail of the fifth screenshot (e.g., the screenshot thumbnail 2312 in the interface shown in d of Figure 23A). This process corresponds to the embodiment shown in Figure 23A.

[0078] In this way, electronic devices can quickly access the "Anywhere Door" function by taking a screenshot, thereby quickly sharing or saving the screenshot content and simplifying user operations.

[0079] In one possible implementation, based on the embodiments shown in Scenario 1, Scenario 2, and Scenario 3, the method further includes: displaying a seventh interface; in response to a screenshot operation on the seventh interface, displaying a thumbnail of the sixth screenshot (e.g., screenshot thumbnail 2501 in the interface shown in Figure 25a) and a one-click favorite control (e.g., one-click favorite control 2502) on the seventh interface; and saving the sixth screenshot to the favorites space application based on a trigger operation on the one-click favorite control. This process may correspond to the embodiment shown in Figure 25.

[0080] This allows for quick saving of screenshots, further reducing the need for users to save screenshots via any door control and improving the user experience.

[0081] In one possible implementation, based on the embodiments shown in Scenario 1, Scenario 2, and Scenario 3, after saving the sixth screenshot to the collection space application, the method further includes: displaying an eighth interface; the eighth interface and the seventh interface are on the same page, and the content in the eighth interface is different from the content in the seventh interface; in response to a screenshot operation on the eighth interface, displaying a thumbnail of the seventh screenshot (e.g., screenshot thumbnail 2601 in the interface shown in Figure 26b) and a merge collection control (e.g., merge collection control 2602) on the eighth interface; according to a trigger operation on the merge collection control, saving the seventh screenshot to the collection space application, and in the collection space application, the saving location of the seventh screenshot is the same as the saving location of the sixth screenshot (e.g., in the interface shown in Figure 26b, both screenshots are saved in folder 2603; or in the interface shown in Figure 26c, both screenshots are saved in folder 2606). This process can correspond to the embodiment shown in Figure 26.

[0082] In this way, the merge collection service can summarize the current screenshot with previous screenshots and save them to the same location in the collection space, so that users can quickly view multiple related screenshots.

[0083] In one possible implementation, based on the embodiments shown in Scenario 1, Scenario 2, and Scenario 3, the method further includes: displaying a ninth interface (e.g., the interface shown in Figure 27a); the ninth interface corresponds to webpage link information or application path information; in response to a screenshot operation on the ninth interface, displaying a thumbnail of the eighth screenshot (e.g., screenshot thumbnail 2701 in the interface shown in Figure 27b) and a sharing control (e.g., sharing control 2702) on the ninth interface; and sharing a first image (e.g., image 2703 in the interface shown in Figure 27c) to a target application (e.g., a social application) according to a trigger operation on the sharing control; the first image is a composite image of the eighth screenshot (e.g., product image 2704) and a fourth scannable code (e.g., scannable code 2705); the fourth scannable code corresponds to the webpage link information or application path information of the ninth interface. This process may correspond to the embodiment shown in Figure 27.

[0084] In this way, electronic devices can quickly generate product links through screenshots. Compared to the method where users can open products and scan codes based on the sharing controls in shopping applications, the screenshot sharing function provided in this application embodiment can reduce user operations.

[0085] One possible implementation further includes: displaying a tenth interface (e.g., an interface with two or more split-screen windows); the tenth interface includes a first split-screen window (e.g., a split-screen window 2401 of a note-taking application or a split-screen window of a social application) and a second split-screen window (e.g., a split-screen window 2402 of a calculator application or a split-screen window of an e-book application); in response to a screenshot operation on the tenth interface, displaying a thumbnail of the ninth screenshot (e.g., the screenshot in the interface shown in b of Figure 24A) on the tenth interface. The thumbnail of the ninth screenshot includes the first split-screen screenshot control (e.g., the upper half-screen screenshot control 2405 in the interface shown in Figure 24Aa) and the second split-screen screenshot control (e.g., the lower half-screen screenshot control 2406 in the interface shown in Figure 24Ab); the thumbnail of the ninth screenshot includes the screenshot thumbnail of the first split-screen window (e.g., the upper half-screen screenshot thumbnail 2407 or the upper half-screen screenshot thumbnail 2412) and the screenshot thumbnail of the second split-screen window (e.g., the lower half-screen screenshot thumbnail 2406). 8. A thumbnail of the lower half-screen screenshot 2413); When a selection operation is received for the first split-screen screenshot control (e.g., the upper half-screen screenshot control 2405), a thumbnail of the first split-screen window in the selected state (e.g., not in the overlay state), the first split-screen screenshot control in the selected state, and a seventh control (e.g., the content extraction control 2102 in the interface shown in Figure 24Ca); the seventh control is a control recommended based on the screenshot content of the first split-screen window; or, When a selection operation is received for the second split-screen screenshot control (e.g., the lower half-screen screenshot control 2406), a thumbnail of the second split-screen window in the selected state (e.g., the thumbnail of the lower half-screen screenshot 2813), the second split-screen screenshot control in the selected state (e.g., the lower half-screen screenshot control 2406), and an eighth control (e.g., the AI ​​summary control 2002 in the interface shown in Figure 24Cb); the eighth control is a control recommended based on the screenshot content of the second split-screen window; the eighth control is different from the seventh control.

[0086] Optionally, if the screenshot content in the second split-screen window does not have a corresponding recommended control, the electronic device may not display recommended controls such as content extraction controls.

[0087] In this way, in split-screen scenarios, users can choose to take screenshots of individual split-screen windows; during the screenshot display process, the electronic device can recommend relevant services based on the screenshot content of each individual split-screen window, thereby improving the user experience.

[0088] One possible implementation further includes: displaying an eleventh interface; the eleventh interface includes a first floating window (e.g., a floating window 2802 for a social application) and a second floating window (e.g., a floating window 2807 for an e-book application); in response to a screenshot operation on the eleventh interface, displaying a thumbnail of the tenth screenshot (screenshot thumbnail 2808), a first floating window screenshot control (e.g., a left floating window screenshot control 2812), and a second floating window screenshot control (e.g., a right floating window screenshot control 2809) on the eleventh interface; the thumbnail of the tenth screenshot includes a screenshot thumbnail of the first floating window (e.g., a floating window screenshot thumbnail 2810 for a social application) and a screenshot thumbnail of the second floating window (e.g., a floating window screenshot thumbnail 2811 for an e-book application); when a selection operation is received for the first floating window screenshot control (e.g., a left floating window screenshot control 2812), displaying the selected screenshot thumbnail of the first floating window. (e.g., floating window screenshot thumbnail 2810), the selected first floating window screenshot control (e.g., left floating window screenshot control 2812) and the ninth control (e.g., content extraction control 2102), as shown in the interface in Figure 28Ba or Figure 28Ca; the ninth control is a control recommended based on the screenshot content of the first floating window; or, when a selection operation is received for the second floating window screenshot control (e.g., right floating window screenshot control 2809), the selected second floating window screenshot thumbnail (e.g., floating window screenshot thumbnail 2811 of an e-book application), the selected second floating window screenshot control (e.g., right floating window screenshot control 2809) and the tenth control (e.g., AI summary control 2002) are displayed, as shown in the interface in Figure 28Bb or Figure 28Cb; the tenth control is a control recommended based on the screenshot content of the second floating window; the tenth control is different from the ninth control.

[0089] In this way, in a floating window scenario, users can choose to take a screenshot of a single floating window; during the screenshot display process, the electronic device can recommend relevant services based on the screenshot content of a single floating window, thereby improving the user experience.

[0090] In one possible implementation, after displaying the application interface corresponding to the first function icon based on a trigger operation on the first function icon, the method further includes: displaying a twelfth interface (e.g., a social application interface); in response to a screenshot operation on the twelfth interface, displaying a thumbnail of an eleventh screenshot (e.g., screenshot thumbnail 2902 in the interface shown in Figure 29c), a sixth control (e.g., any door control 2302), and an eleventh control (e.g., a favorites space control 2903) in the twelfth interface; the eleventh control has the same function as the second function icon; in response to a trigger operation on the sixth control (e.g., any door control 2302), displaying an eleventh screenshot (e.g., a screenshot of the social application interface shown in Figure 29d) and a side toolbar; one or more function icons in the side toolbar include the second function icon (e.g., the favorites space control 2306 in the interface shown in Figure 29d); and the second function icon is located at the top of the side toolbar; the second function icon is the function icon most frequently used by the user in the side toolbar or a user-set pinned function icon.

[0091] In this way, electronic devices can not only provide users with service controls that recognize the content of the screenshot in the screenshot scenario, but also recommend service controls based on user habits or user-defined settings, so that the recommended controls are more in line with the user's usage habits and improve the user experience.

[0092] Secondly, embodiments of this application provide a screenshot-based service recommendation device, which can be an electronic device, or a chip or chip system within an electronic device. The screenshot-based service recommendation device may include a display unit and a processing unit. When the screenshot-based service recommendation device is an electronic device, the display unit may be a display screen. The display unit is used to perform display steps to enable the electronic device to implement the screenshot-based service recommendation method described in the first aspect or any possible implementation of the first aspect. When the screenshot-based service recommendation device is an electronic device, the processing unit may be a processor. The screenshot-based service recommendation device may further include a storage unit, which may be a memory. The storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to enable the electronic device to implement the screenshot-based service recommendation method described in the first aspect or any possible implementation of the first aspect. When the screenshot-based service recommendation device is a chip or chip system within an electronic device, the processing unit may be a processor. The processing unit executes the instructions stored in the storage unit to enable the electronic device to implement the screenshot-based service recommendation method described in the first aspect or any possible implementation of the first aspect. The storage unit can be a storage unit within the chip (e.g., a register, cache, etc.) or a storage unit located outside the chip within the electronic device (e.g., a read-only memory, random access memory, etc.).

[0093] Thirdly, embodiments of this application provide an electronic device, including a processor and a memory, wherein the memory is used to store computer execution instructions, and the processor is used to run the computer execution instructions stored in the memory to perform the method described in the first aspect or any possible implementation of the first aspect.

[0094] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program or instructions that, when executed on a computer, cause the computer to perform the methods described in the first aspect or any possible implementation thereof.

[0095] Fifthly, embodiments of this application provide a computer program product including a computer program, which, when run, causes the computer to perform the method described in the first aspect or any possible implementation thereof.

[0096] Sixthly, this application provides a chip or chip system including at least one processor and a communication interface. The communication interface and the at least one processor are interconnected via a circuit. The at least one processor is used to run computer programs or instructions to perform the methods described in the first aspect or any possible implementation of the first aspect. The communication interface in the chip can be an input / output interface, pins, or circuits, etc.

[0097] In one possible implementation, the chip or chip system described above in this application further includes at least one memory storing instructions. The memory can be an internal storage unit of the chip, such as a register or cache, or it can be a storage unit of the chip itself (e.g., read-only memory, random access memory, etc.).

[0098] It should be understood that the second to sixth aspects of this application correspond to the technical solutions of the first aspect of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here. Attached Figure Description

[0099] Figure 1 is a schematic diagram of the interface of a ticket-grabbing reminder service provided in an embodiment of this application;

[0100] Figure 2 is a schematic diagram of an interface for enabling ticket grabbing reminder service and automatic ticket grabbing service according to an embodiment of this application;

[0101] Figure 3 is a schematic diagram of another interface for enabling ticket grabbing reminder service and automatic ticket grabbing service provided in an embodiment of this application;

[0102] Figure 4 is a schematic diagram of an interface for enabling and setting an alarm clock service according to an embodiment of this application;

[0103] Figure 5 is a schematic diagram of an interface for opening a hotel reservation service provided in an embodiment of this application;

[0104] Figure 6 is a schematic diagram of an interface for opening a train ticket reservation service provided in an embodiment of this application;

[0105] Figure 7 is a schematic diagram of an interface for starting a service via a voice assistant according to an embodiment of this application;

[0106] Figure 8 is a schematic diagram of an interface for using a ticket-grabbing reminder service provided in an embodiment of this application;

[0107] Figure 9 is a schematic diagram of another interface for using the ticket-grabbing reminder service provided in an embodiment of this application;

[0108] Figure 10 is a schematic diagram of another interface for using the ticket-grabbing reminder service provided in an embodiment of this application;

[0109] Figure 11 is a schematic diagram of another interface for using the ticket-grabbing reminder service provided in an embodiment of this application;

[0110] Figure 12 is a schematic diagram of the interface of an exit ticket grabbing reminder card provided in an embodiment of this application;

[0111] Figure 13 is a schematic diagram of the interface for the linkage between the ticketing application and the calendar application provided in an embodiment of this application;

[0112] Figure 14 is a schematic diagram of an interface for enabling a QR code reminder service provided in an embodiment of this application;

[0113] Figure 15 is a schematic diagram of an interface for using a QR code reminder service provided in an embodiment of this application;

[0114] Figure 16 is a schematic diagram of another interface for using the QR code reminder service provided in an embodiment of this application;

[0115] Figure 17 is a schematic diagram of another interface for using the QR code reminder service provided in an embodiment of this application;

[0116] Figure 18 is a schematic diagram of an interface for using a QR code to access a service according to an embodiment of this application;

[0117] Figure 19 is a schematic diagram of an interface using a one-step navigation service provided in an embodiment of this application;

[0118] Figure 20 is a schematic diagram of an interface using an AI summary service provided in an embodiment of this application;

[0119] Figure 21 is a schematic diagram of an interface for using a content extraction service provided in an embodiment of this application;

[0120] Figure 22 is a schematic diagram of the interface of a multi-intent recommendation service provided in an embodiment of this application;

[0121] Figure 23A is a schematic diagram of an interface for exporting screenshots through the Any Door function provided in an embodiment of this application;

[0122] Figure 23B is a schematic diagram of a scrolling screenshot interface provided in an embodiment of this application;

[0123] Figure 23C is a schematic diagram of the animation effect of activating the arbitrary door function provided in an embodiment of this application;

[0124] Figure 24A is a schematic diagram of the interface for exporting screenshots through the Any Door function in a split-screen scenario provided in an embodiment of this application;

[0125] Figure 24B is a schematic diagram of the split-screen screenshot of the "Anywhere Door" function in a split-screen scenario provided in the embodiments of this application;

[0126] Figure 24C shows a schematic diagram of an interface for switching split-screen screenshots in a split-screen scenario provided by an embodiment of this application;

[0127] Figure 25 is a schematic diagram of an interface for using the one-click collection service provided in an embodiment of this application;

[0128] Figure 26 is a schematic diagram of an interface for using the merge collection service provided in an embodiment of this application;

[0129] Figure 27 is a schematic diagram of an interface for using a content extraction service provided in an embodiment of this application;

[0130] Figure 28A is a schematic diagram of a floating window screenshot provided in an embodiment of this application;

[0131] Figure 28B is a schematic diagram of another floating window screenshot provided in an embodiment of this application;

[0132] Figure 28C is a schematic diagram of another scenario of a floating window screenshot provided in an embodiment of this application;

[0133] Figure 28D is a schematic diagram of another scenario of a floating window screenshot provided in an embodiment of this application;

[0134] Figure 28E is a schematic diagram showing the position of the floating window in the screenshot thumbnail provided in the embodiment of this application;

[0135] Figure 29 is a schematic diagram showing the linkage between the recommended service controls and the functional controls in the side toolbar in the screenshot scenario provided in the embodiments of this application;

[0136] Figure 30 is a schematic diagram of the structure of the electronic device 100 provided in an embodiment of this application;

[0137] Figure 31 is a schematic diagram of the structure of the screenshot-based service recommendation device provided in an embodiment of this application. Detailed Implementation

[0138] To facilitate a clear description of the technical solutions in the embodiments of this application, some terms and technologies involved in the embodiments of this application will be briefly introduced below:

[0139] 1. Other terms

[0140] In the embodiments of this application, terms such as "first" and "second" are used to distinguish identical or similar items with substantially the same function and purpose. For example, "first chip" and "second chip" are used only to distinguish different chips and do not limit their order of execution. Those skilled in the art will understand that terms such as "first" and "second" do not limit the quantity or execution order, and that "first" and "second" do not necessarily imply that they are different.

[0141] It should be noted that, in the embodiments of this application, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design scheme described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0142] In this application embodiment, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, a--c, bc, or abc, where a, b, and c can be single or multiple.

[0143] 2. Electronic equipment

[0144] The electronic devices in this application embodiment may include handheld devices, vehicle-mounted devices, etc., with screenshot functionality. For example, some electronic devices include: mobile phones, tablets, PDAs, laptops, mobile internet devices (MIDs), virtual reality (VR) devices, augmented reality (AR) devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, cellular phones, cordless phones, session initiation protocol (SIP) phones, wireless local loop (WLL) stations, personal digital assistants (PDAs), handheld devices with wireless communication capabilities, computing devices or other processing devices connected to wireless modems, in-vehicle devices, terminal devices in 5G networks, or future evolution of public land mobile communication networks. Terminal devices in a network (PLMN), etc., are not limited to this in the embodiments of this application.

[0145] By way of example and not limitation, in this embodiment, the electronic device can also be a wearable device. Wearable devices, also known as wearable smart devices, are a general term for devices that utilize wearable technology to intelligently design and develop everyday wearables, such as glasses, gloves, watches, clothing, and shoes. Wearable devices are portable devices that are worn directly on the body or integrated into the user's clothing or accessories. Wearable devices are not merely hardware devices, but also achieve powerful functions through software support, data interaction, and cloud interaction. Broadly speaking, wearable smart devices include those that are feature-rich, large in size, and can achieve complete or partial functions without relying on a smartphone, such as smartwatches or smart glasses, as well as those that focus on a specific type of application function and require the use of other devices such as smartphones, such as various smart bracelets and smart jewelry for vital sign monitoring.

[0146] The electronic devices in the embodiments of this application may also be referred to as: terminal equipment, user equipment (UE), mobile station (MS), mobile terminal (MT), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent, or user device, etc.

[0147] In potential implementations, the use cases for screenshots are relatively limited. For example, a screenshot might include a scannable code, allowing users to find the screenshot in a photo library app and scan the code to perform activities such as adding friends, redeeming group-buying codes, or printing movie tickets. Alternatively, a screenshot might include text and / or images, allowing users to find the screenshot in a photo library app and view its specific information.

[0148] In view of this, this application provides a screenshot-based service recommendation method. The electronic device can identify the content of a screenshot after taking it and trigger different services in different scenarios. This enriches the application scenarios of screenshots, thus providing users with a variety of services in various screenshot scenarios. For example, in some limited-time flash sale scenarios, after taking a screenshot of the application interface, the electronic device can provide a flash sale reminder service based on the screenshot content. Taking ticket-grabbing reminders as an example, the ticket-grabbing reminder service can, for instance, remind users before tickets go on sale, automatically grab tickets when they go on sale, and provide users with quick access to book train tickets and hotels. In scenarios where scannable codes are screenshotted, the electronic device can identify the scannable codes in the screenshot and provide a scanning reminder service at a specific time and / or location. The scanning reminder service can, for example, display one or more scannable codes, thereby reducing the user's operation of searching for screenshots. For example, upon arriving at a restaurant, the electronic device displays a scannable code for a restaurant's group-buying coupon. In other scenarios, electronic devices can recognize the text content in screenshots and quickly launch corresponding services; for example, when the screenshot content includes a location, it can provide ride-hailing or navigation services; when the screenshot content includes a large amount of text, it can provide AI summary services; when the screenshot content includes key information such as phone numbers, address information, and ID card numbers, it can extract the information from the screenshot so that users can quickly copy the information; and so on.

[0149] The ticket-grabbing reminder service provided in the embodiments of this application will be described below with reference to Figures 1-13.

[0150] Figure 1 is a schematic diagram of the interface for triggering the ticket-grabbing reminder service provided in an embodiment of this application, as shown in Figure 1:

[0151] In some limited-time flash sales, users need to make reservations to purchase items within a specific timeframe, such as for tickets, goods, or appointments for medical treatment. This application uses a ticket-buying scenario as an example to introduce a flash sale reminder service, exemplified as follows:

[0152] In a ticket-buying scenario, the electronic device can display a ticketing application interface, such as the interface shown in Figure 1a. This interface displays the sales start time information 101 and a reservation ticketing control 102. The sales start time information 101 could be, for example, September 10th, 20:00, meaning there are 1 day, 17 minutes, and 54 seconds left until the sales start time. The reservation ticketing control 102 is used to reserve the performance session and seat.

[0153] In the interface shown in Figure 1a, when a screenshot operation is received, the electronic device can display the interface shown in Figure 1b. Screenshot operations can be, for example: responding to a trigger operation on the screenshot control in the control center interface after it is brought up; or triggering an operation based on a key combination (e.g., the power button and volume buttons); or triggering a screenshot with a specific gesture (e.g., a three-finger or palm side swipe); and so on. Screenshot operations can also be operations that trigger area screenshots, such as tapping the screen and taking a screenshot of a selected area.

[0154] In the interface shown in Figure 1b, the electronic device can display screenshot thumbnails 103, voice assistant controls 104, ticket-grabbing reminder controls 105, sharing controls, scrolling screenshot controls, and any-door controls, etc., which can be located on top of the ticketing application interface. The screenshot thumbnail 103 can be used to preview screenshots. For example, after clicking the screenshot thumbnail 103, the electronic device can open the screenshot and edit, mark, and view it. The voice assistant control 104 can be used to wake up the voice assistant and provide corresponding services; for example, after recognizing the screenshot content, the electronic device can determine that the current scenario is a ticket-grabbing scenario, and then the electronic device can intelligently recommend ticket-grabbing reminder services. For example, the ticket-grabbing reminder control 105 is displayed above the voice assistant control 104. The ticket-grabbing reminder control 105 is used to provide ticket-grabbing reminder services, such as adding ticket-grabbing reminders and automatically executing ticket-grabbing operations.

[0155] The share control can be used to quickly share screenshots with others through an application or service; the scrolling screenshot control can be used to capture long content that exceeds the current screen display area, resulting in a long screenshot. The door control can be used to send screenshots to a specific application or service.

[0156] In the interface shown in Figure 1b, if the user needs to use the ticket-grabbing reminder service, the user can control the electronic device to activate the ticket-grabbing reminder service by triggering the ticket-grabbing reminder control 105. If the user does not need to use the ticket-grabbing reminder service, the electronic device can cancel the display of the screenshot thumbnail 103, voice assistant control 104, ticket-grabbing reminder control 105, sharing control, scrolling screenshot control, and any door control after the user triggers the blank area or the screenshot thumbnail 103 has been displayed for a period of time.

[0157] Taking a user's use of the ticket-grabbing reminder service as an example, in the interface shown in Figure 1b, when a trigger operation (such as a click operation) is received for the ticket-grabbing reminder control 105, the electronic device can display the interface shown in Figure 1c. In the interface shown in Figure 1c, the electronic device can display the ticket-grabbing reminder card 106, the voice assistant control 107, and one or more service controls associated with the ticket-grabbing reminder.

[0158] The ticket-grabbing reminder card 106 can be used to provide a ticket-grabbing reminder service. The card 106 may include ticket information, a ticket-grabbing reminder control 108, and an automatic ticket-grabbing operation control 109. The ticket information may include, for example, the ticket name and ticket sales start time. The ticket-grabbing reminder control 108 can be used to enable the ticket-grabbing reminder service, reminding users to grab tickets before sales begin; the automatic ticket-grabbing operation control 109 can be used to automatically grab tickets when sales begin.

[0159] One or more services associated with ticket-buying reminders can be understood as follows: for example, the venue for events such as performances, concerts, and music festivals may be different from the user's location; when attending the event, the user may need to travel to the venue and stay overnight. In this case, while reminding the user to buy tickets, the electronic device can provide services such as quickly booking train tickets, plane tickets, and hotels. One or more service controls associated with ticket-buying reminders can be: hotel booking control 112, train ticket booking control 113, alarm clock setting control 111, etc. Hotel booking control 112 can be used to quickly launch the hotel booking service of an application used for booking hotels (such as a travel application, or other applications); train ticket booking control 113 can be used to quickly launch the train ticket booking service of an application used for booking tickets (such as a travel application, or other applications); alarm clock setting control 111 can be used to quickly launch the alarm clock service of a clock application.

[0160] In the interface shown in Figure 1c, users can choose to add a ticket-grabbing reminder service to manually grab tickets during the sales period; users can also choose to add an automatic ticket-grabbing service to automatically grab tickets using electronic devices during the sales period. The following description, in conjunction with Figure 2, explains the interfaces for enabling the ticket-grabbing reminder service and / or the automatic ticket-grabbing service.

[0161] Upon receiving a trigger operation on the ticket-grabbing reminder control 105, the electronic device can display the interface shown in Figure 2a (refer to the interface shown in Figure 1c), which includes a ticket-grabbing reminder card 106; the ticket-grabbing reminder card 106 may include an add ticket-grabbing reminder control 108 and an automatic ticket-grabbing operation control 109.

[0162] Taking the user's activation of the ticket-grabbing reminder service as an example, when a trigger operation is received for adding the ticket-grabbing reminder control 108, the electronic device can display the interface shown in Figure 2b.

[0163] In the interface shown in Figure 2b, the electronic device can display a ticket-grabbing reminder card 201, which can be located on top of the ticketing application interface. The ticket-grabbing reminder card 201 can reflect the user's actions within the ticket-grabbing reminder card 106; for example, the ticket-grabbing reminder card 201 includes a prompt message 202, a completion control 203, and an automatic ticket-grabbing operation control 109. The prompt message 202 can indicate that the ticket-grabbing reminder service has been activated; for example, the prompt message 202 can be "Ticket-grabbing reminder added." The completion control 203 can be used to cancel the display of the ticket-grabbing reminder card 201; the completion control 203 can be a control labeled "OK." The automatic ticket-grabbing operation control 109 can be used to activate the automatic ticket-grabbing service.

[0164] It is understood that, in the embodiments of this application, the electronic device may enable either the ticket-grabbing reminder service or the automatic ticket-grabbing service; the electronic device may also enable both services simultaneously.

[0165] In some embodiments, in the interface shown in Figure 2b, after enabling the ticket-grabbing reminder service, the user can click the completion control 203 to control the electronic device to cancel the display of the ticket-grabbing reminder card 201, for example, the electronic device enters the ticketing application interface shown in Figure 2d. At this time, the electronic device can only enable the ticket-grabbing reminder service and not the automatic ticket-grabbing service.

[0166] Alternatively, in other embodiments, after activating the ticket-grabbing reminder service, the user can continue to activate the automatic ticket-grabbing service. For example, in the interface shown in Figure 2b, when a trigger operation is received for the automatic ticket-grabbing operation control 109, the electronic device can activate the automatic ticket-grabbing service and display the interface shown in Figure 2c.

[0167] The interface shown in Figure 2c displays a ticket-grabbing reminder card 204. The ticket-grabbing reminder card 204 includes a prompt message 205 and a completion control 206. The prompt message 205 indicates that the automatic ticket-grabbing service has been enabled; for example, the prompt message 205 could be "Automatic ticket-grabbing service added." The completion control 206 can be used to cancel the display of the ticket-grabbing reminder card 204.

[0168] After activating the automatic ticket-grabbing service, users can click the completion control 206 to disable the display of the ticket-grabbing reminder card 204 on the electronic device, for example, the electronic device will enter the ticketing application interface shown in Figure 2d. At this time, the electronic device can simultaneously activate both the ticket-grabbing reminder service and the automatic ticket-grabbing service.

[0169] Optionally, during the display of ticket-grabbing reminder cards (ticket-grabbing reminder cards 201 and 204), the electronic device can cancel the display of the ticket-grabbing reminder cards by triggering an operation on a completion control (e.g., completion control 203 and completion control 206). In practical applications, users can also cancel the display of ticket-grabbing reminder cards by clicking on a blank area or waiting for a period of time (e.g., 1 second), and this embodiment does not impose any limitations on this.

[0170] Optionally, to reduce accidental user actions, the electronic device may display a cancel ticket reminder control in, for example, the ticket reminder card 201; after a user accidentally adds the ticket reminder service, the user can click the cancel ticket reminder control; in response to the user's operation, the electronic device may display, for example, the add ticket reminder control 108 in the ticket reminder card 106, or display a prompt message to inform the user that the ticket reminder has been canceled (not shown in the figure).

[0171] And / or, the electronic device may display a cancel automatic ticket grabbing control in, for example, the ticket grabbing reminder card 204; after a user accidentally activates the automatic ticket grabbing service, the user may click to cancel the automatic ticket grabbing control; in response to the user's operation, the electronic device may display, for example, the automatic ticket grabbing operation control 109 in the ticket grabbing reminder card 201, or display a prompt message to inform the user that automatic ticket grabbing has been canceled (not shown in the figure).

[0172] Optionally, in this embodiment, the voice assistant application can be used to provide ticket-grabbing reminder services and automatic ticket-grabbing services. In some embodiments, the voice assistant application can detect the content of the screenshot and recommend relevant services. In other embodiments, the voice assistant application can also be linked with the corresponding function of the application (e.g., a ticketing application) corresponding to the screenshot. For example, in the interface shown in Figure 1a, the area where the sales time information 101 is located corresponds to an add reminder control. After the voice assistant application enables the ticket-grabbing reminder service, the reminder function of the ticketing application also switches to enabling the ticket-grabbing reminder service; for example, in the interface shown in Figure 2d, the area where the sales time information is located corresponds to an added reminder control 207, thereby reminding the user that the ticket-grabbing reminder service has been enabled.

[0173] In this way, electronic devices can add ticket-grabbing reminders to users' activities, reminding them a period of time before the tickets go on sale to prevent them from missing the ticket sales time; and / or, electronic devices can enable automatic ticket grabbing, helping users grab tickets when the tickets go on sale, simplifying user operations and increasing the success rate of grabbing tickets.

[0174] The above embodiments illustrate the scenario where the ticket-grabbing reminder service is enabled first, with reference to Figure 2. The following describes the scenario where the automatic ticket-grabbing service is enabled first, with reference to Figure 3. As shown in Figure 3:

[0175] Upon receiving a trigger operation on the ticket-grabbing reminder control 105, the electronic device can display the interface shown in Figure 3a, which includes a ticket-grabbing reminder card 106; the ticket-grabbing reminder card 106 may include an add ticket-grabbing reminder control 108 and an automatic ticket-grabbing operation control 109.

[0176] Taking the user's activation of the automatic ticket-grabbing service as an example, when the electronic device receives a trigger operation for the automatic ticket-grabbing operation control 109, the electronic device can display the interface shown in Figure 3b.

[0177] In the interface shown in Figure 3b, the electronic device can display a ticket-grabbing reminder card 301, which can be located on top of the ticketing application interface. The ticket-grabbing reminder card 301 can reflect the user's actions within the ticket-grabbing reminder card 106; for example, the ticket-grabbing reminder card 301 includes a prompt message 302, a completion control 303, and an add ticket-grabbing reminder control 108. The prompt message 302 can indicate that the automatic ticket-grabbing service has been enabled; for example, the prompt message 302 can be "Automatic ticket-grabbing service added." The completion control 303 can be used to cancel the display of the ticket-grabbing reminder card 301; the completion control 303 can be a control labeled "OK." The add ticket-grabbing reminder control 108 can be used to enable the ticket-grabbing reminder service.

[0178] In some embodiments, in the interface shown in Figure 3b, after the automatic ticket-grabbing service is enabled, the user can click the completion control 303 to control the electronic device to cancel the display of the ticket-grabbing reminder card 301. For example, the electronic device enters the ticketing application interface shown in Figure 3d. At this time, the electronic device can only enable the automatic ticket-grabbing service and not enable the ticket-grabbing reminder service.

[0179] Alternatively, in other embodiments, after the automatic ticket-grabbing service is enabled, the user can continue to enable the ticket-grabbing reminder service. For example, in the interface shown in Figure 3b, when a trigger operation is received for adding the ticket-grabbing reminder control 108, the electronic device can enable the ticket-grabbing reminder service and display the interface shown in Figure 3c.

[0180] The interface shown in Figure 3c displays a ticket-grabbing reminder card 304. The ticket-grabbing reminder card 304 includes a prompt message 305 and a completion control 306. The prompt message 305 indicates that the ticket-grabbing reminder service has been enabled; for example, the prompt message 305 could be "Ticket-grabbing reminder added." The completion control 306 can be used to cancel the display of the ticket-grabbing reminder card 304.

[0181] After activating the ticket-grabbing reminder service, users can click the completion control 306 to control the electronic device to cancel the display of the ticket-grabbing reminder card 304, for example, the electronic device will enter the ticketing application interface shown in Figure 3d. At this time, the electronic device can simultaneously activate the ticket-grabbing reminder service and the automatic ticket-grabbing service.

[0182] It should be noted that, in this embodiment, when a user clicks the "Add Ticket-Grabbing Reminder" control 108, the electronic device can indicate that the ticket-grabbing reminder service has been enabled; when a user clicks the "Automatically Execute Ticket-Grabbing Operation" control 109, the electronic device can indicate that the automatic ticket-grabbing service has been enabled. Optionally, the ticket-grabbing reminder card 106 may also include a control for enabling both services with one click. After clicking this control, the electronic device can display, for example, "Ticket-grabbing reminder and automatic ticket-grabbing service added" in the ticket-grabbing reminder card. In this embodiment, the electronic device can enable either the ticket-grabbing reminder service or the automatic ticket-grabbing service; the electronic device can enable the ticket-grabbing reminder service and the automatic ticket-grabbing service sequentially; the electronic device can also enable the ticket-grabbing reminder service and the automatic ticket-grabbing service simultaneously with one click. This embodiment does not impose any limitations on this.

[0183] In this way, electronic devices can add ticket-grabbing reminders to users' activities, reminding them within a preset time before the tickets go on sale to prevent them from missing the sales time; and / or, electronic devices can enable automatic ticket grabbing to help users grab tickets during the sales time, simplifying user operations and increasing the success rate of ticket grabbing.

[0184] In this embodiment, the electronic device can provide users with a ticket-grabbing reminder service, and can also provide users with one or more services associated with the ticket-grabbing reminder service. The services associated with the ticket-grabbing reminder service are described below with reference to Figures 4-6. Figure 4 shows a schematic diagram of the interface for setting an alarm clock provided in this embodiment; Figure 5 shows a schematic diagram of the interface for booking a hotel provided in this embodiment; and Figure 6 shows a schematic diagram of the interface for booking train tickets provided in this embodiment.

[0185] First, refer to Figure 4: The electronic device can display the interface shown in Figure 4a, which can be referred to in the relevant description of the interface shown in Figure 1c.

[0186] In one possible implementation, when a trigger operation is received for setting the alarm clock control 111, the electronic device can switch to the alarm clock service of the clock application, for example, the electronic device displays the interface shown in Figure 4b.

[0187] The interface shown in Figure 4b can be the full-screen interface of the clock application, which can be used to create a new alarm. For example, the interface shown in Figure 4b includes a page title 401, a time wheel 402, a ring date control 403, an alarm name control 404, and a completion control 405.

[0188] The page title 401 can be used, for example, to create a new alarm. The time selected by the time wheel 402 is related to the ticket sales start time. For example, if the ticket sales start time is 20:00, the time wheel 402 can display 19:50 to remind users to try to buy tickets 10 minutes before the sales start. The alarm date control 403 can be used to select the date the alarm will ring. For example, if the sales start time is September 10th, which is a Tuesday, the alarm date control 403 can display "Tuesday". The alarm name control 404 can be used to indicate the current alarm's message. For example, the alarm name control 404 can display "Ticket Purchase Reminder".

[0189] The completion control 405 can be used to create a new alarm based on information such as the time wheel, the ringing date, and the alarm name. For example, when a trigger operation is received on the completion control 405, the electronic device can create a new alarm named "Ticket Grab Reminder" that will ring at 19:50 on September 10th.

[0190] In another possible implementation, in the interface shown in Figure 4a, when a trigger operation is received for setting the alarm clock control 111, the electronic device can start the alarm clock service of the clock application. For example, the electronic device displays the interface shown in Figure 4d.

[0191] The interface shown in Figure 4d may include a floating window 406 for the alarm clock service; the content of the floating window 406 for the alarm clock service is similar to that of the interface shown in Figure 4b, and will not be described again here. In this way, electronic devices can quickly create alarms for ticket-grabbing reminders through the floating window, while reducing the need to switch between interfaces and avoiding interruptions to the user's current activities during the process of creating a new ticket-grabbing reminder alarm.

[0192] In another possible implementation, in the interface shown in Figure 4a, when a trigger operation is received for the alarm clock setting control 111, the electronic device can automatically set the alarm clock. For example, the electronic device displays the interface shown in Figure 4c.

[0193] The interface shown in Figure 4c includes a pop-up window 407, which indicates that an alarm reminder has been successfully added. Pop-up window 407 may include a notification message 408, a time modification control 409, and a completion control 410. The notification message 408 may indicate, for example, that an alarm reminder will be received 10 minutes before the ticket sale begins, and the reminder time can be changed. The time modification control 409 can be used to adjust the time of the ticket-buying reminder alarm. For example, after clicking the time modification control 409, the electronic device may display an interface as shown in Figure 4b or Figure 4d to edit the alarm time. The completion control 410 can be used to close pop-up window 407. The completion control 410 may be marked with a message such as "OK". After clicking the completion control 410, the electronic device will close pop-up window 407 and display an interface as shown in Figure 4a.

[0194] After adding an alarm to remind users to grab tickets, the electronic device can ring at the appropriate time to remind the user to do so.

[0195] For hotel booking services, please refer to Figure 5: The electronic device can display the interface shown in Figure 5a, which can be referred to in the relevant description of the interface shown in Figure 1c.

[0196] In one possible implementation, when a trigger operation is received for the hotel booking control 112, the electronic device can switch to the hotel booking service of the travel application, for example, the electronic device displays the interface shown in Figure 5b.

[0197] The interface shown in Figure 5b can be a full-screen interface for a travel application, which can be used to book hotels; for example, the interface shown in Figure 5b includes hotel location 501, check-in time 502, and hotel search controls 503, etc.

[0198] The hotel location 501 is associated with ticketing information; for example, the ticketing information also includes address information, such as a stadium in City A. Correspondingly, the hotel location 501 could be, for example, a destination in City A and an address in a stadium in City A. The check-in time 502 is also associated with ticketing information; for example, the ticketing information also includes performance time information, such as October 6th to October 7th. Therefore, the start time of check-in time 502 can be the day before the performance, and the end time can be the day after the performance, i.e., check-in time 502 can be October 5th to October 8th. The hotel search control 503 is used to search for hotels that meet the specified conditions based on the hotel location information and check-in time information.

[0199] In another possible implementation, in the interface shown in Figure 5a, when a trigger operation is received for the hotel booking control 112, the electronic device can provide hotel booking services for the travel application. For example, the electronic device displays the interface shown in Figure 5c.

[0200] The interface shown in Figure 5c may include a floating window 504 for booking hotel services; the content of the floating window 504 for booking hotel services is similar to that of the interface shown in Figure 5b, and will not be described again here. In this way, electronic devices can quickly launch the hotel booking service of the travel application through the floating window, while reducing the switching between interfaces and avoiding interruption of the user's current activity during the hotel booking process.

[0201] After booking a hotel, users can check in at the corresponding hotel during the performance period specified on their tickets.

[0202] For the ticket booking service, please refer to Figure 6: The electronic device can display the interface shown in Figure 6a, which can be referred to in the relevant description of the interface shown in Figure 1c.

[0203] In one possible implementation, when a trigger operation is received for the ticket reservation control 113, the electronic device can switch to the ticket reservation service of the travel application, for example, the electronic device displays the interface shown in Figure 6b.

[0204] The interface shown in Figure 6b can be a full-screen interface for a travel application, which can be used to book tickets; for example, the interface shown in Figure 6b includes ticket itinerary information 601 and a ticket query control 602, etc.

[0205] The ticket itinerary information 601 may include departure and destination information, ticket time information, etc. The ticket itinerary information 601 is associated with the ticketing information; for example, the address information of the ticket may be a stadium in City A, and the user's location may be City C; correspondingly, the departure point in the ticket itinerary information 601 may be City C, the destination may be City A, and the ticket time information may be the day before the performance time of the ticket, such as October 5th.

[0206] Optionally, the user's trip to watch the performance may be a round trip. The ticket trip information 601 may include round trip information. For example, the return trip information in the ticket trip information 601 may be that the departure point is City A and the destination is City C. The ticket time information may be the day after the performance time on the ticket, such as October 8th.

[0207] The ticket query control 602 is used to search for trains that meet the conditions based on the ticket itinerary information 601.

[0208] In another possible implementation, in the interface shown in Figure 6a, when a trigger operation is received for the ticket reservation control 113, the electronic device can provide a ticket reservation service for the travel application. For example, the electronic device displays the interface shown in Figure 6c.

[0209] The interface shown in Figure 6c may include a floating window 603 for booking train tickets; the content of the floating window 603 for booking train tickets is similar to that of the interface shown in Figure 6b, and will not be described again here. In this way, electronic devices can quickly launch the travel application's train ticket booking service through the floating window, while reducing the need to switch between interfaces and avoiding interruptions to the user's current activity during the ticket booking process.

[0210] After booking tickets, users can travel to their destination according to the show time on the ticket.

[0211] Optionally, this application embodiment uses the ticket reservation control 113 as an example to illustrate the relationship between ticket reservation service and ticket grabbing scenario; in practical applications, electronic devices can also provide users with flight reservation services, car rental services, and navigation services based on factors such as travel distance, ticket price, and user habits. Furthermore, the services associated with the ticket grabbing scenario in this application embodiment can also be services other than hotel reservation services, alarm clock setting services, and ticket reservation services; this application embodiment does not impose any limitations on this.

[0212] In ticket-buying scenarios, users can activate ticket-buying reminder services and / or automatic ticket-buying services before tickets go on sale. Users can also order related train tickets, plane tickets, and hotels through associated services. In this embodiment, the electronic device can also invoke a voice assistant via a voice assistant control, and then activate the corresponding service through user voice or user operation; this process is illustrated in Figure 7.

[0213] After taking a screenshot of the ticketing application interface, the electronic device can display the interface shown in Figure 7a, which can be referenced in the description of the interface shown in Figure 1b. The interface shown in Figure 7a may include a screenshot thumbnail 103, a voice assistant control 104, and a ticket-grabbing reminder control 105. In some scenarios, the interface shown in Figure 7a may not provide the service controls that the user wants. The user can control the electronic device to wake up the voice assistant by triggering the voice assistant control 104, so as to perform more operations through the voice assistant application; after the voice assistant is woken up, the electronic device can display the interface shown in Figure 7b.

[0214] In the interface shown in Figure 7b, the electronic device can display a dialog box 701 for the voice assistant; the dialog box 701 can be used to prompt the user that the voice assistant has been turned on, and to display user commands, such as text entered by the user, or converting the user's voice into text, etc.

[0215] The dialog box 701 also includes a voice assistant control 702, more controls 703, and a voice control 704. When a trigger operation is received for the voice assistant control 702, the dialog box 701 can display a prompt message such as "Recording audio, please speak your command" to prompt the user to record their voice. When a trigger operation is received for the more controls 703, users can upload images from a gallery application, upload photos taken with their own camera, or upload files in the dialog box 701. When a trigger operation is received for the voice control 704, the electronic device can record the user's voice and display the converted text in the dialog box 701, allowing the voice assistant application to execute corresponding processes based on the user's commands.

[0216] For example, after clicking voice control 704, the user can say "Add ticket-grabbing reminder" to the voice assistant, and the electronic device will then activate the ticket-grabbing reminder service in response to the user's command. As another example, after clicking voice control 704, the user can say "Add alarm for 7:50 PM on September 10th" to the voice assistant, and the electronic device will then set an alarm for the ticket-grabbing reminder, and so on, thus simplifying user operations.

[0217] Furthermore, when a ticket-grabbing scenario is identified based on the screenshot content, the electronic device can recommend one or more related services to the user based on a voice assistant. For example, in the interface shown in Figure 7b, the electronic device can also display multiple service controls associated with the ticket-grabbing scenario, such as a ticket-grabbing reminder control 705, an alarm clock setting control 706, a hotel reservation control 707, and a train ticket reservation control 708.

[0218] The electronic device can invoke the ticket-grabbing reminder card 106 via the ticket-grabbing reminder control 105 in the interface shown in Figure 7a, allowing the user to add ticket-grabbing reminders and / or activate the automatic ticket-grabbing service. The electronic device can also invoke the ticket-grabbing reminder card 106 via the ticket-grabbing reminder control 705 in the interface shown in Figure 7b. For example, in the interface shown in Figure 7b, when a trigger operation is received on the ticket-grabbing reminder control 705, the electronic device can display the interface shown in Figure 7c; the interface shown in Figure 7c can be referenced to the relevant description of the interface shown in Figure 1c.

[0219] Furthermore, in the interface shown in Figure 7b, the electronic device can also quickly launch the alarm setting service based on the alarm setting control 706, the hotel booking service based on the hotel booking control 707, and the ticket booking service based on the ticket booking control 708. The corresponding processes can be referred to the relevant descriptions in Figures 4-6.

[0220] Optionally, in other scenarios, the interface shown in Figure 7c may not provide the service controls that the user wants. The user can also control the electronic device to wake up the voice assistant by triggering the voice assistant control 107, so as to perform more operations through the voice assistant application. After the voice assistant is woken up, the electronic device can display the interface shown in Figure 7b.

[0221] In this way, during ticket-buying scenarios, users can use user commands to control the voice assistant to automatically activate the corresponding services, reducing user operations.

[0222] The above embodiments, in conjunction with Figures 1-7, illustrate the process of electronic devices activating ticket-grabbing reminder services and automatic ticket-grabbing services before ticket sales begin in a ticket-grabbing scenario. The following sections, in conjunction with Figures 8-12, describe the process of using the ticket-grabbing reminder and automatic ticket-grabbing services.

[0223] First, refer to Figure 8, which shows a schematic diagram of a ticket-grabbing reminder scenario provided by an embodiment of this application; as shown in Figure 8:

[0224] With the addition of ticket-grabbing reminders, on the day tickets go on sale, electronic devices can display service cards associated with the ticket-grabbing scenario on the desktop to remind users to grab tickets and book train tickets, hotels, and other matters.

[0225] For example, if ticket sales begin at 20:00 on September 10th, the electronic device can display the desktop shown in Figure 8a on that day. The desktop can display multiple application icons and multiple service cards; these service cards can be, for example, a ticket card 801, a train ticket card 802, a hotel card 803, and a clock card 804. Ticket card 801 can be used to quickly launch the ticketing application; it includes the ticket name and the ticket sales start time to remind the user to grab tickets at the start time. Train ticket card 802 can be used to quickly launch the train ticket booking service in the travel application. Hotel card 803 can be used to quickly launch the hotel booking service in the travel application. Clock card 804 can be used to indicate the current time; for example, clock card 804 indicates the current time is 8:00 AM on September 10th, which is the ticket sales start date. It should be understood that the clock card 804 is only an example to indicate that the display time of the ticket card 801, the train ticket card 802 and the hotel card 803 is the day the tickets go on sale. In the actual scenario, the desktop may not include the clock card 804.

[0226] It should be noted that in this embodiment, the ticket card 801, train ticket card 802, and hotel card 803 can be intelligently recommended service cards. These intelligently recommended service cards can be relevant service cards provided to the user by the voice assistant based on the scenario and / or time. That is, the cards in the area where the intelligently recommended service cards are located can change according to the scenario and / or time. The multiple application icons on the desktop and, for example, the clock card 804, are persistent icons on the desktop, and these persistent icons do not change according to the scenario and / or time.

[0227] For example, in some embodiments, in the interface shown in Figure 8a, when a trigger operation is received for the ticket card 801, the electronic device may display the interface shown in Figure 8c. The interface shown in Figure 8c can be a ticketing application interface, where users can view ticketing information and / or grab tickets.

[0228] In other embodiments, after taking a screenshot of the ticketing information, the user may not have booked a hotel or train ticket; in this case, on the day tickets go on sale, the electronic device can display ticket card 802 and hotel card 803. In the interface shown in Figure 8a, when a trigger operation is received for ticket card 802, the electronic device can display the interface shown in Figure 8b, allowing the user to book a train ticket; the interface shown in Figure 8b can be referred to in the relevant description of the embodiment shown in Figure 6. When a trigger operation is received for hotel card 803, the electronic device can display the interface shown in Figure 8d, allowing the user to book a hotel; the interface shown in Figure 8d can be referred to in the relevant description of the embodiment shown in Figure 5.

[0229] In some other embodiments, after taking a screenshot of the ticketing information, the user may have already booked a hotel and train tickets. The booking process can be referred to in the embodiments shown in Figures 5 and 6. In this case, on the day the tickets go on sale, the electronic device may not display the ticket card 802 and the hotel card 803.

[0230] In some embodiments, after taking a screenshot of the ticketing information, the user may have already booked a hotel and train tickets. The booking process can be referred to in the embodiments shown in Figures 5 and 6. On the day tickets go on sale, the electronic device can display ticket card 802 and hotel card 803. When a trigger operation is received for ticket card 802, the electronic device can display the booked ticket information for the user to view (not shown in the figures). When a trigger operation is received for hotel card 803, the electronic device can display the booked hotel information for the user to view (not shown in the figures).

[0231] In this way, on the day tickets go on sale, electronic devices can notify users of the ticket-grabbing event through a reminder card on the desktop, and prompt users to book tickets and hotels through related service cards such as ticket booking cards and hotel booking cards; helping users quickly complete services related to the ticket-grabbing scenario and avoid missing the ticket sales time.

[0232] In this embodiment, the electronic device can provide various ticket-buying reminder services. Besides displaying a reminder card on the desktop on the day tickets go on sale, as mentioned above, the electronic device can also push notifications to users some time before sales begin. (See Figure 9.)

[0233] For example, within one hour before ticket sales begin, the electronic device may display one or more notification reminders. For instance, if the electronic device detects that there is one hour left before the ticket sales start time while a user is chatting using a social application, it may display the interface shown in Figure 9a. In the interface shown in Figure 9a, the electronic device may display a ticket-grabbing reminder card 901 on top of, for example, the social application interface. The ticket-grabbing reminder card 901 may include ticket information, thereby reminding the user that there is a ticket-grabbing activity and preventing the user from missing the ticket sales start time; at the same time, the ticket-grabbing reminder card 901 is small in size, which can reduce the interference of notification reminders on the user's current activity.

[0234] Optionally, in this embodiment, if the user has not booked tickets and hotels, the electronic device may display ticket booking controls 902 and hotel booking controls 903 in the ticket booking reminder card 901. Alternatively, if the user has booked tickets but not hotels, the electronic device may display hotel booking controls 903 in the ticket booking reminder card 901, but not ticket booking controls 902. Alternatively, if the user has booked hotels but not tickets, the electronic device may display ticket booking controls 902 in the ticket booking reminder card 901, but not hotel booking controls 903. Alternatively, if the user has booked both hotels and tickets, the electronic device may only display ticket information in the ticket booking reminder card 901, without displaying ticket booking controls 902 and hotel booking controls 903.

[0235] For example, taking the ticket-grabbing reminder card 901, which includes ticketing information, a ticket reservation control 902, and a hotel reservation control 903, in the interface shown in Figure 9a, when a trigger operation is received on the ticket-grabbing reminder card 901 (excluding the area of ​​the ticket reservation control 902 and the hotel reservation control 903), the electronic device can display the ticketing application interface, as shown in Figure 9c. When a trigger operation is received on the ticket reservation control 902, the electronic device can display the ticket reservation service interface of the travel application, as shown in Figure 9b, which can be referred to the relevant description in the embodiment shown in Figure 6. When a trigger operation is received on the hotel reservation control 903, the electronic device can display the hotel reservation service interface of the travel application, as shown in Figure 9d, which can be referred to the relevant description in the embodiment shown in Figure 5.

[0236] Optionally, one hour before the ticket sales start time, the electronic device can display the ticket-grabbing reminder card 901 while the screen is on. Alternatively, one hour before the ticket sales start time, the electronic device can be in a screen-off state; in this case, the electronic device can display the ticket-grabbing reminder card 901 to the user when it receives an operation to turn on the screen. Alternatively, within one hour before the ticket sales start time, the electronic device can display the ticket-grabbing reminder card 901 multiple times. This increases the probability that the user will see the ticket-grabbing reminder card 901, thereby reminding the user to grab tickets. This application embodiment uses one hour as an example, but other times are possible in actual scenarios, and this application embodiment does not limit this.

[0237] Optionally, during the display of the ticket-grabbing reminder card 901, the electronic device can provide various ways to interact with the user. For example, the user can control the electronic device to activate the corresponding services of the travel application based on the ticket booking control 902 and the hotel booking control 903. As another example, in the interface shown in Figure 9a, the electronic device can also display a voice assistant dialog box 904; the user can control the electronic device to activate the corresponding services based on voice input or text input, enriching the user's choices. Simultaneously, the voice assistant application can provide users with more services besides ticket and hotel booking services, thereby enhancing the user experience.

[0238] It's important to note that the ticket card 801 and the ticket-buying reminder card 901 are different. The ticket card 801 can be a service card on the desktop, and the desktop can include an area that supports intelligently recommended service cards, such as the area where the ticket card 801 is located. The electronic device can recommend multiple services in this area based on the context; that is, on the day tickets go on sale, the electronic device can display the ticket card 801 on a loop on the desktop. The ticket-buying reminder card 901, on the other hand, can be a notification message. The interface beneath the ticket-buying reminder card 901 is not limited to the desktop; for example, the ticket-buying reminder card 901 could be located above a social media application interface. In this way, the electronic device can remind users of ticket-buying opportunities in different ways to prevent them from missing out on the event.

[0239] To simplify user operations, this application embodiment can recommend an automatic ticket-grabbing service to users. Figure 10 shows a schematic diagram of the interface in this application embodiment that reminds users to enable the automatic ticket-grabbing service before ticket sales begin.

[0240] For example, in the embodiments shown in Figures 1 to 3, the electronic device may not receive the user's operation on the automatic ticket-grabbing control 109, and therefore the electronic device will not activate the automatic ticket-grabbing service. Ten minutes before ticket sales begin, the electronic device can remind the user again whether to activate the automatic ticket-grabbing service. For example, at 19:50, the electronic device can display the interface shown in Figure 10a.

[0241] In the interface shown in Figure 10a, the electronic device can display a ticket-grabbing reminder card 1001 and a voice assistant dialog box 1002. The ticket-grabbing reminder card 1001 can remind the user to activate the automatic ticket-grabbing service again. For example, the ticket-grabbing reminder card 1001 includes an automatic ticket-grabbing operation control 1003 and ticket information; the automatic ticket-grabbing operation control 1003 can be used to automatically grab tickets when tickets go on sale; the ticket information may include, for example, the ticket name and the ticket sale time. The voice assistant dialog box 1002 can be used to receive user commands.

[0242] In some embodiments, the electronic device can access the ticketing application based on the ticket-grabbing reminder card 1001. For example, in the interface shown in Figure 10a, in response to a triggering operation on the ticket-grabbing reminder card 1001 (other than the automatic ticket-grabbing operation control 1003), the electronic device can access the ticketing application interface shown in Figure 10b. This interface can be referred to in the relevant description of the interface shown in Figure 1a.

[0243] In other embodiments, the electronic device can activate the automatic ticket-grabbing service based on the automatic ticket-grabbing operation control 1003 in the ticket-grabbing reminder card 1001. For example, in the interface shown in Figure 10a, the electronic device can activate the automatic ticket-grabbing service in response to a trigger operation on the automatic ticket-grabbing operation control 1003.

[0244] In other embodiments, the electronic device can activate the automatic ticket-grabbing service based on the voice assistant's dialog box 1002. For example, in the interface shown in Figure 10a, the dialog box 1002 can display, for example, "Do you want to automate?". The user can record voice or input text in the voice assistant's dialog box 1002 to instruct the electronic device to activate the automatic ticket-grabbing service; the voice or text recorded by the user can be, for example, "Automate", "Execute", "Okay", "Execute for me", etc.

[0245] After enabling the automatic ticket-grabbing service, the electronic device can automatically grab tickets when the tickets go on sale. For example, at 20:00 on September 10th, the electronic device can display the interface shown in Figure 10c. The interface shown in Figure 10c may include an automatic ticket-grabbing window 1004; the automatic ticket-grabbing window 1004 can be used to remind the user that the electronic device is currently automatically grabbing tickets. For example, the automatic ticket-grabbing window 1004 includes an image of the ticket and prompt text. The image of the ticket can be a thumbnail of the ticket cover or a fixed-style image; the prompt text may be, for example, "Trying to grab tickets."

[0246] After a period of time, if the electronic device successfully grabs a ticket, it can display an interface as shown in Figure 10(d). The interface shown in Figure 10(d) may include a ticket grabbing result window 1005, which can be a capsule-shaped window. The ticket grabbing result window 1005 can be used to notify the user of the ticket grabbing result. For example, the ticket grabbing result window 1005 includes a service identifier and a ticket grabbing result identifier. The service identifier can be used to indicate that the content currently displayed in the capsule window is related to the ticketing application, and the ticket grabbing result identifier can be used to indicate whether the ticket grabbing was successful. For example, if the ticket grabbing is successful, the ticket grabbing result identifier is "ticket issuance confirmation".

[0247] After successfully purchasing tickets, users can access the ticketing application through the ticket purchase result window 1005 to view ticket information and make payments; alternatively, users can access the ticketing application through the desktop icon. Taking the first scenario as an example, in the interface shown as d in Figure 10, when a trigger operation is received for the ticket purchase result window 1005, the electronic device can launch the ticketing application and display, for example, an order details interface or a payment interface; after the user completes the payment, the electronic device successfully purchases the tickets.

[0248] It is understandable that in the interfaces shown in Figure 10c and Figure 10d, the interface beneath the automatic ticket-grabbing window 1004 and the ticket-grabbing result window 1005 can be the desktop or any application interface. That is, while the electronic device is displaying any interface, when the ticket sales start time arrives, the electronic device can notify the user that it is automatically grabbing tickets in the form of the automatic ticket-grabbing window 1004, and notify the user that the ticket grabbing was successful in the form of the ticket-grabbing result window 1005.

[0249] It should be noted that, in this embodiment, the automatic ticket-grabbing window 1004 and the ticket-grabbing result window 1005 may differ from the ticket-grabbing reminder card 901 and the ticket-grabbing reminder card 1001. For example, the automatic ticket-grabbing window 1004 and the ticket-grabbing result window 1005 may be located at the front-facing camera cutout, partially covering the notification bar; the ticket-grabbing reminder card 901 and the ticket-grabbing reminder card 1001 may be located below the notification bar, without overlapping with it. The automatic ticket-grabbing window 1004 and the ticket-grabbing result window 1005 can be used to display real-time reminders or real-time status of specific services (such as the automatic ticket-grabbing service of a ticketing application); the ticket-grabbing reminder card 901 and the ticket-grabbing reminder card 1001 can be message reminders to prompt users to book hotel tickets or activate automatic ticket-grabbing, etc.

[0250] In this way, after triggering the ticket-grabbing reminder by taking a screenshot, the electronic device can remind the user to use the automatic ticket-grabbing service multiple times, thereby reducing user operations and increasing the success rate of grabbing tickets.

[0251] The above embodiments illustrate the subsequent automatic ticket-grabbing process using the scenario shown in Figures 1-3 where the automatic ticket-grabbing service is not enabled. The following describes the automatic ticket-grabbing service provided in this application embodiment using the scenario where the automatic ticket-grabbing service is enabled, in conjunction with Figure 11. As shown in Figure 11:

[0252] For example, in the embodiments shown in Figures 1 to 3, the electronic device may have received the user's operation on the automatic ticket-grabbing control 109, thus activating the automatic ticket-grabbing service. Ten minutes before tickets go on sale, the electronic device can remind the user to execute the automatic ticket-grabbing in 10 minutes. For example, at 19:50, the electronic device can display the interface shown in Figure 11a.

[0253] In the interface shown in Figure 11a, the electronic device can display a ticket-grabbing reminder card 1101 and a voice assistant dialog box 1102. The ticket-grabbing reminder card 1101 can remind the user that the automatic ticket-grabbing service has been activated. For example, the ticket-grabbing reminder card 1101 includes a prompt message 1103, which could be "The automatic ticket-grabbing operation will be executed in 10 minutes." The voice assistant's dialog box 1102 can be used to receive user commands.

[0254] In some embodiments, the electronic device can access the ticketing application based on the ticket-grabbing reminder card 1101. For example, in the interface shown in Figure 11a, in response to a triggering operation on the ticket-grabbing reminder card 1101, the electronic device can access the ticketing application interface shown in Figure 11b. This interface can be referred to in the relevant description of the interface shown in Figure 1a.

[0255] In other embodiments, after the electronic device automatically grabs tickets based on the ticket-grabbing reminder card 1101, the user can control the electronic device to de-display the ticket-grabbing reminder card 1101. For example, if the user clicks on a blank area outside the ticket-grabbing reminder card 1101, the electronic device will de-display the ticket-grabbing reminder card 1101; or, if the user does not perform any operation on the screen for a period of time, the electronic device will de-display the ticket-grabbing reminder card 1101. This application does not impose limitations on these embodiments.

[0256] In other embodiments, the electronic device can activate other services based on the voice assistant's dialog box 1102. For example, in the interface shown in Figure 11a, the dialog box 1102 may display, for example, "Is there anything else I can help you with?", and the user can enter voice or text in the voice assistant's dialog box 1102 to instruct the electronic device to activate other services.

[0257] After enabling the automatic ticket-grabbing service, the electronic device can automatically grab tickets during the ticket sales period. For example, at 20:00 on September 10th, the electronic device can display the interface shown in Figure 11c. The interface shown in Figure 11c may include an automatic ticket-grabbing window 1104, and the relevant description of the automatic ticket-grabbing window 1004 can be referred to.

[0258] After a period of time, if the electronic device successfully grabs a ticket, it can display an interface as shown in Figure 11d. The interface shown in Figure 11d may include a ticket grabbing result window 1105, and the relevant description in the ticket grabbing result window 1005 can be referred to.

[0259] Optionally, in some scenarios, users may only enable the automatic ticket-grabbing service in the scenarios shown in Figures 1-3, without enabling the ticket-grabbing reminder service. In this case, the electronic device may not display interfaces such as those shown in Figure 8a, Figure 9a, Figure 10a, and Figure 11a; when the ticket sales start time arrives, the electronic device may automatically execute the interfaces shown in Figure 11c and Figure 11d. This application does not impose limitations on this.

[0260] Understandably, the electronic devices no longer display the hotel reservation and train ticket reservation controls in ticket reminder cards 1001 and 1101. This is because the time is close to the ticket sales start time, and if users attempt to reserve hotels or train tickets, they may miss the ticket sales start time, resulting in failure to secure tickets.

[0261] Optionally, this application embodiment describes the ticket-grabbing reminder service of electronic devices before ticket sales begin, using the day of sale, one hour before sale, and ten minutes before sale as examples. In practical applications, electronic devices may also remind users to grab tickets at other times, and this application embodiment does not impose any restrictions on this.

[0262] In this way, after triggering the ticket-grabbing reminder by taking a screenshot, the electronic device can remind the user to use the automatic ticket-grabbing service multiple times, thereby reducing user operations and increasing the success rate of grabbing tickets.

[0263] In this embodiment, after taking a screenshot, the user can activate various services such as ticket-grabbing reminders, automatic ticket grabbing, setting alarms, booking hotels, and booking train tickets based on trigger operations on the controls. The user can also interact with the voice assistant in multiple modes, such as entering text in a dialog box, recording voice, importing images and files, etc., to instruct the voice assistant to provide corresponding services. For example, the usage scenarios related to the voice assistant in the embodiments shown in Figures 1-11. In this way, the electronic device can provide multiple interaction methods, and the user can choose the appropriate interaction mode according to their usage habits. At the same time, the voice assistant-based approach can provide users with more services, thus providing more user-relevant service content based on the screenshot.

[0264] After using the service corresponding to the multimodal interaction state, the electronic device can exit the multimodal interaction state. Figure 12 shows a schematic diagram of the interface for exiting the service corresponding to the multimodal interaction state.

[0265] The electronic device can display the interface shown in Figure 12a, which can be referenced in the description of the interface shown in Figure 11a. The interface shown in Figure 12a may include a ticket-grabbing reminder card 1101 and a voice assistant dialog box 1102.

[0266] In one possible implementation, in the interface shown in Figure 12a, when a click operation is received on a blank area (excluding the ticket-grabbing reminder card 1101 and the voice assistant's dialog box 1102), the electronic device can exit the voice assistant, for example, displaying the interface shown in Figure 12b. The voice assistant's dialog box 1102 is de-displayed in the interface shown in Figure 12b.

[0267] In another possible implementation, in the interface shown in Figure 12a, when a trigger operation is received that slides inward from the edge of the screen (e.g., the left or right edge), the electronic device can return to the previous level to exit the voice assistant. For example, the electronic device can display the interface shown in Figure 12b.

[0268] In another possible implementation, in the interface shown in Figure 12a, when an up swipe operation is received, the electronic device can exit the voice assistant. For example, the electronic device can display the interface shown in Figure 12b.

[0269] In the interface shown in Figure 12b, the user can further control the electronic device to exit various services. For example:

[0270] In one possible implementation, in the interface shown in Figure 12b, when a swipe operation is received for the ticket-grabbing reminder card 1101, the electronic device can cancel the display of the ticket-grabbing reminder card 1101, as shown in the interface shown in Figure 12c.

[0271] In another possible implementation, in the interface shown in Figure 12b, if the electronic device does not receive user operation within a certain period of time (e.g., 5 seconds), the electronic device can cancel the display of the ticket grabbing reminder card 1101, as shown in the interface shown in Figure 12c.

[0272] In this embodiment, the electronic device can exit the voice assistant first, and then exit the ticket-grabbing reminder card. This distributed exit effectively prevents accidental closure of the ticket-grabbing reminder card by the user, ensuring the user doesn't view the notification message in time.

[0273] Optionally, in this embodiment, the user can also directly enter the interface shown in Figure 12c from the interface shown in Figure 12a based on a single trigger operation. This embodiment does not limit this.

[0274] The above embodiments illustrate the ticket-grabbing reminder service and automatic ticket-grabbing service in this application. In this application, the ticket-grabbing reminder service can be linked with a calendar application, and electronic devices can also disable the added ticket-grabbing reminder service based on the calendar application. As shown in Figure 13:

[0275] When a trigger action is received on the desktop targeting the calendar application icon, the electronic device can launch the calendar application. The electronic device can display a schedule interface, such as shown in Figure 13a. The interface shown in Figure 13a can display a timeline 1305 and multiple activity cards for the day, such as alarm card 1301, schedule card 1302, and ticket card 1303. For example, on September 10th, the user sets an alarm for 7:00 AM, corresponding to alarm card 1301; the user books a ticket for 2:00 PM, corresponding to schedule card 1302; and the user activates a ticket-buying reminder service for 7:00 PM, corresponding to ticket card 1303.

[0276] In one possible implementation, the electronic device can jump to a ticketing application based on the ticket card 1303. For example, when a trigger operation is received for the ticket card 1303, the electronic device can display a ticketing application interface, such as shown in Figure 1a, where the user can view ticketing information.

[0277] In another possible implementation, the electronic device can disable the ticket-buying reminder service based on ticket card 1303. For example, when a left swipe operation is received for ticket card 1303, the electronic device can display the interface shown in Figure 13b. In the interface shown in Figure 13b, the electronic device displays a delete control 1304 and part of ticket card 1303, where the delete control 1304 corresponds to the position of ticket card 1303 and can be used to delete ticket card 1303 from the user's activities for the day. In response to the trigger operation of delete control 1304, the electronic device can enter the interface shown in Figure 13c, which displays alarm card 1301 and trip card 1302, but does not display ticket card 1303. Accordingly, when the ticket card is deleted in the calendar application, the service corresponding to the ticket card is also turned off. For example, after deleting ticket card 1303, the electronic device will no longer provide ticket-buying reminders on the day of ticket sales, one hour before sales, and ten minutes before sales. Users can subsequently reactivate the ticket-grabbing reminder service based on screenshots of the ticketing application interface.

[0278] In this way, users can view ticket cards through the calendar app to remind them that they need to participate in the ticket-buying activity on that day; or, if users do not need the ticket-buying reminder service, they can also turn it off through the calendar app.

[0279] The above embodiments, in conjunction with Figures 1-13, illustrate the identification of ticket-grabbing scenarios based on screenshots and the provision of services associated with these scenarios. Services for other scenarios are described below.

[0280] Figures 14-17 illustrate scenarios where a QR code reminder is identified based on a screenshot, and services related to the QR code reminder are provided. First, refer to Figure 14.

[0281] It should be understood that when a screenshot includes a scannable code, the electronic device can recognize the scan reminder scenario based on the screenshot. The following uses a scannable code in ticketing as an example to illustrate the service in a scan reminder scenario. Example:

[0282] After successful ticket purchase, the electronic device will display ticket details, as shown in Figure 14a. The interface shown in Figure 14a includes ticket information 1401 and a scannable code 1402; the scannable code 1402 corresponds to partial ticket information, such as seat information like "Second Floor, Second Floor, Row 15, Seat 19". Users can take a screenshot of the interface shown in Figure 14a to quickly find the scannable code when using the ticket later. After taking the screenshot, the electronic device will display the interface shown in Figure 14b.

[0283] In the interface shown in Figure 14b, the electronic device can display a QR code reminder control 1403, a voice assistant control 1404, and a screenshot thumbnail 1405. The screenshot thumbnail 1405 can be used to preview screenshots; the voice assistant control 1404 can be used to wake up the voice assistant and provide corresponding services; and the QR code reminder control 1403 is used to provide QR code reminder services.

[0284] In the interface shown in Figure 14b, if the user needs to use the QR code reminder service, the user can control the electronic device to enable the QR code reminder service by triggering the QR code reminder control 1403. If the user does not need to use the QR code reminder service, the electronic device can cancel the display of the screenshot thumbnail 1405, voice assistant control 1404, and QR code reminder control 1403 after the user triggers the blank area or the screenshot thumbnail 1405 is displayed for a period of time.

[0285] Taking the user's use of the QR code reminder service as an example, in the interface shown in Figure 14b, when a trigger operation is received for the QR code reminder control 1403, the electronic device can display the interface shown in Figure 14c. In the interface shown in Figure 14c, the electronic device can display the QR code reminder card 1406 and the voice assistant control 1407.

[0286] The QR code reminder card 1406 can be used to provide a QR code reminder service. The QR code reminder card 1406 may include the scannable code for the ticket, a prompt message 1408, and a QR code reminder addition control 1409. The prompt message 1408 can be used to remind the user's electronic device that the scannable code for the ticket can be displayed at a specific time and / or location; for example, the prompt message 1408 could be "A QR code will be displayed for you when you arrive at the stadium on October 6, 2024." The QR code reminder addition control 1409 can be used to enable the QR code reminder service.

[0287] For example, in the interface shown in Figure 14c, when a trigger operation is received for the add QR code reminder control 1409, the electronic device can activate the QR code reminder service and display the interface shown in Figure 14d. The interface shown in Figure 14d may include a QR code reminder card 1410. The QR code reminder card 1410 can be used to remind the user that the QR code reminder service has been activated. The QR code reminder card 1410 may include a prompt message and a completion control 1411. The prompt message may be, for example, "QR code reminder added"; the completion control 1411 can be used to cancel the display of the QR code reminder card 1410.

[0288] Upon receiving a trigger operation for the completion control 1411, the electronic device can return to the interface shown in Figure 14a.

[0289] After enabling the QR code reminder service, electronic devices can display the scannable code in the screenshot at a specific time and / or location. The following explanation of this scenario is based on Figure 15. As shown in Figure 15:

[0290] For example, on the day of the ticketed performance, the electronic device can remind the user via a service card on the desktop. For instance, if the ticketed performance is on October 6th-7th, the electronic device can display the desktop shown in Figure 15a on October 6th. This desktop may include a QR code reminder card 1501, which may include a scannable code and ticket information.

[0291] In this way, on the day of the ticketed performance, electronic devices can remind users of the performance by scanning a QR code on the desktop, thus preventing users from missing the performance.

[0292] Furthermore, the electronic device can also remind the user to scan a QR code upon arrival at the ticketed performance time and / or venue. For example, the ticketed performance time is October 6th-7th, and the venue is the A City Gymnasium. On, for instance, October 6th, when the electronic device detects the user is at the A City Gymnasium, it can display the interface shown in Figure 15b. This interface may include a QR code reminder window 1502, which may contain a scannable code 1503 and seat information 1504, allowing the user to understand the purpose of the scannable code 1503 based on the seat information 1504.

[0293] In this way, when users arrive at the venue at the performance time, their electronic devices can automatically display a scannable code, allowing users to quickly verify their tickets based on the scannable code. Users do not need to open the ticketing app to view the scannable code or search for a screenshot of the scannable code in the gallery app, thus simplifying the user operation.

[0294] Optionally, a user may have purchased multiple tickets for the same event. When the user takes a screenshot of the QR code for any ticket using their electronic device and enables the scan notification service, the electronic device can send a scan notification for the scannable codes of multiple tickets. See Figure 16:

[0295] Taking a user who has purchased two tickets as an example, upon arrival at the performance time and / or venue, the electronic device can also remind the user to scan the QR code and display the interface shown in Figure 16a. This interface can display a QR code reminder window 1502; the QR code reminder window 1502 can include a scannable code 1 and ticket quantity information 1601. When the number of tickets is greater than or equal to 2, the QR code reminder window 1502 can also include a previous control 1602 and a next control 1603, etc.

[0296] Among them, the scannable code 1 is the scannable code of the first ticket, and the ticket quantity information 1601 can be 1 / 2 tickets; when the electronic device receives a trigger operation for the previous control 1602 or the next control 1603, or when the electronic device receives a left or right swipe operation for the scan reminder window 1502, the electronic device can display the scannable code 2 of the second ticket, as shown in the interface in Figure 16b.

[0297] The interface shown in Figure 16b may include a QR code reminder window 1604, which includes a scannable code 2, ticket quantity information 1605, a previous control 1606, and a next control 1607. The scannable code 2 is the scannable code for the second ticket, and the ticket quantity information 1605 can be 2 / 2 tickets. When the electronic device receives a trigger operation for the previous control 1606 or the next control 1607, or when the electronic device receives a left or right swipe operation for the QR code reminder window 1604, the electronic device may display the scannable code 1 for the first ticket, as shown in the interface in Figure 16a.

[0298] During the ticket verification process, users can first show the staff the scannable code of the first ticket. After verification, users can use the previous control 1602 and the next control 1603 or the left and right swiping operation to control the electronic device to display the scannable code of the second ticket, so as to continue to verify the ticket.

[0299] In other embodiments, a user may purchase multiple tickets but want to use only one of them, and scannable code 1 is not the scannable code for the ticket the user wants to use. In this case, the user can also control the electronic device to display scannable codes for other tickets based on the previous control 1602 and the next control 1603 or by swiping left and right. This application embodiment does not limit this.

[0300] In this way, when users arrive at the venue at the performance time, the electronic device can display multiple associated scannable codes, allowing users to quickly verify multiple tickets, simplifying user operations and improving the user experience.

[0301] In this embodiment, the electronic device can also quickly launch the ticketing application based on the QR code reminder window 1502 or QR code reminder window 1604 to display ticketing details to the user.

[0302] For example, the electronic device can display the interface shown in Figure 16a, which includes a QR code reminder window 1502; when a click operation is received on the QR code reminder window 1502 (the area excluding the previous control 1602 and the next control 1603), the electronic device can launch the ticketing application and display the interface shown in Figure 16c.

[0303] The interface shown in Figure 16c may include ticket quantity information 1608, scannable code 1, and seat information 1609. The content of the interface shown in Figure 16c corresponds to the content of the scan reminder window 1502; for example, both the scan reminder window 1502 and the interface shown in Figure 16c display scannable code 1, the ticket quantity information is 1 / 2 tickets, and the seat information is 2nd floor, 2nd row, 15 seat, 19.

[0304] For example, the electronic device can display the interface shown in Figure 16b, which includes a QR code reminder window 1604; when a click operation is received on the QR code reminder window 1604 (the area excluding the previous control 1606 and the next control 1607), the electronic device can launch the ticketing application and display the interface shown in Figure 16d.

[0305] The interface shown as d in Figure 16 may include ticket quantity information 1610, scannable code 2, and seat information 1611. The content of the interface shown as d in Figure 16 corresponds to the content of the scan reminder window 1604; for example, both the scan reminder window 1604 and the interface shown as d in Figure 16 display scannable code 2, the ticket quantity information is 2 / 2 tickets, and the seat information is 2nd floor, 2nd row, 15 seat number 20.

[0306] In this embodiment, the electronic device can launch a ticketing application based on the QR code reminder window and display the ticket details corresponding to the QR code reminder window.

[0307] Optionally, the electronic device can also switch between the interface shown in c of Figure 16 and the interface shown in d of Figure 16 based on operations such as previous and next controls or left and right swipes.

[0308] Optionally, when a user purchases multiple tickets and some tickets have been redeemed, the electronic device may, during the scanning reminder process, not display the scannable codes of the redeemed tickets in the scanning reminder window, or prompt the user that the scannable code has been redeemed, thereby reducing the scenario where users use invalid scannable codes.

[0309] In this way, users can use the scannable code in the QR code reminder window to verify tickets according to their own usage habits, or they can quickly launch the ticketing application through the QR code reminder window and use the scannable code in the corresponding ticket details information to verify tickets, thereby simplifying user operations and improving user experience.

[0310] The above embodiments use scannable codes in performance ticketing as an example to illustrate the scenario where a scan reminder is triggered after a screenshot is taken and a scan reminder service is provided. The scan reminder service provided in this application embodiment can also be applied to other types of scannable codes. The applicable scenarios for the scan reminder service are described below with reference to Figure 17:

[0311] The first type of QR code reminder scenario can be seen in the interface shown in Figure 17a. This interface can be referred to in the relevant descriptions in Figures 14-16, and will not be repeated here.

[0312] The second type of QR code reminder scenario can be seen in the interface shown in Figure 17b. This interface may include a QR code reminder window 1701, which may include a scannable code 3 and information 1702 of the scannable code 3. The scannable code 3 may be, for example, a food pickup code; the user can understand the purpose of the scannable code 3 based on the information 1702 of the scannable code 3. For example, the information 1702 of the scannable code 3 may be "xx restaurant. Food pickup code: 090924. Cabinet number: 83".

[0313] For example, a user can take a screenshot of the food pickup code on the restaurant application interface and enable the scan reminder service. Subsequently, when the user arrives at the pickup locker, the electronic device can display a scan reminder window 1701 to prompt the user to pick up the food. After the user presents the scannable code 3 in the scan reminder window 1701, the user can quickly pick up the food.

[0314] The third type of QR code reminder scenario can be seen in the interface shown in Figure 17c. This interface may include a QR code reminder window 1703, which may include a scannable code 4 and information 1704 of the scannable code 4. The scannable code 4 may be, for example, a scannable code for group buying coupons, discount coupons, or vouchers; users can understand the purpose of the scannable code 4 based on the information 1704 of the scannable code 4. For example, the information 1704 of the scannable code 4 may be "017899234847 (2 pieces) xx hot pot voucher".

[0315] For example, a user can take a screenshot of the scannable code on a voucher in a restaurant application interface and enable the scan reminder service. Later, when the user arrives at, for example, a hot pot restaurant, the electronic device can display a scan reminder window (1703) to notify the user that they have purchased a voucher from that merchant. After the user presents the scannable code (4) in the scan reminder window (1703), the user can quickly redeem the voucher.

[0316] The fourth QR code reminder scenario can be seen in the interface shown in Figure 17d. This interface may include a QR code reminder window 1705, which may include a scannable code 5 and information 1706 of the scannable code 5. The scannable code 5 may be, for example, a scannable code for a movie ticket; the user can understand the purpose of the scannable code 5 based on the information 1706 of the scannable code 5. For example, the information 1706 of the scannable code 5 may be "Verification code: 201214957674224xx 2 movies".

[0317] For example, a user can take a screenshot of the scannable code on a movie ticket in the movie viewing application interface and enable the scan reminder service; subsequently, when the user arrives at the cinema, the electronic device can display a scan reminder window 1705. After the user presents the scannable code 5 in the scan reminder window 1705, the user can quickly redeem the movie ticket.

[0318] This application only illustrates some QR code reminder scenarios, and the above scenarios do not limit the implementation of this application.

[0319] In this embodiment, the scanning reminder scenario is illustrated with reference to Figures 14-17. It is understood that the scannable code can be, for example, a code used for activities such as watching performances, movies, picking up food, and group buying. This type of scannable code is suitable for displaying to merchants at specific times and / or locations. In this case, the electronic device can quickly display the scannable code through a scanning reminder window after taking a screenshot.

[0320] For other types of scannable codes used for information access, which are often webpage links or application-specific paths to control electronic devices to jump to specific webpages or application pages, these types of scannable codes may not be applicable to the scenarios shown in Figures 14-17.

[0321] It should be noted that the scenario corresponding to the scannable code used for display can be defined as a scan reminder scenario, to remind the user to use the scannable code at a specific time and / or a specific location. The scenario corresponding to the scannable code used for information access can be defined as a scan-to-access scenario, where the electronic device can quickly launch the scan function to scan the scannable code and jump to the corresponding interface.

[0322] Figure 18 shows a schematic diagram of an interface for a QR code-based direct access scenario provided in an embodiment of this application. As shown in Figure 18:

[0323] Taking the scannable code in the user's QR code business card as an example, the electronic device can display the interface shown in Figure 18a. This interface can display image 1801. Image 1801 may be an image saved in a gallery application, an image shared by other users in a social application, or an image being displayed in a video or file. This application embodiment does not restrict the source of the image.

[0324] Image 1801 may include a scannable code 1802 and information 1803 of the scannable code 1802; wherein, the scannable code 1802 may be a QR code business card of user A, and the user can learn about the purpose of the scannable code 1802 through the information 1803 of the scannable code 1802. The scannable code 1802 is used to add user A as a social friend. For example, the information 1803 of the scannable code 1802 may be "Scan the QR code above to add me as a friend".

[0325] In response to a screenshot operation, the electronic device can take a screenshot of the interface shown in Figure 18a and display the interface shown in Figure 18b. The interface shown in Figure 18b may include a screenshot thumbnail 1804, a voice assistant control 1805, and a QR code access control 1806. The screenshot thumbnail 1804 can be used to preview the screenshot. The voice assistant control 1805 can be used to wake up the voice assistant and provide corresponding services. The QR code access control 1806 provides a QR code access service, which refers to the service of scanning a scannable code after taking a screenshot and displaying the corresponding link interface.

[0326] For example, when a trigger operation is received for the QR code scanning control 1806, the electronic device can quickly launch the scan service to scan the scannable code in the screenshot; the scan service may be, for example, a service function provided by a social application. During the scanning process, the electronic device may display the interface shown in Figure 18c. The interface shown in Figure 18c includes a floating window 1807 of the social application, which includes a prompt message 1808. The prompt message 1808 can be used to inform the user that scanning is in progress and needs to wait a moment; for example, the prompt message 1808 can be "Scan completed, preparing to open".

[0327] After scanning is complete, the electronic device can display the interface shown in Figure 18d. The interface shown in Figure 18d includes a floating window 1809 for a social application, which may include user A's information and an add friend control 1810, etc.; user A's information may include, for example, user A's avatar, username, and user ID. When a trigger operation is received for the add friend control 1810, the electronic device can add user A as a social friend.

[0328] Optionally, after saving the image of user A's QR code business card, the electronic device can first launch the social application and enable the scan function; in the scan interface, it can search for the image in the gallery application based on the album control, and after finding the image, add it to the scan. The electronic device can then display the interface shown in Figure 18 (d).

[0329] Compared to the manual activation of the scan function described above, the direct scan service provided in this application simplifies the user's operation of opening social applications and the scan service. It also simplifies the process of importing images with scannable codes from the gallery application within the scan service, allowing electronic devices to quickly jump to the link interface corresponding to the scannable code and improving the user experience. Furthermore, this application embodiment can quickly bring up the application's floating window corresponding to the scan service within the existing interface, reducing interface switching and preventing the direct scan service from interrupting the user's current activity.

[0330] This application uses a user's QR code business card as an example to illustrate the direct access service via QR code scanning. In practical applications, the direct access service can also be used to quickly access links to other scannable codes. For example, an electronic device can receive a scannable code for a song shared by another user; after taking a screenshot of the scannable code and activating the direct access service, the electronic device can open a music application and display the song corresponding to the scannable code. As another example, an electronic device can receive a scannable code for a product shared by another user; after taking a screenshot of the scannable code and activating the direct access service, the electronic device can open a shopping application and display the product information corresponding to the scannable code. This application will not list all such instances.

[0331] The above embodiments illustrate direct access scenarios via QR code scanning. This application also provides more direct access scenarios to simplify user operations. For example, direct access scenarios may include QR code scanning scenarios, content access scenarios, etc. Specifically, electronic devices can identify QR code scanning scenarios based on scannable codes in screenshots and provide QR code scanning services; electronic devices can also identify corresponding direct access scenarios based on text and / or images in screenshots.

[0332] The following section will take the direct navigation scenario as an example and illustrate the direct content access scenario with reference to Figure 19, as shown in Figure 19:

[0333] In social applications, users may mention address information, as shown in the interface in Figure 19a, which includes address information, such as: A City Gymnasium.

[0334] When a screenshot request is received, the electronic device can display the interface shown in Figure 19b; this interface may include a screenshot thumbnail 1901 and a one-step navigation control 1902, etc. The screenshot thumbnail 1901 can be used to preview the screenshot; the one-step navigation control 1902 can be used to quickly launch the navigation application.

[0335] For example, in the interface shown in Figure 19b, when a trigger operation is received for the one-step navigation control 1902, the electronic device can recognize the text in the screenshot and display the interface shown in Figure 19c. The interface shown in Figure 19c may include a floating window 1903 of the navigation application; the floating window 1903 of the navigation application may include starting location information, ending location information 1904, and a start navigation control 1905. The starting location information can be the current location of the electronic device, and the ending location information 1904 can be the address information extracted from the screenshot, such as a stadium in City A. When a trigger operation is received for the start navigation control 1905, the electronic device can begin navigation.

[0336] In this way, electronic devices can identify a user's intention to use a navigation application by taking a screenshot, as well as the destination location in the navigation process. Based on the one-step navigation service, the electronic device can quickly launch the navigation application and provide multiple routes to the destination location, simplifying user operations and improving the user experience.

[0337] This application uses a navigation-to-direct-access scenario as an example to illustrate a scenario where direct access to functions is achieved based on text in a screenshot. In practical applications, electronic devices can also provide services such as one-step ride-hailing, direct ticket booking, direct music access, and direct merchant access based on text in a screenshot.

[0338] For example, when the screenshot includes address information, the electronic device can display a one-step ride-hailing control. In response to a trigger action on the one-step ride-hailing control, the electronic device can quickly launch a floating window of the ride-hailing app, displaying the corresponding origin and destination location information. Optionally, when the electronic device recognizes address information, it can launch either a floating window of the ride-hailing app or a floating window of the navigation app, depending on the user's usage habits. Alternatively, the electronic device can simultaneously provide both a one-step ride-hailing control and a one-step navigation control for the user to choose from, and launch the corresponding application's floating window based on the user's selection.

[0339] For example, when a screenshot includes the music title, lyrics, and artist, the electronic device can display a music direct access control; in response to a trigger action on the music direct access control, the electronic device can quickly pull up a floating window of the music application and display the corresponding music.

[0340] For example, when the screenshot includes the merchant's name or the product's name, the electronic device can display a direct access control for the merchant or the product; in response to a triggering operation on the direct access control for the merchant or the product, the electronic device can quickly launch a floating window of the shopping application and display the information of the corresponding merchant or product.

[0341] The embodiments of this application will not list all the scenarios where functions can be directly accessed.

[0342] In this embodiment, the electronic device can also extract information from the content of the screenshot. Information extraction can include, for example, extracting text, video, and images to generate a summary or extracting key information. The following description, in conjunction with Figures 20 and 21, illustrates the information extraction scenario, which can correspond to related services such as AI summarization services, translation services, video extraction services, image extraction services, and content extraction services.

[0343] The following uses AI summarization service as an example to illustrate the information extraction scenario in this application embodiment, as shown in Figure 20:

[0344] Users can use electronic devices to read text content in applications such as e-books or browsers. For example, the electronic device displays the interface shown in Figure 20a, which may include a large amount of text. In response to a screenshot operation, the electronic device may display the interface shown in Figure 20b. The interface shown in Figure 20b may include a screenshot thumbnail 2001 and an AI summary control 2002. The screenshot thumbnail 2001 can be used to preview the screenshot, and the AI ​​summary control 2002 can be used to provide an AI summary service, which can be a service that extracts and summarizes text.

[0345] In the interface shown in Figure 20b, when a trigger operation is received for the AI ​​summarization control 2002, the electronic device can activate the AI ​​summarization service and display the interface shown in Figure 20c. The interface shown in Figure 20c can display a prompt window 2003; the prompt window 2003 can be used to remind the user that the voice assistant is recognizing the page content and needs to wait a while. For example, the prompt window 2003 includes the prompt message "Recognizing page content, click anywhere to stop".

[0346] After the electronic device completes its processing, it can display the interface shown in Figure 20d. The interface shown in Figure 20d includes an AI summary card 2004, which may include a prompt message 2005, AI summary information, a copy control 2006, and a save to notes control 2007.

[0347] The prompt message 2005 can be used to remind users of word count and reading time. For example, prompt message 2005 could be "2000 words in total, 5 minutes reading time". It should be understood that prompt message 2005 can be used to remind users of the number of words on the page where the screenshot is located and the reading time required for that number of words. For example, the 2000 words mentioned in prompt message 2005 refers to the total number of words, not the number of words in the screenshot. This reduces the need for users to take long screenshots of the full text and then extract AI summaries from those long screenshots, thus reducing user operations and improving the user experience.

[0348] AI summary information can be a summary extracted from the entire text. It should be understood that AI summary information is a summary obtained from the entire text, not just a summary obtained from fragmented information in a screenshot. Therefore, in this embodiment, users can quickly obtain the AI ​​summary of the entire text through a screenshot, without needing to perform the operation of taking a long screenshot or selecting the entire text, thus simplifying the user operation; at the same time, the AI ​​summary information obtained from the entire text is more accurate.

[0349] The Copy Control 2006 allows users to copy AI summary information, enabling them to quickly paste it to other locations. The Save to Notes 2007 allows users to quickly save AI summary information to a note-taking application for later viewing.

[0350] This application uses AI summarization service as an example to illustrate information extraction service. Information extraction service can also be applied to translation service, video extraction service, image extraction service, and content extraction service, etc.

[0351] In some embodiments, the electronic device may also provide translation services when the text on the page containing the screenshot is lengthy. Optionally, the electronic device may provide either translation or AI summarization services to the user based on the frequency with which the user uses the translation and AI summarization functions. Alternatively, the electronic device may provide both translation and AI summarization services simultaneously, offering the appropriate service based on the user's selection.

[0352] In other embodiments, when detecting screenshots of a video, the electronic device analyzes the video content, identifies information such as speech, text, and scene changes in the video, and extracts key information from the video or generates a video summary.

[0353] In other embodiments, when a screenshot of an image is detected, the electronic device can identify and extract specific information from the image, such as object recognition, text recognition (OCR), facial recognition, etc.

[0354] In some embodiments, the electronic device may also provide a content extraction service. This service can be used to extract key information from screenshots, such as a user's ID number, address information, phone number, and WeChat ID. The content extraction service is described below with reference to Figure 21. As shown in Figure 21:

[0355] The electronic device can display the interface shown in Figure 21a, which can be a social application interface and includes multiple phone numbers. When a screenshot request is received, the electronic device can display the interface shown in Figure 21b.

[0356] In the interface shown in Figure 21b, the electronic device can display a screenshot thumbnail 2101, a voice assistant control, and a content extraction control 2102. The screenshot thumbnail 2101 can be used to preview the screenshot; the content extraction control 2102 is used to enable the content extraction service, which can be used to extract key information from the screenshot.

[0357] For example, in response to a triggering operation on the content extraction control 2102, the electronic device may display the interface shown in Figure 21c. This interface includes a content extraction card 2103, which may include prompts 2104, key information, a copy control 2105, and a save to notes control 2106.

[0358] The notification message 2104 can be used to notify the user that key information has been extracted. For example, notification message 2104 could be "Your mobile phone number has been intelligently extracted." The key information corresponds to notification message 2104. For example, if notification message 2104 indicates that the key information extracted is a mobile phone number, then the key information is the mobile phone number.

[0359] The copy control 2105 can be used to copy key information, allowing users to quickly paste it to other locations. The save to notes 2106 can be used to quickly save key information to a note-taking application for later viewing.

[0360] In this way, in scenarios where text cannot be copied (for example, key information in an image cannot be copied), electronic devices can quickly extract key information and provide users with copy and save functions, reducing user operations and improving the user experience.

[0361] Understandably, in some scenarios, the content in a screenshot may fit multiple scenarios, allowing electronic devices to perform multi-intent recommendation. The multi-intent recommendation function is explained below with reference to Figure 22. As shown in Figure 22:

[0362] The electronic device can display the interface shown in Figure 22a, which can be a social application interface, including phone number and address information. When a screenshot is received, the electronic device can recognize the screenshot content. The user may use the phone number or the address information in the screenshot; then the electronic device can provide various services, as shown in the interface in Figure 22b.

[0363] In the interface shown in Figure 22b, the electronic device can display screenshot thumbnails 2201, voice assistant controls 2205, content extraction controls 2202, one-step ride-hailing controls 2203, and one-step navigation controls 2204. The screenshot thumbnail 2201 can be used to preview screenshots; the content extraction control 2202 is used to enable the content extraction service; the one-step ride-hailing control 2203 is used to enable the one-step ride-hailing service; and the one-step navigation control 2204 is used to enable the one-step navigation service. It can be understood that if the electronic device recognizes address information in the screenshot, it will recommend the one-step ride-hailing service and the one-step navigation service to the user; furthermore, if the electronic device recognizes a phone number in the screenshot, it will recommend the content extraction service to the user.

[0364] For example, in response to a trigger operation on the content extraction control 2202, the electronic device can extract key information such as address information and phone number from the screenshot so that the user can quickly copy and use the key information.

[0365] For example, in response to a trigger operation on the one-step ride-hailing control 2203, the electronic device can launch the ride-hailing application and import the address information into the application so that the user can quickly complete the ride-hailing activity.

[0366] For example, in response to a triggering operation on the one-step navigation control 2204, the electronic device can launch a navigation application and import address information into the navigation application so that the user can quickly search for driving routes.

[0367] Furthermore, to improve the accuracy of multi-intent recommendations, electronic devices can provide users with more services based on the voice assistant control 2205. For example, in the interface shown in Figure 22b, when a trigger operation is received for the voice assistant control 2205, the electronic device can activate the voice assistant and display the interface shown in Figure 22c.

[0368] The interface shown in Figure 22c may include a voice assistant dialog box 2206 and controls for various related services. The dialog box 2206 can be used to prompt the user that the voice assistant has been activated and to display user commands. The controls for various related services may include, for example, a one-step navigation control 2207, a one-step ride-hailing control 2208, a content extraction control 2209, and a coupon purchase control 2210. The one-step navigation control 2207, one-step ride-hailing control 2208, and content extraction control 2209 can be referenced to the descriptions of the one-step navigation control 2204, one-step ride-hailing control 2203, and content extraction control 2202 mentioned above. The coupon purchase control 2210 can be used to launch the restaurant application to help users quickly purchase coupons.

[0369] Users can also control electronic devices to perform more services by recording voice or typing text. For example, a user can say to the voice assistant, "Call 159xxxxxxxx," and in response to the user's command, the electronic device can launch the calling application and make a call to 159xxxxxxxx. This application does not limit the services supported by the voice assistant.

[0370] Optionally, in the interface shown in Figure 22b, when the user selects any of the multiple controls, the electronic device can enter the interface of the corresponding service. For example, upon receiving a trigger operation for the one-step navigation control 2204, the electronic device can enter the interface shown in Figure 19c, for example. After exiting the interface shown in Figure 19c, the electronic device can continue to display the interface shown in Figure 22b, where the user can select to use other service controls.

[0371] It is understandable that in the interface shown in Figure 22b, the electronic device is set to display the screenshot thumbnail and multiple controls for a time, such as 3 seconds. If a trigger operation is received for a control within the display time, the electronic device enters the interface corresponding to the control and pauses the timer. After exiting the interface corresponding to the control, the electronic device can resume the timer or restart the timer until the display time is reached, at which point the electronic device cancels the display of the screenshot thumbnail and multiple controls.

[0372] In this way, electronic devices can identify multiple user intents based on screenshots, thereby providing users with more accurate services and improving the user experience.

[0373] In this embodiment, the screenshot operation can also be linked with the side toolbar to quickly save or share the screenshot content. For example, the process will be described below with reference to Figures 23A to 24C.

[0374] Figure 23A shows a schematic diagram of a scenario where a screenshot and a sidebar toolbar are linked, according to an embodiment of this application; as shown in Figure 23A:

[0375] Taking the display of an e-book application interface on an electronic device as an example, when a screenshot operation is received, the electronic device can display the interface shown in Figure 23A(a). This interface may include a screenshot thumbnail 2001, an AI summary control 2002, a voice assistant control, a sharing control, a scrolling screenshot control 2301, and a "door" control 2302. The scrolling screenshot control 2301 can be used to capture long content exceeding the current screen display area, resulting in a long screenshot. The "door" control 2302 can be used to send the screenshot to a specific application or service.

[0376] For example, when a trigger operation is received for any door control 2302, the electronic device may display the interface shown in Figure 23Ab. This interface may display screenshot 2303 and a side toolbar.

[0377] The content in screenshot 2303 is the same as that in screenshot thumbnail 2001. Screenshot 2303 has a corresponding cropping frame 2304, and the user can adjust the size of the cropping frame 2304 to display the key information in the screenshot.

[0378] The side toolbar may include multiple functional controls, such as a voice assistant control 2305, a favorites space control 2306, a print control 2307, a send to friends control 2308, and an email control 2309; the functional controls in the side toolbar may also be application icons, and this application embodiment does not limit this.

[0379] Taking saving a screenshot as an example, in the interface shown in b of Figure 23A, when a trigger operation is received for the collection space control 2306, the electronic device can save the screenshot content in the cropping box 2304 to the collection space and display the interface shown in c of Figure 23A.

[0380] The interface shown in Figure 23Ac may include a pop-up window 2310, which is used to remind the user that the screenshot has been saved to the favorites space. For example, pop-up window 2310 displays a message such as "Saved successfully". Pop-up window 2310 may also include a viewing control 2311; the viewing control 2311 may be labeled with the words "Go to favorites space to view".

[0381] When a trigger operation is received for viewing control 2311, the electronic device can display the interface shown in Figure 23A(d), which can be a favorites space interface. The interface shown in Figure 23A(d) can display one or more images, web pages, videos, documents, and text files stored in the favorites space. For example, this interface includes a screenshot thumbnail 2312, which corresponds to the screenshot source, such as an e-book application. Subsequently, the user can view or share the screenshot content based on the screenshot thumbnail 2312.

[0382] It should be noted that, in the embodiments of this application, when a trigger operation is received for any door control 2302 in the interface shown in Figure 23Aa, the electronic device can display an animation effect that transitions from the screenshot thumbnail 2001 in the interface shown in Figure 23Aa to the screenshot 2303 in the interface shown in Figure 23Ab; for example, the screenshot thumbnail 2001 can be gradually enlarged to the size shown in the screenshot 2303.

[0383] It is understood that the size of screenshot 2303 in this embodiment can be related to the size of the underlying application interface. For example, in the interface shown in b of Figure 23A, the e-book application interface can be located below screenshot 2303, and the e-book application interface presents a "door-opening" effect that is wider on the left and narrower on the right. The width of the e-book application interface can be the same as the width of screenshot 2303 (as shown by the dotted line in Figure 23A) to improve the cleanliness of the interface under the "any door" function, and to prompt the user that screenshot 2303 is a full-screen screenshot by using the same width.

[0384] In this way, electronic devices can quickly access the "Anywhere Door" function by taking a screenshot, thereby quickly sharing or saving the screenshot content and simplifying user operations.

[0385] Figure 23B shows a schematic diagram of a scrolling screenshot interface provided in an embodiment of this application. Exemplary:

[0386] After taking a screenshot of the e-book application interface, the electronic device can display the interface shown in Figure 23Ba; the interface may include a screenshot thumbnail 2001, an AI summary control 2002, and a scrolling screenshot control 2301.

[0387] When a trigger operation is received for the scrolling screenshot control 2301, the electronic device can scroll down to display the e-book application interface. During the scrolling display, when a user trigger operation is received, the electronic device stops scrolling the e-book application interface and displays a long screenshot thumbnail 2313 after the scrolling screenshot, as shown in b of Figure 23B. The long screenshot thumbnail 2313 may include the content in the screenshot thumbnail 2001 and the content of the e-book application interface displayed during scrolling.

[0388] Understandably, the functions supported by long screenshot thumbnail 2313 and screenshot thumbnail 2001 are similar. For example, in the interface shown in Figure 23Bb, after obtaining long screenshot thumbnail 2313, the electronic device can display any door control 2302 and AI summary control 2002 intelligently recommended based on the screenshot content.

[0389] When a trigger operation is received for the arbitrary door control 2302, the electronic device can display the interface shown in Figure 23Ab. This interface can display a long screenshot 2314 and a side toolbar. The side toolbar may include, for example, a voice assistant control 2305, a favorites space control 2306, a print control 2307, a send to friend control 2308, and an email control 2309.

[0390] It should be noted that if the electronic device associates the scale of a long screenshot with the underlying application interface, the width of the long screenshot will be the same as the width of the application interface, but the height of the long screenshot will be greater than the height of the application interface, and the electronic device will not be able to display the complete long screenshot. Therefore, in this embodiment, for long screenshots, the electronic device may not associate the scale of the long screenshot with the underlying application interface; for example, the width of long screenshot 2314 may be smaller than the width of the note-taking application interface. This embodiment does not impose any restrictions on this.

[0391] Figure 23C shows a schematic diagram of the animation effect of activating an arbitrary door function according to an embodiment of this application, as shown in Figure 23C:

[0392] When a screenshot operation is received, the electronic device can take a screenshot and obtain the interface shown in Figure 23Ca; the interface may include, for example, a screenshot thumbnail 2315, a content extraction control, a sharing control, a scrolling screenshot control, and an arbitrary door control 2302.

[0393] When a trigger operation is received for the Any Door control 2302, the electronic device can display an animation effect to activate the Any Door function, as shown below:

[0394] After clicking the AnyDoor control 2302, the electronic device controls the transparency of multiple controls to gradually decrease, as shown in the interface in Figure 23Cb. For example, the content extraction control, sharing control, scrolling screenshot control, and AnyDoor control 2302 gradually become transparent. In some embodiments, during the display of screenshot thumbnails, the electronic device can display a back panel of the screenshot thumbnail (which can be understood as the outer border of the screenshot thumbnail, the size of which is larger than the size of the screenshot thumbnail, not shown in the figure); after clicking the AnyDoor control 2302, the electronic device can retract the back panel of the screenshot thumbnail.

[0395] Optionally, the electronic device can shrink the screenshot thumbnail 2315 while reducing the control opacity and collapsing the back panel. For example, the size of the screenshot thumbnail 2315 in the interface shown in Figure 23Cb is smaller than the size of the screenshot thumbnail 2315 in the interface shown in Figure 23Ca.

[0396] After a period of time (e.g., 500ms), the opacity values ​​of multiple controls decrease to 0, and the electronic device does not display these controls. For example, in the interface shown in c of Figure 23C, the electronic device does not display the content extraction control, sharing control, scrolling screenshot control, and any-door control 2302, etc. Simultaneously, the electronic device can display a light effect 2316, which can move within the screenshot thumbnail 2315, presenting a sweeping light effect. This serves to indicate to the user that the electronic device is recognizing the content of the screenshot thumbnail 2315, and to enhance the fun of the interface interaction and improve its aesthetics. This application embodiment does not limit the form of the light effect.

[0397] In this embodiment of the application, after displaying the light effect 2316, the electronic device can add a mask to the area of ​​the interface other than the screenshot thumbnail 2315 to guide the user's attention to the screenshot thumbnail 2315.

[0398] After the content in the screenshot thumbnail 2315 is identified (the time for the light effect 2316 to sweep the light in the screenshot thumbnail 2315 is approximately 500ms), the electronic device can display the gradually enlarged screenshot thumbnail 2315 and the effect of the light effect 2316 being emitted to the right, as shown in the interface d in Figure 23C.

[0399] In Figure 23C, the screenshot thumbnail 2315 in interface d is larger than the screenshot thumbnail 2315 in interface c, to gradually enlarge the screenshot thumbnail 2315. Furthermore, the light effect 2316 in interface d is positioned to the right of the light effect 2316 in interface c, presenting an effect of the light effect 2316 radiating to the right. This right-side position corresponds to the position of the sidebar, thus guiding the user's attention to the right side of the screen.

[0400] Optionally, in the interface shown in d of Figure 23C, the application interface can present a door opening effect that is wider on the left and narrower on the right.

[0401] After a period of time (e.g., 800ms), the electronic device can display a full-screen screenshot 2320, as shown in e of Figure 23C. A full-screen screenshot 2320 can be understood as the screenshot 2320 having the same width as the underlying application interface, thus appearing as a full-screen screenshot.

[0402] Optionally, after displaying the full-screen screenshot 2320, the electronic device may display controls for setting the screenshot; for example, extract text control 2316, edit control 2317, and save control 2318, etc.

[0403] It should be noted that as the screenshot thumbnail 2315 gradually zooms in to screenshot 2320, the electronic device can load the corresponding service of AnyDoor based on the recognized screenshot content. The duration of loading the service can be, for example, 0-1000ms.

[0404] After the corresponding service of AnyDoor is loaded, the electronic device can display the interface shown in f of Figure 23C. The interface shown in f of Figure 23C includes a side toolbar 2319, which may include one or more items corresponding to the content of screenshot 2320.

[0405] It should be noted that the embodiment shown in Figure 23C uses a full-screen screenshot as an example to illustrate the animation effect of activating the Any Door function. In the embodiment shown in Figure 23B, the animation process of transitioning from the interface shown in b of Figure 23B to the interface shown in c of Figure 23B can be referred to the relevant description in Figure 23C, and will not be repeated here.

[0406] At this point, the electronic device has finished playing the animation to activate the Anywhere Door function, and the user can use the controls provided in the side toolbar to operate screenshot 2320.

[0407] In this embodiment of the application, in a split-screen scenario, the electronic device can also bring up the side toolbar through a screenshot operation. Figure 24A shows another scenario diagram of screenshot and side toolbar linkage provided by this embodiment of the application; as shown in Figure 24A:

[0408] The electronic device can display two application interfaces in a split-screen mode. For example, in the interface shown in Figure 24A(a), the electronic device can display a split-screen window 2401 for a note-taking application and a split-screen window 2402 for a calculator application. When a screenshot operation is received, the electronic device can display the interface shown in Figure 24A(b).

[0409] The interface shown in Figure 24Ab may include a screenshot thumbnail 2403, a full-screen screenshot control 2404, a top-screen screenshot control 2405, and a bottom-screen screenshot control 2406. The full-screen screenshot control 2404 is selected, while the top-screen screenshot control 2405 and the bottom-screen screenshot control 2406 are both unselected.

[0410] In some embodiments, if a user wants to save or share the screenshot thumbnail 2403, the user can follow the operation flow shown in the embodiment of FIG23A to save the full-screen screenshot to the collection space or share the full-screen screenshot to other applications.

[0411] In other embodiments, if a user wants to share or save a screenshot of the application interface on the upper half of the screen, the user can use the following operation process: In the interface shown in b of Figure 24A, when a trigger operation is received for the upper half screen screenshot control 2405, the electronic device can take a screenshot of the upper half screen interface and display the interface shown in c of Figure 24A.

[0412] In the interface shown in Figure 24Ac, the upper half-screen screenshot control 2405 is selected, while the full-screen screenshot control and the lower half-screen screenshot control are both unselected. Correspondingly, the electronic device can display a thumbnail 2407 of the upper half-screen screenshot; the thumbnail 2408 of the lower half-screen screenshot is in a masked state to indicate that the lower half-screen screenshot is unavailable. Alternatively, the electronic device can display only the thumbnail 2407 of the upper half-screen screenshot and not display the thumbnail 2408 of the lower half-screen screenshot (not shown in the figure).

[0413] The interface shown in Figure 24Ac may also include an arbitrary door control 2302. When a trigger operation is received for the arbitrary door control 2302, the electronic device may display the interface shown in Figure 24Ad. The interface shown in Figure 24Add may display a top half-screen screenshot 2409 and a side toolbar. The top half-screen screenshot 2409 may correspond to the content of the split-screen window 2401 of the note-taking application.

[0414] The sidebar may include controls such as voice assistant control, favorites control, print control, send to friends control, and email control. Electronic devices can save the upper half of the screen screenshot 2409 based on the favorites control, print the upper half of the screen screenshot 2409 based on the print control, share the upper half of the screen screenshot 2409 based on the send to friends control and email control, and so on.

[0415] Optionally, in a split-screen scenario, the width of the top half-screen screenshot and / or the bottom half-screen screenshot can be the same as the width of the application interface. This will not be described in detail in the embodiments of this application.

[0416] It is understood that in the embodiments of this application, the animation effect of launching the Any Door function in the split-screen scenario is similar to the animation effect of launching the Any Door function in the full-screen scenario; the animation process of launching the Any Door function in the split-screen scenario, such as the process of entering the interface shown in c of Figure 24A from the interface shown in d of Figure 24A, can be referred to the relevant description in Figure 23C, and will not be repeated here.

[0417] In this way, in split-screen scenarios, electronic devices can quickly access the "Anywhere Door" function by taking a screenshot, thereby quickly sharing or saving full-screen or half-screen screenshots and simplifying user operations.

[0418] In a split-screen scenario, the electronic device can switch between split-screen screenshots under the "Anywhere Door" function, as shown in Figure 24B. In one possible implementation, after taking a screenshot and activating the "Anywhere Door" function in a split-screen scenario, the electronic device can display the interface shown in Figure 24B(a). This interface may include the upper half-screen screenshot 2409 and a cropping frame 2410. When the user adjusts the position of the cropping frame 2410 (for example, dragging the cropping frame 2410 downwards to the lower half-screen screenshot), the electronic device can display the interface shown in Figure 24B(b).

[0419] In the interface shown in Figure 24Bb, the cropping box 2410 selects the lower half of the screen screenshot 2411. The electronic device can perform operations such as sharing and saving the lower half of the screen screenshot 2411.

[0420] In another possible implementation, in a split-screen scenario, after taking a screenshot and activating the "Anywhere Door" function, the electronic device can display the interface shown in Figure 24B(a). This interface may include the upper half-screen screenshot 2409, a cropping box 2410, and a portion of the application interface; the portion of the application interface may be, for example, the split-screen interface of a calculator application. When a click operation is received on the split-screen interface of, for example, a calculator application, the electronic device displays the interface shown in Figure 24B(b). In the interface shown in Figure 24B(b), the cropping box 2410 selects the lower half-screen screenshot 2411; the electronic device can perform operations such as sharing and saving on the lower half-screen screenshot 2411.

[0421] In another possible implementation, in a split-screen scenario (as shown in interface a of Figure 24A), when an operation to take a screenshot is received, the electronic device can display the interface shown in interface b of Figure 24A. The interface shown in interface b of Figure 24A may include a full-screen screenshot control 2404, a top-half-screen screenshot control 2405, and a bottom-half-screen screenshot control 2406.

[0422] When a user wants to share or save a screenshot of the lower half of the application interface, the electronic device may receive a trigger operation for the lower half-screen screenshot control 2406, and the electronic device will display a thumbnail of the lower half-screen screenshot, while the thumbnail of the upper half-screen screenshot will be in a masked state. When a trigger operation is received for the arbitrary door control 2302, the electronic device may display the interface shown in Figure 24Bb (refer to the relevant description in Figure 24A, but this scenario is not shown in the figure).

[0423] The interface shown in Figure 24B (b) may include a lower half-screen screenshot 2411. The electronic device can perform operations such as sharing and saving the lower half-screen screenshot 2411.

[0424] It should be noted that, in this embodiment of the application, the electronic device can provide a "door to anywhere" function based on the screenshot content. For example, when the upper half of the screen screenshot 2409 is selected in the cropping box 2410, the side toolbar can be, for example, controls 1, 2, 3, 4, and 5. When the lower half of the screen screenshot 2411 is selected in the cropping box 2410, the side toolbar can be, for example, controls 6, 7, 8, 9, and 10.

[0425] It should be noted that this application embodiment uses vertical split-screen as an example to illustrate the split-screen screenshot scenario in this application embodiment. In practical applications, electronic devices can also support horizontal split-screen, and the horizontal split-screen scenario can be referred to the relevant descriptions in Figure 24A or Figure 24B, which will not be repeated here.

[0426] In this way, in split-screen scenarios, after taking a screenshot, users can choose the form of the screenshot to be processed, such as a full-screen screenshot (e.g., including the split-screen windows of all applications in the split-screen interface) or a half-screen screenshot (e.g., including the split-screen window of a single application); the AnyDoor function can provide corresponding services based on the content of the split-screen screenshots of different applications, so as to improve the relevance of the recommended services to users and enhance the user experience.

[0427] It should be noted that, in this embodiment of the application, the electronic device can provide corresponding services based on different split-screen content when taking split-screen screenshots. Figure 24C shows a schematic diagram of an interface for switching split-screen screenshots in a split-screen scenario provided by an embodiment of the application. As shown in Figure 24C:

[0428] Electronic devices can display split-screen windows; for example, an electronic device can display a split-screen window of a social media application and a split-screen window of an e-book application. When a screenshot request is received, the electronic device can take screenshots of the split-screen windows of the social media application and the e-book application. For example, the electronic device can display the interface shown in Figure 24Ca.

[0429] The interface shown in Figure 24Ca may include a screenshot thumbnail 2414, a full-screen screenshot control, a top-half-screen screenshot control 2405, and a bottom-half-screen screenshot control 2406. The top-half-screen screenshot control 2405 is selected, while the full-screen screenshot control and the bottom-half-screen screenshot control 2406 are both unselected.

[0430] The screenshot thumbnail 2414 may include a thumbnail 2412 for the upper half of the screen and a thumbnail 2413 for the lower half of the screen. The upper half-screen screenshot control 2405 is selected; correspondingly, the electronic device can display the thumbnail 2412 of the upper half-screen screenshot; the thumbnail 2413 of the lower half-screen screenshot is in a masked state to indicate that the lower half-screen screenshot is unavailable, or the electronic device can only display the thumbnail 2412 of the upper half-screen screenshot and not display the thumbnail 2413 of the lower half-screen screenshot (not shown in the figure).

[0431] The services provided by the voice assistant application can correspond to the content of the selected split-screen screenshot. For example, in the interface shown in Figure 24Ca, if the selected upper half-screen screenshot is a split-screen window screenshot of a social application, the electronic device can recommend corresponding services based on the content of the social application. For example, if the content of the social application includes phone numbers, the electronic device can display a content extraction control 2102 to extract content such as phone numbers from the upper half-screen screenshot.

[0432] In the interface shown in Figure 24C(a), when a trigger operation is received for the lower half-screen screenshot control 2406, the electronic device can switch the screenshot of the split-screen window. In the interface shown in Figure 24C(b), the lower half-screen screenshot control 2406 is selected, while the full-screen screenshot control and the upper half-screen screenshot control 2405 are both unselected. Accordingly, the electronic device displays the thumbnail 2413 of the lower half-screen screenshot, and the thumbnail 2412 of the upper half-screen screenshot is in a masked state to indicate that the upper half-screen screenshot is unavailable. Alternatively, the electronic device may only display the thumbnail 2413 of the lower half-screen screenshot and not display the thumbnail 2412 of the upper half-screen screenshot (not shown in the figure).

[0433] The services provided by the voice assistant application can correspond to the content of the selected split-screen screenshot. For example, in the interface shown in Figure 24Cb, if the selected lower half of the screenshot is a split-screen window screenshot of an e-book application, the electronic device can recommend corresponding services based on the content of the e-book application. For instance, if the content of the e-book application includes a large amount of text, the electronic device can display an AI summary control 2002 to extract and summarize the text content in the lower half of the screenshot.

[0434] In this embodiment of the application, in the interface shown in b of Figure 24C, the electronic device can also switch back to the interface shown in a of Figure 24C based on the upper half-screen screenshot control 2405. This process will not be described in detail in this embodiment of the application.

[0435] Optionally, when a trigger operation is received for the full-screen screenshot control, the electronic device can display screenshot thumbnails 2414, with both the upper half-screen screenshot thumbnail 2412 and the lower half-screen screenshot thumbnail 2413 selected (not shown in the figure). The electronic device can identify the content in the screenshot thumbnails 2414 and recommend corresponding services. For example, after selecting the full-screen screenshot control, the electronic device can display a content extraction control and an AI summary control. The content extraction control is identified based on the content of the upper half-screen screenshot thumbnail 2412, and the AI ​​summary control is identified based on the content of the lower half-screen screenshot thumbnail 2413. This embodiment of the application does not limit this.

[0436] In this way, in split-screen scenarios, after taking a screenshot, users can choose the form of the screenshot to be processed, such as a full-screen screenshot (e.g., including the split-screen windows of all applications in the split-screen interface) or a half-screen screenshot (e.g., including the split-screen window of a single application); the voice assistant application can provide corresponding services based on the content of the split-screen screenshots of different applications, so as to improve the relevance of the recommendation services to users and enhance the user experience.

[0437] In some embodiments, the electronic device can also quickly save screenshots to a collection space via a screenshot operation.

[0438] For example, electronic devices can provide a one-click collection service, allowing them to save one or more screenshots to their collection space. As an example, Figure 25 shows a schematic diagram of the interface for a one-click collection service provided in an embodiment of this application, as shown in Figure 25:

[0439] After taking a screenshot, the electronic device can display the interface shown in Figure 25a, which includes a screenshot thumbnail 2501 and a one-click favorite control 2502. The one-click favorite control 2502 provides a one-click favorite service, which allows users to quickly add screenshots to their favorites.

[0440] In one possible implementation, when a trigger operation is received for the one-click favorites control 2502, the electronic device can save the screenshot to the favorites space and display the interface shown in Figure 25b. The interface shown in Figure 25b may include a favorites space window, which may be located on one side of the electronic device screen to reduce obstruction of the user's current browsing interface.

[0441] The Favorites window may include a screenshot thumbnail 2503, the content of which is the same as that of the screenshot thumbnail 2501, to indicate to the user that the screenshot has been saved to the Favorites space.

[0442] Users can then quickly open the Collections Space application based on the Collections Space window. For example, in the interface shown in Figure 25b, when a trigger operation is received for the Collections Space window, the electronic device can display the interface shown in Figure 25c. The interface shown in Figure 25c includes a screenshot thumbnail 2504. The content of screenshot thumbnail 2504 is the same as that of screenshot thumbnail 2501. Screenshot thumbnail 2504 corresponds to the screenshot source, for example, screenshot thumbnail 2504 comes from an e-book application. Users can then view or share the screenshot content based on screenshot thumbnail 2504.

[0443] In another possible implementation, when a trigger operation is received for the one-click favorites control 2502, the electronic device can save a screenshot to the favorites space and display an interface, such as shown in Figure 23Ac, which includes a viewing control 2311. When a trigger operation is received for the viewing control 2311, the electronic device can display an interface, such as shown in Figure 25c.

[0444] It is understandable that in this embodiment, after taking a screenshot, the electronic device can automatically save the screenshot to the gallery application. However, the gallery application contains a large number of screenshots, many of which are meaningless (e.g., screenshots that will not be reused). When the screenshot content is important, the user needs to search for the target screenshot among the large number of screenshots in the gallery application, which is a cumbersome operation. However, after saving important screenshot content to the favorites space, the information stored in the favorites space is all important information and is relatively small in number. The user can quickly find the target screenshot in the favorites space to use it.

[0445] This allows for quick saving of screenshots, further reducing the need for users to save screenshots via any door control and improving the user experience.

[0446] Figure 26 illustrates a scenario diagram of another one-click collection service provided in an embodiment of this application. As shown in Figure 26:

[0447] In scenarios such as browsing e-books, watching videos, and participating in video conferences, users may take multiple screenshots of their screen and wish to save these screenshots to their favorites. In this embodiment, the electronic device may provide a merge-and-favorites function to intelligently categorize multiple screenshots taken within a short period of time from the same application.

[0448] For example, in the embodiment shown in Figure 25, the electronic device takes a first screenshot of the e-book interface and saves the screenshot to the favorites space. Afterwards, the user can continue browsing the e-book interface and control the electronic device to take a second screenshot, as shown in Figure 26a.

[0449] In the interface shown in Figure 26a, the electronic device can display screenshot thumbnails 2601 and a merge collection control 2602. The merge collection control 2602 can be used to provide a merge collection service, which can summarize the current screenshot with previous screenshots and save them to the same location in the collection space, so that users can quickly view multiple related screenshots.

[0450] When a trigger operation is received for the merge collection control 2602, the electronic device can display a collection space window. This window may include, for example, a folder 2603. Folder 2603 may store screenshots saved, for example, in the embodiment shown in FIG. 25, and screenshots saved based on the merge collection control 2602. For example, folder 2603 may display screenshot thumbnails 2604 and 2605, where the content of screenshot thumbnail 2604 is the same as the content of screenshot thumbnail 2601, and the content of screenshot thumbnail 2605 is the same as the content of screenshot thumbnail 2601.

[0451] Users can later view the saved screenshots in the Collections Space application. For example, after launching the Collections Space application, the electronic device displays a full-screen window of Collections Space, as shown in Figure 26c. This interface may include folder 2606, which can be used to save screenshots of the e-book application. For example, folder 2606 displays screenshot thumbnails 2607 and 2608. The content of screenshot thumbnail 2607 is the same as the content of screenshot thumbnail 2501, and the content of screenshot thumbnail 2607 is the same as the content of screenshot thumbnail 2601.

[0452] Optionally, in some embodiments, when a user takes a third screenshot in the e-book application within a certain period of time, the electronic device can automatically add the third screenshot to the favorites space and save it in the same folder as the first and second screenshots. Alternatively, in other embodiments, when a user takes a third screenshot in the e-book application, the electronic device can continue to display the merge favorites control; in response to a trigger operation on the merge favorites control, the electronic device saves the third screenshot to the folder containing the first and second screenshots. This application does not impose limitations on these embodiments.

[0453] In this embodiment of the application, the electronic device can also add a scannable code to the screenshot based on the screenshot operation, so that after the screenshot is shared, others can quickly view the content corresponding to the screenshot through the scannable code. As shown in Figure 27:

[0454] The electronic device can display a shopping application interface, as shown in Figure 27a. The shopping application interface may include product information, such as product images, prices, and names. When a screenshot request is received, the electronic device can display the interface shown in Figure 27b. This interface may include a screenshot thumbnail 2701 and a sharing control 2702.

[0455] When a trigger operation is received for the sharing control 2702, the electronic device can quickly launch a social application and share the screenshot with others. For example, the electronic device can display the interface shown in Figure 27c. The interface shown in Figure 27c can display image 2703, which includes a product image 2704, a scannable code 2705, and the icon of the application to which it belongs. The content of the product image 2704 is the same as the content of the product image on the shopping application interface, the scannable code 2705 can be a product link, and the icon of the application to which image 2703 belongs can be the shopping application icon 2706.

[0456] The recipient can view image 2703. When the recipient uses an electronic device to scan the scannable code 2705 in image 2703, the electronic device can quickly open the product link. In this way, the electronic device can quickly generate a product link through a screenshot. Compared to the method of users opening the product scannable code based on the sharing control in the shopping application, the screenshot sharing function provided in this application embodiment can reduce user operations.

[0457] Optionally, after taking a screenshot, the electronic device can save the screenshot corresponding to the screenshot thumbnail 2701 to the gallery application, and / or save the image 2703 after stitching the scannable code to the gallery application. This application embodiment does not limit this.

[0458] Furthermore, the screenshot sharing function can also be used to stitch together other scannable codes. For example, in response to screenshotting lyrics or playlists in a music application interface, the electronic device can take a screenshot of the music application interface and generate an image stitched together with a music image and a music scannable code. The recipient can then quickly listen to the corresponding music or playlist using the music scannable code. This application's embodiments will not list all examples of this functionality.

[0459] The screenshot processing corresponding to the floating window scene in the embodiments of this application will be described below with reference to Figures 28A-28E. Figure 28A shows a schematic diagram of a floating window screenshot scene provided in an embodiment of this application, as shown in Figure 28A:

[0460] Electronic devices can display one or more floating windows. Taking a floating window of 1 as an example, the electronic device displays a floating window 2802 of a social application. The floating window 2802 of the social application can float on top of the full-screen window 2801, as shown in the interface in Figure 23Aa.

[0461] When a screenshot request is received, the electronic device can display the interface shown in Figure 28Ab. In the interface shown in Figure 28Ab, on top of the floating window 2802 of the social application, there may be displays such as a screenshot thumbnail 2803, a full-screen screenshot control 2805, and a floating window screenshot control 2806. The screenshot thumbnail 2803 may include a floating window screenshot thumbnail 2804.

[0462] Among them, the full-screen screenshot control 2805 can be used to display screenshots of full-screen windows; the floating window screenshot control 2806 can be used to display screenshots of floating windows.

[0463] In one possible implementation, when taking a screenshot of the interface shown in Figure 28A(a), the electronic device can display the interface shown in Figure 28A(b). In the interface shown in Figure 28A(b), the full-screen screenshot control 2805 can be selected, and the floating window screenshot control 2806 can be unselected to prompt the user that screenshot 2803 is a full-screen screenshot.

[0464] In another possible implementation, when taking a screenshot of the interface shown in Figure 28A(a), the electronic device can display the interface shown in Figure 28A(c). In the interface shown in Figure 28A(c), a screenshot thumbnail 2803, a full-screen screenshot control 2805, and a floating window screenshot control 2806 can be displayed above the floating window 2802 of the social application. The screenshot thumbnail 2803 may include a floating window screenshot thumbnail 2804.

[0465] In the interface shown in Figure 28Ac, the full-screen screenshot control 2805 can be unselected, the floating window screenshot control 2806 can be selected, and the screenshot thumbnail 2803, except for the floating window screenshot thumbnail 2804, has other areas in a masked state; thus prompting the user that screenshot 2804 is a floating window screenshot.

[0466] This application embodiment does not limit the default form of screenshots in the floating window scenario. For example, the electronic device can display a full-screen screenshot thumbnail in the interface shown in Figure 23Ab (such as screenshot thumbnail 2803); it can also display a floating window screenshot thumbnail in the interface shown in Figure 23Ac (such as floating window screenshot thumbnail 2804).

[0467] In another possible implementation, in the interface shown in Figure 28A(b), when a trigger operation is received for the floating window screenshot control 2806, the electronic device can display the interface shown in Figure 28A(c). In the interface shown in Figure 28A(c), when a trigger operation is received for the full-screen screenshot control 2805, the electronic device can display the interface shown in Figure 28A(b). The electronic device can switch the screenshot thumbnail format.

[0468] Optionally, after selecting the floating window screenshot thumbnail, the electronic device can provide corresponding functional controls based on the content of the floating window. For example, in the interface shown in Figure 28Ac, the floating window screenshot thumbnail 2804 is selected. The electronic device provides a content extraction function based on the content of the floating window screenshot of the social application. The interface shown in Figure 28Ac may include a content extraction control 2102.

[0469] In this way, in the floating window scenario, after taking a screenshot, the user can choose the form of the screenshot to be processed, such as a full-screen screenshot (e.g., a screenshot including both the full-screen window and the floating window) or a floating window screenshot; the voice assistant application can provide corresponding services based on the content of the floating window screenshot to improve the relevance of the recommended services to the user and enhance the user experience.

[0470] Figure 28B shows a schematic diagram of another floating window screenshot provided in an embodiment of this application, as shown in Figure 28B:

[0471] The electronic device can display one or more floating windows. Taking two floating windows as an example, the electronic device displays a floating window 2802 for a social application and a floating window 2807 for an e-book application. When a screenshot operation is received, the electronic device can display the interface shown in Figure 28Ba. In the interface shown in Figure 28Ba, on top of the floating windows 2802 for the social application and 2807 for the e-book application, there can be displays such as a screenshot thumbnail 2808, a full-screen screenshot control 2805, a left floating window screenshot control 2812, and a right floating window screenshot control 2809. The screenshot thumbnail 2808 can include a screenshot thumbnail 2810 for the social application and a screenshot thumbnail 2811 for the e-book application.

[0472] In some embodiments, when the floating window 2802 of the social application is in an operational state and a screenshot operation is received, the electronic device can take a screenshot thumbnail 2808, as shown in the interface in Figure 28Ba. The operational state can be a touch object (finger or stylus) clicking the floating window 2802 of the social application. The area in the screenshot thumbnail 2808 other than the floating window screenshot thumbnail 2810 can display a mask to indicate that the floating window screenshot thumbnail 2810 is selected and the floating window screenshot thumbnail 2811 is unselected.

[0473] Correspondingly, in the interface shown in Figure 28Ba, if the floating window screenshot thumbnail 2810 is located in the left area of ​​the screenshot thumbnail 2808, then the left floating window screenshot control 2812 can be selected.

[0474] In other embodiments, when the floating window 2807 of the e-book application is in operation and a screenshot operation is received, the electronic device can take a screenshot to obtain a thumbnail 2808, as shown in the interface in Figure 28Bb. The area in the screenshot thumbnail 2808 other than the floating window screenshot thumbnail 2811 can display a mask to indicate that the floating window screenshot thumbnail 2811 is selected and the floating window screenshot thumbnail 2810 is unselected.

[0475] Correspondingly, in the interface shown in Figure 28Bb, if the floating window screenshot thumbnail 2811 is located in the right area of ​​the screenshot thumbnail 2808, then the right floating window screenshot control 2809 can be selected.

[0476] In this embodiment of the application, after taking a screenshot, the electronic device can switch between floating window screenshots. For example, in the interface shown in Figure 28Ba, when a trigger operation is received for the right floating window screenshot control 2809, the electronic device can display the interface shown in Figure 28Bb. In the interface shown in Figure 28Bb, when a trigger operation is received for the left floating window screenshot control 2812, the electronic device can display the interface shown in Figure 28Ba.

[0477] Optionally, in this embodiment, the styles of the left floating window screenshot control 2812 and the floating window screenshot control 2806 can be the same or different.

[0478] It should be noted that the intelligent recommendation function of the voice assistant application differs depending on the screenshot content selected by the user. For example, in the interface shown in Figure 28B(a), the electronic device can recognize the content in the floating window screenshot of a social application and provide a content extraction control 2102. In the interface shown in Figure 28B(b), the electronic device can recognize the content in the floating window screenshot of an e-book and provide an AI summarization control 2002.

[0479] It is understood that in the embodiments of this application, the animation effect of launching the Any Door function in the floating window scenario is similar to the animation effect of launching the Any Door function in the full-screen scenario; the animation effect process of launching the Any Door function in the floating window scenario can be referred to the relevant description in Figure 23C, and will not be repeated here.

[0480] It should be noted that this embodiment uses two floating windows as an example to illustrate the processing of a screenshot scenario. In practical applications, electronic devices can also launch multiple application floating windows, and the electronic device can provide corresponding functions based on the content of the screenshot taken from any selected floating window.

[0481] Optionally, in this embodiment, the electronic device may also support displaying three or more floating windows. For example, the electronic device may provide a multi-tasking (desktop) mode; in multi-tasking mode, the electronic device displays three floating windows. After receiving a screenshot operation, the electronic device may display a screenshot thumbnail and four switching controls, such as a full-screen screenshot control, a first floating window screenshot control, a second floating window screenshot control, and a third floating window screenshot control. That is, in this embodiment, after taking a screenshot, the number of floating windows displayed by the electronic device may correspond to the number of switching controls in the screenshot.

[0482] Optionally, when a trigger operation is received for the full-screen screenshot control 2805, the electronic device can display screenshot thumbnails 2808, wherein the floating window screenshot thumbnails 2810 of the social application and 2811 of the e-book application are both selected (not shown in the figure). The electronic device can identify the content in the screenshot thumbnails 2808 and recommend corresponding services. For example, after the full-screen screenshot control is selected, the electronic device can display a content extraction control and an AI summary control. The content extraction control is based on the content identified from the floating window screenshot thumbnail 2810 of the social application, and the AI ​​summary control is based on the content identified from the floating window screenshot thumbnail 2811 of the e-book application. This embodiment of the application does not limit this.

[0483] In this way, in scenarios with multiple floating windows, after taking a screenshot, the user can choose which floating window to screenshot. For example, they can select the left floating window or the right floating window. The voice assistant application can then provide corresponding services based on the content of the screenshot, thereby improving the relevance of recommended services to the user and enhancing the user experience.

[0484] Figure 28C shows a schematic diagram of another scenario for a floating window screenshot provided in an embodiment of this application, as shown in Figure 28C:

[0485] The electronic device can display multiple floating windows, which may overlap. For example, the electronic device can display a floating window 2802 for a social application and a floating window 2807 for an e-book application, where the floating window 2802 of the social application partially covers the floating window 2807 of the e-book application. When a screenshot operation is received, the electronic device can display the interface shown in Figure 28Ca.

[0486] In the interface shown in Figure 28Ca, the electronic device can display screenshot thumbnails 2808, full-screen screenshot control 2805, left floating window screenshot control 2812, and right floating window screenshot control 2809, etc.; the screenshot thumbnails 2808 may include floating window screenshot thumbnails 2810 for social applications and floating window screenshot thumbnails 2811 for e-book applications.

[0487] Understandably, if the floating window 2802 of the social application partially overlaps the floating window 2807 of the e-book application, then the floating window 2802 of the social application can be in an operational state, while the floating window 2807 of the e-book application can be in an inactive state. In the screenshot thumbnail 2808, the area other than the floating window screenshot thumbnail 2810 can be in a masked state, the left floating window screenshot control 2812 can be in a selected state, and the full-screen screenshot control 2805 and the right floating window screenshot control 2809 can be in a deselected state, thus prompting the user that the current screenshot is a screenshot of the floating window of the social application.

[0488] Optionally, in the interface shown in Figure 28Ca, when a trigger operation is received for the left floating window screenshot control 2812, the electronic device can display the interface shown in Figure 28Cb.

[0489] In the interface shown in Figure 28Cb, the electronic device can display screenshot thumbnails 2808, full-screen screenshot control 2805, left floating window screenshot control 2812, and right floating window screenshot control 2809, etc.; the screenshot thumbnails 2808 may include floating window screenshot thumbnails 2810 for social applications and floating window screenshot thumbnails 2811 for e-book applications.

[0490] In the screenshot thumbnail 2808, the area other than the floating window screenshot thumbnail 2811 can be in a masked state, the right floating window screenshot control 2809 can be in a selected state, and the full-screen screenshot control 2805 and the left floating window screenshot control 2812 can be in an unselected state, thereby prompting the user that the current screenshot is a screenshot of the floating window of the e-book application.

[0491] It is understandable that when floating windows are obscured, during screenshotting, the electronic device can display a screenshot of the current interface and simultaneously take a screenshot of the obscured lower floating window in the background. When the upper floating window is selected, the electronic device can display a thumbnail of the selected upper floating window in the screenshot thumbnail of the current interface. When the lower floating window is selected, the electronic device can paste a thumbnail of the lower floating window on top of the screenshot thumbnail of the current interface and display the selected lower floating window thumbnail. This application embodiment does not limit the specific implementation of the above scenarios.

[0492] It should be noted that the intelligent recommendation function of the voice assistant application differs depending on the screenshot content selected by the user. For example, in the interface shown in Figure 28C(a), the electronic device can recognize the content in the floating window screenshot of a social application and provide a content extraction control 2102. In the interface shown in Figure 28C(b), the electronic device can recognize the content in the floating window screenshot of an e-book and provide an AI summarization control 2002.

[0493] In this way, when multiple floating windows overlap in a screenshot, the electronic device can provide the user with a screenshot of the floating window of the upper-level application that is not covered, as well as the functional controls corresponding to the screenshot content; the electronic device can also provide the user with a screenshot of the floating window of the lower-level application that is covered, as well as the functional controls corresponding to the screenshot content; thereby improving the relevance of the recommendation service to the user and enhancing the user experience.

[0494] Figure 28D shows a schematic diagram of another scenario for a floating window screenshot provided in an embodiment of this application, as shown in Figure 28D:

[0495] Electronic devices can display full-screen windows and floating windows, which may partially overlap. For example, in the interface shown in Figure 28Da, the electronic device can display a full-screen window 2801 of an e-book application and a floating window 2802 of a social application; however, only part of the floating window 2802 of the social application is displayed on the screen, while the other part is hidden off-screen.

[0496] In the interface shown in Figure 28D(a), when a screenshot operation is received, the electronic device can display the interface shown in Figure 28D(b). The interface shown in Figure 28D(b) may include a screenshot thumbnail 2813, a full-screen screenshot control 2805, and a floating window screenshot control 2806. The screenshot thumbnail 2813 includes full-screen screenshot thumbnails for e-book applications and floating window screenshot thumbnails for some social applications; the screenshot thumbnail 2813 corresponds to the interface shown in Figure 28D(a). At this time, the full-screen screenshot control 2805 is selected, and the floating window screenshot control 2806 is unselected.

[0497] In the interface shown in Figure 28Db, when a trigger operation is received for the floating window screenshot control 2806, the electronic device can display the interface shown in Figure 28Dc.

[0498] The interface shown in Figure 28D (c) includes screenshot thumbnails 2814, full-screen screenshot controls 2805, and floating window screenshot controls 2806. Among them, screenshot thumbnails 2814 include full-screen screenshot thumbnails for e-book applications and floating window screenshot thumbnails 2815 for complete social applications.

[0499] The full-screen screenshot control 2805 is unselected, while the floating window screenshot control 2806 is selected. Correspondingly, the floating window screenshot thumbnail 2815 of the social application is selected, and the area in the screenshot thumbnail 2814 other than the floating window screenshot thumbnail 2815 can display a mask to indicate that full-screen screenshot is unavailable.

[0500] Optionally, the voice assistant application can provide corresponding services based on the content of the full-screen screenshot or the floating window screenshot. For example, after recognizing the screenshot thumbnail 2813, the electronic device can recommend an AI summary service; as shown in the interface of Figure 28D (b), the AI ​​summary control 2002 is displayed. As another example, after recognizing the floating window screenshot thumbnail 2815 in the screenshot thumbnail 2814, the electronic device can recommend a content extraction service; as shown in the interface of Figure 28D (c), the content extraction control 2102 is displayed.

[0501] In this way, when the floating window extends beyond the screen, the electronic device can display the complete floating window in the screenshot thumbnail based on the floating window screenshot control, thereby recommending accurate services to the user based on the content of the floating window, enriching the use cases of recommended services, and improving the user experience.

[0502] Regarding the embodiment shown in Figure 28D, Figure 28E illustrates the position of the floating window in the screenshot thumbnail when the floating window extends beyond the screen, according to an embodiment of this application. As shown in Figure 28E:

[0503] In some embodiments, the floating window may extend beyond the screen and contact one edge of the screen. In other embodiments, the floating window may extend beyond the screen and contact both edges of the screen.

[0504] For example, a scenario where the floating window is in contact with one edge of the screen can be represented by interfaces from a in Figure 28E to d1 in Figure 28E.

[0505] Specifically, in the first scenario, the floating window can extend vertically beyond the bottom edge of the screen. After taking a screenshot, the electronic device can display a screenshot thumbnail as shown in Figure 28E(a); a portion of the floating window thumbnail is displayed in the screenshot thumbnail. Upon receiving a trigger operation for the floating window screenshot control, the electronic device can display a screenshot thumbnail as shown in Figure 28E(a1); the screenshot thumbnail displays the entire floating window thumbnail, and the bottom edge of the floating window thumbnail coincides with or is close to the bottom edge of the screenshot thumbnail.

[0506] In the second scenario, the floating window can extend horizontally beyond the left edge of the screen. After taking a screenshot, the electronic device can display a screenshot thumbnail as shown in Figure 28E(b); a portion of the floating window thumbnail is displayed in the screenshot thumbnail. Upon receiving a trigger operation for the floating window screenshot control, the electronic device can display a screenshot thumbnail as shown in Figure 28E(b1); the screenshot thumbnail displays the entire floating window thumbnail, and the left edge of the floating window thumbnail coincides with or is close to the left edge of the screenshot thumbnail.

[0507] In the third scenario, the floating window can extend vertically beyond the screen's edge. After taking a screenshot, the electronic device can display a screenshot thumbnail as shown in c of Figure 28E; a portion of the floating window thumbnail is displayed within the screenshot thumbnail. Upon receiving a trigger operation for the floating window screenshot control, the electronic device can display a screenshot thumbnail as shown in c1 of Figure 28E; the screenshot thumbnail displays the entire floating window thumbnail, and the upper edge of the floating window thumbnail coincides with or is close to the upper edge of the screenshot thumbnail.

[0508] In the fourth scenario, the floating window can extend horizontally beyond the right edge of the screen. After taking a screenshot, the electronic device can display a screenshot thumbnail as shown in d of Figure 28E; a portion of the floating window thumbnail is displayed in the screenshot thumbnail. Upon receiving a trigger operation for the floating window screenshot control, the electronic device can display a screenshot thumbnail as shown in d1 of Figure 28E; the screenshot thumbnail displays the entire floating window thumbnail, and the right edge of the floating window thumbnail coincides with or is close to the right edge of the screenshot thumbnail.

[0509] For example, a scenario where the floating window is in contact with the two boundaries of the screen can be represented by the interface shown as e in Figure 28E to the interface shown as h1 in Figure 28E.

[0510] In the fifth scenario, the floating window can extend beyond the left edge of the screen horizontally and beyond the bottom edge of the screen vertically. After taking a screenshot, the electronic device can display a screenshot thumbnail as shown in e of Figure 28E; a portion of the floating window thumbnail is displayed in the screenshot thumbnail. When a trigger operation is received for the floating window screenshot control, the electronic device can display a screenshot thumbnail as shown in e1 of Figure 28E; the screenshot thumbnail displays all the floating window thumbnails, and the left edge of the floating window thumbnail coincides with or is close to the left edge of the screenshot thumbnail, and the bottom edge of the floating window thumbnail coincides with or is close to the bottom edge of the screenshot thumbnail.

[0511] In the sixth scenario, the floating window can extend beyond the right edge of the screen horizontally and beyond the bottom edge of the screen vertically. After taking a screenshot, the electronic device can display a screenshot thumbnail as shown in f of Figure 28E; a portion of the floating window thumbnail is displayed in the screenshot thumbnail. Upon receiving a trigger operation for the floating window screenshot control, the electronic device can display a screenshot thumbnail as shown in f1 of Figure 28E; the screenshot thumbnail displays all the floating window thumbnails, and the right edge of the floating window thumbnail coincides with or is close to the right edge of the screenshot thumbnail, and the bottom edge of the floating window thumbnail coincides with or is close to the bottom edge of the screenshot thumbnail.

[0512] In the seventh scenario, the floating window can extend beyond the left edge of the screen horizontally and beyond the top edge of the screen vertically. After taking a screenshot, the electronic device can display a screenshot thumbnail as shown in g in Figure 28E; a portion of the floating window thumbnail is displayed in the screenshot thumbnail. Upon receiving a trigger operation for the floating window screenshot control, the electronic device can display a screenshot thumbnail as shown in g1 in Figure 28E; the screenshot thumbnail displays all the floating window thumbnails, and the left edge of the floating window thumbnail coincides with or is close to the left edge of the screenshot thumbnail, and the top edge of the floating window thumbnail coincides with or is close to the top edge of the screenshot thumbnail.

[0513] In the eighth scenario, the floating window can extend beyond the right edge of the screen horizontally and beyond the top edge of the screen vertically. After taking a screenshot, the electronic device can display a screenshot thumbnail as shown in h in Figure 28E; a portion of the floating window thumbnail is displayed in the screenshot thumbnail. When a trigger operation is received for the floating window screenshot control, the electronic device can display a screenshot thumbnail as shown in h1 in Figure 28E; the screenshot thumbnail displays all the floating window thumbnails, and the right edge of the floating window thumbnail coincides with or is close to the right edge of the screenshot thumbnail, and the top edge of the floating window thumbnail coincides with or is close to the top edge of the screenshot thumbnail.

[0514] In the eight scenarios described above, when an electronic device receives a trigger operation on the floating window screenshot control, it can control the partial floating window screenshot thumbnail in the full-screen screenshot thumbnail to gradually transform into the complete floating window screenshot thumbnail. Taking the interfaces shown in Figures 28Ea and 28Ea1 as examples, when a trigger operation is received on the floating window screenshot control, the partial floating window screenshot can gradually move upwards until the complete floating window screenshot thumbnail is displayed. This improves the smoothness of the interface transition.

[0515] Understandably, when a floating window extends beyond the screen and is obscured by the screen, the electronic device can display a thumbnail of the current screen after taking a screenshot. When a floating window is selected, the electronic device can take a screenshot of the floating window in the background and place the floating window screenshot thumbnail on top of the current screen screenshot thumbnail; then, the electronic device can display a dynamic effect of the floating window screenshot thumbnail moving in the corresponding direction until the floating window screenshot thumbnail is no longer obscured.

[0516] In this way, when the floating window extends beyond the screen, the electronic device can display the complete floating window thumbnail in the screenshot thumbnail based on the floating window screenshot control, thereby recommending accurate services to the user based on the content of the floating window; at the same time, the position of the complete floating window thumbnail corresponds to the obscuring position, improving the smoothness and consistency of the transition effect.

[0517] In some embodiments, the electronic device can provide a "Door to Anywhere" function after taking a screenshot. The sidebar of this "Door to Anywhere" function may include multiple functional controls. The order of these controls in the sidebar can be adjusted according to user preferences, and the recommended service controls in the screenshot scenario can be linked with the functional controls in the sidebar. This scenario is illustrated below with reference to Figure 29:

[0518] In the e-book application interface, when a screenshot request is received, the electronic device can display the interface shown in Figure 29a. This interface may include a screenshot thumbnail 2901, an AI summary control 2002, a voice assistant control, a sharing control, a scrolling screenshot control, and a "door to anywhere" control 2302, etc. Among them, the AI ​​summary control 2002 makes recommendations by recognizing the content in the screenshot thumbnail 2901.

[0519] Upon receiving a trigger operation for the arbitrary door control 2302, the electronic device can enter the interface shown in Figure 29b. The interface shown in Figure 29b may include a screenshot of the e-book application interface and a side toolbar; the side toolbar may include multiple function controls, and the order of these function controls from top to bottom in the side toolbar may be, for example, voice assistant control 2305, favorites space control 2306, print control, send to friend control, and email control, etc.

[0520] In this embodiment, the electronic device can make intelligent recommendations to the user based on the user's use of the function controls in the side toolbar after taking a screenshot.

[0521] In the interface shown in Figure 29b, the electronic device receives a trigger operation for the Favorites space control 2306. The electronic device can save a screenshot of the e-book application to the Favorites space, or enter the Favorites space interface (see the interface shown in Figure 23Ac or Figure 23Ad). The electronic device can count the number of times and the duration of user use of the functional controls in the side toolbar; for example, after receiving a trigger operation for the Favorites space control 2306, the electronic device increments the count of Favorites space control 2306 usage. When the user uses the Favorites space control 2306 multiple times, and the Favorites space control 2306 is the control with the highest usage frequency and / or the longest usage time among multiple functional controls, the electronic device can intelligently recommend the Favorites space control 2306. The electronic device can intelligently recommend the Favorites space control 2306 after taking a screenshot, and the electronic device can also prioritize recommending the Favorites space control 2306 in the side toolbar of the Any Door function.

[0522] For example, when a screenshot request is subsequently received, the electronic device can display a screenshot of a social application, as shown in Figure 29c. This interface may include a screenshot thumbnail 2902, a content extraction control 2102, a favorites control 2903, a voice assistant control, a sharing control, a scrolling screenshot control, and an "Anywhere Door" control 2302, etc. The content extraction control 2102 makes recommendations based on the content identified in the screenshot thumbnail 2902; the favorites control 2903 makes recommendations based on the usage of the "Anywhere Door" function's controls in the screenshot scenario.

[0523] It should be noted that, in the embodiments of this application, the electronic device can statistically analyze the usage of the functional controls in the Any Door function through various methods.

[0524] For example, an electronic device can open a "door to anywhere" function based on a screenshot, and the device can track the number of times a user uses the function controls in the sidebar. Subsequently, the most frequently used function controls can be pinned to the top of the sidebar.

[0525] For example, electronic devices can open any door function based on the user's knuckle tapping and circling operation, and electronic devices can count the number of times the user uses the function controls in the side toolbar.

[0526] For example, electronic devices can open any door function based on long press and drag operations on text and images, and electronic devices can count the number of times users use the function controls in the side toolbar.

[0527] For example, electronic devices can open any door function based on the operation of long-pressing the screenshot thumbnail, and electronic devices can count the number of times users use the function controls in the side toolbar.

[0528] For example, for elements that cannot be dragged, the electronic device can take a screenshot and enter the screenshot editing interface; the electronic device can open any door function based on the operation of long press and drag screenshot; the electronic device can count the number of times the user uses the function controls in the side toolbar.

[0529] For example, electronic devices can activate the smart screen recognition function by pressing with two fingers, which can identify and extract text and images on the interface; electronic devices can open the "Anywhere Door" function by long-pressing and dragging text and images; and electronic devices can count the number of times users use the function controls in the side toolbar.

[0530] In this embodiment, the electronic device may use one or more of the above methods to statistically analyze the usage of the function controls in the "Anywhere Door" feature. This embodiment does not impose any limitations on this. The electronic device may also use other methods to access the "Anywhere Door" feature, which will not be listed here. It should be noted that in this embodiment, the "Anywhere Door" feature may also support user-defined settings for the arrangement order of function controls in the sidebar. For example, the electronic device can configure the "Anywhere Door" feature in the AI ​​voice assistant settings of the application. The "Anywhere Door" feature provides a customization service, allowing users to add, delete, and adjust the position of function controls in the sidebar. When the user does not customize settings, the electronic device may recommend function controls based on the various methods for statistically analyzing usage frequency. When the user customizes the function controls displayed at the top of the sidebar, the electronic device may provide the user-defined function controls when displaying screenshot thumbnails. This embodiment does not impose any limitations on this.

[0531] It is understandable that when the frequently used function controls of the "Anywhere Door" feature change during a screenshot scenario, the electronic device also updates the service controls recommended based on the screenshot content. This application's embodiments will not elaborate further on this.

[0532] For example, in the interface shown in Figure 29c, when a trigger operation is received for the arbitrary door control 2302, the electronic device can enter the interface shown in Figure 29d. The interface shown in Figure 29d may include a screenshot of the social application interface and a side toolbar; the side toolbar may include multiple functional controls, and the order of these functional controls from top to bottom in the side toolbar may be, for example, a favorites control 2306, a voice assistant control 2305, a print control, a send to friends control, and an email control, etc.

[0533] Understandably, electronic devices can also sort multiple function controls in the sidebar according to the user's usage habits. For example, if the Favorites control 2903 is used more frequently than the Voice Assistant control 2305, the electronic device will prioritize recommending the Favorites control 2903.

[0534] It should be noted that after taking a screenshot, the electronic device can display a screenshot thumbnail, recommended service controls based on the screenshot content, and recommended function controls based on the usage of the Anywhere Door function. It should be understood that the function controls accessing the Anywhere Door function from a screenshot can change according to the screenshot content; after launching the Anywhere Door function through a screenshot operation, different screenshot content will result in different function controls provided by the Anywhere Door function; furthermore, different screenshot content will lead to different recommended function controls based on the usage of the Anywhere Door function.

[0535] For example, in scenarios where the screenshot content includes text, the AnyDoor feature can provide text-related functional controls, such as text extraction and text translation; in scenarios where the screenshot content includes images, the AnyDoor feature can provide image search controls for multiple applications; in addition, the AnyDoor feature can also provide general functional controls applicable to various scenarios, such as sharing controls and printing controls.

[0536] When the screenshot includes text, the recommended functional controls based on the usage of the "Anywhere Door" feature are: the most frequently used general functional controls and the most frequently used specific functional controls corresponding to text scenarios. When the screenshot includes an image, the recommended functional controls based on the usage of the "Anywhere Door" feature are: the most frequently used general functional controls and the most frequently used specific functional controls corresponding to image scenarios. When the screenshot includes both text and an image, the recommended functional controls based on the usage of the "Anywhere Door" feature are: the most frequently used general functional controls, the most frequently used specific functional controls corresponding to text scenarios, and the most frequently used specific functional controls corresponding to image scenarios.

[0537] This application embodiment can also set other scenarios and set specific functional controls according to other scenarios, and this application embodiment does not limit this. In this way, the voice assistant application in the screenshot scenario can not only provide users with service controls that recognize the screenshot content, but also recommend service controls according to user habits, so that the recommended controls are more in line with the user's usage habits and improve the user experience.

[0538] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in the embodiments of this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0539] Figure 30 shows a schematic diagram of the structure of electronic device 100. Electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a subscriber identification module (SIM) card interface 195, and an embedded secure element (eSE) 196, etc.

[0540] The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0541] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0542] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0543] Electronic device 100 implements display functions through GPU, display screen 194, and application processor.

[0544] The display screen 194 is used to display images, videos, etc. In this embodiment, the display screen 194 can be used to display the interface shown in Figures 1-28C.

[0545] Touch sensor 180K, also known as a "touch device," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0546] The screenshot-based service recommendation method of this application has been described above. The apparatus for performing the above method provided in this application is described below. Those skilled in the art will understand that the methods and apparatus can be combined and referenced together, and the related apparatus provided in this application can perform the steps in the screenshot-based service recommendation method described above.

[0547] As shown in Figure 31, the screenshot-based service recommendation device 3100 can be used in communication equipment, circuits, hardware components, or chips. The screenshot-based service recommendation device includes a display unit 3101 and a processing unit 3102. The display unit 3101 supports the display steps performed by the screenshot-based service recommendation device 3100; the processing unit 3102 supports the information processing steps performed by the screenshot-based service recommendation device 3100.

[0548] In a possible implementation, the screenshot-based service recommendation device 3100 may also include a communication unit 3103. Specifically, the communication unit supports the screenshot-based service recommendation device 3100 in performing data transmission and data reception steps. The communication unit 3103 may be an input or output interface, pins, or circuitry, etc.

[0549] In a possible embodiment, the screenshot-based service recommendation device may further include a storage unit 3104. The processing unit 3102 and the storage unit 3104 are connected via a line. The storage unit 3104 may include one or more memories, which may be devices in one or more devices or circuits used for storing programs or data. The storage unit 3104 may exist independently and be connected to the processing unit 3102 of the screenshot-based service recommendation device via a communication line. Alternatively, the storage unit 3104 may be integrated with the processing unit 3102.

[0550] Storage unit 3104 may store computer-executable instructions for the methods in the terminal device, so that processing unit 3102 executes the methods in the above embodiments. Storage unit 3104 may be a register, cache, or RAM, etc., and storage unit 3104 may be integrated with processing unit 3102. Storage unit 3104 may be a read-only memory (ROM) or other types of static storage devices capable of storing static information and instructions, and storage unit 3104 may be independent of processing unit 3102.

[0551] The screenshot-based service recommendation method provided in this application can be applied to electronic devices with communication functions. Electronic devices include terminal devices, and the specific device form of the terminal device can be referred to the above-mentioned descriptions, which will not be repeated here.

[0552] This application provides a terminal device, which includes a processor and a memory; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory, causing the terminal device to perform the above-described method.

[0553] This application provides a chip. The chip includes a processor, which is used to call a computer program in memory to execute the technical solutions in the above embodiments. Its implementation principle and technical effects are similar to those in the related embodiments described above, and will not be repeated here.

[0554] This application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, it implements the methods described above. The methods described in the above embodiments can be implemented wholly or partially by software, hardware, firmware, or any combination thereof. If implemented in software, the functionality can be stored as one or more instructions or code on or transmitted over the computer-readable medium. The computer-readable medium can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium accessible by a computer.

[0555] In one possible implementation, a computer-readable medium may include RAM, ROM, compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage or other magnetic storage devices, or any other medium targeted to carry or to store the required program code in the form of instructions or data structures, and accessible by a computer. Furthermore, any connection is appropriately referred to as a computer-readable medium. For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. As used herein, disks and optical discs include optical discs, laser discs, optical discs, Digital Versatile Discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while optical discs optically reproduce data using lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0556] This application provides a computer program product, which includes a computer program that, when run, causes a computer to perform the above-described method.

[0557] This application describes embodiments with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, special-purpose computer, embedded processor, or other programmable device to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing device, create means for implementing the functions specified in one or more flowchart illustrations and / or one or more block diagrams.

[0558] The above detailed embodiments further illustrate the purpose, technical solution, and beneficial effects of the embodiments of this application. It should be understood that the above are merely specific embodiments of the embodiments of this application and are not intended to limit the protection scope of the embodiments of this application. Any modifications, equivalent substitutions, improvements, etc., made on the basis of the technical solutions of the embodiments of this application should be included within the protection scope of the embodiments of this application.

Claims

1. A screenshot-based service recommendation method, characterized in that, Applied to electronic devices, the method includes: The first interface is displayed; the first interface includes a preset time and / or a preset location; In response to a screenshot operation on the first interface, a thumbnail of the first screenshot and a first control are displayed on the first interface; the first control is used to provide a reminder service, and the first control corresponds to the thumbnail of the first screenshot; The reminder service is activated based on the triggering operation on the first control; When the time of the electronic device reaches or approaches the preset time, and / or the location of the electronic device is at the preset location, a prompt message is displayed; wherein, the prompt message is used to prompt the user to perform an operation related to the first interface; the time of the electronic device reaching or approaching the preset time includes: the time of the electronic device is equal to the preset time, or the time interval between the time of the electronic device and the preset time is less than a time threshold; Displays a second interface of the first application, the second interface including first information for jumping to the second application; the first application is different from the second application. In response to a screenshot operation on the second interface, a thumbnail of the second screenshot and a second control are displayed on the second interface; the second control is used to provide application jump service, and the second control corresponds to the first information; Based on the trigger operation on the second control, the third interface of the second application is displayed; the third interface corresponds to the first information.

2. The method of claim 1, wherein, Also includes: A fourth interface is displayed, which includes the second information; In response to a screenshot operation on the fourth interface, a thumbnail of the third screenshot and a third control are displayed on the fourth interface; the third control is used to provide an information extraction service, which is used to extract third information from the second information, the third information including text information in the second information or summary information of the second information; the third control corresponds to the third screenshot. Based on the trigger operation of the third control, a first card is displayed in the fourth interface. The first card includes the third information, a copy control, and a save control. The copy control is used to copy the third information, and the save control is used to save the third information.

3. The method of claim 1, wherein, The first interface is the ticketing application interface, and the preset time includes the ticket sales start time; the reminder service includes a ticket-grabbing reminder service, which is used to prompt the user to grab tickets when the time of the electronic device is close to the ticket sales start time; The first control includes a ticket-grabbing reminder control; The step of activating the reminder service based on the trigger operation on the first control includes: In response to a trigger operation on the ticket-grabbing reminder control, a second card is displayed on the first interface, the second card including the add ticket-grabbing reminder control; In response to the triggered operation of adding the ticket-grabbing reminder control, a third card is displayed on the first interface, the third card including a first prompt message; the first prompt message is used to notify the user that a ticket-grabbing reminder has been added.

4. The method of claim 3, wherein, The third card also includes controls for automatically executing ticket-grabbing operations; after the third card is displayed on the first interface, it also includes: In response to the triggering operation of the automatic ticket-grabbing control, a fourth card is displayed on the first interface. The fourth card includes a second prompt message, which is used to prompt the user that the automatic ticket-grabbing service has been added. The automatic ticket-grabbing service is used to automatically grab tickets when the time of the electronic device reaches the ticket sales opening time.

5. The method of claim 4, wherein, The ticket-grabbing reminder service corresponds to one or more associated services; the associated services are services intelligently recommended by the voice assistant application based on the first screenshot, and the associated services include one or more of the following: alarm clock setting service, hotel booking service, and train ticket booking service; the preset time in the first interface also includes the performance time, and the preset location includes the performance location; the method further includes: During the display of the second card, the third card, or the fourth card, the first interface also displays controls for setting an alarm clock, booking a hotel, and booking train tickets. In response to a trigger operation on the alarm clock control, a clock application interface is displayed; the clock application interface is used to create a new alarm clock, and the clock application interface includes an alarm clock time and a new control, wherein the alarm clock time corresponds to the ticket sales time; the new control is used to create an alarm clock that rings at the alarm clock time. Alternatively, in response to a trigger operation on the hotel booking control, an application interface for booking hotels is displayed; the hotel booking application interface includes hotel location, check-in time, and a hotel search control; wherein, the hotel location corresponds to the performance venue, and the check-in time corresponds to the performance time; the hotel search control is used to search for hotels that match the hotel location and the check-in time; Alternatively, in response to a trigger operation on the ticket booking control, an application interface for booking tickets is displayed; the ticket booking application interface includes ticket itinerary information and a ticket query control; wherein, the ticket itinerary information corresponds to the performance location and the performance time; the ticket query control is used to query tickets whose itineraries satisfy the performance location and the performance time.

6. The method according to any one of claims 3-5, characterized in that, The ticket sales start time includes the ticket sales date and the ticket sales start time; when the electronic device's time reaches or approaches the preset time, and / or the electronic device's location is at the preset location, a prompt message is displayed, including: When the time on the electronic device reaches the ticket sales date, a ticket card, a train ticket card, and a hotel card are displayed on the desktop; the ticket card is used to launch the ticketing application, the train ticket card is used to launch the train ticket booking application, and the hotel card is used to launch the hotel booking application. And / or, if the time interval between the electronic device's time and the ticket sales launch time is less than a first time threshold, a fifth card is displayed, the fifth card including a third prompt message, the ticket reservation control, and / or the hotel reservation control; the third prompt message is used to prompt the user to grab tickets at the preset time; the electronic device's time is earlier than the ticket sales launch time; And / or, if the time interval between the electronic device's time and the ticket sales launch time is less than a second time threshold, a sixth card is displayed; wherein, if the electronic device has not added an automatic ticket-grabbing service, the sixth card includes the automatic ticket-grabbing operation control to prompt the user to enable the automatic ticket-grabbing service; if the electronic device has added the automatic ticket-grabbing service, the sixth card includes a fourth prompt message, the fourth prompt message being used to prompt the user to automatically execute the ticket-grabbing operation after the second time threshold; the electronic device's time is earlier than the ticket sales launch time, and the second time threshold is less than the first time threshold.

7. The method according to claim 5 or 6, characterized in that, Also includes: During the display of the second card, the third card, or the fourth card, a voice assistant control is also displayed on the first interface; the voice assistant control is a control provided by the voice assistant application, used to interact with the user through user commands, the user commands including text input by the user or voice recording; In response to a trigger operation on the voice assistant control, a dialog box is displayed in the first interface; According to the first user instruction entered by the user in the dialog box, the process corresponding to the first user instruction is executed; wherein, the user instruction includes the first user instruction, which is used to instruct to start the ticket grabbing reminder service, start the automatic ticket grabbing service, start the alarm clock setting service, start the hotel reservation service and / or start the train ticket reservation service.

8. The method of claim 7, wherein, Also includes: The dialog box is also displayed during the display of the fifth or sixth card; According to the second user instruction entered by the user in the dialog box, the process corresponding to the second user instruction is executed; wherein, the user instruction includes the second user instruction, which is used to instruct the automatic ticket grabbing service, the hotel reservation service and / or the train ticket reservation service to be started.

9. The method of claim 8, wherein, After displaying the fifth card or the sixth card, the process further includes: In response to a first exit operation, the dialog box is canceled from display; wherein the first exit operation includes a click operation on a first blank area, a swipe operation from the edge of the screen inward, and / or a swipe-up operation; the first blank area does not include the fifth card or the sixth card, and the dialog box; In response to a second exit operation, the display of the fifth card or the sixth card is cancelled; wherein the second exit operation includes an up swipe operation on the fifth card or the sixth card, and / or no trigger operation is received within a target time.

10. The method according to any one of claims 6-9, characterized in that, After the fourth card is displayed on the first interface, the following is also included: When the time on the electronic device reaches the time when tickets go on sale, a first window is displayed; the first window includes a fifth prompt message; the fifth prompt message is used to indicate that automatic ticket grabbing is in progress; After successfully grabbing a ticket, a second window is displayed; the second window includes a sixth prompt message; the sixth prompt message is used to indicate that the ticket has been successfully grabbed and confirmation of ticket issuance is required.

11. The method according to any one of claims 3-9, characterized in that, After the third card is displayed on the first interface, the following is also included: Launch the calendar application and display the calendar application interface; the calendar application interface includes a timeline and one or more schedules under the ticket sales date, the one or more schedules including ticket-grabbing reminder schedules; the ticket-grabbing reminder schedules correspond to the ticket sales time on the timeline.

12. The method of claim 1, wherein, The first interface further includes a first scanable code; the reminder service further includes a code scanning reminder service, which is used to display the first scanable code when the time of the electronic device reaches or approaches the preset time and / or the location of the electronic device is at the preset location, and the first control includes a code scanning reminder control; the step of activating the reminder service according to the trigger operation of the first control includes: In response to a trigger operation on the QR code reminder control, a seventh card is displayed on the first interface. The seventh card includes the first scanable code, a seventh prompt message, and an add QR code reminder control. The seventh prompt message is used to prompt the user to display the first scanable code when the time of the electronic device reaches or approaches the preset time and / or the location of the electronic device is at the preset location. In response to the triggering operation of the added QR code reminder control, an eighth prompt message is displayed; the eighth prompt message is used to notify the user that a QR code reminder has been added.

13. The method of claim 12, wherein, When the time of the electronic device reaches or approaches the preset time, and / or the location of the electronic device is at the preset location, a prompt message is displayed, including: When the time of the electronic device reaches the preset time, a QR code reminder card is displayed on the desktop. The QR code reminder card is used to launch the application corresponding to the first scannable code. The QR code reminder card includes the first scannable code. And / or, when the time of the electronic device reaches or approaches the preset time, and / or the location of the electronic device is at the preset location, a third window is displayed; the third window includes the first scannable code.

14. The method according to claim 12 or 13, characterized in that, The first scannable code is associated with a second scannable code, and the third window also includes a toggle control; after the third window is displayed, the following is also included: In response to a trigger operation on the switching control, the third window switches from the first scanable code to the second scanable code.

15. The method of claim 1, wherein, The first information includes a third scannable code, the second control is a direct scan control, and the second application supports scanning functionality; the step of displaying a third interface of the second application based on a trigger operation on the second control includes: In response to a trigger operation on the QR code access control, the second application is launched and a floating window of the second application is displayed in the second interface. The floating window of the second application includes information for indicating the scanning process. After the scan is completed, the third interface is displayed in the floating window of the second application, and the third interface corresponds to the third scannable code.

16. The method of claim 1, wherein, The first information also includes address information; the second control includes a direct travel control, which includes a one-step navigation control and a one-step ride-hailing control; the second application includes a travel application, which includes a navigation application and a ride-hailing application; the navigation application corresponds to the one-step navigation control, and the ride-hailing application corresponds to the one-step ride-hailing control; the step of displaying a third interface of the second application based on a trigger operation on the second control includes: In response to a trigger operation on the travel direct control, the travel application is launched, and a floating window of the travel application is displayed in the second interface; the floating window of the travel application includes the third interface; the third interface includes a starting point location and a destination location, the starting point location being the location of the electronic device, and the destination location being the address information.

17. The method of claim 2, wherein, The second information includes text information, and the third control includes an AI summary control. The step of displaying the first card on the fourth interface based on a trigger operation on the third control includes: responding to a trigger operation on the AI ​​summary control by displaying a prompt window on the fourth interface, the prompt window indicating to the user that the text information in the corresponding page of the fourth interface is being recognized; after recognition is completed, the first card is displayed on the fourth interface, the first card including the third information and a seventh prompt, the third information being a summary of the second information; the seventh prompt indicating to the user the number of words and reading time of the corresponding page of the fourth interface; and the save control saving the third information to a note-taking application.

18. The method of claim 2, wherein, The second information includes text information, and the third control includes a content extraction control; the step of displaying the first card in the fourth interface based on a trigger operation on the third control includes: In response to a trigger operation on the content extraction control, the third information and the tenth prompt information are displayed on the fourth interface; the third information includes key information in the text information; the key information includes one or more of the following: ID number, address, phone number, social ID, and account password; the tenth prompt information is used to prompt the user that the key information has been intelligently extracted.

19. The method of any one of claims 1-18, wherein, Also includes: Display the fifth interface; In response to a screenshot operation on the fifth interface, a thumbnail of the fourth screenshot, a fourth control, and a fifth control are displayed on the fifth interface; the fourth control and the fifth control are each one of a first control, a second control, or a third control; the fourth control and the fifth control are different. Based on the trigger operation for the fourth control, start the service corresponding to the fourth control; Alternatively, based on the triggering operation for the fifth control, the service corresponding to the fifth control can be started.

20. The method of any one of claims 1-19, wherein, Also includes: Display the sixth interface; In response to a screenshot operation on the sixth interface, a thumbnail of the fifth screenshot and a sixth control are displayed on the sixth interface; In response to a trigger operation on the sixth control, the fifth screenshot and a side toolbar are displayed; the side toolbar includes one or more function icons, and the one or more function icons include a first function icon; Based on the trigger operation on the first function icon, display the application interface corresponding to the first function icon; The application interface corresponding to the first function icon includes a thumbnail of the fifth screenshot.

21. The method of any one of claims 1-20, wherein, Also includes: Display the seventh interface; In response to a screenshot operation on the seventh interface, a thumbnail of the sixth screenshot and a one-click favorite control are displayed on the seventh interface. Based on the trigger operation of the one-click favorites control, the sixth screenshot is saved to the favorites space application.

22. The method of claim 21, wherein, After saving the sixth screenshot to the collection space application, the process also includes: The eighth interface is displayed; the eighth interface and the seventh interface are on the same page, and the content of the eighth interface is different from the content of the seventh interface. In response to a screenshot operation on the eighth interface, a thumbnail of the seventh screenshot and a merge / favorite control are displayed on the eighth interface. Based on the trigger operation of the merge collection control, the seventh screenshot is saved to the collection space application, and in the collection space application, the saving location of the seventh screenshot is the same as the saving location of the sixth screenshot.

23. The method of any one of claims 1-22, wherein, Also includes: Display the ninth interface; The ninth interface corresponds to webpage link information or application path information; In response to a screenshot operation on the ninth interface, a thumbnail of the eighth screenshot and a share control are displayed on the ninth interface. Based on the trigger operation of the sharing control, the first image is shared to the target application; the first image is an image stitched together from the eighth screenshot and the fourth scannable code; the fourth scannable code corresponds to the webpage link information or application path information on the ninth interface.

24. The method of any one of claims 1-23, wherein, Also includes: Displaying the tenth screen; The tenth interface includes a first split-screen window and a second split-screen window; In response to a screenshot operation on the tenth interface, a thumbnail of the ninth screenshot, a first split-screen screenshot control, and a second split-screen screenshot control are displayed on the tenth interface; the thumbnail of the ninth screenshot includes a screenshot thumbnail of the first split-screen window and a screenshot thumbnail of the second split-screen window. When a selection operation is received for the first split-screen screenshot control, a screenshot thumbnail of the selected first split-screen window, the selected first split-screen screenshot control, and a seventh control are displayed; the seventh control is a control recommended based on the screenshot content of the first split-screen window. Alternatively, when a selection operation is received for the second split-screen screenshot control, a screenshot thumbnail of the selected second split-screen window, the selected second split-screen screenshot control, and an eighth control are displayed; the eighth control is a control recommended based on the screenshot content of the second split-screen window; the eighth control is different from the seventh control.

25. The method of any one of claims 1-24, wherein, Also includes: The eleventh interface is displayed; the eleventh interface includes a first floating window and a second floating window; In response to a screenshot operation on the eleventh interface, a thumbnail of the tenth screenshot, a first floating window screenshot control, and a second floating window screenshot control are displayed on the eleventh interface; the thumbnail of the tenth screenshot includes the screenshot thumbnail of the first floating window and the screenshot thumbnail of the second floating window. When a selection operation is received for the first floating window screenshot control, a screenshot thumbnail of the first floating window in the selected state, the first floating window screenshot control in the selected state, and a ninth control are displayed; the ninth control is a control recommended based on the screenshot content of the first floating window. Alternatively, when a selection operation is received for the second floating window screenshot control, a screenshot thumbnail of the selected second floating window, the selected second floating window screenshot control, and a tenth control are displayed; the tenth control is a control recommended based on the screenshot content of the second floating window; the tenth control is different from the ninth control.

26. The method of claim 20, wherein, After displaying the application interface corresponding to the first function icon based on the trigger operation on the first function icon, the method further includes: Displaying the twelfth screen; In response to a screenshot operation on the twelfth interface, a thumbnail of the eleventh screenshot, the sixth control, and the eleventh control are displayed on the twelfth interface; the eleventh control has the same function as the second function icon. In response to a trigger operation on the sixth control, the eleventh screenshot and the side toolbar are displayed; one or more function icons in the side toolbar include the second function icon, and the second function icon is located at the top of the side toolbar; the second function icon is the function icon most frequently used by the user in the side toolbar or the user-set pinned function icon.

27. An electronic device, comprising: include: Processor and memory; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the electronic device to perform the method as described in any one of claims 1-26.

28. A computer-readable storage medium, the computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1-26.

29. A chip system, characterized by It includes at least one processor and a communication interface, the communication interface and the at least one processor being interconnected via a line, the at least one processor being used to run a computer program or instructions to perform the method as described in any one of claims 1-26.

30. A computer program product, characterised in that, Includes a computer program that, when run, causes a computer to perform the method as described in any one of claims 1-26.

Images