Processing method and electronic equipment

Abstract

The embodiment of the invention provides a processing method and electronic equipment, and relates to the technical field of terminal equipment, and the method comprises the steps that a user can operate an interested movable control, and the electronic equipment can respond to the operation so as to control the control based on the control content of the interested control of the user. And generating a first service card with the structured first card information. As the user foreknows the function and the function of the control and the display content of the control, before the first service card related to the control is generated, the function and the function of the user on the first service card are predictable, so that the generated service card meets the requirements of the user.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of terminal devices, and in particular, to a processing method and an electronic device. Background Art

[0002] With the development of electronic devices, electronic devices can provide service cards for applications so that users can use the applications conveniently.

[0003] Currently, electronic devices provide service cards to users by providing preset service cards, and users can select service cards to be added from the preset service cards. However, the functions of the preset service cards are fixed, and before the service cards are added and used by users, their effects and functions are unpredictable.

[0004] Therefore, the service cards generated in the prior art often do not meet user needs. Summary of the invention

[0005] In order to solve the above technical problems, the present application provides a processing method and an electronic device. In the method, the electronic device can generate relevant service cards based on the movable controls that the user is interested in, so that the generated service cards meet the user's needs.

[0006] In a first aspect, an embodiment of the present application provides a processing method, which is applied to an electronic device. The method includes: in response to a first user operation received on a first control, generating a first service card based on the first control, wherein the first control is a movable control, and the first service card includes first card information related to the control content of the first control; and displaying the first service card.

[0007] The first user operation may include but is not limited to: a drag operation, a press operation, a slide operation, a pull-down operation, etc.

[0008] The control content of the first control may include information displayed on the first control and / or information related to the first control but not displayed.

[0009] For example, if the first control is a notification message, the control content may include information displayed on the first control, such as the message content of the notification message, the application to which the notification message belongs, the reminder time of the notification message, etc.

[0010] For another example, if the first control is a floating ball, the control content may include interface content of an application interface minimized to the floating ball, and the interface content is not displayed on the floating ball. The interface content here is information related to the first control but not displayed.

[0011] Taking the electronic device as a mobile phone as an example, in one example, when the mobile phone generates a first service card based on a first control, the service information can be determined based on the control content of the first control, and then the first service card can be generated based on the service information, wherein the first card information included in the first service card can be related to the service information.

[0012] In one example, when the mobile phone displays the generated first service card, the mobile phone may temporarily display the first service card in the display interface when the user operates the first control through the first user operation, for example, the first service card is displayed for a period of time and then canceled.

[0013] In one example, when the mobile phone displays the generated first service card, the mobile phone can display the first service card on the desktop interface (also described as pinning it to the desktop) so that the user can see the first service card the next time he browses the desktop interface.

[0014] In an embodiment of the present application, a user can operate a movable control of interest, and the electronic device can respond to the operation to generate a first service card with structured first card information based on the control content of the control of interest to the user. Since the user knows the role and function of the control and its display content in advance, the user can predict the function and role of the first service card related to the control before generating the first service card related to the control. In this way, the user can generate a service card related to the control by operating the control of interest, and the service card generated in this way is more likely to meet the user's card addition needs. In addition, the user can browse the card information in the service card to achieve the effect of the user browsing the control content related to the control, so compared with the control content, the card information displayed in the service card is more intuitive and concise, and its information is more readable. In addition, regardless of whether the application or system has a pre-set relevant service card, as long as the user operates a movable control, the electronic device can generate a service card related to it, thereby improving the diversity of service cards. And the process of adding a service card by the user only needs to operate the relevant control, thereby simplifying the generation and addition process of the service card and reducing the complexity.

[0015] According to the first aspect, displaying the first service card includes: refreshing the displayed first control to the first service card.

[0016] In an embodiment of the present application, the electronic device can convert a movable control operated by a user into a corresponding first service card, so that the control content of the movable control can be displayed through the first service card. The card information of the first service card is more structured than the control content of the movable control, so that the user can browse the control content of the first control by browsing the first service card, and the readability of the first card information is stronger than the readability of the control content.

[0017] According to the first aspect, or any implementation of the first aspect above, the method further includes: in response to receiving a second user operation on the first service card, displaying the first service card on the desktop interface.

[0018] This implementation method may be a detailed implementation method of displaying the first service card in the first aspect, or may be an additional implementation method after displaying the first service card in the first aspect, and is not limited here.

[0019] For example, the first service card generated by the mobile phone is temporarily displayed on the corresponding interface, then the user can continue to perform a second user operation on the temporarily displayed first service card. The operation type of the second user operation is not restricted, and it can be a pull-down operation, a sliding operation, a drag operation, etc. The mobile phone can respond to the second user operation to pin the first service card on the desktop display. In this way, the operation of pinning the service card on the desktop display is simpler, faster and smoother.

[0020] According to the first aspect, or any implementation of the first aspect above, the first card information is also related to at least one of a user portrait and a user habit.

[0021] For example, if the first control is a floating window on the video playback interface of a video application, the user portrait may be the user's age, gender, the types of videos the user likes to watch, etc. The user habit may be information about the videos that the user has recently collected or browsed in the video application. The situational information may include information about several movies that are currently popular in the video application.

[0022] In this embodiment, when the electronic device generates a first service card for the first control operated by the user, it can not only refer to the control content of the first control to generate the first card information of the first service card, but also combine the user portrait, scenario information, user habits, etc. to generate the first card information of the first service card to generate a first service card with the first card information, so that the generated service card can be related not only to the control content of the control operated by the user, but also to the user portrait, scenario, user habits, etc.

[0023] According to the first aspect, or any implementation of the first aspect above, the control type of the first control includes one of the following: a notification message, a floating control, and a transfer station control.

[0024] The notification message may be a notification message currently popped up on the mobile phone, or a notification message displayed in the notification bar interface, or a notification message displayed in the lock screen interface.

[0025] The floating control may be a floating window, a floating ball, etc., wherein the floating ball is a minimized floating window.

[0026] The transfer station control may be a control placed in the transfer station.

[0027] Any of the above types of controls are movable controls.

[0028] According to the first aspect, or any implementation of the first aspect above, the control type of the first control is the notification message, and the first user operation includes at least one of the following: a pull-down operation, a long press operation, and a sliding operation.

[0029] In an embodiment of the present application, a user can perform at least one operation such as a pull-down operation, a long press operation, a sliding operation, etc. on the notification message, so that the mobile phone can generate a service card related to the notification message operated by the user.

[0030] According to the first aspect, or any implementation of the first aspect above, displaying the first service card includes: floating and displaying the first service card above a second control, wherein the control type of the second control is the same as the control type of the first control.

[0031] Taking the first control as a notification message as an example, other types of first controls are also applicable to the method of this implementation.

[0032] For example, if the notification bar interface displays multiple notification messages, the user can long-press a notification message of interest, and the mobile phone can generate a service card related to the notification message, and can display the service card in a floating manner above other notification messages that have not received the long-press operation. In this way, when the user selects the first control of interest from multiple controls of the same type to request the generation of a service card, the mobile phone can display the generated service card in a floating manner above other controls of no interest, so as to highlight the information of interest to the user.

[0033] According to the first aspect, or any implementation manner of the first aspect above, the control type of the first control is the floating control or the transfer station control, and the first user operation includes: dragging the first control to the first position of the desktop interface, and the method also includes: in response to the first user operation, displaying a first area on the desktop interface, the first area is the area to be displayed for the first service card, and the first area includes the first position; displaying the first service card includes: displaying the first service card in the first area, and canceling the display of the first area.

[0034] For example, the first area may be displayed as a dotted frame or an area of ​​a specific color, which is not limited here.

[0035] In an embodiment of the present application, after the user drags a floating control or a transfer station control to a certain position on the desktop interface, the electronic device may display an area on the desktop interface that can accommodate the corresponding service card and includes the position. Then, the electronic device may display the generated first service card related to the floating control or the transfer station control in the first area, and cancel the display of the first area, thereby displaying the generated service card at the position of the desktop interface that the user is interested in.

[0036] According to the first aspect, or any implementation of the first aspect above, after displaying the first service card, the method also includes: in response to receiving a third user operation, switching the display interface to the first interface; wherein the first interface is an application interface that receives the first user operation on the first control.

[0037] Similar to the first user's operation, this application does not limit the specific operation of the third user.

[0038] For example, the third user operation may be an operation on the displayed first service card (such as long pressing a control in the card), or touch input on the mobile phone screen, or input on a physical button, or user voice or text input and other user operations requesting tracing of the first service card.

[0039] The electronic device can respond to the third user operation to switch the display interface of the electronic device to the application interface where the user originally performed the first user operation on the first control to generate the first service card, so that the electronic device can locate the display interface where the first service card was originally generated and the corresponding position in the interface, so that the first service card can be traced.

[0040] According to the first aspect, or any implementation of the first aspect above, the method also includes: in response to a received fourth user operation, generating respective second service cards based on multiple third controls, wherein the fourth user operation includes indicating operations performed on the multiple third controls of the same control type, at least one of the third controls is a movable control, and each of the second service cards includes second card information related to the control content of the corresponding third control; and displaying multiple second service cards.

[0041] In this embodiment, the user can select multiple third controls, wherein at least one third control is a movable control, and the mobile phone can batch generate respective second service cards for the multiple third controls selected by the user, for example Figure 5e In the example, multiple notification messages can be selected to batch generate service cards for the selected notification messages; or, the user can also select a third control from multiple controls of the same type to generate corresponding service cards for the third control and its related third controls. Figure 6d In the interface of (2), the user drags control 406, and the mobile phone can convert both control 406 and control 407 into corresponding service cards. In this way, the user can perform a single operation on multiple controls of the same type, and can realize batch generation of service cards related to multiple controls of the same type.

[0042] The other implementation methods of each second service card are the same as the implementation principles of the above-mentioned implementation methods of the single first service card, and will not be repeated here.

[0043] According to the first aspect, or any implementation of the first aspect above, the method also includes: in response to a fifth user operation received on the display interface, generating a third service card based on the context of the display interface, wherein the third service card includes third card information related to the context; and displaying the third service card.

[0044] In an embodiment of the present application, the mobile phone can generate a corresponding service card based on the context of the display interface operated by the user. The card information of the service card is related to the context. The third service card can be displayed temporarily or pinned to the desktop without restriction.

[0045] According to the first aspect, or any implementation of the first aspect above, the context of the display interface includes at least one of the following: a conversation message, a text segment selected by the fifth user operation indication, an application interface, an image, a video, etc.

[0046] The image may be a screenshot, a picture in a session, or a picture in a gallery, etc., without limitation.

[0047] In the embodiment of the present application, the user can perform a fifth user operation on any object such as a conversation message, a text fragment, an application interface, an image, a video, etc., so that the mobile phone can generate a third service card related to the object. The operation type of the fifth user operation is not limited, and can be touch input or voice or text input, etc.

[0048] According to the first aspect, or any implementation of the first aspect above, the third card information is also related to at least one of a user portrait and a user habit.

[0049] In this embodiment, when the electronic device generates a third service card based on the context of the display interface operated by the user, it can not only refer to the context of the display interface, but also combine the user portrait, situational information, user habits, etc. to generate the third card information of the third service card to generate a third service card with the third card information, so that the generated service card can be related not only to the context of the display interface, but also to the user portrait, situation, user habits, etc.

[0050] According to the first aspect, or any implementation of the first aspect above, the method also includes: in response to a received first user input, generating a fourth service card, wherein the first user input includes information indicating a search for the same object in multiple first applications, and the fourth service card includes fourth card information related to multiple first search results, wherein the multiple first search results are respective search results of the multiple first applications for the same object; and displaying the fourth service card.

[0051] The first user input may be voice or text input.

[0052] In an embodiment of the present application, the mobile phone can generate a fourth service card based on user input of searching for the same object in multiple applications. The fourth service card is a comparison card. The comparison card may include information related to the search results of the multiple applications for the same object, such as comparison information of the search results, etc., so that the comparison card can be generated according to user needs.

[0053] According to the first aspect, or any implementation of the first aspect above, after displaying the fourth service card, the method also includes: in response to a received second user input, refreshing the fourth card information displayed by the fourth service card; wherein the second user input includes information indicating a search for the same object in the multiple first applications and the second application, and the refreshed fourth card information also includes information related to the second search result, wherein the second search result is a search result of the second application for the same object.

[0054] The first application and the second application are different.

[0055] In an embodiment of the present application, after the mobile phone displays the generated comparison card, when the user wishes to continue searching for the same object in another application (for example, a second application), the mobile phone can continue to call the second application added by the user to search for the object, so as to update the fourth card information in the generated fourth service card with reference to information related to the search results.

[0056] According to the first aspect, or any implementation of the first aspect above, the method also includes: generating a fifth service card in response to a received third user input, wherein the third user input includes information indicating a first setting for a third application or system, and the fifth service card includes fifth card information related to the first setting; and displaying the fifth service card.

[0057] The third application may be the same as or different from the first application, and the third application may be the same as or different from the second application, without limitation.

[0058] The information indicating the first setting for the third application or system may be information of a custom rule for the application or system, such as a personalized alarm.

[0059] In an embodiment of the present application, a user can, based on the personalized setting requirements for an application or a mobile phone system, use customized rules and, through third-party input (such as voice or text), enable the mobile phone to generate a personalized service card that meets the customized rules based on the third-user input.

[0060] According to the first aspect, or any implementation of the first aspect above, after displaying the fifth service card, the method further includes: configuring the first setting to the third application or the system.

[0061] In an embodiment of the present application, the mobile phone can configure personalized settings about the application or the system related to the generated personalized service card into the corresponding application or mobile phone system to realize personalized settings for settings that the application or mobile phone does not have.

[0062] In a second aspect, an embodiment of the present application provides a processing device. The device includes: a first generating module, configured to generate a first service card based on a first control in response to a first user operation received on the first control, wherein the first control is a movable control, and the first service card includes first card information related to the control content of the first control; and a first display module, configured to display the first service card.

[0063] According to the second aspect, the first display module is specifically configured to refresh the displayed first control to the first service card.

[0064] According to the second aspect, or any implementation of the second aspect above, the device also includes: a second display module, used to display the first service card on the desktop interface in response to a second user operation received on the first service card.

[0065] According to the second aspect, or any implementation of the second aspect above, the first card information is also related to at least one of a user portrait and a user habit.

[0066] According to the second aspect, or any implementation of the second aspect above, the control type of the first control includes one of the following: a notification message, a floating control, and a transfer station control.

[0067] According to the second aspect, or any implementation of the second aspect above, the control type of the first control is the notification message, and the first user operation includes at least one of the following: a pull-down operation, a long press operation, and a sliding operation.

[0068] According to the second aspect, or any implementation of the second aspect above, the first display module is further used to display the first service card in suspension above a second control, wherein the control type of the second control is the same as the control type of the first control.

[0069] According to the second aspect, or any implementation method of the second aspect above, the control type of the first control is the floating control or the transfer station control, and the first user operation includes: dragging the first control to the first position of the desktop interface, and the device also includes: a third display module, used to display a first area on the desktop interface in response to the first user operation, the first area is the area to be displayed for the first service card, and the first area includes the first position; the first display module is specifically used to display the first service card in the first area and cancel the display of the first area.

[0070] According to the second aspect, or any implementation of the second aspect above, the device also includes: a switching module, used to switch the display interface to the first interface in response to a received third user operation; wherein the first interface is an application interface that receives the first user operation on the first control.

[0071] According to the second aspect, or any implementation of the second aspect above, the device also includes: a second generation module, used to generate respective second service cards based on multiple third controls in response to a received fourth user operation, wherein the fourth user operation includes an instruction to perform operations on the multiple third controls of the same control type, at least one of the third controls is a movable control, and each of the second service cards includes second card information related to the control content of the corresponding third control; a fourth display module, used to display multiple second service cards.

[0072] According to the second aspect, or any implementation of the second aspect above, the device also includes: a third generation module, used to generate a third service card based on the context of the display interface in response to a fifth user operation received on the display interface, wherein the third service card includes third card information related to the context; a fifth display module, used to display the third service card.

[0073] According to the second aspect, or any implementation of the second aspect above, the context of the display interface includes at least one of the following: a conversation message, a text segment selected by the fifth user operation indication, an application interface, an image, a video, etc.

[0074] According to the second aspect, or any implementation of the second aspect above, the third card information is also related to at least one of a user portrait and a user habit.

[0075] According to the second aspect, or any implementation of the second aspect above, the device also includes: a fourth generation module, used to generate a fourth service card in response to a received first user input, wherein the first user input includes information indicating a search for the same object in multiple first applications, and the fourth service card includes fourth card information related to multiple first search results, wherein the multiple first search results are respective search results of the multiple first applications for the same object; a sixth display module, used to display the fourth service card.

[0076] According to the second aspect, or any implementation of the second aspect above, the device also includes: a refresh module, used to refresh the fourth card information displayed by the fourth service card in response to a received second user input; wherein the second user input includes information indicating a search for the same object in the multiple first applications and the second application, and the refreshed fourth card information also includes information related to the second search result, wherein the second search result is a search result of the second application for the same object.

[0077] According to the second aspect, or any implementation of the second aspect above, the device also includes: a fifth generation module, used to generate a fifth service card in response to a received third user input, wherein the third user input includes information indicating a first setting for a third application or system, and the fifth service card includes fifth card information related to the first setting; a seventh display module, used to display the fifth service card.

[0078] According to the second aspect, or any implementation of the second aspect, the device further includes: a configuration module, configured to configure the first setting to the third application or the system.

[0079] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, which will not be repeated here.

[0080] In a third aspect, an embodiment of the present application provides an electronic device. The electronic device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the method in the first aspect and any one of the implementations of the first aspect.

[0081] The technical effects corresponding to the third aspect can be found in the technical effects corresponding to the above-mentioned first aspect and any implementation method of the first aspect, and will not be repeated here.

[0082] In a fourth aspect, an embodiment of the present application provides a computer-readable medium for storing a computer program, which, when executed on an electronic device, enables the electronic device to execute the method in the first aspect and any one of the implementations of the first aspect.

[0083] The technical effects corresponding to the fourth aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation method of the first aspect, and will not be repeated here.

[0084] In a fifth aspect, an embodiment of the present application provides a computer program product comprising instructions. When the computer program product is run on a computer, the computer is caused to execute the method in the first aspect and any one of the implementations of the first aspect.

[0085] The technical effects corresponding to the fifth aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation method of the first aspect, and will not be repeated here.

[0086] In a sixth aspect, an embodiment of the present application provides a chip. The chip includes one or more interface circuits and one or more processors; the interface circuit is used to receive a signal from a memory of a first electronic device and send the signal to the processor, the signal including a computer instruction stored in the memory; when the processor executes the computer instruction, the first electronic device executes the method in the first aspect and any one of the implementations of the first aspect.

[0087] The technical effects corresponding to the sixth aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation method of the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0088] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0089] Figure 1 One of the structural schematic diagrams of an electronic device is shown as an example;

[0090] Figure 2 A schematic diagram of the software structure of an electronic device is shown as an example;

[0091] Figure 3 A schematic diagram of an implementation process of a prior art is shown as an example;

[0092] Figure 4 A schematic diagram of a processing method is shown as an example;

[0093] Figure 5a A schematic diagram of an exemplary application scenario;

[0094] Figure 5b A schematic diagram of an exemplary application scenario;

[0095] Figure 5c A schematic diagram of an exemplary application scenario;

[0096] Figure 5d A schematic diagram of an exemplary application scenario;

[0097] Figure 5e A schematic diagram of an exemplary application scenario;

[0098] Figure 6a A schematic diagram of an exemplary application scenario;

[0099] Figure 6b A schematic diagram of an exemplary application scenario;

[0100] Figure 6c A schematic diagram of an exemplary application scenario;

[0101] Figure 6d A schematic diagram of an exemplary application scenario;

[0102] Figure 7a A schematic diagram of an exemplary application scenario;

[0103] Figure 7b A schematic diagram of an exemplary application scenario;

[0104] Figure 7c A schematic diagram of an exemplary application scenario;

[0105] Figure 7d A schematic diagram of an exemplary application scenario;

[0106] Figure 8 A schematic diagram of an exemplary application scenario;

[0107] Fig. 9 A schematic diagram of an exemplary application scenario;

[0108] Fig.10 A schematic diagram of an exemplary application scenario;

[0109] Fig.11a A schematic diagram of an exemplary application scenario;

[0110] Fig.11b A schematic diagram of an exemplary application scenario;

[0111] Fig.12 A schematic diagram of an exemplary application scenario;

[0112] Fig.13 A schematic diagram of the structure of the device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0113] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0114] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0115] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.

[0116] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0117] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0118] Figure 1 1 shows a schematic diagram of the structure of the electronic device 100. It should be understood that Figure 1 The electronic device 100 shown is only an example of an electronic device. Optionally, the electronic device 100 may be a terminal, which may also be referred to as a terminal device. The terminal may be a cellular phone, a tablet computer, a wearable device, an IoT device, etc., which is not limited in this application. It should be further explained that the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. Figure 1 The various components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0119] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0120] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0121] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0122] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0123] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0124] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0125] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0126] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0127] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0128] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0129] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0130] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0131] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0132] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0133] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with the network and other devices through wireless communication technology.

[0134] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0135] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0136] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0137] The camera 193 is used to capture still images or videos. The object is projected onto the photosensitive element by generating an optical image through the lens.

[0138] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0139] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 enables the electronic device 100 to execute the method in the embodiment of the present application by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0140] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0141] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0142] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0143] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0144] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0145] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0146] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0147] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

[0148] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0149] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover can be automatically unlocked.

[0150] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0151] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0152] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0153] The ambient light sensor 180L is used to sense the brightness of ambient light. The fingerprint sensor 180H is used to collect fingerprints. The temperature sensor 180J is used to detect temperature. The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0154] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.

[0155] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0156] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0157] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power changes, messages, missed calls, notifications, etc.

[0158] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0159] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.

[0160] Figure 2 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0161] The layered architecture of the electronic device 100 divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer.

[0162] The application layer can include a series of application packages.

[0163] like Figure 2 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0164] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0165] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0166] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0167] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0168] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0169] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0170] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0171] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0172] The system library and runtime layer include the system library and Android Runtime. The system library can include multiple functional modules. For example: surface manager, media library, 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), artificial intelligence (AI) module, etc. The 3D graphics library is used to implement 3D graphics drawing, image rendering, synthesis and layer processing, etc. The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for the scheduling and management of the Android system. The core library contains two parts: one part is the function functions that need to be called by the Java language, and the other part is the core library of Android. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0173] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0174] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0175] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0176] A 2D graphics engine is a drawing engine for 2D drawings.

[0177] The AI ​​module can be used to determine a processing object in response to a received target input indicating AI recognition, generate service information based on the processing object, and generate a service card based on the service information.

[0178] For the implementation method of the specific functions of the AI ​​module and other functions, please refer to the specific description of the subsequent embodiments, which will not be repeated here.

[0179] It should be understood that the AI ​​module that implements the method of the present application can also be configured at the application framework layer for application calls, or configured at the application layer, which is not limited here.

[0180] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0181] Understandably, Figure 2 The components included in the system framework layer, system library and runtime layer shown do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or combine some components, or split some components, or arrange the components differently.

[0182] With the development of electronic devices, electronic devices can provide service cards for applications so that users can use applications conveniently. Take the service card of the gallery application as an example. Figure 3 The following is a schematic diagram showing an application scenario of a service card in the prior art.

[0183] like Figure 3 As shown in (1), the display interface 101 of the mobile phone 100 is a desktop application interface, and the display interface 101 includes multiple application icons, such as a gallery application icon, a calendar application icon, etc. Figure 3 As shown in (1), the user long presses the gallery application icon. Figure 3 As shown in (2), mobile phone 100 can display controls 102 and 103 below the gallery application icon in response to the user's long press operation.

[0184] Among them, control 102 is an option for adding a service card of the gallery application, and control 103 may include options for other functions of the gallery application, such as search, discovery, my favorites, latest photos, etc.

[0185] like Figure 3 As shown in (2), the user clicks the control 102, and the mobile phone 100 can respond to the user operation and switch the display interface 101 to the following Figure 3 (3) Display interface 104 shown. Display interface 104 includes a card list of the gallery application, where multiple styles of cards are shown, namely card 105 and card 106. Cards of different styles may have different functions. However, before a user adds and uses a card (such as card 105 or card 106), the specific function of the card may not be clear, making it difficult to predict the function of the card to be added.

[0186] like Figure 3 As shown in (3), the mobile phone 100 defaults to placing the card 105 displayed on the top layer among the multiple cards as the card selected by the user. The display interface 104 also includes controls 107 and 108, which are used to set the selected card as a slide-up card or add it to the desktop respectively.

[0187] like Figure 3 As shown in (3), after receiving the user's operation of clicking the control 108, the mobile phone 100 can respond to the user's operation and change the display interface of the mobile phone 100 from Figure 3 (3) The display interface 104 is switched to Figure 3 (4) The display interface 101 shown in FIG. 4 adds the card 105 selected by the user to the desktop interface. The desktop interface here is as follows: Figure 3 (4) The display interface 101 shown.

[0188] like Figure 3 As shown in (3), both card 105 and card 106 are service cards with fixed style, fixed size and fixed function for the gallery application pre-configured by mobile phone 100. Among them, the fixed function of card 105 is to create pictures in the gallery application, such as video production or puzzle. The fixed function of card 106 is to browse and view pictures in the gallery application. However, the specific function of the card may be difficult to predict before the user adds and uses the card. For the user, the purpose and function of the previewed card are unpredictable. In addition, the size and style of card 105 and card 106 are pre-set and cannot be adjusted automatically.

[0189] Furthermore, although the functions of card 105 and card 106 are different, the types of service cards for the gallery application provided by mobile phone 100 are limited, resulting in limited functions of the service cards of the gallery application for users to use.

[0190] In addition, when adding a card, the user needs to go through the following steps: Figure 3 (1) to Figure 3 The three steps shown in (3) can generate Figure 3 (4) The card 105 shown. Therefore, the process of generating the service card in the prior art is relatively complicated and the steps are relatively cumbersome.

[0191] Combination Figure 3It can be made clear from the example of the card generation process in the prior art that the service card generation method in the prior art has the following technical problems: 1) The service cards provided by the electronic device are all system preset cards, and the preset cards are preset with specific functions of the card. However, it is difficult to clarify the functions supported by the card before the user adds and uses the preset card, so that before the user adds the service card, the purpose and function of the service card are unpredictable, and the user may need to add the card repeatedly before finally determining the card to be used. 2) The card function, card size, and card style of the service card provided by the electronic device are fixed, and the functions that the preset cards can provide are also limited, making it difficult for the existing service cards to meet the user's personalized use needs for the service cards. 3) The generation process of the service card provided by the electronic device is relatively complicated, the steps are relatively cumbersome, and the user interaction experience is poor.

[0192] To this end, the present application provides a data processing method, which can generate service cards according to any content, such as natural language, conversation content, text fragments, application interfaces, notification messages, etc., so that the functions or uses supported by the service cards are related to the above content known to the user. In this way, the user can flexibly decide whether to add the service card according to personal needs on the premise of clarifying the functions or users of the service card to be added, so that the user can predict the purpose and function of the service card before adding the service card.

[0193] Figure 4 The schematic diagram is an exemplary diagram showing the processing procedure of the method of the present application.

[0194] like Figure 4 As shown, the process may include the following steps:

[0195] S201 , the electronic device may determine a processing object in response to a received target input indicating AI recognition.

[0196] S202: The electronic device may generate service information based on the above processing object.

[0197] S203, the electronic device may generate a service card based on the service information.

[0198] Among them, Figure 4 As shown, the target input indicating AI recognition may be an AI dialogue, a preset input, or a combination of an AI dialogue and a preset input.

[0199] The AI ​​dialogue may be content of interaction between a user and an electronic device through AI, such as text or voice.

[0200] In some embodiments, Figure 4As shown, when the target input includes an AI dialogue, the processing object may include the dialogue content (specifically natural language) in the AI ​​dialogue, and the natural language may be text or voice.

[0201] For example, a user wakes up (e.g., starts) an electronic device’s AI recognition service (e.g., Figure 2 The AI ​​module shown in the figure) and conducts an AI dialogue. For example, the text corresponding to the dialogue content input by the user is "Set an alarm for the last Saturday of the month", then the AI ​​module can use the received dialogue content "Set an alarm for the last Saturday of the month" as the processing object in S202. And the AI ​​module can perform AI recognition on the processing object to generate structured service information. For example, the service information includes: the alarm date is the last Saturday of the month (for example, the last Saturday of the month is June 24), and the alarm time is the previously set alarm time on a weekday (for example, 7:30). Finally, the electronic device can generate an alarm card that meets the user's personalized needs based on the structured service information (for example Fig.12 a(2) shown in card 905), and applies the alarm requested by the user to the alarm application, for example, adding an alarm for 7:30 on June 24 to the alarm application.

[0202] In some embodiments, Figure 4 As shown, when the target input includes a preset input, the processing object can be a movable control (such as a notification message, etc.), or it can be any one or more of a continuous conversation (such as multiple continuous conversations in a conversation interface), a text fragment, an application interface, an image, a video, etc.

[0203] The preset input is an input that can indicate AI recognition. In other words, by triggering the preset input, the user can start the AI ​​recognition service of the electronic device to perform AI recognition on the relevant processing object and obtain service information.

[0204] The preset input may include but is not limited to at least one of the following: sliding input, dragging input, pressing input (such as short pressing input or long pressing input), screenshot input, input for starting AI recognition service (such as clicking on Figure 5c AI control 605 shown), etc.

[0205] In some embodiments, the electronic device may Figure 4 The natural language in the AI ​​dialogue shown, and / or, at least one of the movable controls, continuous dialogues, text fragments, application interfaces, images, and videos that receive preset inputs, perform AI recognition to identify the user's intent, and obtain service information (such as structured service information) based on the user's intent, so as to use the service information to generate a service card that meets the user's personalized needs.

[0206] In an embodiment of the present application, a user may make a preset input through natural language (voice, text, etc.) and / or some data objects (such as at least one of movable controls, continuous conversations, text snippets, application interfaces, images, videos, etc.) to send a request to the electronic device to generate a service card. The electronic device may call an AI module to perform AI recognition on the natural language and / or data objects input by the user to understand the user's intention, thereby converting the user input data into service information and generating a corresponding service card. The service card generated by the present application is not a preset card, but a service card that meets the user's personalized needs and is generated in combination with the user's needs for some content (such as natural language, the above-mentioned data objects, etc.). In this way, before the user adds the service card, the function, content and role of the service card are already known, so that the added service card is consistent with the user's expectations of the service card.

[0207] In addition, even if some applications are not configured with preset cards, the method of the present application can generate service cards related to the application, thereby improving the richness of the service cards.

[0208] Moreover, the card functions of the service cards generated by the present application are not fixed functions preset by the system, but functions that match the user's needs for content (such as personalized alarm clocks, etc.). In this way, the types of functions that the service cards generated by the present application can support are more diverse, and the specific functions depend on user needs, thereby satisfying the user's personalized use needs for service cards.

[0209] Also, in the process of generating service cards, users only need to conduct AI dialogues and / or make preset inputs to generate and add service cards, making the service card generation process more concise and improving the user's interactive experience.

[0210] In addition, the service cards generated by the present application are service cards that meet the user's personalized needs based on the user's needs for certain content (such as natural language, the above-mentioned data objects, etc.). Therefore, when there are differences in the content, the size and style of the service card may also be different. Even if they are service cards with the same or similar functions, due to the differences in the content targeted by the service cards, there may be differences in the size and style of similar service cards.

[0211] The following is based on Figure 4 The processing process shown is combined with different application scenarios to illustrate the method of the present application. The electronic device is taken as a mobile phone as an example. In other embodiments, the electronic device can also be a tablet computer, wearable device, etc. The principle of the implementation process is the same and will not be repeated here.

[0212] Example 1

[0213] Please refer to Figure 5a to Figure 5e , the mobile phone can convert notification messages that the user is interested in (such as notification messages that are not processed in time, etc.) into service cards that match the content of the message (such as to-do cards). Figure 4 The processing object shown may be a notification message.

[0214] In one possible implementation, please refer to Figure 5a The application scenario diagram shown in Figure 5a As shown in (1), the display interface 201 of the mobile phone is a desktop interface, and the display interface 201 may include one or more controls, including but not limited to: a power icon, a network icon, an application icon, etc.

[0215] And, in Figure 5a In the state shown in (1), the mobile phone receives a notification message, and the mobile phone can pop up and display the notification message 202. Figure 5a As shown in (1), the notification message 202 is a courier pickup reminder message. The user can pull down the notification message 202 in the direction of the arrow, and the mobile phone can respond to the pull-down operation to update the notification message 202 to Figure 5a (2) Service card 203 shown.

[0216] For example, in response to a pull-down operation (a preset input) on the notification message 202, the mobile phone can perform AI recognition on the message content of the notification message 202 to obtain structured service information. For example, the service information may include but is not limited to: pickup location, pickup code, item type of the express item, express name, etc. Then, the mobile phone can use the recognized service information to refresh the notification message 202 as follows: Figure 5a (2) Service card 203 shown.

[0217] like Figure 5a As shown in (2), the service card 203 may include but is not limited to: control 2031, control 2032, control 2033, control 2034, etc. Among them, control 2031 is used to indicate the information that the express delivery has not been picked up, such as "pending collection". Control 2032 is used to indicate the collection code, such as "0-1-1010". Control 2033 is used to indicate the collection location, such as "YY Station at the north gate of a certain community". Control 2034 can be a picture to indicate the item type of the item in the express delivery to be picked up, for example, the item type here is headphones.

[0218] like Figure 5a As shown in (2), the service card 203 is the result of replacing the pop-up notification message 202. If the user does not pull down the service card 203 in the direction of the arrow, the service card 203 will be displayed in the following manner: Figure 5a(2) After the display interface 201 shown is displayed for a period of time, for example, any time period between 1 second and 2 seconds, which can be flexibly configured according to needs, the mobile phone will no longer display the service card 203 in the display interface 201.

[0219] In addition, when the mobile phone generates Figure 5a (2) After the service card 203 shown in FIG. 2 is displayed, the mobile phone can also treat the service card 203 as an unread message and place it in the notification bar interface of the mobile phone. For example, the user opens the service card 203 by operating Figure 5a (4) The display interface 301 is a notification bar interface. The display interface 301 not only displays the notification message 204 and the notification message 205, but also displays the Figure 5a (1) The notification message 202 shown in FIG. 203 is converted into a service card. In this way, the mobile phone generates a service card 203 as shown in FIG. Figure 5a (2) After the service card 203 shown in FIG. 2 is displayed, the next time the user needs to view the service card 203, the user needs to open the notification bar interface of the mobile phone (for example, Figure 5a (4) is used to browse the service card 203.

[0220] In some embodiments, in order to facilitate the user to view the service card 203, the user can Figure 5a The service card 203 shown in (2) continues to be pulled down in the direction of the arrow, and the mobile phone can respond to the pull-down operation and refresh the display as shown in FIG. Figure 5a (3) The display interface 201 (a desktop interface) is shown to display the service card 203 in a blank area of ​​the desktop interface (referred to as "pinning to the desktop"). In this way, the user can search and browse the structured service information presented by the service card on the desktop interface at any time to find the items to be done, such as the items to be picked up indicated by the service card 203.

[0221] In this embodiment, the comparison Figure 5a (2) and Figure 5a (3) The service cards 203 are shown respectively. The display size and display content of the service cards 203 have changed. Figure 5a (3) The service card 203 shown does not display the control 2034 indicating the item type, and the card size is reduced. In other words, the application can flexibly set the card size, card style, card information, etc. of the generated service card according to the size of the area available for displaying the service card or the scene and other requirements.

[0222] In this embodiment, the user pulls down the currently popped-up notification message, and the mobile phone can replace the unread notification message with a service card in response to the user operation. The service card can display structured service information obtained by the mobile phone performing AI recognition (such as semantic analysis, etc.) on the notification message. The mobile phone converts the poorly readable notification message into a service card with a larger size and structured message content, so that the service card is more readable than the notification message, which helps to remind the user of important information in the unread notification message.

[0223] In addition, in the prior art, it is easy for users to forget to check the content of unread notification messages displayed in the notification bar interface. The service card 203 generated by the present application is similar to a to-do card, which can be displayed on the desktop interface to intuitively remind users of their to-do items in real time, thereby improving the reminder effect of the relevant to-do items.

[0224] In a possible implementation, when the AI ​​module of the mobile phone converts the notification message 202 into the service card 203, the AI ​​module may generate a pickup event related to the service card 203. Figure 5a The service card 203 shown in the figure is used to remind the user of the event (e.g., pickup event). For example, if the service card 203 is a card indicating pickup, then when the mobile phone is located near the pickup location (e.g., YY Station at the north gate of a certain community), the mobile phone can remind the user to pick up the item; or, when the mobile phone determines that the courier has not been picked up for a certain period of time (e.g., 3 days), the mobile phone can remind the user of the event related to the service card 203.

[0225] It should be understood that in other embodiments of generating a service card, the AI ​​module of the mobile phone can also generate events related to the service card.

[0226] The method by which the mobile phone reminds an event related to the service card 203 (eg, reminding to pick up an item) may include but is not limited to at least one of the following: ringing reminder, vibration reminder, notification message, updating the status of the service card, etc.

[0227] Among them, the card status of the service card may include but is not limited to at least one of the following: card information, card style, card size, card animation, etc.

[0228] For example, Figure 5b As shown, the mobile phone can pop up a notification message 206 based on the service information corresponding to the service card 203, and the display content of the notification message 206 is "Pickup reminder, you are near the YY post station, there is a courier to be picked up, the pickup code...", reminding the pickup in the form of a notification message. Alternatively, the notification message popped up by the mobile phone can also be as follows Figure 5aThe notification message 202 shown in (1) is to pop up the notification message 202 again, which is not limited here. It should be understood that the notification message of the present application can also pop up on the lock screen interface to remind the user that the pickup point is close to the pickup point.

[0229] And, if Figure 5b As shown in the figure, when the mobile phone determines that the location is close to the pickup location, compared with Figure 5a (3) in the service card 203, such as Figure 5b As shown, the mobile phone can update the display content of the control 2031 in the service card 203 from "pending for pickup" to "near the post station, available for pickup" to remind the user of the nearby pickup location by updating the card information.

[0230] In addition, the phone can also Figure 5b The service card 203 shown has added dynamic effects such as shaking to remind the user that the pickup location is approaching.

[0231] It should be understood that the above-mentioned embodiments are all described using the service card 203 for reminding to pick up items as an example, but the methods of the various embodiments of the present application are also applicable to other types of service cards generated by the methods of the various embodiments of the present application, such as video cards, schedule cards, to-do cards, etc.

[0232] In one possible implementation, Figure 5c , Figure 5d The following are schematic diagrams showing two exemplary application scenarios.

[0233] Different from Figure 5a (1) and Figure 5a (2) Pull down the currently popped-up notification message to generate the corresponding service card. Figure 5c , Figure 5d In the embodiment, the user can also generate a corresponding service card by selecting the notification message for which a service card needs to be generated in the notification bar interface. In other words, the entry for generating a service card for a notification message can be not only Figure 5a (1) and Figure 5a (2) The pop-up interface of the notification message described in the embodiment may also be Figure 5c , Figure 5d The notification bar interface of the notification message described in the embodiment, Figure 5c , Figure 5d The principle and process of generating a service card in the embodiment, the implementation process of pinning the service card to the desktop for display, and the process of changing the state of the service card are all related to Figure 5a The embodiments are the same, except that the preset input of the notification message and the display method of the service card may be different to a certain extent.

[0234] Please refer to Figure 5c, the following combination Figure 5c Let's briefly describe the processing of this application scenario. Figure 5c As shown in (1), the user slides down from the top edge of the left half of the display interface 201 in the direction of the arrow to pull out the display as shown in FIG. Figure 5c (2) Notification bar interface 301 shown.

[0235] It should be understood that the input of the user operation to display the notification bar interface is not limited to Figure 5c The pull-down operation shown in (1) is performed from the top edge of the left half of the display interface. Alternatively, the pull-down operation can be performed from the top edge of the right half of the display interface, or other input operations can be performed to display the notification bar interface. There is no limitation here.

[0236] like Figure 5c As shown in (2), the notification bar interface 301 displays notification message 202, notification message 204, and notification message 205. The user long presses the notification message 202, and the mobile phone can respond to the long press operation ( Figure 4 202) to generate a service card 203 related to the notification message 202. Figure 5c As shown in (3), the mobile phone can cancel the display of the notification message 202 that is long pressed in the notification bar interface 301, and display the generated service card 203 above the notification message in the notification bar interface 301 in a floating manner.

[0237] In other embodiments, the user may also use Figure 5a (1) The method of pulling down the notification message 202 is used to Figure 5c (2) The notification message 202 shown in FIG. 1 is pulled down, and the mobile phone can respond to the user operation and present the following Figure 5a (4) The notification bar interface 301 shown in FIG. 4 shows a service card 203 and notification messages 204 and 205 that are displayed in parallel on the same layer. Figure 5c (3) The service card 203 shown is suspended above other notification messages.

[0238] Please refer to Figure 5d , the following combination Figure 5d Let's briefly describe the processing of this application scenario. Figure 5d As shown in (1), the user slides left from the right edge of the notification message 202 in the direction of the arrow in the notification bar interface 301 to select the notification message of interest. The mobile phone can respond to the user operation and display the following Figure 5d (2) The notification bar interface 301 shown in FIG. Figure 5d (1) in the notification message 202, the mobile phone can Figure 5d(2) The control length of the notification message 202 is shortened, and the displayed message content is reduced. At the same time, a control 2021 is displayed on the right side of the notification message 202 to indicate that the notification message 202 is in a selected state. Figure 5d As shown in (2), the mobile phone can also respond to the user's left swipe operation to display controls 2022 and 2023 in the notification bar interface 301. Among them, control 2022 displays the text "Generate Card" and control 2023 displays the text "Pin to Desktop".

[0239] It should be understood that the present application does not limit the display positions of controls 2022 and 2023 , and they may also be displayed near the selected notification message 202 , for example, on the right side of control 2021 .

[0240] In some embodiments, when a user clicks on Figure 5d (2) When the control 2022 shown in FIG. 2 is displayed, the mobile phone can respond to the user operation and display the following Figure 5c (3) as shown in the notification bar interface 301, or as shown in Figure 5a (4) The notification bar interface 301 is shown to Figure 5d (2) The notification message 202 in the notification bar interface 301 is replaced with the service card 203, and the above-mentioned control 2021 and control 2022 are not displayed. Figure 5c (3) as shown in the notification bar interface 301, or as shown in Figure 5a In the notification bar interface 301 shown in (4), the following information may also be displayed: Figure 5d (2) The control 2023 shown is used to pin the generated single service card on the desktop interface for display.

[0241] In this way, the mobile phone can replace a single notification message of interest selected by the user in the notification message list in the notification bar interface with a service card. In addition, based on user operations, the generated service card can be pinned to the desktop interface for display.

[0242] In some embodiments, when the user does not click on Figure 5d (2) as shown in the control 2022, and directly click on Figure 5d (2) When the control 2023 shown in FIG. 2 is displayed, the mobile phone can respond to the user operation and display Figure 5a (3) The display interface 201 shown in FIG. Figure 5d (2) generates a corresponding service card 203 for the selected notification message 202 in the notification list, and pins the service card 203 on the desktop interface for display, without requiring the service card 203 to be displayed on the desktop interface. Figure 5dThe notification message 202 in the notification bar interface 301 shown in (2) is replaced by the corresponding service card 203. In this way, the user operation of converting the notification message into a service card and pinning it on the desktop for display can be reduced.

[0243] It should be understood that when selecting a notification message of interest in the notification bar interface to generate a service card for it, the preset input entered by the user is not limited to the long press operation, pull-down operation, and sliding operation (such as left sliding operation) mentioned above. The specific input method can be flexibly configured according to needs.

[0244] In this embodiment, the user selects a notification message of interest (for example, there is no time to view and process it) in the notification bar interface, and the mobile phone can generate a service card corresponding to the selected notification message in response to the user's selection operation, and replace the notification message with the service card. In this way, when the user does not operate the real-time pop-up notification message to generate the corresponding service card due to various reasons, the user can also select the notification message of interest in the notification bar interface to trigger the mobile phone to generate the corresponding service card, avoiding the situation where the user misses the time window for the notification message to pop up and cannot generate a service card for the notification message, and provides the user with more entrances to generate service cards for the same notification message.

[0245] In one possible implementation, Figure 5e The figure is a schematic diagram of another application scenario for exemplary purposes.

[0246] Different from Figure 5a to Figure 5d In the embodiment, a service card is generated for a single notification message, and the single service card is pinned to the desktop. Figure 5e In the embodiment, the user can select multiple notification messages that need to generate service cards in the notification bar interface, so that the mobile phone can batch generate corresponding service cards. And the user can input so that the mobile phone can batch pin multiple service cards on the desktop for display. Figure 5e The principle and process of generating a single service card in the embodiment, the implementation process of pinning a single service card to the desktop for display, and the process of realizing the state change of a single service card can all be compared with Figure 5a to Figure 5d The corresponding processes described are the same and will not be repeated here. Figure 5e The embodiment involves batch processing of notification messages and a process of pinning batches of service cards to the desktop for display.

[0247] Please refer to Figure 5e , the following combination Figure 5e Let's briefly describe the processing of this application scenario. Figure 5e (1) As shown, the user uses the notification bar interface 301 Figure 5dThe left swipe operation shown in (1) is to swipe left from the right edge of the notification message list in the direction of the arrow to select the notification messages of interest, which are notification message 202, notification message 204, and notification message 205. The remaining notification message 207 is not selected. Figure 5e (2) In response to the user's left swipe operation on each notification message, the mobile phone can shorten the control length of the corresponding notification message and reduce the displayed message content, and at the same time display a control indicating that the notification message is in a selected state on the right side of the corresponding notification message, where control 2021, control 2041, and control 2051 are shown to indicate that notification message 202, notification message 204, and notification message 205 are in a selected state, respectively. In addition, unlike Figure 5d Embodiment, since the user here selects multiple notification messages, therefore, Figure 5e As shown in (2), the mobile phone can also respond to the user's left swipe operation on each of the multiple notification messages to display controls 208 and 209 on the notification bar interface 301. Optionally, it can also display Figure 5e (3) The control 210 shown in FIG. 208 displays the text "Batch generate cards", and the control 209 displays the text "Batch delete messages".

[0248] In some embodiments, when the user clicks on the control 209 , the mobile phone may delete the selected notification message 202 , notification message 204 , and notification message 205 from the notification message list of the notification bar interface 301 in response to the user operation.

[0249] In some embodiments, when a user clicks on Figure 5e (2) When the control 208 shown in FIG. 2 is pressed, the mobile phone can generate service cards for the selected notification messages 202, 204, and 205 in batches in response to the user operation, and replace the three notification messages displayed in the notification bar interface 301 with their respective service cards, so as to display the following image: Figure 5e (3) Notification bar interface 301 shown.

[0250] Among them, Figure 5e As shown in (3), the mobile phone can Figure 5e (2) The notification message 202 shown is replaced with the service card 203, and the display control 2021 is cancelled; and the mobile phone can Figure 5e (2) The notification message 204 shown is replaced with a service card 2042, and the display control 2041 is cancelled; the mobile phone can also Figure 5e The notification message 205 shown in (2) is replaced with the service card 403, and the display control 2051 is cancelled.

[0251] exist Figure 5eIn the embodiment shown in (3), the service card 203, service card 2042, service card 403 and the notification message 207 are displayed side by side on the same layer. In some embodiments, the service card 203, service card 2042, and service card 403 can also float above the notification message that has not been converted into a service card (such as the notification message 207) to display the service card and the unread notification message on different layers in the notification bar interface. This application does not limit the display method between the service card and the unread notification message that has not been converted into a service card in the notification bar interface.

[0252] From Figure 5e (3), it can be seen that the mobile phone performs AI recognition on the Figure 5e notification message 204 shown in (1) to determine service information, and thus displays the generated service card 2042. The card information of the service card 2042 is "There will be heavy rainstorms in Beijing tomorrow and road congestion. Make arrangements in advance on the road", thus converting a notification message of the weather application into a weather reminder card with structured service information to remind the user to arrange tomorrow's itinerary in advance, so that the reminder effect of the key content of this notification message is more obvious.

[0253] From Figure 5e (3), it can be seen that the mobile phone performs AI recognition on the Figure 5e notification message 205 shown in (1) to determine service information, and thus displays the generated service card 403. Among them, the message content of the notification message 205 is "The TV drama "TV Drama Name 1" you are following has been updated to episode 20" to remind the user of the update progress of the TV drama they like. As Figure 5e (3) shows, the service card 403 generated by the mobile phone corresponding to this notification message 205 is a video card. The service card 403 displays controls 4031, 4032, and 4033. The control 4031 is used to display the poster thumbnail of the TV drama, the control 4032 is used to display the name of the TV drama that the user is following, here it is "TV Drama Name 1", and the control 4033 is used to display the updated episode number of the TV drama, here it is "has been updated to episode 20". In this way, by converting the notification message 205 into a video card with structured service information, the mobile phone can effectively remind the user of some key information of the TV drama they like, such as the updated episode number.

[0254] In addition, as Figure 5e (1) shows, limited by the length of the control of the notification message, the notification message displayed by the mobile phone in the notification bar interface 301 cannot fully display its message content. The mobile phone can only expand and display the complete message content of the notification message after the user selects the notification message. And in this application, by converting the notification message that the user is interested in into a service card, as Figure 5e(3) As described above, the service card can display the main information of the corresponding notification message in a structured manner, so that the user can intuitively and quickly understand the main information of the notification message that he is interested in through the expanded service card when opening the notification bar interface 301 next time.

[0255] Please continue to refer to Figure 5e (3) The user clicks on the control 210. The mobile phone can respond to the user operation by pinning the service cards displayed in the notification bar interface 301, here service card 203, service card 2042, and service card 403, to the desktop interface at one time for display, so as to display the following: Figure 5e (4) The display interface 201 (a desktop interface) is shown. Figure 5e As shown in (4), the display interface 201 displays service card 203, service card 2042, and service card 403.

[0256] Optionally, the user can Figure 5e The notification bar interface 301 shown in (3) performs an operation of instructing to delete the service cards in batches (for example, a button is provided in the notification bar interface 301), and the mobile phone can respond to the operation to batch delete all the service cards in the notification bar interface 301, here service card 203, service card 2042, and service card 403. In this way, when the user does not need to use these service cards, these service cards can be deleted in batches.

[0257] In this embodiment, when a user selects multiple notification messages in the notification bar interface, the mobile phone can respond to the user operation to batch convert the selected multiple notification messages into their corresponding service cards, and replace each notification message with a service card for display, so as to improve the efficiency of converting notification messages into service cards, and provide a method for batch processing of multiple notification messages in the notification bar interface. In addition, the user can also instruct to batch pin multiple service cards displayed in the notification bar interface to the desktop (for example, click Figure 5e (3) as shown in the control 210, but not limited thereto), the mobile phone can respond to the operation to pin multiple service cards displayed in the notification bar interface to the desktop interface at one time to improve the efficiency of displaying multiple service cards on the desktop.

[0258] In some embodiments, when a user passes Figure 5e After selecting multiple notification messages by swiping left as shown in (1), the present application does not restrict the operation triggered by the user to instruct batch generation of service cards for the multiple notification messages. The operation can be Figure 5e (2) The operation of clicking the control 208 shown in Figure 5e(2) A pull-down operation or a long press operation is performed on any one of the notification messages 202, 204, and 205. The mobile phone can generate respective service cards for the notification messages 202, 204, and 205 and replace the display thereof in response to the operation of batch-generating service cards for the multiple notification messages indicated.

[0259] In some embodiments, Figure 5e As shown in (3), when the notification bar interface 301 displays multiple service cards, the present application does not limit the operation triggered by the user to instruct to pin the service card to the desktop display. The operation can be Figure 5e (3) The operation of the click control 210 shown. In some embodiments, the user can also Figure 5e (3) Perform any operation such as swiping left on any of the multiple service cards shown, so that the mobile phone can respond to the operation and pin the service card triggered by the left swiping operation on the desktop; or, in response to the operation, the mobile phone pins all the multiple service cards displayed on the notification bar interface 301 on the desktop. Of course, if some service cards have already been pinned on the desktop, there is no need to pin them on the desktop.

[0260] In a possible implementation, the mobile phone can adjust the status of the service card that has been generated and displayed according to the status changes of the event related to the service card generated by this application (such as time, location, media information (such as video update information), whether the event is over, etc.). Figure 5e The event associated with the service card 203 shown may be a pickup event, or a to-do event; Figure 5e The service card 403 shown has a video update event associated with it; Figure 5e The events related to the service card 2042 shown are weather reminder events, etc.

[0261] For example, for Figure 5e (4) The service card 203 shown in FIG. 4 is displayed. When the mobile phone detects that the pickup event corresponding to the service card 203 has ended (for example, the pickup has been completed), the mobile phone can cancel the display of the service card 203, for example, Figure 5a (4) The service card 203 in the notification bar interface 301 shown in FIG. Figure 5e(4) The service card 203 pinned to the desktop is canceled. The mobile phone can monitor whether the corresponding courier has completed the pickup by calling the interface of the relevant shopping application. The specific monitoring method is not limited. In this way, the status of the service card generated by this application can be consistent with the status of the event related to the service card. In this example, the mobile phone can reduce the display of unnecessary service cards to reduce the occupation of the display space of the desktop interface and improve the utilization rate of the display space.

[0262] For example, for Figure 5e (4) The mobile phone determines through the AI ​​module that the corresponding related event is the update event of the TV series "TV Series Name 1". Then, when the mobile phone detects a message (not limited to a notification message) about the update of the TV series "TV Series Name 1" through the AI ​​module, the mobile phone does not need to generate a video card similar to the service card 403 for "TV Series Name 1". Instead, the mobile phone updates the video card 403 as shown in FIG. Figure 5e (4) The control 4033 in the service card 403 shown in FIG. 4 displays the episode number, so that the updated episode number displayed in the service card 403 can be updated in real time as the episodes of the TV series "Drama Title 1" are updated.

[0263] For example, for Figure 5e (4) The mobile phone determines through the AI ​​module that the corresponding related event is the rainstorm reminder event on June 2, 2023. Then, when the mobile phone detects through the AI ​​module that the system time is updated from June 1 to June 2, the mobile phone can Figure 5e (4) The title of the service card 2042 is updated from "Heavy rain in Beijing tomorrow" to "Heavy rain in Beijing today" so that the display content of the service card 2042 can change with time. When the mobile phone detects that the time is updated to June 3, the mobile phone can cancel the display of the service card 2042. In this way, the card status of the service card 2042 generated by the present application can be updated with information such as time and location.

[0264] In an embodiment of the present application, the card status of the service card generated by the mobile phone may change with the status of the event related to the service card, and / or with changes in time, place (location), etc., so that the status of the service card can be consistent with the status of the related event, which is conducive to realizing accurate reminders of related events through changes in the status of the service card.

[0265] In the above Figure 5a to Figure 5e In the drawings, the same reference numerals represent the same or similar objects. Therefore, the reference numerals of the drawings are not explained one by one. The reference numerals not mentioned in the above drawings can be referred to in Figure 5a to Figure 5e The explanations of the same figure marks mentioned in the figure will not be repeated here.

[0266] Example 2

[0267] Please refer to Figures 6a to 6d , the mobile phone can convert the movable control that the user is interested in into a service card that matches the movable control, and the movable control can be, for example, Figure 6a (1) The floating window 610 shown, Figure 6b (2) The suspended ball 402 shown, Figure 6d (2) The transfer station controls shown (here are controls 406 and 407), etc.

[0268] In one possible implementation, please refer to Figure 6a The application scenario diagram shown in Figure 6a As shown in (1), the display interface 401 of the mobile phone is a desktop interface, and the display interface 401 may include one or more controls, including but not limited to: a power icon, a network icon, an application icon, etc. In addition, the display interface 401 also includes a floating window 610, and the display content of the floating window 610 is the video playback screen of the Huawei video application, and the floating window 610 is playing a video.

[0269] like Figure 6a As shown in (1), the floating window 610 may include but is not limited to: control 6101, control 6102, control 6103, and control 6104. Among them, control 6101 is used to close the floating window 610, control 6102 is used to display the display content of the floating window 610 in full screen, control 6103 is used to minimize the floating window 610, and control 6104 is used to move the floating window 610.

[0270] like Figure 6a As shown in (1), the user long presses the control 6104 and drags the floating window 610 to position A in the direction of the dotted arrow, where position A is a blank position in the desktop interface. Figure 6a As shown in (2), the user long presses the control 6104 to move the floating window 610 from the original position (corresponding to Figure 6a (1) to position A, the mobile phone can respond to the dragging operation and switch the floating window 610 from its original position to the display position of the floating window 610. Figure 6a (2) Position A shown; Optionally, when the user drags the floating window 610 to position A, the user does not let go, and the mobile phone can respond to the dragging operation and display a dotted frame 611 on the display interface 401 based on position A.

[0271] It should be understood that Figure 6a(2) The dotted line of the original position of the floating window 610 and the schematic diagram of the floating window are only for the convenience of readers to understand the position of the floating window 610 before being dragged by the user. In actual application, the mobile phone may not display the position of the floating window 610 before being dragged.

[0272] In some embodiments, when the user drags the floating window 610 to a position in the desktop interface where the area is not large enough to place a video playback card (for example, there is an application icon near position A), the mobile phone can remind the user that the position currently being dragged is unavailable.

[0273] In this embodiment, when the user drags the floating window 610 to position A in the desktop interface and releases the finger, the mobile phone responds to the user operation, determines the service information related to the floating window 610, and generates a corresponding service card 4000 based on the service information. Figure 6a As shown in (3), the mobile phone can respond to the user operation and display the generated service card 4000 on the screen. Figure 6a (2) is within the area where the dotted frame 611 is located. Optionally, the mobile phone can minimize the floating window 610 or close the floating window 610 in response to the user operation, which is not limited here.

[0274] Among them, the floating window 610 is playing the first minute of the 10th episode of the TV series named "Drama Title 1". Then the service information determined by the mobile phone for the floating window 610 may include but is not limited to: the name of the video application is Huawei Video, the name of the currently playing video is "Drama Title 1", the video playback progress is the first minute of the 10th episode, the video playback volume value and other information.

[0275] Based on the service information, the mobile phone can generate and display Figure 6a (3) Service card 4000 shown. Figure 6a As shown in (3), the service card 4000 includes but is not limited to: control 4001, control 4002, control 4003, control 4004, and control 4005. Among them, control 4001 is used to display the poster thumbnail of the TV series; control 4002 is used to display the title of the TV series that the user has just played in the floating window 610 (here, "Title 1"), and the current playing episode number (here, the 10th episode); control 4003 is the video playing progress bar of the TV series, and the current playing progress is the first minute of the 10th episode; control 4004 is used to start playing or pause playing the TV series according to the current playing progress, and adjust the playing to the previous episode or the next episode; control 4005 is used to adjust the playing volume of the video.

[0276] In this way, the mobile phone can display a service card matching the content of the floating window on the desktop interface based on the user's dragging operation on the floating window, and the service card can display structured service information related to the information in the floating window.

[0277] In some embodiments, for example, a user Figure 6a (3) The service card 4000 shown in FIG. 4 shows a video card 4000. If the start play button in the control 4004 is clicked, the mobile phone can respond to the user operation and play the video according to the play progress in the service card 4000 to refresh the display content of the service card 6000 to the following: Figure 6a (4) Display contents of service card 6000 shown.

[0278] like Figure 6a As shown in (4), the refreshed service card 6000 not only displays the controls 4003 and 4004, but also displays the video screen 4006. The refreshed service card 6000 displays the Figure 6a (3) The video screen of the video is played according to the video playing progress indicated. And the button in the control 4004 is changed from Figure 6a (3) The triangular start play button is refreshed to Figure 6a (4) The double vertical bar pause play button shown.

[0279] It should be understood that when a user clicks Figure 6a After the play button in the control 4004 shown in (3) is activated, the mobile phone can respond to the user's operation on the service card 6000 and play the video according to the corresponding play progress. This application does not limit the play window that displays the play screen of the video. Figure 6a (4) The video can be played in the service card 6000 shown, or in the floating window 610, or in a full-screen window or a split-screen window.

[0280] In this way, the service card 4000 generated by the present application based on the floating window can be an interactive service card. In actual applications, its interactive content is not limited to starting or pausing the video, but can also be the adjustment of the currently playing episode or the progress of the play, or the adjustment of the play volume, etc. The specific interactive content can vary according to the difference in the service information provided by the service card, and is not limited here.

[0281] In this embodiment, the mobile phone can determine the service information related to the floating window based on the user's preset input to the floating window (such as a drag operation, without limitation), and generate a service card based on the service information to convert the floating window into a service card. The card information of the service card can match the display content of the floating window, and display the relevant information of the floating window in the form of structured service information in the service card. In this way, the user can convert the floating window into a service card to record the important content currently displayed in the floating window on the service card, so as to intuitively remind the user of some operations recently performed (such as playing videos, viewing memos, etc.) or some information viewed through the service card.

[0282] In some embodiments, Figure 6a (3) and Figure 6a As shown in (4), the service card generated by the present application is interactive. Also, the service card generated by the present application for the floating window can also change with the state change of related events (such as media broadcast control events). For example Figure 6a The service card 6000 generated by the embodiment is a video playback card, and its related event is a video playback event. Changes in the state of starting and pausing the video, adjusting the playback progress, adjusting the number of episodes played, adjusting the playback volume, etc. can all cause changes in the state of the service card 6000.

[0283] exist Figure 6a In the embodiment, dragging a floating window on the desktop interface to generate a service card is used as an example. In other embodiments, the user can also drag the floating window to an application interface outside the desktop interface (such as a chat session interface). In response to the dragging operation, the mobile phone can generate a service card related to the floating window and share the service card to the application interface. For example, the mobile phone can share the service card as a session message in the chat session interface. Then the service card may not be Figure 6a The service card 6000 supporting media playback control shown in FIG. 60 is an information display card, such as a card similar to Figure 5e The service card 403 shown in the figure does not limit the specific service information carried by the generated service card. Figure 4 There are differences due to the different processing objects shown.

[0284] Optionally, in some embodiments, in Figure 4 When generating a related service card for the processing object shown, not only the related information of the processing object can be combined with the user portrait, scenario information, etc. to determine the service information, so as to generate a service card based on the service information. Figure 6aTake the implementation example as an example, for example, the user portrait includes the following information: such as user age, user gender, the types of videos the user likes to watch, etc. User habits may include: the user has recently not only frequently watched the TV series "Drama Title 1", but also frequently watched the TV series "Drama Title 2". Scenario information may include information about several popular movies currently on the Huawei video application. Then, based on the processing object (the floating window here is not limited), as well as the user portrait, scenario information, etc., the service card generated by the mobile phone may include information about some film and television dramas related to the user portrait, the above-mentioned "Drama Title 1", "Drama Title 2" and the above-mentioned popular movies. Accordingly, the size and style of the service card can also be different from the original. Figure 6a (3) or Figure 6a (4) The service cards 6000 shown are different in size and style.

[0285] In one possible implementation, Figure 6b , Figure 6c Each of them is a schematic diagram of another application scenario shown as an example.

[0286] Different from Figure 6a In the embodiment, the mobile phone generates a service card in response to the user dragging the floating window. Figure 6b , Figure 6c In the embodiment, the user can minimize the floating window (which can be called a floating ball, for example Figure 6b The suspended ball 402 shown, Figure 6c The mobile phone can generate a service card related to the floating ball in response to the dragging operation. Figure 6a The implementation process of the related embodiments is the same and will not be repeated here. Please refer to the above for details.

[0287] Please refer to Figure 6b , the following combination Figure 6b Let's briefly describe the processing of this application scenario. Figure 6b As shown in (1), a floating window 610 is displayed on the mobile phone display interface 401, and the floating window 610 is playing a video. The user clicks the control 6103, and the mobile phone can respond to the user operation and minimize the floating window 610 to display the video. Figure 6b (2) The display interface 401 shown. Figure 6b As shown in (2), the floating window 610 is minimized to a floating ball 402, and the floating ball 402 is located in the control 400. Figure 6b As shown in (3), the user drags Figure 6b(2) moves the floating ball 402 to the position A in the blank area of ​​the desktop interface in the direction of the dotted arrow. In response to the dragging operation, the mobile phone displays a dotted frame 611 including the position A in the display interface 401, and cancels the display of the control 400 and the floating ball 402 in the control 400 (shown here with a dotted line to indicate that they are no longer displayed). Figure 6b (3) After the user moves his finger from position A, the mobile phone can respond to the user operation, such as Figure 6b As shown in (4), the service card 4000 generated based on the floating ball 402 is displayed at the position of the dotted frame 611.

[0288] In some embodiments, Figure 6c Another application scenario diagram of dragging a floating ball to generate a service card is exemplified.

[0289] like Figure 6c As shown, in Figure 6b (1) and Figure 6b (2) Afterwards, the floating window 610 is minimized to Figure 6b (2) The floating ball 402 in the control 400 shown in FIG. The control 400 can be extended and displayed on the side of the mobile phone. Figure 6b (2) After the display interface 401 shown in FIG. 2 is displayed for a period of time (e.g., 2 seconds, not limited to the specific case), the control 400 and the control 402 inside it can be changed from Figure 6b (2) The extended state shown is switched to Figure 6c (1) is the collapsed state shown. When the control 400 and the control 402 inside it are in Figure 6c (1) In the contracted state, Figure 6c As shown in (1), the user can also drag the control 402 to position A in the direction of the dotted arrow, and the mobile phone can respond to the drag operation to display the dotted frame 611. After the user's finger leaves position A, the mobile phone can respond to the user operation and display the following Figure 6c The display interface 401 shown in (2) displays the service card 4000 generated for the floating ball 402 in the dotted frame 611 .

[0290] In the embodiment of the present application, when a user wishes to generate a service card for the content of the floating window, the user can not only Figure 6a Embodiment, to drag the floating window ( Figure 4 An example of preset input shown in the figure) can also be performed by dragging the floating ball after the floating window is minimized ( Figure 4The preset input shown in the figure is an example of a preset input, so that the mobile phone generates a corresponding service card in response to the user operation, thereby providing users with more input methods to generate service cards from the floating window content. Users can flexibly select input methods according to their needs to trigger the mobile phone to call the AI ​​module to identify the service information of the floating window or floating ball, so as to generate a corresponding service card based on the service information. Of course, the preset input of the indication AI recognition triggered by the floating window or floating ball is not limited to the above-mentioned dragging operation, and the dragging direction is not limited to Figure 6b , Figure 6c The direction of the dotted arrow shown can be any direction and is not limited here.

[0291] In one possible implementation, Figure 6d The figure is a schematic diagram of another application scenario for exemplary purposes.

[0292] Different from Figures 6a to 6c In the embodiment, the mobile phone generates a single service card in response to the user dragging a single floating window or a single floating ball. Figure 6d In an embodiment, a user can control a transfer station control (e.g. Figure 6d The mobile phone can generate a service card related to each transfer station control in response to the dragging operation, thereby realizing batch generation of service cards. Figures 6a to 6c The implementation process of the related embodiments is the same and will not be repeated here. Please refer to the above for details.

[0293] Please refer to Figure 6d , the following combination Figure 6d Let's briefly describe the processing of this application scenario. Figure 6d As shown in (1), the mobile phone display interface 401 displays a control 400, and the control 400 includes a floating ball 404, which is different from Figure 6b and Figure 6c The floating ball 402 in the embodiment is used to indicate that there are floating windows of multiple applications in a minimized state, such as a floating window of a memo application and a floating window of a Huawei video application. When a user clicks on the floating ball 404, the mobile phone can respond to the user operation and display the following Figure 6d (2) The display interface 401 is to expand the control 400 and the floating ball 404 inside it into Figure 6d(2) The transfer station window 405 shown in the figure may include a control 406 and a control 407. Among them, the control 406 is used to indicate the minimized floating window of the memo application, and the control 407 is used to indicate the minimized floating window of the Huawei video application. Among them, the control 406 includes a close button 6101, and the close button 6101 is used to close the floating window of the memo application. After the user clicks the close button 6101, the mobile phone can respond to the user operation, close the floating window of the memo application, and cancel the display of the text "Memo" and the corresponding memo icon shown in the transfer station window 405, as well as the control 406, so that the transfer station window 405 only displays controls related to Huawei video, such as the control 407. Similarly, the control 407 also includes a close button 6101, which is used to close the floating window of the Huawei video application, and its function is the same as that of the control 407. Figure 6a and Figure 6b In addition, the transfer station window 405 also includes a control 410. After the user clicks the control 410, the mobile phone can respond to the user operation and restore the transfer station window 405 to the following state: Figure 6d (1) The minimized control 400 is shown.

[0294] Continue to refer to Figure 6d (2) The user presses and holds the relevant control of any transfer application in the transfer station window 405 (for example, control 406 or control 407). Here, the user presses and holds control 406 and drags it to position B in the direction of the dotted arrow. In response to the user operation, the mobile phone can display a dotted frame 612 and a dotted frame 611 near position B (the dotted frame is optional), wherein the size of the dotted frame 612 matches the size of the service card generated by the mobile phone for the memo application, and the size of the dotted frame 611 matches the size of the service card generated by the mobile phone for the Huawei video application. Figure 6d (3) shows Figure 6d (2) is an enlarged view of the control 406 shown, Figure 6d (2) The enlarged view of the control 407 shown is Figure 6a and Figure 6b The control 610 shown is similar to the control 610 shown, except that the control 6101 has a certain size difference. And the mobile phone can also generate a service card 409 related to the floating window corresponding to the control 406 in response to the user dragging the control 406 to position B, and generate a floating window (e.g. Figure 6a and Figure 6b The floating window 610 shown in FIG. 4000) is associated with the service card 4000, and as shown in FIG. Figure 6d (4) As shown in FIG. 4, the mobile phone can display the service card 409 on the Figure 6d (2) The service card 4000 is displayed in the area corresponding to the dotted frame 612 shown in FIG. Figure 6d(2) is within the area corresponding to the dotted box 611 shown.

[0295] Among them, mobile phones are based on Figure 6d When the control 406 shown in the figure is used to generate service information and to generate a service card 409 based on the service information, the mobile phone can display the content of the floating window of the memo application when it is minimized, for example Figure 6d The display content shown in (3) can optionally be combined with user portraits, user habits, etc. to generate service information.

[0296] like Figure 6d As shown in (3), the memo application has two functions: recording notes and recording to-do items. When the user minimizes the floating window of the memo application, the memo application displays the interface of the note function. Then, when the mobile phone calls the AI ​​module to generate service information, the AI ​​module can recognize that the user is recently recording notes and read at least one note that the user has recently browsed with a high or highest frequency from the memo application. Then, the AI ​​module can generate service information based on the at least one note. Thus, the mobile phone can display the following information based on the service information: Figure 6d (4) The service card 409 shown in FIG. 409 shows the title, category, and summary of a note that the user has browsed most frequently recently (here, “I was born with talent and I will use it for good”).

[0297] In other embodiments, the service card generated based on the control 406 of the memo application may also include information of one or more to-do items. The implementation principle is similar to the principle of generating related information including one or more notes, which will not be repeated here.

[0298] In addition, if Figure 6d As shown in (4), when the mobile phone generates service cards 409 and service cards 4000 in batches in response to the user's dragging operation on the control 406 and displays them on the desktop interface (here, the display interface 401), the control 400 and the floating ball 404 inside it can continue to be displayed. In other embodiments, the mobile phone can also cancel the display of the control 400 in response to the user's dragging operation to close the floating window of the corresponding application for which the service card has been generated, which is the floating window of the Huawei video application and the floating window of the memo application.

[0299] In some embodiments, users can not only Figure 6d (2) to drag the control of any application in the transfer station window 405 to realize batch generation of service cards of multiple applications with floating windows. Figure 6dThe control 400 or the floating ball 404 in the extended state shown in (1), or the control 400 or the floating ball 404 in the contracted state, performs a similar drag operation to batch generate corresponding service cards for the corresponding multiple applications. The implementation principle is the same as Figure 6d The process of introduction is the same and will not be repeated here.

[0300] In the embodiment of the present application, when there are multiple applications with minimized floating windows on the mobile phone, the user can indicate the minimized floating windows of the multiple applications by clicking on the control (for example, Figure 6d The drag operation can be performed on any application-related control within the control 400, control 404, and control 405 shown, such as control 406), but is not limited to the drag operation and can be flexibly configured according to the application scenario. The mobile phone can respond to the drag operation to batch generate corresponding service cards for multiple applications in transit, thereby realizing the batch generation and batch display of service cards on the desktop, improving the generation efficiency of service cards, and reducing the operation of users requesting the generation of multiple service cards.

[0301] In the above Figures 6a to 6d In the drawings, the same reference numerals represent the same or similar objects. Therefore, the reference numerals of the drawings are not explained one by one. The reference numerals not mentioned in the above drawings can be referred to in Figures 5a to 6d The explanations of the same figure marks mentioned in the figure will not be repeated here.

[0302] It should be understood that the scenario of generating a service card for a transfer station control is not limited to Figure 6d The transfer station controls in the scene shown, such as control 406 and control 407.

[0303] In some embodiments, the method for generating a transfer station control in the present application can also be: long press an object (picture, selected text, file, etc.) until it floats up, and then drag the floating object to the transfer station for temporary storage. Then the object temporarily stored in the transfer station can also be the transfer station control of the present application. In combination with the method of the present application, the user can drag the object temporarily stored in the transfer station to the desktop interface, and the mobile phone can respond to the user's dragging operation, optionally display a dotted box (the location of the service card to be generated) at the dragging position on the desktop interface, and register the object ( Figure 4 The principle of the implementation process is the same as that of generating service cards for other types of movable controls, which will not be repeated here.

[0304] Example 3

[0305] Please refer to Figures 7a to 7d , combined with Figure 4The mobile phone can generate a schedule card based on the interface context and / or the natural language input by the user to communicate with the AI ​​module. The interface context may include but is not limited to: continuous dialogue, text fragments, application interface, image, video, etc.

[0306] In one possible implementation, please refer to Figure 7a The application scenario diagram shown in Figure 7a As shown in (1), the display interface 501 of the mobile phone is a conversation interface of the communication application. The display interface 501 displays a chat dialogue between the user and "Xiao Wang", such as "Let's go boating in Beihai the day after tomorrow", "Okay, 10 am?", "Okay, see you at the North Gate!". The user approaches the mobile phone and inputs "Xiao Yi, Xiao Yi" by voice. The mobile phone can respond to the received voice input (a kind of Figure 4 The preset input shown in the figure) is used to wake up the AI ​​module and display a control 502 indicating the AI ​​module. In other embodiments, the preset input for the user to wake up the AI ​​module may also be a gesture input, etc., which is not limited here. In some embodiments, the user may also have an AI dialogue with the AI ​​module after waking up the AI ​​module, such as voice input "please generate a schedule card", and the AI ​​module of the mobile phone may respond to the voice input to generate a schedule card related to the display interface 501 (an application interface).

[0307] Specifically, when the AI ​​module generates the schedule card, the AI ​​module of the mobile phone can Figure 7a (1) AI recognition is performed on the content in the display interface 501 shown to identify the user's intention, thereby determining the service information. The content recognized by the AI ​​module on the display interface 501 may be text, pictures, etc., which are not limited here. For example, the service information may include but is not limited to: time: Saturday morning 10 o'clock, location: North Gate of Beihai Park, event: Play with Xiao Wang. The AI ​​module of the mobile phone can generate a service card 504 (a schedule card) based on the service information and display it as follows: Figure 7a (2) The display interface 501 shown. The display interface 501 may include a window 503, the window 503 may include a service card 504, and optionally include a control 5051, and optionally include a control 5052 and a control 6104, wherein the function of the control 6104 is the same as that of the control 6104. Figure 6a The function of the control 6104 described in the embodiment is similar, and is used to move the window 503, which will not be described in detail here.

[0308] like Figure 7a As shown in (2), the service card 504 generated by the mobile phone displays structured service information, including the time, location and event of the schedule.

[0309] Then, the user clicks Figure 7a(2) The control 5051 shown, the mobile phone can respond to the user operation, such as Figure 7a As shown in (3), the schedule interface of the calendar application is opened, and a schedule with the above-mentioned time, place and event information is added to the calendar application, and the service card 504 corresponding to the added schedule is displayed in the schedule interface. The schedule interface is as follows Figure 7a (3) The display interface 601 shown in FIG. 6 may include, but is not limited to, a control 602 , a control 603 , a service card 504 , a service card 506 , and the like.

[0310] Among them, control 602 is used to indicate that the display mode of the calendar application is a schedule mode among multiple modes of year, month, week, day, and schedule, for displaying schedule information. Control 603 is used to indicate the timeline of schedule information. Service card 504 is located near the time point "10:00" in control 603, to indicate that the time of the schedule corresponding to service card 504 is: ten o'clock the day after tomorrow. Among them, in this example, today is Thursday, June 1, 2023, and the time agreed by the user and his friend Xiao Wang is ten o'clock in the morning on Saturday. Therefore, the schedule added by the mobile phone to the calendar application is the schedule for ten o'clock in the morning the day after tomorrow. In addition, a schedule at nine o'clock in the morning on June 20, 2023 was previously added to the calendar application. The schedule information of this schedule can refer to the service information displayed by service card 506, which will not be repeated here.

[0311] In this way, the embodiment of the present application can display the generated schedule card in the display interface 601 of the calendar application in a manner of associating the timeline and the service card, so that the user can clearly understand his or her schedule through the service card in the display interface 601.

[0312] In some embodiments, the mobile phone displays Figure 7a When the display interface 501 shown in (2) is displayed, the user can also use other operation methods to trigger the mobile phone to create a corresponding schedule in the calendar application based on the service card 504, such as long pressing the service card 504, etc., which is not limited here.

[0313] In some embodiments, the mobile phone displays Figure 7a When the display interface 501 shown in (2) is displayed, the user can also click the control 5052 (or other operations, which are not limited here) to request that the service card 504 be pinned to the desktop interface for display. The mobile phone can respond to the user operation and display the following: Figure 7a(4) The display interface 201 (a desktop interface) shown in FIG. 4 is used to display the service card 504 generated this time on the desktop interface. Here, the display interface 201 also includes other service cards 4000 and service cards 203 that have been generated and pinned to the desktop through the method of the present application. The specific generation method of the service card 4000 and the service card 203, and the operation process of pinning them to the desktop refer to the introduction of the above embodiment, which will not be repeated here.

[0314] Compared to Figure 7a (2) service card 504 shown, and Figure 7a (4) The service card 504 shown in FIG. 5 may have certain differences in card size and card layout. In other words, this application does not limit the preview generated Figure 7a (2) The service card 504 shown is the same as the one pinned to the desktop. Figure 7a (4) The service card 504 shown, and the service card 504 added to the application Figure 7a (3) The service cards 504 shown are completely identical, but may differ in any one of the card styles, card sizes, card information, etc.

[0315] In the embodiment of the present application, the user can trigger the input of the AI ​​module of the mobile phone to wake up in the application interface, so that the AI ​​module can perform AI recognition on the interface content of the application interface to determine the service information, and then generate a service card based on the service information. For example, the service card is a schedule card, and the specific card type is not limited here. The card type can be different according to the difference in the display content of the application interface. For example, in combination with Figure 4 , Figure 7a The processing object corresponding to the embodiment is the application interface.

[0316] In a possible implementation, when the mobile phone generates a service card, for example Figure 7a The schedule card of the embodiment may specifically be service card 504, service card 506, etc. The mobile phone can not only refer to Figure 4 The processing object shown (for example Figure 7a The information of the application interface of the embodiment can also be combined with user portraits, user habits, real-time scenarios and other information to determine the service information, so as to generate a service card based on the service information, so that the card information of the service card can be related to at least one of the processing object, user portraits, user habits, real-time scenarios and the like.

[0317] For example, when a mobile phone generates Figure 7a(3) When the service card 506 shown in FIG. 5 is displayed, for example, the AI ​​module of the mobile phone performs AI recognition on the corresponding application interface and determines that the meeting location described in the interface content of the application interface is conference room 1. However, the AI ​​module calls the interface of the conference system and determines that conference room 1 has been reserved. The AI ​​module can intelligently adjust the recommended meeting location, for example, to conference room 7, and in the recommended service card (for example, Figure 7a The service card displayed in the window 503 shown in FIG. 5 shows that the meeting location is conference room 7. In this way, the user can flexibly decide whether to use the conference room intelligently recommended by the AI ​​module to create a schedule, and whether to create a service card for the corresponding schedule in the calendar application or the desktop application.

[0318] In a possible implementation, the mobile phone can generate service card-related events (such as Figure 7a The status of the service card 504 shown in the figure is adjusted according to the status change of the schedule event (such as the change of time, location, etc.).

[0319] Among them, the card status of the service card may include but is not limited to at least one of the following: card information, card style, card size, card animation, etc.

[0320] In some embodiments, Figure 7b The figure is a schematic diagram showing an exemplary application scenario.

[0321] like Figure 7b (1) shows that the display interface 501 of the mobile phone is compared with Figure 7a The display interface 501 shown in (1) updates the conversation message. Figure 7b The display interface 501 shown in (1) further includes a conversation message 507 and a conversation message 508. The message content of the conversation message 507 is "I have something urgent to do the day after tomorrow morning, how about we change it to 2 pm?", and the message content of the conversation message 508 is "Sure, no problem". Then the update of the conversation message of the display interface 501 of the mobile phone can wake up the AI ​​module again (or the user can wake it up through the target operation, without limitation). In this way, the AI ​​module can perform AI recognition on the interface content of the display interface 501 to obtain a recognition result (such as the semantics of the conversation), so that based on the recognition result, the service card related to the recognition result can be located in the generated service card, here is Figure 7a (3) or Figure 7a (4) The AI ​​module can then modify the time information in the generated service card 504 from "10:00" to "14:00". Figure 7b (2) When the user opens the calendar application's schedule interface (here, display interface 601) again, compared to Figure 7a (3) Service card 504, Figure 7b The time in the service card 504 shown in (2) has been updated to "14:00". Figure 7b (3) As shown in the figure, when the user opens the Figure 7b (3) when the display interface 201 is shown, compared with Figure 7a (4) Service card 504, Figure 7b The time in the service card 504 shown in (3) has been updated to "14:00".

[0322] In this way, after the user modifies the corresponding schedule through the application interface (here, display interface 501) that generates the service card 504, the AI ​​module of the mobile phone can perform AI recognition on the interface information of the application interface, so as to locate the service card related to the schedule (here, service card 504) when it is determined that the schedule has changed, and refresh the card information of the service card based on the information of the modified schedule, such as the time, location and other information of the schedule. In this way, when the schedule for which the corresponding service card has been generated changes, the mobile phone does not need to generate a new schedule and a new service card based on the changed information, but only needs to refresh the card status of the existing service card related to the schedule, which reduces the signaling overhead of the mobile phone and enables the status of the service card to always be consistent with the status of the event related to the service card (here, the schedule event).

[0323] In a possible implementation, the mobile phone can also generate service information (such as card information) of the service card, optionally in combination with the user portrait, optionally in combination with the real-time scenario (such as navigation duration, etc.), etc., to generate an event corresponding to the service card, such as Figure 7b The service card 504 shown is used to remind the schedule event corresponding to the service card 504.

[0324] The reminder method of the mobile phone for the schedule corresponding to the service card may include but is not limited to at least one of the following: ring reminder, vibration reminder, notification message, update service card status, etc.

[0325] In some embodiments, Figure 7c The diagram is a schematic diagram showing an exemplary application scenario.

[0326] Please refer to Figure 7b (3) or Figure 7b (4) The time of the schedule corresponding to the service card 504 is 2:00 p.m. on Saturday. The mobile phone can determine the time to remind the schedule through the AI ​​module, for example, 1:30 p.m. on Saturday. The process of determining the reminder time will be described in detail below.

[0327] likeFigure 7c As shown, when the system time of the mobile phone is 13:30 on Saturday, the mobile phone can change the card information of the service card 504 from Figure 7b (3) The service card 504 shown is refreshed to Figure 7c Service card 504 is shown.

[0328] Please refer to Figure 7c , Figure 7c The service card 504 shown is a navigation card for the above schedule, and the service card 504 may include information such as the navigation starting point, navigation end point, navigation duration, and the time of the schedule appointment. In addition, the service card 504 also includes a navigation button 5041. After the user clicks the navigation button 5041 in the service card 504, the mobile phone can respond to the user operation and switch the display interface of the mobile phone from the display interface 201 to the navigation interface from the starting point to the end point of the mobile phone map application, so that the user can navigate the itinerary of the schedule.

[0329] In this embodiment, the mobile phone can determine the reminder time for the schedule of the generated service card through the AI ​​module (here is 1:30 p.m.), and when the mobile phone system time reaches the reminder time, the schedule information displayed by the service card 504 is refreshed to the navigation information about the schedule, so as to update the status of the service card 504 and realize the reminder of the schedule related to the service card 504.

[0330] In some embodiments, the mobile phone determines the Figure 7b When the reminder time of the schedule related to the service card 504 shown is set (here 1:30 p.m. on Saturday), the AI ​​module can flexibly determine the reminder time based on the schedule time corresponding to the service card 504 (2 p.m.), user profile (for example, statistical or collected user model data including information that the user will go out half an hour in advance), and real-time scenario (for example, navigation time is half an hour), etc. The reminder time of the schedule can be the same as the schedule time corresponding to the schedule, or earlier than the schedule time.

[0331] Furthermore, in an embodiment of the present application, the mobile phone can remind the user of events related to the service card (here, the schedule) based on the service information of the generated service card, optionally in combination with user portraits, real-time scenario information, etc.

[0332] In one possible implementation, Figure 7d The figure is a schematic diagram of another application scenario for exemplary purposes.

[0333] Different from Figure 7a In the embodiment, the user wakes up the AI ​​module of the mobile phone by voice input, so as to generate a corresponding service card 504 for the display interface 501. Figure 7d , which shows a variety of other input methods that a user can use to wake up the AI ​​module, so as to trigger the AI ​​module to perform AI recognition on the corresponding processing object to determine the service information, thereby generating a service card based on the service information. Figure 7d The specific process of generating a service card in the embodiment is as follows Figure 7a The introduction is the same as that of the present invention, except that the difference lies in the input method of waking up the AI ​​module. Optionally, there may also be a difference in the processing object of the AI ​​module. The similarities will not be repeated here.

[0334] Please refer to Figure 7d , the following combination Figure 7d Let's briefly describe the processing process of this application scenario.

[0335] In some embodiments, Figure 7d As shown in (1), the user can long press a blank position near the conversation message (e.g., a position where the conversation message is not displayed) on the display interface 501 of the mobile phone, and the mobile phone can respond to the long press operation of the user and wake up the AI ​​module, and the AI ​​module can perform a long press operation on the area near the user's long press position (e.g., Figure 7d The conversation message within the dotted circle shown in (1) is semantically recognized to generate a service card 504, thereby displaying Figure 7a (2) The display interface 501 shown. In this example, the long press operation is Figure 4 A preset input shown in FIG. 1 , the three conversation messages in the dotted circle are Figure 4 A continuous dialogue is shown.

[0336] In some embodiments, the user Figure 7d The position in the display interface 501 shown in (1) where the AI ​​module is awakened by long pressing is not limited to a blank position, and at least one conversation message may be long pressed. Then, the AI ​​module may take multiple consecutive conversation messages around the long pressed position as processing objects to identify service information, thereby generating a service card.

[0337] In some embodiments, Figure 7d As shown in (2), the user can perform a screenshot operation on the display interface 501, and the mobile phone can respond to the screenshot operation by displaying a thumbnail 604 of the screenshot image and an AI button 605 in the display interface 501. Then, the user can drag the thumbnail 604 to the AI ​​button 605 in the direction of the arrow, and the mobile phone can respond to the user operation and perform AI recognition on the screenshot image corresponding to the thumbnail 604 to generate a service card 504, thereby displaying the following. Figure 7a (2) The display interface 501 shown. In this example, the operation of dragging the thumbnail 504 to the AI ​​button 605 can be used as Figure 4 A preset input shown in FIG. 6 shows a screenshot image (an image) corresponding to the thumbnail 604. Figure 4 A processing object is shown.

[0338] In some embodiments, Figure 7d As shown in (3), the user can enter the text "@AI assistant generates a schedule" in the text box 606 displayed on the display interface 501, and then the user clicks the control 607 displayed on the display interface 501 to send a message including the text. Then, the mobile phone can recognize the message in response to the user's operation of clicking the control 607, wherein the mobile phone can wake up the AI ​​module by recognizing "@AI assistant". Then, the AI ​​module can respond to the "generate a schedule" instruction in the message. Figure 7d (3) The interface content of the display interface 501 shown in FIG. 5 is AI recognized to generate a schedule card 504, thereby displaying the following: Figure 7a (2) The display interface 501 shown. In this example, the operations of entering "@AI assistant" in the text box 606, entering the type of service card (here, schedule), and clicking the control 407 together constitute Figure 4 The display interface 501 and the natural language of "generate schedule" are Figure 4 An example of a processing object is shown.

[0339] In some embodiments, the mobile phone can also recognize different special symbols input by the user to generate different types of service cards through the AI ​​module. For example, the "@" symbol indicates the generation of a schedule card, the "&" symbol indicates the generation of a to-do card, and the "#" symbol indicates the generation of a video card.

[0340] In this embodiment, the mobile phone can provide the user with more triggering methods for generating service cards on the conversation interface, so that the user can flexibly select the input for instructing the generation of service cards according to needs.

[0341] In the above Figures 7a to 7d In the drawings, the same reference numerals represent the same or similar objects. Therefore, the reference numerals of the drawings are not explained one by one. The reference numerals not mentioned in the above drawings can be referred to in Figures 5a to 7d The explanations of the same figure marks mentioned in the figure will not be repeated here.

[0342] Example 4

[0343] Please refer to Figures 8 to 10 , combined with Figure 4 The mobile phone can generate to-do service cards based on the interface context and / or the natural language input by the user to communicate with the AI ​​module. The interface context may include but is not limited to: continuous dialogue, text fragments, application interface, image, video, etc.

[0344] The service card of the to-do category can display structured service information obtained by the AI ​​module through AI recognition of the processing object (such as interface context and / or natural language). By displaying the service card of the to-do category on the mobile phone, it can play the role of collecting relevant service information. And the mobile phone displays the service information directly on the service card, without the user having to obtain the service information in the favorites of the application or searching for related application information. Just by browsing the cards of the to-do category, you can quickly locate the previously collected content.

[0345] In a possible implementation, the to-do service card may be a location card. Figure 8 The figure is a schematic diagram of an exemplary application scenario.

[0346] like Figure 8 As shown in (1), the display interface 701 of the mobile phone displays some introductory information about the location "Yuyuantan Park" and the user's evaluation information. For example, if the user is interested in the location "Yuyuantan Park" and hopes to visit the park in the future, the user can collect the park so as to browse some information about the park later. In the prior art, the user can only click the control 805 in the display interface 701 to find the entrance of the collection function provided by the application program to collect the park. However, the collection list contains a lot of information. Every time the user views the collected location, he needs to find the link of the location to be browsed one by one from the collection list, and then open the link to browse the content about the location that was collected at the time. However, in actual applications, after a user collects a location, he rarely browses the previously collected content through the favorites or collection list.

[0347] To this end, the method of the present application can generate a location card for the location that the user is interested in, so that the user can find the content that he has collected before. Figure 8 As shown in (1), the user inputs "Xiaoyi, save as a card" by voice, and the mobile phone can respond to the user's voice input ( Figure 4 An example of an AI dialogue shown in the figure) wakes up the AI ​​module of the mobile phone and displays a control 502 indicating the AI ​​module; and the AI ​​module can receive a request to generate a card for the display interface 701.

[0348] It should be understood that the user can instruct the AI ​​module to generate a service card for the corresponding application interface (display interface 701 here) not only by natural language, but also by touch input and other methods, without limitation. In addition, the instruction input by the user can also include information indicating the generation of a location card.

[0349] like Figure 8 (2) As shown in FIG. Figure 8 The voice input in (1) is used to generate a service card 702 through the AI ​​module, and the generated service card 702 is previewed and displayed in the window 503. In addition, the window 503 also includes a control 703 for pinning the service card 702 on the desktop interface for display.

[0350] The AI ​​module can respond to the user's voice input to Figure 8 (1) The display interface 701 ( Figure 4 The example of an application interface as a processing object shown in the figure performs AI recognition to determine service information, where the determined service information includes: the place name is "Yuyuantan Park", the business hours of the place are "06:00 to 22:30", the address of the place is "No. 10 West Third Ring Road, Haidian District, Beijing", pictures of the place, etc.

[0351] Of course, the service information identified by the AI ​​module may not be limited to this, and may also include a summary of the user's hot comments on the place, etc. In addition, when identifying the service information, the AI ​​module may not only refer to the display interface 701, but also refer to information such as user portraits, which is not limited here. In addition, the collection of the place is taken as an example here to illustrate, but the present application does not limit the type of collection of places, and it can also be any type of place, such as restaurants, clothing stores, nail salons, schools, buildings, etc. Moreover, based on the difference in location, the service information about the place identified by the AI ​​module may also be different, and the present application does not limit this. For example, when the place is a restaurant, the identified service information may include not only the restaurant location and restaurant business hours, but also information such as the restaurant's popular dishes.

[0352] like Figure 8 As shown in (2), the AI ​​module can use Figure 8 (1) generates the service information of the display interface 701 to generate the service card 702, and displays the service card 702 in the window 503. Figure 8 As shown in (2), the service card 702 may include, but is not limited to: a control 7021 indicating the name of the place, a picture 7024 indicating the landmark of the place, a control 7022 indicating the opening hours of the place, a control 7023 indicating the address of the place, etc.

[0353] Then, the user clicks Figure 8 (2) The control 703 shown, the mobile phone can respond to the user operation, such as Figure 8 As shown in (3), the service card 702 is displayed in the display interface 201, wherein the display interface 201 is a desktop interface.

[0354] It should be understood that Figure 8 The service card 702 previewed in (2) may differ from the service card 702 pinned on the desktop in terms of card style, layout of card information, card size, level of detail and richness of card information, and any other information. The mobile phone may flexibly set the service card 702 pinned on the desktop interface based on information such as the size of the display space on the desktop interface used to display the service card 702, and this application does not impose any restrictions on this.

[0355] Optionally, the service card generated by this application can be an interactive service card. Figure 8 In an embodiment, the service card 702 can be used to navigate to a location through interaction.

[0356] For example, Figure 8 As shown in (3), the user clicks the control 7023 in the service card 702, and the mobile phone can respond to the user operation and navigate to the favorite location "Yuyuantan Park". For example, the mobile phone can respond to the user operation and display the following Figure 8 (4) The display interface 706 shown in the figure may include but is not limited to a map preview control 705 and a control 706. The map preview control 705 displays a map preview screen near Yuyuantan Park. The control 706 displays information such as the distance from the current location of the mobile phone to the park (here 15 km), the navigation time (here 30 minutes), and a control 7061. The control 7061 displays the text "View route".

[0357] For example, a user clicks Figure 8 (4) The control 7061 shown in FIG. 4 , the mobile phone can open the installed map application and display map information of the navigation route from the current location of the mobile phone to the address of the Yuyuantan Park, so as to facilitate the user to navigate to the park.

[0358] In other embodiments, when the user clicks Figure 8 (3) After the control 7023 shown in FIG. 5 is pressed, the mobile phone can also directly start the installed map application in response to the user operation, and display the map information of the navigation route from the current location of the mobile phone to the address of the Yuyuantan Park, so as to facilitate the user to navigate to the park.

[0359] This application aims to express the generated place cards (e.g. Figure 8 The service card 702 shown in the figure can be used for navigation, and the specific method and process of realizing navigation are not limited and can be flexibly set according to the actual application scenario and the functions supported by the map application.

[0360] In an embodiment of the present application, regardless of whether the application installed on the mobile phone supports the function of providing a service card, the present application can generate a service card (such as a location card here) based on the application interface of the application based on user operations, so as to realize the collection of relevant information within the application (here is the relevant information of the location).

[0361] In a possible implementation, the to-do service card may also be a contact card. Fig. 9 The figure is a schematic diagram of an exemplary application scenario.

[0362] like Fig. 9 As shown in (1), the display interface 801 of the mobile phone is a user's conversation interface, which includes a conversation message 809. The content of the conversation message 809 is "Your father is in a bad mood recently. Take some time to call him." The user long presses the conversation message 809, and the mobile phone can respond to the user's operation and display the following Fig. 9 (2) The display interface 801 shown. Fig. 9 As shown in (2), the mobile phone may display a control 802 near the conversation message 809, and the control 802 may include but is not limited to the following options: option 8021, option 8022, option 8023, and option 8024.

[0363] Among them, option 8021 is used to wake up the AI ​​module to conduct an AI dialogue with the AI ​​module; option 8022 is used to generate a service card for the conversation message 809; option 8023 is used to copy the text of the conversation message 809; option 8024 is used to cut the text of the conversation message 809.

[0364] Then, if Fig. 9 As shown in (2), the user clicks option 8022, such as Figure 8 As shown in (3), the mobile phone can generate a service card 803 through the AI ​​module in response to the user operation. Then, the mobile phone can Fig. 9 (2) The display interface 801 shown in FIG. 8 shows a window 503 , in which a preview of the generated service card 803 is displayed, and in which a control 703 is displayed.

[0365] The AI ​​module can respond to the user's voice input to Fig. 9 The conversation message 809 shown in (2) is AI-recognized to determine the semantics as "waiting to call dad". Based on the semantics, service information can be determined to generate the following: Fig. 9 (3) Service card 803 shown.

[0366] like Fig. 9As shown in (3), since the semantics recognized by the AI ​​module is a to-do item of calling dad, in order to make the service card 803 generated in this embodiment interactive, a contact card can be generated as the service card 803. The service card 803 may include controls 8031, 8032, 8033, and 8034.

[0367] Among them, control 8031 ​​is the relevant information of the contact avatar of the mobile phone user's father; control 8034 is the text of the message content referenced by the service card 803 (or it can also be the summary or semantics of the message content, etc.).

[0368] Control 8032 may be used to call a telephone interface (which may also be a voice call interface) to initiate a telephone call request to "Dad"; control 8033 may be used to call a video call interface to initiate a video call request to "Dad".

[0369] Then, the user clicks Fig. 9 (3) The control 703 shown, the mobile phone can respond to the user operation, such as Fig. 9 As shown in (4), the service card 803 is displayed in the display interface 201, wherein the display interface 201 is a desktop interface.

[0370] It should be understood that Fig. 9 The service card 803 previewed in (3) may differ from the service card 803 pinned to the desktop in terms of card style, layout of card information, card size, level of detail and richness of card information, and any other information. The mobile phone may flexibly set the service card 803 pinned to the desktop interface based on information such as the size of the display space used to display the service card 803 on the desktop interface, and the present application does not impose any restriction on this.

[0371] In this embodiment, the service card 803 generated by the mobile phone is an interactive service card. For example, when a user clicks Fig. 9 (3) or Fig. 9 (4) The control 8032 shown in the figure, the mobile phone can respond to the user operation to call the telephone interface (or the voice call interface) to initiate a telephone call request to "Dad" to realize the voice call between the user and "Dad". Alternatively, the user can also click Fig. 9 (3) or Fig. 9 As shown in control 8033 of (4), the mobile phone can call the video call interface to initiate a video call request to "Dad" in response to the user operation.

[0372] about Fig. 9 Regarding the embodiments Figure 4 The preset inputs shown may include Fig. 9 (1) shows a long press operation on the conversation message 809, and Fig. 9 (2) clicking on option 8022 shown, and Fig. 9 Regarding the embodiments Figure 4 The processing object shown may include the message content of the conversation message 809.

[0373] Thus, in the embodiment of the present application, the mobile phone can perform AI recognition on the conversation message based on the user's target input for AI recognition of the conversation message to generate a contact card. Thus, the collection record of the to-do items related to the conversation message can be realized by generating a contact card, so as to prevent the user from forgetting the to-do items (here, talking to dad). In addition, the contact card is interactive, and the user can directly make a phone call or video call of the to-do item (here, the to-do item for making a phone call) through the contact card, which can reduce the user's operation of searching for the corresponding contact in the call application to make a phone call or video call.

[0374] In some embodiments, when the user clicks Fig. 9 (3) or Fig. 9 (4) When the control 8034 shown in FIG. 4 is displayed, the mobile phone can also respond to the user operation and switch the display interface of the mobile phone to Fig. 9 (1) and locates and displays the location of the conversation message 809 in the display interface 801.

[0375] In this way, after the present application generates a service card based on the processing object, the user can also perform specific operations on the service card to locate the display position of the processing object on which the service card was generated, thereby making the service card generated by the present application traceable.

[0376] It should be understood that in each embodiment of the present application, the generated service cards can be traceable, and the implementation principle is the same as that of Fig. 9 The description of the related methods of the embodiment is similar and will not be repeated here. In addition, the above-mentioned specific operation for tracing is not limited to the operation on the service card, such as clicking a certain control in the service card (such as Fig. 9 (4) The control 8034 shown) can also be other touch inputs, and / or AI dialogue inputs, etc.

[0377] In a possible implementation, the to-do service card may be an excerpt card. Fig.10 The figure is a schematic diagram of an exemplary application scenario.

[0378] like Fig.10 As shown in (1), the display interface 804 of the mobile phone displays an article titled "Title 2". The display interface 804 may include one or more controls, and the control may include control 805. Fig. 9Regarding the introduction of control 805 in the embodiment, when the user is interested in the article displayed in the display interface 804 and hopes to collect it, in the prior art, the user can click control 805 to collect the link of the article. However, after the article is collected, it is difficult for the user to see it intuitively on the mobile phone interface. Basically, the article will not be read after it is collected, which makes the usability of the existing collection function extremely poor. In addition, the existing collection function does not support collecting part of the content (text or pictures, etc.) of the article.

[0379] In the embodiment of the present application, the user can Fig.10 In the article displayed on the display interface 804 shown in (1), text is selected. The selected text is indicated by a mark 806. The present application does not limit the display method of the selected text.

[0380] The mobile phone can respond to the user operation and display a control 802 near the text (for details, refer to Fig. 9 Then, the user clicks on the control 8022 in the control 802, such as Fig.10 As shown in (2), the mobile phone can perform AI recognition on the text indicated by the mark 806 in response to the user operation to generate a service card 807, and display the service card 807 in the window 503. In addition, the window 503 also includes but is not limited to: a control 808, and a control 703, etc.

[0381] The service card 807 may include but is not limited to: a control 8071 and a control 8072. The control 8071 is used to indicate the title of the article where the selected text is located, here "Title 1"; the control 8072 is used to indicate the user in Fig.10 (1) The text selected.

[0382] Then, the user clicks Fig.10 (2) The control 703 shown in FIG. 1 shows that the mobile phone can respond to the user operation by displaying Fig.10 (3) The display interface 201 (a desktop interface) shown in FIG. 2 may include the service card 807 pinned to the desktop. In addition, the display interface 201 may also include Figure 8 The service card 702 generated by the embodiment and Fig. 9 The service card 803 generated by the embodiment enables the desktop interface to display multiple service cards generated by the method of the present application.

[0383] In some embodiments, after the window 503 is displayed for a preset time, if no user operation is received on the window 503, the mobile phone can cancel the display of the window 503, so that the generated service card 807 is only temporarily displayed, and the service card is not generated in the corresponding application to which the corresponding processing object belongs, nor is the service card displayed on the desktop interface. The solution of this embodiment is also applicable to the service cards generated by other embodiments of the present application, and the principles are similar, so they will not be repeated one by one.

[0384] In some embodiments, when the user does not need to collect the above text temporarily, the user can click control 808 to close the window 503 on the mobile phone and no longer display the service card 807, thereby not collecting the above text in the form of a summary card. The solution of this embodiment is also applicable to the service cards generated by other embodiments of the present application, and the principles are similar, so they will not be described one by one.

[0385] In the embodiment of the present application, when one or more objects are of interest in any application, the object may be Fig.10 The text described in the embodiment may also be a picture, or a video, or an icon, etc., which is not limited here. The user can trigger the target input indicating AI recognition so that the mobile phone can generate a specific type of service card (such as a summary card, a picture card, a video card, etc.) that matches the object through the AI ​​module, so as to achieve the purpose of collecting the object. For example, the mobile phone collects a video selected by the user to generate a video card, and the video card can be used to play the video collected by the user. The present application collects objects of interest to the user in the form of service cards, which can help the user browse the collected content again.

[0386] Optionally, the mobile phone can also position the display interface to the display interface when the user collects the object (such as the video) based on the user's specific operations, such as the playback interface of the video (such as the playback interface of the corresponding video application for the video), so as to realize the traceability function of the service card of the present application.

[0387] In the above Figures 8 to 10 In the drawings, the same reference numerals represent the same or similar objects. Therefore, the reference numerals of the drawings are not explained one by one. The reference numerals not mentioned in the above drawings can be referred to in Figures 5a to 10 The explanations of the same figure marks mentioned in the figure will not be repeated here.

[0388] Example 5

[0389] Please refer to Figure 11a to Figure 11b , combined with Figure 4The mobile phone can generate service information according to natural language (text or voice, etc.) related to AI, and generate a comparison card based on the service information. The comparison card may include service information related to multiple search results (such as comparison information of search results), where the multiple search results are the search results of multiple applications for the same object.

[0390] In one possible implementation, Fig.11a The figure is a schematic diagram of an exemplary application scenario.

[0391] like Fig.11a As shown in (1), the display interface 901 of the mobile phone includes multiple controls, wherein the display interface 901 is a desktop interface. The multiple controls may include but are not limited to: service card 702, service card 203, service card 504, and control 903. Among them, control 903 is used to interact with the AI ​​module. Among them, control 903 may include but is not limited to: control 9031 and control 9032, etc.

[0392] For example, the user can enter text in the blank area of ​​control 903 to interact with the AI ​​module; for another example, the user can also interact with the AI ​​module by voice input by clicking control 9032 in control 903; for another example, the user can also interact with the AI ​​module by taking an image by clicking control 9031 in control 903. For example, when the user clicks control 9031, the mobile phone can open the camera application to take a photo, and provide the taken picture or video to the AI ​​module for AI recognition.

[0393] like Fig.11a As shown in (2), the user enters text 9033 in control 903. By enlarging text 9033, it can be seen that the user enters the text "Help me find the price of P60 at e-commerce 1 and e-commerce 2". The text entered by the user is relatively long and its length exceeds the maximum length of text that can be displayed in control 903. Therefore, Fig.11a The control 903 shown in (2) may only display part of the input text, such as "see the price of P60 at e-commerce 1 and e-commerce 2". Fig.11a (1) After the user enters text in control 903, the mobile phone can switch the control 9031 displayed in control 903 to Fig.11a (2) Control 9034 shown.

[0394] Then, the user clicks Fig.11a(2) As shown in the control 9034, the mobile phone can respond to the user operation and call the AI ​​module to perform AI recognition on the input text 9033 to determine the user intention. The user intention here is to search for the price information of the same object "Huawei Mobile Phone P60" in Application 1 corresponding to e-commerce 1 and Application 2 corresponding to e-commerce 2.

[0395] Among them, this application does not limit the price screening conditions (such as the latest month, the lowest price, the highest price, the current price, etc.) used when searching for the price information of the Huawei mobile phone P60 in e-commerce 1 and e-commerce 2, and can be flexibly determined according to user portraits or real-time scenarios. For example, in other embodiments, the mobile phone can only search for the current price information of the Huawei mobile phone P60 sold in application 1 and application 2.

[0396] For example, in this Fig.11a In an embodiment, based on the above user intent, the AI ​​module can search in Application 1 for price information of Huawei mobile phone P60 in the past month, as well as the lowest price in the past month, the highest price in the past month, and the current price, etc.

[0397] And the AI ​​module can search for the price information of Huawei mobile phone P60 in the past month, the lowest price in the past month, the highest price in the past month, and the current price in Application 2 based on the above user intention.

[0398] Then, the AI ​​module can use the price search results for the same object in the two applications to generate information on the price change trend of the Huawei P60 mobile phone in the past month, as well as service information such as the lowest price of the mobile phone in e-commerce 1 (here is RMB 4,280) and the lowest price of the mobile phone in e-commerce 2 (here is RMB 4,380), thereby generating a service card 904 (a comparison card).

[0399] like Fig.11a (3) As shown in the figure, the mobile phone can respond to the user clicking Fig.11a (2) The control 9034 shown in FIG. 2 is operated, and the control 902 and the generated service card 904 are displayed in the control 902 to indicate that the service card 904 is associated with the control 902. Fig.11a As shown in (3), the service card 904 may include but is not limited to: a picture 9041 for indicating the product image of Huawei mobile phone P60, a control 9042, a control 9043, a control 9044, a control 9045, a control 9046, etc.

[0400] Among them, control 9042 is information on the price change trend of the Huawei mobile phone P60 in the past month generated based on the AI ​​module, and a price change curve chart of the price of the mobile phone sold on the above two e-commerce platforms is generated.

[0401] Control 9043 is used to indicate the lowest price of the mobile phone sold in e-commerce 1 in the past month. Control 9044 is used to open and display the application interface of application 1 corresponding to e-commerce 1. The application interface can be the product details interface of Huawei P60 in the application 1, etc., and there is no limitation here.

[0402] Control 9045 is used to indicate the lowest price of the mobile phone sold in e-commerce 2 in the past month, and control 9046 is used to open and display the application interface of application 2 corresponding to e-commerce 2. The application interface can be the product details interface of Huawei P60 in the application 2, etc., and there is no limitation here.

[0403] In this way, the present application can determine the search object and multiple applications to be searched based on the natural language input by the user indicating AI recognition, and then generate a comparison card with information about the search object based on the search results of the search object in the multiple applications. In this way, it is possible to request search results on multiple applications for the same object, and generate comparison cards related to the search results of multiple applications through the AI ​​module.

[0404] Among them, the natural language Fig.11a In the embodiment, it is text. In other embodiments, it can also be voice, or picture, or any two of the three or a combination of the three. For example, if the search object is a picture (such as a picture of Huawei P60) and a voice (such as searching for the prices of e-commerce 1 and e-commerce 2), the mobile phone of the present application can also display the following: Fig.11a (3) Service card 904 shown.

[0405] In one possible implementation, Fig.11b The figure is a schematic diagram of an exemplary application scenario.

[0406] The phone displays Fig.11a After generating the service card 904, as shown in the application scenario Fig.11b As shown in (1), the user continues to add the input text "Add e-commerce 3" in control 903, so that the text input by the user is updated to "Help me find out the price of P60 in e-commerce 1 and e-commerce 2, and add e-commerce 3", refer to Fig.11b (1) The enlarged text 9033 is shown.

[0407] Then, the user clicks Fig.11bIn the control 9034 shown in (1), the mobile phone can respond to the user operation and call the AI ​​module to perform AI recognition on the input updated text 9033 (or the above-mentioned newly input text) to determine the user intention, which is: searching for the price information of the same object "Huawei Mobile Phone P60" in Application 1 corresponding to e-commerce 1, Application 2 corresponding to e-commerce 2, and Application 3 corresponding to e-commerce 3.

[0408] The phone can respond to the above Fig.11b The user operation of (1) searches for the price information of Huawei mobile phone P60 in the last month, as well as the lowest price in the last month, the highest price in the last month, and the current price in the application 3 corresponding to the e-commerce 3, to obtain the price search results.

[0409] The phone can then read the Fig.11a In the process of searching, the price search results of Huawei mobile phone P60 in e-commerce 1 and e-commerce 2 have been searched by the AI ​​module, and combined with the price search results searched in application 3 corresponding to e-commerce 3, the price change trend information of Huawei mobile phone P60 in the past month is generated (which can be combined with Fig.11a The price change trends of the two e-commerce platforms generated by the embodiment are different), as well as the lowest price of the mobile phone in e-commerce 3 (here RMB 4480), the lowest price of the mobile phone in e-commerce 1 (here RMB 4280), and the lowest price of the mobile phone in e-commerce 2 (here RMB 4380) and other service information, thereby generating the following Fig.11b (2) Service card 904 (a comparison card) shown.

[0410] Among them, about Fig.11b In the embodiment, the service information generated about the lowest price of the Huawei P60 mobile phone in e-commerce 1 and e-commerce 2 does not need to be regenerated here, but the cached information can be directly read. Fig.11a The information obtained in the embodiment about the lowest price of the Huawei P60 mobile phone at e-commerce 1 and e-commerce 2 respectively.

[0411] like Fig.11b (2) As shown in the figure, the mobile phone can respond to the user clicking Fig.11b (1) The control 9034 shown in FIG. 1 is operated, and the generated service card 904 is displayed in the control 902. Fig.11b (1) The service card 904 shown, Fig.11bThe service card 904 shown in (2) has newly added controls 9047 and 9048. In addition, the price change curve shown in control 9042 is a price change curve of the price of the Huawei mobile phone P60 sold on the above three e-commerce platforms generated based on the AI ​​module's comprehensive information on the price change trend of the above three e-commerce platforms in the past month. Fig.11a and Fig.11b The control 9042 shown in (1) only expresses the cancellation chart of the price changes of the Huawei P60 sold by e-commerce 1 and e-commerce 2 in the past month.

[0412] like Fig.11b As shown in (2), the control 9047 is used to indicate the lowest price of the mobile phone sold in e-commerce 3 in the past month, and the control 9048 is used to open and display the application interface of application 3 corresponding to e-commerce 3. The application interface can be the product details interface of Huawei P60 in the application 3, etc., which is not limited here.

[0413] In addition, compared with Fig.11b (1) The service card 904 shown and Fig.11b (2) The service cards 904 shown may differ in card style, card size, card information, etc.

[0414] Alternatively, if Fig.11b (2) As shown, the size of the service card 904 is compared to Fig.11b (1) The service card 904 shown is larger in size, so that Fig.11b (2) The height of the control 902 shown has also been increased, so that the control 904 can be displayed on top of the service card 702 to focus on displaying the information of the comparison card (here, the service card 904) that the user is currently focusing on.

[0415] In this way, after the mobile phone generates a comparison card for the natural language input by the user through the AI ​​module, when the user supplements the request to search for the search object related to the comparison card on other applications, the mobile phone can continue to search for related search results of the search object on other applications through the AI ​​module, and update the generated comparison card based on the search results of the search object on other newly added applications, so that the comparison card can match the user's comparison request.

[0416] In some embodiments, regardless of Fig.11a still Fig.11b For the service card 904 generated in the embodiment, the mobile phone can also provide a control in the control 902 for pinning the service card 904 on the desktop for display, so that the user can quickly display the generated service card 904 on the desktop by operating the control, so that the user can browse the comparison content of the comparison card later.

[0417] It should be understood that the type of search objects in the scenario of generating comparison cards is not limited to electronic products (such as the above-mentioned Huawei mobile phone P60), but can also be objects such as air tickets and hotels. The objects can be flexibly set according to user needs, and this application does not impose any restrictions on this.

[0418] In the above Figure 11a to Figure 11b In the drawings, the same reference numerals represent the same or similar objects. Therefore, the reference numerals of the drawings are not explained one by one. The reference numerals not mentioned in the above drawings can be referred to in Figures 5a to 11b The explanations of the same figure marks mentioned in the figure will not be repeated here.

[0419] Example 6

[0420] Please refer to Fig.12 , combined with Figure 4 , the mobile phone can generate service information according to natural language (text or voice, etc.) related to AI, and generate a personalized service card based on the service information. Among them, the personalized setting can be a setting option that does not provide a setting operation interface (or setting operation entry) in the application setting or the mobile phone system setting. Then the user can input the personalized setting requirements for the application or the mobile phone system into the mobile phone through natural language in the form of custom rules, so that the mobile phone can generate a personalized service card that meets the custom rules based on the natural language through the AI ​​module, and apply the personalized setting to the corresponding application setting, or to the system setting of the mobile phone.

[0421] exist Fig.12 In the embodiment, a user request to set a personalized alarm is taken as an example to illustrate the process of personalizing the alarm application based on the user's natural language and generating a service card related to the personalized setting.

[0422] In one possible implementation, Fig.12 The figure is a schematic diagram of an exemplary application scenario.

[0423] like Fig.12 As shown in (1), the display interface 901 of the mobile phone includes multiple controls, which may include but are not limited to: service card 702, service card 203 and service card 504 located in control 500, and control 903 (for specific functions, refer to Fig.11a ).

[0424] like Fig.12As shown in (1), the user enters text 9035 in control 903. Referring to the enlarged text 9035, the input text is "Set an alarm to wake up on the last Saturday of the month". Then, the user clicks control 9034. In response to the user operation, the mobile phone can call the AI ​​module to perform AI recognition on the input text 9035 to determine the user's intention. The user's intention here is: add a new alarm to the alarm application, the alarm time of the new alarm is the same as the alarm time for getting up on weekday mornings (for example, 7:30 am), and the alarm date of the new alarm is the last Saturday of each month starting from today.

[0425] Then, based on the user intent, the AI ​​module can identify the dates of the last Saturday of each month after June 1, 2023 (e.g., June 24, 2023, July 29, 2023, August 26, 2023, etc.), and determine that the alarm time to be set for these dates is 7:30 am.

[0426] Next, the AI ​​module can use the identified alarm date and alarm time information to generate a service card 905, and Fig.12 (2) The display interface 901 shows a window 503. The window 503 may include, but is not limited to, a control 9051, a control 9052, a service card 905, and a control 9055.

[0427] Among them, control 9051 is used to indicate that the display information in window 503 is the content obtained through AI recognition.

[0428] Control 9052 displays the text "The next Saturday at the end of the month is 6.24, and the alarm will be set according to your wake-up time on weekdays."

[0429] Control 905 may include, but is not limited to: text 9053 and text 9054 .

[0430] Among them, text 9053 indicates that the alarm time to be set is 7:30 a.m. The text content of text 9054 is "According to your recent habits, the default setting of the weekday wake-up alarm is set for the last Saturday of each month. You can cancel the alarm setting on the alarm page."

[0431] Then, the user clicks on control 9055 , and the AI ​​module of the mobile phone can respond to the user operation by calling the alarm application to set an alarm at 7:30 am for the last Saturday of each month and cancel the display of window 503 .

[0432] And, the phone can respond to the user clicking Fig.12(2) The user operates the control 9055 shown in FIG. 1 , or the user independently starts the alarm application to open its application interface, so that the mobile phone can display the application interface 906 of the alarm application. The application interface 906 may include multiple controls, which may include but are not limited to: clock control 9061, control 908, control 907, control 909, control 910, etc.

[0433] Among them, the clock control 9061 is a dynamic electronic clock that indicates the current time.

[0434] Among them, control 910 is used to add an alarm.

[0435] Controls 908, 907, and 909 all indicate an alarm in an activated state, and their functions are similar. Taking control 908 as an example, control 908 may include controls 9081, 9082, and 9083, wherein control 9081 is used to indicate that the alarm time is 7:30 a.m., control 9082 is used to indicate that the alarm date is 9082, and control 9083 is used to indicate that the alarm is in an activated state.

[0436] Control 9071 in control 907 , control 9091 in control 909 , and control 9081 in control 908 have similar functions.

[0437] The functions of control 9072 in control 907 , control 9092 in control 909 , and control 9082 in control 908 are similar.

[0438] Control 9073 in control 907 , control 9093 in control 909 , and control 9083 in control 908 have similar functions.

[0439] Among them, the weekday alarm indicated by the control 908 is the user's Fig.12 Before entering the text 9035 in (1), set a new alarm in the Alarm app.

[0440] Among them, as described above, the AI ​​module recognizes that the last Saturday of June 2023 is June 24th. Therefore, the AI ​​module of the mobile phone adds an alarm to the alarm application at 7:30 am on June 24th indicated by control 907.

[0441] Furthermore, the AI ​​module recognizes that the last Saturday of July 2023 is July 29, so the AI ​​module of the mobile phone adds an alarm to the alarm application at 7:30 a.m. on July 29, as indicated by control 909.

[0442] Considering here that the display space of the application interface 906 of the alarm application is not enough to accommodate the control display of the wake-up alarm on the last Saturday of each month after June 1, 2023, the mobile phone can only display the controls for the early wake-up alarm on the last Saturday of the month for the last two months (such as controls 907 and controls 909). The present application does not limit the number of alarm controls (such as controls 907 and controls 909) displayed by the mobile phone in the application interface of the alarm application in accordance with the user's personalized settings, and can also display the controls for the early wake-up alarm on the last Saturday of the month for more than two months in a folded manner.

[0443] Optionally, in some embodiments, after the mobile phone responds to the user's operation of setting a personalized alarm and sets the personalized alarm for the alarm application, the mobile phone can also provide a closing entry for the personalized alarm in the setting interface of the alarm application or the system setting interface of the mobile phone, such as a similar Fig.12 (3) The switch option of the control 9073 shown in the figure can control the on and off of the wake-up alarm for Saturday at the end of the month. In this way, when the user does not need the personalized alarm set this time (the alarm for 7:30 on Saturday at the end of the month), the personalized alarm can be turned off through the above switch option of the corresponding interface. In response to the user's operation on the switch option, the mobile phone can turn off all the personalized alarms of 7:30 on the morning of the end of the month in the alarm application, so that Fig.12 The controls 907 and 909 shown in (3) are no longer displayed on the application interface 906.

[0444] Optionally, in the above Fig.12 (2), the mobile phone can also display in window 503 such as Figure 7a (2) The control 5052 shown in FIG. 1 provides a function of pinning the service card 905 on the desktop interface to keep it displayed. Fig.12 (2) When the operation of pinning the service card 905 to the desktop is triggered in the display interface 901 shown, the mobile phone can also respond to the user operation and apply (or take effect) the corresponding personalized alarm to the alarm setting of the alarm application to add a wake-up alarm on the last Saturday of each month.

[0445] Above Fig.12 The embodiment takes setting a personalized alarm as an example to describe a specific process of setting a personalized alarm for an alarm application based on a user's natural language.

[0446] Similarly, applications that support personalized settings are not limited to alarm applications, but can also be call applications (such as telephone applications or video call applications, etc.). For example, a user inputs through natural language "Click the phone screen three times in a row to make an emergency call", where the user has pre-set emergency contacts in the call application of the mobile phone (such as police phone 110, family emergency contacts, etc.). Then, after receiving the above natural language input, the mobile phone can perform the following personalized call settings on the call application: three consecutive clicks on the mobile phone screen can trigger a call to the emergency contact. In addition, the mobile phone can also generate a service card for the personalized call setting in response to the natural language input. The specific implementation process is the same as above. Fig.12 The embodiments are similar and will not be described again here.

[0447] In other embodiments, the personalized settings and the method for generating a personalized service card supported by the present application can also be applied to the processing of personalized settings for a mobile phone system.

[0448] For example, the incoming call settings of a mobile phone system only have the setting options of ringing and vibrating. However, when a user is in a meeting or other situation where it is inconvenient to answer a call, he or she hopes to temporarily adjust the reminder setting of the incoming call to screen flash by flipping the phone downward to avoid the phone's incoming call reminder being a ring or vibration that would disturb the meeting. When the user flips the phone upward, the reminder setting of the incoming call is restored to the original setting (such as ringing or vibrating). Among them, flipping the phone downward refers to flipping the phone screen from an upward state to a downward state, and flipping the phone upward refers to flipping the phone screen from a downward state to an upward state.

[0449] In one embodiment, the user inputs "flip the screen down to flash a reminder for incoming calls" through natural language. After receiving the above natural language input, the mobile phone can use the AI ​​module to perform the following personalized settings on the mobile phone system: flipping the mobile phone screen down can trigger a reminder of incoming calls by flashing the screen. In addition, the mobile phone can also respond to the natural language input and generate a service card for the personalized mobile phone system settings. The specific implementation process is as follows Fig.12 The embodiments are similar and will not be described again here.

[0450] In the above Fig.12 In, with Figures 5a to 11b The same figure marks between any figures represent the same or similar objects. Therefore, the figure marks of each figure are not explained one by one. They can be referred to each other and will not be repeated here.

[0451] It is understandable that, in order to realize the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.

[0452] In one example, Fig.13 A schematic block diagram of a device 300 according to an embodiment of the present application is shown. The device 300 may include: a processor 301 and a transceiver / transceiver pin 302 , and optionally, a memory 303 .

[0453] The components of the device 300 are coupled together via a bus 304, wherein the bus 304 includes a power bus, a control bus, and a status signal bus in addition to a data bus. However, for the sake of clarity, all buses are referred to as bus 304 in the figure.

[0454] Optionally, the memory 303 may be used for instructions in the aforementioned method embodiment. The processor 301 may be used to execute instructions in the memory 303, and control the receiving pin to receive a signal, and control the sending pin to send a signal.

[0455] The apparatus 300 may be the electronic device or a chip of the electronic device in the above method embodiment.

[0456] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here.

[0457] This embodiment further provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the processing method in the above-mentioned embodiment.

[0458] This embodiment further provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the processing method in the above-mentioned embodiment.

[0459] In addition, an embodiment of the present application also provides a device, which may specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer execution instructions, and when the device is running, the processor may execute the computer execution instructions stored in the memory so that the chip executes the processing methods in the above-mentioned method embodiments.

[0460] Among them, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above and will not be repeated here.

[0461] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0462] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0463] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0464] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0465] Any content of each embodiment of the present application, as well as any content of the same embodiment, can be freely combined. Any combination of the above content is within the scope of the present application.

[0466] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0467] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

[0468] The steps of the method or algorithm described in conjunction with the disclosure of the embodiments of the present application can be implemented in a hardware manner, or can be implemented by a processor executing a software instruction. The software instruction can be composed of corresponding software modules, and the software module can be stored in a random access memory (Random Access Memory, RAM), a flash memory, a read-only memory (Read Only Memory, ROM), an erasable programmable read-only memory (Erasable Programmable ROM, EPROM), an electrically erasable programmable read-only memory (Electrically EPROM, EEPROM), a register, a hard disk, a mobile hard disk, a read-only compact disk (CD-ROM) or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in a network device. Of course, the processor and the storage medium can also be present in a network device as discrete components.

[0469] Those skilled in the art should be aware that in one or more of the above examples, the functions described in the embodiments of the present application can be implemented with hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein the communication media include any media that facilitates the transmission of a computer program from one place to another. The storage medium can be any available medium that a general or special-purpose computer can access.

[0470] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A processing method, characterized in that: Applied to electronic equipment, the method comprises: In response to a received first user operation on a first control, generating a first service card based on the first control, wherein the first control is a movable control, and the first service card includes first card information related to control content of the first control; The first service card is displayed.

2. The method according to claim 1, characterized in that The displaying the first service card includes: The displayed first control is refreshed to the first service card.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: In response to receiving a second user operation on the first service card, displaying the first service card on the desktop interface.

4. The method according to any one of claims 1 to 3, characterized in that The first card information is also related to at least one of a user portrait and a user habit.

5. The method according to any one of claims 1 to 4, characterized in that: The control type of the first control includes one of the following: Notification messages, floating controls, and transfer station controls.

6. The method according to claim 5, characterized in that The control type of the first control is the notification message, and the first user operation includes at least one of the following: a pull-down operation, a long press operation, and a sliding operation.

7. The method according to claim 6, characterized in that The displaying the first service card includes: The first service card is displayed in a floating manner above a second control, wherein the control type of the second control is the same as the control type of the first control.

8. The method according to claim 5, characterized in that The control type of the first control is the floating control or the transfer station control, the first user operation includes: an operation of dragging the first control to a first position on the desktop interface, and the method further includes: In response to the first user operation, displaying a first area on the desktop interface, where the first area is an area to display the first service card, and the first area includes the first position; The displaying the first service card includes: The first service card is displayed in the first area, and the first area is canceled.

9. The method according to any one of claims 1 to 8, characterized in that After displaying the first service card, the method further includes: In response to the received third user operation, switching the display interface to the first interface; The first interface is an application interface that receives the first user operation performed on the first control.

10. The method according to any one of claims 1 to 9, characterized in that The method further comprises: In response to a fourth user operation received, generating respective second service cards based on the plurality of third controls, wherein the fourth user operation includes an instruction to perform an operation on the plurality of third controls of the same control type, at least one of the third controls is a movable control, and each of the second service cards includes second card information related to the control content of the corresponding third control; A plurality of the second service cards are displayed.

11. The method according to any one of claims 1 to 10, characterized in that The method further comprises: In response to a fifth user operation received on the display interface, generating a third service card based on the context of the display interface, wherein the third service card includes third card information related to the context; The third service card is displayed.

12. The method according to claim 11, characterized in that The context of the display interface includes at least one of the following: Conversation message, text segment selected by the fifth user operation instruction, application interface, image, video, etc.

13. The method according to claim 11 or 12, characterized in that: The third card information is also related to at least one of a user portrait and a user habit.

14. The method according to any one of claims 1 to 13, characterized in that The method further comprises: In response to the received first user input, a fourth service card is generated, wherein the first user input includes information indicating that the same object is searched in multiple first applications, and the fourth service card includes fourth card information related to multiple first search results, wherein the multiple first search results are respective search results of the multiple first applications for the same object; The fourth service card is displayed.

15. The method according to claim 14, characterized in that After displaying the fourth service card, the method further includes: In response to the received second user input, refreshing the fourth card information displayed on the fourth service card; The second user input includes information indicating a search for the same object in the multiple first applications and the second application, and the refreshed fourth card information also includes information related to the second search result, wherein the second search result is a search result of the second application for the same object.

16. The method according to any one of claims 1 to 15, characterized in that The method further comprises: generating a fifth service card in response to a received third user input, wherein the third user input includes information indicating that a first setting is to be performed on a third application or system, and the fifth service card includes fifth card information related to the first setting; The fifth service card is displayed.

17. The method according to claim 16, characterized in that After displaying the fifth service card, the method further includes: The first setting is configured to the third application or the system.

18. A processing device, characterized in that: The device comprises: A first generating module, configured to generate a first service card based on a first control in response to a received first user operation on the first control, wherein the first control is a movable control, and the first service card includes first card information related to control content of the first control; The first display module is used to display the first service card.

19. An electronic device, characterized in that: include: a memory and a processor, the memory and the processor being coupled; The memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the processing method as described in any one of claims 1 to 17.

20. A computer-readable storage medium, characterized in that: It comprises a computer program, and when the computer program is run on an electronic device, the electronic device executes the processing method as claimed in any one of claims 1 to 17.

21. A computer program product comprising instructions, characterized in that When the computer program product is executed on a computer, the computer is enabled to execute the processing method according to any one of claims 1 to 17.

22. A chip, characterized in that: It comprises one or more interface circuits and one or more processors; the interface circuit is used to receive a signal from a memory of an electronic device and send the signal to the processor, wherein the signal includes a computer instruction stored in the memory; when the processor executes the computer instruction, the electronic device executes the processing method described in any one of claims 1 to 17.

Images