Information processing method and related device

Abstract

The invention provides an information processing method and a related device, when the method is implemented, an electronic device can display any door interface, the any door interface can comprise one or more multi-intention service icons, and one or more multi-intention service icons can be displayed through the multi-intention service icons. A user can enable the electronic equipment to efficiently and quickly transmit information to a plurality of application services at the same time through simple operation, operation steps needed by the user for completing information cross-application transmission can be effectively reduced, and the interaction efficiency between the user and the electronic equipment is improved.

Description

Information processing method and related apparatus TECHNICAL FIELD

[0001] The present application relates to the field of terminal information transmission, and in particular to an information processing method and related apparatus. BACKGROUND

[0002] With the continuous development of electronic information technology, smart devices such as mobile phones and tablets have become indispensable products in our daily life, work and entertainment. In the process of using smart devices, users usually open multiple applications in the smart device to work together, and often have the need to transfer information obtained from one application to multiple other applications simultaneously. For example, when a user receives a picture of a product from WeChat, he or she may open Jingdong and Taobao to search for the product to compare the preferential strength of different shopping platforms. For another example, after a user obtains a schedule message from a social software, he or she needs to open a calendar to create a schedule and open a map application to search and view the distance to the location contained in the schedule information.

[0003] However, when a user needs to transfer information to multiple applications, he or she usually needs to perform a series of complex operations such as copying information and switching applications to complete the information transmission. Such information transmission method makes the interaction between the user and the smart device inefficient, and seriously affects the user experience.

[0004] Therefore, it is necessary to study a more efficient and convenient information processing method.

[0005] SUMMARY

[0006] The present application aims to provide an information processing method and related apparatus. By implementing the method, an electronic device can display an arbitrary door interface, which can include one or more multi-intent service icons. Through the multi-intent service icons, a user can make the electronic device efficiently and quickly complete the transmission of information to multiple application services through simple operations, effectively reducing the operation steps required by the user to complete the cross-application transmission of information, and improving the interaction efficiency between the user and the electronic device.

[0007] The above and other objects will be achieved by the features of the independent claims. Further implementation forms are apparent from the dependent claims, the description and the figures.

[0008] In a first aspect, the present application provides an information processing method, comprising: displaying a first interface, the first interface comprising first information, the first information comprising one or more of text, pictures, videos, audio, files, webpages or links; in response to a first operation of a user on the first information, displaying a second interface, the second interface comprising a first sub-interface and a first icon area, the first sub-interface being obtained by deforming the first interface, the first icon area comprising a first icon and a second icon, the first icon corresponding to a first application service, the second icon corresponding to a second application service and a third application service, the icons in the first icon area being associated with the first information; in a case where a second operation of the user selecting the first icon is received, displaying a third interface, the third interface comprising a window of the first application service; in a case where a third operation of the user selecting the second icon is received, displaying a fourth interface, the fourth interface comprising a first area and a second area, the first area being used to display a window of the second application service, and the second area being used to display a window of the third application service.

[0009] In the present application, the first interface can be any interface provided by an application installed on the electronic device, such as a chat interface provided by the application WeChat or a commodity search interface provided by the application Taobao; the first interface can also be a home screen interface, a negative one screen interface, etc. of the electronic device, which is not limited in the present application.

[0010] When the user needs to transmit the first information in the first interface to an application service, the user can perform the first operation on the first information in the first interface, so that the electronic device displays the second interface. The second interface can be any door interface provided by the embodiments of the present application, which can contain the first sub-interface obtained by the electronic device performing three-dimensional transformation on the first interface originally displayed in the screen, create a visual effect of the first interface being pushed inwards in the screen, and display application service icons recommended by the electronic device for the first information and / or application service icons customized by the user on the side of the screen; then, the user can select one of the icons, so as to transmit the information element to the application service corresponding to the icon and start the corresponding application service function.

[0011] Specifically, in the present application, the first icon area can contain single-intent icons (such as the first icon) and multi-intent icons (such as the second icon). The single-intent icon corresponds to one application service, and the multi-intent icon corresponds to at least two application services. Optionally, in the multiple application services corresponding to the multi-intent icon, any two application services can be services provided by different applications, or can be different services provided by the same application, which is not limited in the present application.

[0012] When the user only needs to transmit the first information to one application service, the user can select a single-intent icon corresponding to his / her needs from all single-intent icons included in the first icon area, and select the first icon through the second operation, so as to transmit the first information to the first application service corresponding to the first icon, and make the electronic device display a window corresponding to the first application service on the screen. For example, when the user needs to transmit the first information to WeChat Moments for publishing, the user can select a single-intent icon corresponding to the Moments service in the first icon area, so as to transmit the first information to the Moments service, and the electronic device can directly display a window of the Moments service on the screen. Optionally, in the third interface, the window of the first application service can be displayed in full screen or in the form of a floating window, which is not limited in the present application.

[0013] When the user needs to transmit the first information to two or more application services, the user can select a multi-intent icon corresponding to his / her needs from all multi-intent icons included in the first icon area, and select the second icon through the third operation, so as to transmit the first information to the second application service and the third application service corresponding to the second icon, and make the electronic device display a window corresponding to the second application service and a window corresponding to the third application service on the screen at the same time. For example, when the user needs to transmit the first information to a navigation service provided by a map application and a new schedule service provided by a calendar application, the user can select a multi-intent icon corresponding to the navigation service and the new schedule service in the first icon area, so as to transmit the first information to the navigation service and the new schedule service, and the electronic device can directly display a window of the navigation service and a window of the new schedule service on the screen at the same time.

[0014] Optionally, after the user selects the first icon or the second icon, the information transmitted by the electronic device to the first application service or the second application service and the third application service can be all or part of the first information. Specifically, the electronic device can filter the first information according to the specific needs (including the needs in format and content) of the application service, and select all or part of the information to transmit to the corresponding application service. For example, assuming that the first information includes location information and event information, and the second application service is a navigation service provided by a map application, after the user selects the second icon, the electronic device can filter the location information from the first information, and only transmit the location information to the navigation service.

[0015] It can be understood that through the multi-intent service icon provided in the first icon area, the user can make the electronic device efficiently and quickly complete the transmission of information to multiple application services and display the interfaces of the multiple application services in the interface at the same time without closing, switching, etc. of the interface, effectively reducing the operation steps required by the user to complete the cross-application transmission of information, improving the interaction efficiency between the user and the electronic device, and providing a better browsing experience for the user.

[0016] In combination with the first aspect, in a possible implementation, the second interface further includes second information, the second information including part or all of the content of the first information; the first operation includes a long press and drag operation on the first information; the second operation includes an operation of the user dragging and releasing the second information to the first icon; and the third operation includes an operation of the user dragging and releasing the second information to the second icon.

[0017] In this embodiment, after the user performs the first operation on the first information, the user can obtain the second information. Optionally, the second information can exist in the form of a thumbnail in the second interface, and the second information can move with the user's fingertips in the second interface without the user releasing the hand.

[0018] Optionally, the second operation can further include an operation of the user dragging the second information to a position within a certain threshold distance from the right or left side of the screen in the first interface, and in response to the operation, the electronic device can display the second interface.

[0019] In the second interface, the user can associate the second information with the first icon through the second operation, and the electronic device can transmit the second information to the first application service corresponding to the first icon in response to the second operation. Similarly, the user can associate the second information with the second icon through the third operation, and the electronic device can transmit the second information to the second application service and the third application service corresponding to the second icon in response to the third operation.

[0020] Optionally, the second operation and the third operation can also be operations of dragging the second information close to the first icon and the second icon, and can also be other operations of associating the second information with the first icon and the second icon, which are not limited in the present application. As long as the second operation and the third operation can select the icon needed by the user from the multiple icons included in the icon area and associate the second information with the icon needed by the user.

[0021] It can be understood that, in the embodiment, the information transmission process provided by the application is continuous from the user dragging the first information to the whole process of putting the first information into the application service corresponding to the target icon. The "continuous" refers to that the user does not need to perform copy, paste and other operations, and does not need to perform application switching operation. The finger of the user can not leave the screen of the electronic device in the whole operation process. The operation is simple and fast, and the efficiency of the user in cross-application information transmission can be effectively improved, and the user experience is improved.

[0022] With reference to the first aspect, in a possible implementation, the first region and the second region are displayed in a split-screen manner in the fourth interface, and there is no overlapping region between the first region and the second region.

[0023] In the embodiment, after the user selects the second icon to transmit the first information to the second application service and the third application service, the first region and the second region can be displayed in a split-screen manner in the fourth interface. The application does not limit the relative position of the first region and the second region in the first sub-interface. For example, the first region can be displayed above the second region, or can be displayed below the second region. It can be understood that, in the embodiment, the first region and the second region can substantially cover the display screen of the electronic device (that is, the total area of the two regions is substantially equal to the area of the display screen).

[0024] Optionally, by default, the areas of the first region and the second region can be equal.

[0025] Optionally, the first region and the second region can take a split-screen line as the boundary between the two regions. The user can perform a drag operation on the split-screen line to change the area sizes of the first region and the second region (the proportions of the two regions in the display screen are changed, but the total area of the two regions is still substantially equal to the area of the display screen).

[0026] Optionally, the first region and the second region can each include an expansion control, a closing control and a minimizing control. The user can also perform a user operation on the expansion control, the closing control or the minimizing control included in any one of the regions to make the application service window included in the region to be displayed in full screen, closed or in the form of a minimized window (i.e., a capsule).

[0027] With reference to the first aspect, in a possible implementation, the first interface displays a fourth application service in full screen, and the fourth interface further includes an application service icon corresponding to the fourth application service. After the fourth interface is displayed, the method further includes: in a case where a fourth operation of a user on the application service icon corresponding to the fourth application service is received, displaying a third area in the fourth interface, the third area being used to display a window of the fourth application service, and the third area being displayed in the third interface in the form of a floating window.

[0028] In this embodiment, since the window of the fourth application service is no longer displayed in the fourth interface, the application service icon corresponding to the fourth application service can be displayed in the fourth interface. Optionally, the application service icon corresponding to the fourth application service can be contained in a capsule, and the capsule can be displayed on the right side of the fourth interface.

[0029] If the user needs to browse the window of the fourth application service again, the user can perform the fourth operation on the application service icon corresponding to the fourth application service in the fourth interface, so that the window of the fourth application service is displayed in the form of a floating window in the fourth interface.

[0030] Optionally, the fourth operation is a click operation on the application service icon corresponding to the fourth application service in the fourth interface.

[0031] With reference to the first aspect, in a possible implementation, the method is applied to a foldable screen device. In a case where the foldable screen device is in an unfolded state, the first area and the second area are displayed in the fourth interface in the form of left-right split screen. In a case where the foldable screen device is in a folded state, the first area and the second area are displayed in the fourth interface in the form of up-down split screen.

[0032] It can be understood that when the display screen area of the electronic device is large enough, for example, when the electronic device is a foldable screen device (in an unfolded state) or a tablet computer, after the user provides the multi-intent service icon to the multiple application services through any door interface, in order to provide a better browsing experience for the user, the interfaces corresponding to the multiple application services can not be displayed in the form of up-down split screen in the interface, but can be displayed in the form of left-right split screen in the interface.

[0033] Therefore, in this embodiment, in a case where the foldable screen device is in a folded state, the first area and the second area are displayed in the fourth interface in the form of up-down split screen. In a case where the foldable screen device is in an unfolded state, the first area and the second area are displayed in the fourth interface in the form of left-right split screen.

[0034] Optionally, when the user unfolds the electronic device from the folded state to the unfolded state, the display manner of the first region and the second region in the fourth interface changes from top-bottom split screen to left-right split screen; similarly, when the user folds the electronic device from the unfolded state to the folded state, the display manner of the first region and the second region in the fourth interface changes from left-right split screen to top-bottom split screen.

[0035] In combination with the first aspect, in a possible implementation, the first region and the second region are displayed in the form of floating windows in the fourth interface.

[0036] Optionally, in the case where the first region and the second region are displayed in the form of floating windows in the fourth interface, the first region and the second region can be displayed in a stack manner, and one region can be displayed on top of the other region. The user can change the display position of the first region and the second region in the interface (i.e., control which region is displayed on top) by left swiping or right swiping any one of the floating windows. In addition, the user can also click any one of the two regions to make the clicked region directly displayed on top of all other sub-interfaces.

[0037] Optionally, in the case where the first region and the second region are displayed in the form of floating windows in the fourth interface and the electronic device is a foldable screen device, the first region and the second region can also not have any overlapping region.

[0038] In combination with the first aspect, in a possible implementation, the first icon region further includes a third icon corresponding to a fifth application service and a sixth application service, and the method further includes: in the case where a fifth operation of selecting the third icon by the user is received, displaying a fifth interface, the fifth interface containing a floating window of the fifth application service and an application service icon corresponding to the sixth application service.

[0039] In this embodiment, after the user selects the third icon, the electronic device can also transmit the first information to the fifth application service and the sixth application service corresponding to the third icon. However, after the transmission of the information is completed, the electronic device displays the window of the fifth application service in full screen in the fifth interface, so as to facilitate the user to better browse the content contained in the window of the fifth application service. In addition, in order to facilitate the user to quickly view the content contained in the window of the sixth application service in the future, the electronic device displays the application service icon corresponding to the sixth application service in the fifth interface at the same time, and the user can click the application service icon corresponding to the sixth application service to make the electronic device quickly display the content contained in the window of the sixth application service on the screen.

[0040] Optionally, the fifth operation can include dragging the first information to obtain second information, and dragging the second information to the third icon and releasing.

[0041] With reference to the first aspect, in a possible implementation, after the fifth interface is displayed, the method further includes: in response to a sixth operation of a user on an application service icon corresponding to the sixth application service, displaying a sixth interface, the sixth interface including a floating window of the sixth application service and the application service icon corresponding to the fifth application service.

[0042] Optionally, the sixth operation can be a click operation on the application service icon corresponding to the sixth application service.

[0043] With reference to the first aspect, in a possible implementation, the first icon area further includes a fourth icon, the fourth icon corresponding to at least two application services, and the method further includes: in a case where a seventh operation of a user selecting the fourth icon is received, displaying a seventh interface, the seventh interface including at least two application service icons and a floating window of a seventh application service, the seventh application service being included in the at least two application services, the at least two application service icons corresponding to the at least two application services; in response to an eighth operation of a user on an application service icon corresponding to an eighth application service in the at least two application service icons, displaying an eighth interface, the eighth interface including the at least two application service icons and a floating window of the eighth application service.

[0044] Optionally, the fifth operation can include dragging the first information to obtain second information, and dragging the second information to the third icon and releasing.

[0045] Optionally, a specific number of the at least two application services can be 2, 3, 4, or another number, which is not limited in the application.

[0046] In the embodiment, when the user selects the fourth icon, the electronic device can also transmit the first information to the at least two application services corresponding to the fourth icon.

[0047] However, after the transmission of the information is completed, the electronic device displays a window of one of the at least two application services in the form of a floating window in the seventh interface, and displays application service icons corresponding to the at least two application services in the seventh interface. Optionally, in the case where the floating window of the seventh application service is displayed in the seventh interface, among the application service icons corresponding to the at least two application services, the application service icon corresponding to the seventh application service can be in a selected state, and the application service icons corresponding to other application services can be in an unselected state. In addition, in order to facilitate the user to subsequently quickly view the content contained in the window of the other application service, the user can click any one of the application service icons in the unselected state (for example, the icon corresponding to the eighth application service) to quickly display the window corresponding to the application service icon (also in the form of a floating window) on the screen.

[0048] With reference to the first aspect, in a possible implementation, the first interface is full-screen displayed with a fourth application service, and the floating window of the eighth application service contains a split-screen setting control. After the eighth interface is displayed, the method further includes: in response to a ninth operation of the user on the split-screen setting control, displaying a ninth interface, the ninth interface including a third region and a fourth region, the third region and the fourth region being split-screen displayed in the ninth interface, the third region being used to display the window of the eighth application service, and the fourth region being used to display the window of the fourth application service.

[0049] In this embodiment, in the case where the floating window of the eighth application service is displayed in the eighth interface, the electronic device can perform a ninth operation on the floating window to split-screen display the window of the fourth application service and the window of the eighth application service in a ninth interface, so that the user can more comprehensively browse the content of the window of the fourth application service while browsing the content of the window of the eighth application service.

[0050] Optionally, the ninth operation includes an operation of long-pressing the split-screen setting control and dragging the floating window of the eighth application service to the side of the screen of the electronic device.

[0051] With reference to the first aspect, in a possible implementation, the ninth interface further comprises a switching control corresponding to an application service other than the eighth application service among the at least two application services, and after the ninth interface is displayed, the method further comprises: in response to a tenth operation of the switching control by the user, displaying a corresponding application service icon of a ninth application service in the ninth interface, the ninth application service being included in the at least two application services; and in response to an eleventh operation of the application service icon corresponding to the ninth application service, replacing the window of the eighth application service in the third region with a window of the ninth application service.

[0052] After the window of the fourth application service and the window of the eighth application service are displayed in split screen in the ninth interface, the user is likely to need to browse the window content of the other application services other than the eighth application service among the at least two application services again. Therefore, in this implementation, the ninth interface further comprises a switching control, which can correspond to the other application services other than the eighth application service among the at least two application services. After the tenth operation of the switching control by the user, the switching control can be expanded, and a plurality of application service icons including the application service icon corresponding to the ninth application service are displayed. After the eleventh operation of the application service icon corresponding to the ninth application service by the user, the electronic device can replace the window of the eighth application service in the third region with the window of the ninth application service.

[0053] It can be understood that, after the window of the eighth application service in the third region is replaced with the window of the ninth application service, the switching control can correspond to the other application services other than the ninth application service among the at least two application services.

[0054] Optionally, the tenth operation can be a click operation of the switching control, and the eleventh operation can be a click operation of the application service icon corresponding to the ninth application service.

[0055] With reference to the first aspect, in a possible implementation, the first icon area further includes a fifth icon, and the method further includes: in response to receiving a twelfth operation of the user selecting the fifth icon, displaying a tenth interface, the tenth interface including a plurality of service cards corresponding to two or more application services; in response to a thirteenth operation of selecting a first service card and a second service card from the plurality of service cards and a fourteenth operation of selecting the confirmation opening control, displaying an eleventh interface, the first service card and the second service card corresponding to a tenth application service and an eleventh application service from the two or more application services; the eleventh interface including a fifth area and a sixth area, the fifth area and the sixth area being displayed in a split screen manner in the eleventh interface, the fifth area being configured to display a window of the tenth application service, and the fifth area including a thumbnail of a window of the eleventh application service; or, the fifth area and the sixth area being displayed in the form of a floating window in the eleventh interface, the fifth area being configured to display the window of the tenth application service, and the sixth area being configured to display the window of the eleventh application service.

[0056] It can be understood that, in some cases, the multi-intent icon in the first icon area can correspond to a plurality of application services, and the user can actually only need to transmit the first information to part of the application services. Therefore, in this embodiment, after the user selects the fifth icon corresponding to the plurality of application services, the electronic device can provide the user with a plurality of application service cards corresponding to the plurality of application services based on the fifth icon in the tenth interface. The user can select the application service needed by the user from the plurality of application service cards and start the application service, and the electronic device displays a corresponding interface for the user to browse a window interface corresponding to the selected application service.

[0057] In addition, a smart assistant service is now provided in most electronic devices, which can recognize information such as images, texts and voices obtained by the electronic device, and provide corresponding services for the user according to the recognition result, for example, providing a control for starting a code scanning function for the user when recognizing that the image is a two-dimensional code, or popping up a browser interface for the user to view the web page content corresponding to the link when recognizing that the text contains a web page link. Therefore, optionally, the fifth icon can also be a smart service icon provided by the electronic device, which can recognize the first information and recommend multiple application services including the tenth application service and the eleventh application service to the user according to the recognition result. Correspondingly, when the user selects the smart service icon, the electronic device can also provide multiple application service cards corresponding to the recommendation function of the smart service for the user, and the user can also independently select the application service he needs from the multiple application service cards and start it, and make the electronic device display the corresponding interface for the user to browse the window interface corresponding to the application service selected by the user.

[0058] In the embodiment, when the user selects the first card and the second card, the electronic device can also transmit the first information to the tenth application service and the eleventh application service corresponding to the first card and the second card.

[0059] Optionally, after completing the transmission of information, the window of the tenth application service (displayed in the fifth area) and the window of the eleventh application service (displayed in the sixth area) can be displayed in the form of split screen in the eleventh interface. The area of the fifth area is larger than the area of the sixth area, and when the number of service cards selected by the user is greater than three, the electronic device can also display the windows of other application services in the sixth area. In some embodiments, the content of the application service window displayed in the fifth area can be browsed and operated by the user, while the application service window displayed in the sixth area is only displayed in the form of a thumbnail, and its content only supports being browsed by the user and cannot be operated by the user.

[0060] Optionally, after completing the transmission of information, the window of the tenth application service (displayed in the fifth area) and the window of the eleventh application service (displayed in the sixth area) are both displayed in the form of a floating window in the eleventh interface. At this time, the fifth area and the sixth area can be displayed in a stacked manner, and one area can be displayed on top of the other area. The user can change the display position of the fifth area and the sixth area in the interface by left swiping or right swiping any one of the floating windows.

[0061] With reference to the first aspect, in a possible implementation, in a case where the fifth region and the sixth region are displayed in split screen in the eleventh interface, the method further includes: in response to a fifteenth operation of a user on the thumbnail of the window of the eleventh application service, replacing the window of the tenth application service in the fifth region with the window of the eleventh application service, and replacing the thumbnail of the window of the eleventh application service in the sixth region with the thumbnail of the window of the tenth application service.

[0062] In this embodiment, in order to facilitate the user to view the content of the window of the eleventh application service in more detail, the user can replace the window of the tenth application service in the fifth region with the window of the eleventh application service through a thirteenth operation on the thumbnail of the window of the eleventh application service, so that the window of the eleventh application service has a larger display area in the eleventh interface, facilitating the user to view.

[0063] With reference to the first aspect, in a possible implementation, the method is applied to a foldable screen device, in a case where the foldable screen device is in an unfolded state, the first icon region includes icons of a plurality of application services displayed by the user and icons of a plurality of application services recommended by the foldable screen device for the user to display according to the first information, and in a case where the foldable screen device is in a folded state, the first icon region does not include icons of a plurality of application services recommended by the foldable screen device for the user to display according to the first information.

[0064] In some embodiments, when the electronic device is a foldable screen device, if the electronic device is in a folded state, it is likely that the user does not have the user demand of displaying a plurality of application service windows in the display screen at the same time at this time, and the user does not want to display a plurality of application interfaces in a split screen manner in the screen. Therefore, in this embodiment, in a case where the electronic device is in a folded state, the electronic device does not display the recommended multi-intent icon in the first icon region for the user, and if the user has historically set a double-intent icon to be fixedly displayed in an arbitrary door interface, the electronic device still displays the multi-intent icon set by the user to be fixedly displayed in the arbitrary door interface in the arbitrary door interface.

[0065] In a second aspect, the present application provides an electronic device, including one or more processors and a memory; the memory is coupled with the one or more processors, the memory is used to store computer program codes, the computer program codes include computer instructions, and the one or more processors invoke the computer instructions to make the electronic device execute the method in the first aspect or any possible implementation manner of the first aspect.

[0066] In a third aspect, the present application provides a chip system applied to an electronic device, the chip system comprising one or more processors configured to invoke computer instructions to cause the electronic device to perform the method in the first aspect or any possible implementation manner of the first aspect.

[0067] In a fourth aspect, the present application provides a computer program product comprising instructions which, when executed on an electronic device, cause the electronic device to perform the method in the first aspect or any possible implementation manner of the first aspect.

[0068] In a fifth aspect, the present application provides a computer-readable storage medium comprising instructions which, when executed on an electronic device, cause the electronic device to perform the method in the first aspect or any possible implementation manner of the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0069] FIG. 1 is a process schematic diagram of information cross-application transmission provided by an embodiment of the present application;

[0070] FIG. 2 is a process schematic diagram of information cross-application transmission provided by an embodiment of the present application;

[0071] FIG. 3 is a schematic diagram of split-screen display of a folding screen device in different forms provided by an embodiment of the present application;

[0072] FIG. 4-FIG. 6 are some user interfaces involved in self-setting of arbitrary door interface icons provided by an embodiment of the present application;

[0073] FIG. 7 is an interface displayed by an electronic device when a multi-intent icon does not match information provided by an embodiment of the present application;

[0074] FIG. 8 is a user interface for embodying an icon display order provided by an embodiment of the present application;

[0075] FIG. 9 is a schematic diagram of icon display of a folding screen device in different forms provided by an embodiment of the present application;

[0076] FIG. 10 is an interface displayed by an electronic device after information is transmitted through a double-intent icon provided by an embodiment of the present application;

[0077] FIG. 11 is an interface displayed by an electronic device after information is transmitted through a double-intent icon provided by an embodiment of the present application;

[0078] FIG. 12 is an interface displayed by an electronic device after information is transmitted through a multi-intent icon provided by an embodiment of the present application;

[0079] FIG. 13 is a process schematic diagram of switching of an application service window provided by an embodiment of the present application;

[0080] FIG. 14 is an interface displayed by an electronic device after transmitting information through a multi-intent icon according to an embodiment of the present disclosure;

[0081] FIG. 15 is an interface displayed by an electronic device after transmitting information through a multi-intent icon according to an embodiment of the present disclosure;

[0082] FIG. 16 is a structural diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0083] The terminology used in the following embodiments of the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the present disclosure. As used in the specification and the appended claims of the present disclosure, the singular forms "a," "an" and "the" are intended to include both the singular and the plural forms, unless the context clearly indicates otherwise. It will be further understood that the terms "and / or," as used in the present disclosure, refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0084] For the convenience of understanding, the related terms involved in the embodiments of the present disclosure are introduced first as follows.

[0085] (1) Arbitrary door interface

[0086] In the present disclosure, the "arbitrary door interface" is a functional interface provided by an electronic device based on a user's cross-application transmission of information. In some embodiments of the present disclosure, the interface can also be referred to as a "cross-application transmission interface" or a "smart flow interface". As its name implies, under any interface displayed by the electronic device, when the user needs to perform cross-application transmission of information in the interface, the user only needs to long-press an information element in the interface and drag it to the edge of the screen, and the electronic device will perform a three-dimensional transformation on the originally displayed interface in the screen, creating a visual effect of the original interface being pushed inwards, and displaying application service icons recommended by the electronic device and / or application service icons customized by the user on the side of the screen; then, the user releases the dragged information element on the icon, and the information element is transmitted to the application service corresponding to the icon and the corresponding application service function is started. Specifically, in the present disclosure, a certain application APP installed in the electronic device can have multiple application services (for example, the WeChat application can provide chat services, collection services, and code scanning services), and the application service icons displayed in the cross-application transmission interface provided by the present disclosure can include some or all of the application service icons provided by the same application APP, which is not limited by the present disclosure.

[0087] (2) Small window, capsule, snack bar

[0088] A "small window" is a system tool of a smart device that can suspend an operation window of an application above an interface or on a desktop, and thus is also referred to as a "suspended window". As a kind of application interface that is shrunk, a suspended window can be displayed on top of other application interfaces (e.g., a full-screen displayed application interface), and the small window can still display an interface style and a function list inherent to the corresponding application. A user can directly operate a control in the suspended window interface to use a function corresponding to the control without closing or exiting an application interface of other applications. For example, when a WeChat, QQ, or the like message is suddenly received while a game or a video is being played in full screen, a chat interface corresponding to the message can be directly displayed above the game interface in the form of a suspended window. A user can view and reply to the message in the chat interface displayed in the small window without switching or exiting the currently opened application.

[0089] A "capsule" is a form of a small window after being minimized, and is named because of its capsule-like shape. Unlike a small window, a capsule generally cannot display an interface style and a function list inherent to the corresponding application, and only displays a small icon on a side of a screen of an electronic device. A user can expand the capsule by clicking the capsule. After the capsule is expanded, the capsule is displayed in the form of an application interface (e.g., a small window) on top of the screen.

[0090] A "snack bar" is a lighter feedback method than a toast, and includes a line of text related to an ongoing operation and can include a corresponding jump control to facilitate a user to browse an application interface related to the aforementioned ongoing operation. A snack bar is also a non-modal pop-up window, and is generally used to notify a user of a process that is occurring or will occur in the program. The content of the snack bar must be related to a current operation of the user. The snack bar generally appears briefly at the bottom of the screen, does not interrupt a user experience, and does not require any operation of the user. After a period of time, the snack bar automatically disappears. In some embodiments, if a snack bar appears in an interface, a user can make the snack bar disappear by clicking an area other than the snack bar.

[0091] (3) Multi-intent service icon

[0092] A multi-intent service icon is an icon obtained by combining two or more application service icons. Specifically, when two application service icons are included in a multi-intent service icon, the multi-intent service icon can be referred to as a "dual-intent icon".

[0093] In the present application, when the user long-presses and drags the picture or text information contained in the interface, and the electronic device displays an arbitrary door interface, the electronic device can display a multi-intent service icon on the side of the arbitrary door interface. When the user releases the information element placed on the icon, the information element can be transmitted to multiple application services corresponding to the multi-intent icon and start the corresponding application service function. At the same time, the electronic device can also display the windows corresponding to the multiple application services. These windows can be displayed in the interface in the form of split screen, or in the form of a floating window, or part of the split screen and part of the capsule, or in other combinations (for details, please refer to the relevant description of the subsequent embodiments). In order to facilitate the user to browse the content of multiple windows at the same time or flexibly switch the windows of the application service. In this way, the user can transmit the information to multiple application services at the same time through simple operation.

[0094] Optionally, the number of multi-intent service icons displayed on the side of the arbitrary door interface can be one or more, which can include multi-intent service icons intelligently recommended by the electronic device according to information content, user habits, and historical use data of the electronic device, and can also include multi-intent service icons customized by the user according to his own preferences.

[0095] (4) unfolded state and folded state of folding screen device

[0096] The folding screen device is a kind of smart device that uses a flexible display screen. Its characteristic is that the screen can change size by folding inward or outward like a book. This design allows the phone to switch between small and large sizes, thus adapting to different use scenarios. The most common folding screen device is the folding screen phone, which usually uses an OLED panel. OLED panels can emit light on their own. After a certain angle of bending, combined with the folding mechanism of the body, the folding effect is achieved.

[0097] The folded state and the unfolded state are the two most basic forms of the foldable screen device. When in the unfolded state, the foldable screen device has a larger screen size and can display application content more fully. Correspondingly, when in the folded state, the screen size of the foldable screen device becomes smaller. In this application, when the electronic device is a foldable screen device, after the user opens the windows of two application services through the multi-intent service icon, the electronic device can determine the display mode of the windows of the two application services according to the form of the electronic device. For example, when the electronic device is in the folded state, the electronic device can display the two application windows in a top-and-bottom split screen manner; when the electronic device is in the unfolded state, the electronic device can display the windows of the two application services in a left-and-right split screen manner. Alternatively, if the electronic device subsequently switches from the folded state (unfolded state) to the unfolded state (folded state), the electronic device will also switch the display mode of the windows of the two application services from the top-and-bottom split screen manner (left-and-right split screen manner) to the left-and-right split screen manner (top-and-bottom split screen manner). For details, please refer to the related description of the subsequent embodiments.

[0098] With the continuous development of electronic information technology, smart devices such as mobile phones and tablets have become indispensable products in our daily life, work and entertainment. In the process of using smart devices, users often open multiple applications in the smart device to work together, and users often use smart devices to transfer information across applications, that is, to process, share, upload, etc. information in one application through another or more applications. However, when the user needs to transfer information across applications, especially when the user needs to transfer information to multiple applications, the user usually needs to perform a series of complex operations such as copying information and switching applications to complete the operation.

[0099] Take FIG. 1 as an example for illustration. FIG. 1 is a schematic diagram of the interface change process of an electronic device when a user transfers an image across applications based on an arbitrary door interface.

[0100] As shown in (A) of FIG. 1, the user interface 11 can be a chat interface provided by an application in the electronic device. The user interface 11 can include chat text 111 and a function option box 112. Among them:

[0101] The function option box 112 can be displayed by the electronic device in response to the user's user operation on the chat text 112, for example, a long press operation. The function option box 112 can specifically include a copy option, a forward option, a collection option, a delete option, and multiple options. Any one option can respond to the user's click operation, so that the electronic device executes the function corresponding to the option for the chat text 111.

[0102] To transfer the text contained in the chat text 111 to other applications, to establish a new schedule according to the schedule information contained in the chat text 111, and to navigate and view the distance to the current location and the changed location according to the location information contained in the chat text 111, the user can perform a long press operation on the chat text 111 and drag the chat text 111 to the side of the screen, so that the electronic device displays a user interface 12 as shown in (B) of FIG. 1.

[0103] As shown in (B) of FIG. 1, the user interface 12 is any door interface mentioned in the foregoing description, which can include a sub-interface 121, an icon area 122, and a text 123. Among them:

[0104] The text 123 is the text formed by the long press operation of the user on the chat text 111. When the user does not release the hand, the text 123 can move in the user interface 12 along with the user's fingertips, and the text 123 can be displayed on top of the user interface 12 (that is, the text 123 can cover any element contained in the user interface 12). It should be understood that the text content contained in the text 123 can be the same as the text content contained in the chat text 111, or the chat text 111 contains the text content of the text 123. The size of the text 123 is usually smaller than or equal to the size of the chat text 111.

[0105] The element content (such as text, picture, etc.) displayed in the sub-interface 121 is the same as the element content (except the status bar) displayed in the user interface 11. In fact, the sub-interface 121 can be considered as the interface obtained by the electronic device performing a three-dimensional transformation on all element content (except the status bar) of the original user interface 11. In the user interface 12, the sub-interface 121 can create a visual effect that the original interface (that is, the user interface 11) is pushed inwards in the screen. It can be understood that this visual effect of "opening the door" metaphorically represents the behavior of transferring information, which is more intuitive than copying and pasting. Alternatively, in the user interface 12, the background behind the sub-interface 121 can be set as the picture obtained by superimposing a blur effect on the desktop background (that is, the desktop wallpaper) of the electronic device.

[0106] The icon area 122 can be used to display one or more application service icons displayed by the electronic device based on the dragged information element (that is, the text 123 or the chat text 111 in the embodiments of the present application). Among them, the corresponding text explanation can be displayed below each icon in the icon area 122, which can be used to explain the specific application name or application service name corresponding to the icon.

[0107] In the user interface 12, after the user places the dragged information element (i.e. the text 123) on the corresponding icon in the icon area 122 and releases the hand, the electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation, and display the application interface corresponding to the application service icon or feedback information.

[0108] As shown in (B) of FIG. 1, in order to establish a new schedule according to the schedule information contained in the text 111, the user can first drag the text 123 to the application service icon 122a and release the hand. After the user releases the hand, the electronic device can display the user interface 13 as shown in (C) of FIG. 1 in response to the user operation.

[0109] As shown in (C) of FIG. 1, the user interface 13 can include a main interface 131 and a sub-interface 132. The main interface 131 can be an application interface of the application "Calendar" in the electronic device, and the sub-interface 132 is a small window interface of the application "Calendar".

[0110] The minimize control 1322 can respond to the user operation to make the electronic device retract the sub-interface 132 and display it in the form of a capsule on the side of the screen.

[0111] The close control 1323 can respond to the user operation to make the electronic device close the sub-interface 132.

[0112] The expand control 1321 can respond to the user operation to make the electronic device display the interface of the application "Calendar" in full screen, i.e. display the sub-interface 132 in full screen.

[0113] At this time, the electronic device can recognize the information contained in the text information 111, and automatically fill the recognized time, place, event, etc. information into the window of the new schedule service provided by the application "Calendar" to facilitate the user to establish a new schedule event.

[0114] After the user establishes a new schedule, as shown in (C) of FIG. 1, the electronic device can display the user interface 14 as shown in (D) of FIG. 1 in response to the user's click operation on the close control 1323. As can be seen from the user interface 14, at this time the electronic device has closed the window of the new schedule service provided by the application "Calendar".

[0115] ​Similarly, in order to navigate the location information contained in the chat text 111 again, as shown in (D) of FIG. 1, after the electronic device displays the user interface 14, the user can display the user interface 15 shown in (E) of FIG. 1 by performing the operation of long pressing the chat text 111 and dragging to the side of the screen. As shown in (E) of FIG. 1, the user interface 15 is also an arbitrary door interface mentioned in the foregoing description, which can include a sub-interface 151, an icon area 152, and a text 153. Among them:

[0116] The text 153 is the text formed by the long pressing operation of the user on the foregoing chat text 111.

[0117] The element content (such as text, picture, etc.) displayed in the sub-interface 151 is the same as the element content (except the status bar) displayed in the user interface 14.

[0118] The icon area 152 can be used to display one or more application service icons displayed by the electronic device based on the user long pressing and dragging the information element (that is, the text 153 or the chat text 111 in the embodiments of the present application). The specific information of the sub-interface 151, the icon area 152, and the text 153 can refer to the related description of the sub-interface 121, the icon area 122, and the text 123 in the foregoing description, which will not be repeated here.

[0119] As shown in (E) of FIG. 1, in order to navigate the location information contained in the text 111, the user can release the text 153 after dragging it to the application service icon 152a. After the user releases the hand, the electronic device can display the user interface 16 shown in (F) of FIG. 1 in response to the user operation.

[0120] As shown in (F) of FIG. 1, the user interface 16 can include a main interface 161 and a sub-interface 162. Among them, the main interface 161 can be an application interface of the application of the electronic device, and the sub-interface 162 is a small window interface of the application "map". The user can adjust the specific position of the sub-interface 162 in the user interface 16 by pressing and dragging the sub-interface 162, and the user can directly operate in the sub-interface 162, such as re-inputting location information and searching. As can be seen from the user interface 16, the sub-interface 162 can include an expansion control 1621, a minimize control 1622, and a close control 1623. The specific functions of these controls can refer to the related description of the user interface 13 in the foregoing description, which will not be repeated here. At this time, the electronic device can recognize the location information contained in the text information 111, and automatically search the location information based on the search function provided by the "map" application, so as to facilitate the user to view the specific distance to the location and select the appropriate travel mode.

[0121] In the embodiments of this application and subsequent embodiments, users can also perform other operations on the selected information elements (such as one or more of text, images, videos, audio, files, web pages, or links) to make the electronic device display the arbitrary door interface provided in this application, and this application does not limit this. For example, in some embodiments, users can also perform a knuckle selection operation on the above-mentioned chat text 111 in the user interface 11 to make the electronic device display the aforementioned user interface 12.

[0122] As explained in the foregoing description of Figure 1, when a user needs to transmit information such as images or text contained in the interface to multiple application services to achieve multiple user intentions, the user needs to perform multiple operation steps. The interaction efficiency between the user and the electronic device is very low, which seriously affects the user experience. In addition, the electronic device needs to open, close, or switch between multiple application service windows. If the user wants to view the content contained in the windows of two application services simultaneously on the same interface, the user needs to perform other operations to make the windows of multiple application services appear on the same interface at the same time.

[0123] This application provides an information transmission method and an electronic device. The electronic device can be used to implement the method. When implementing the method, the electronic device can display an "anywhere door" interface, which can include one or more multi-intent service icons. Through these multi-intent service icons, users can efficiently and quickly transmit information to multiple application services simultaneously through simple operations. The interfaces of multiple application services are simultaneously displayed in the interface in the form of small windows and / or capsules. This effectively reduces the number of operation steps required for users to complete cross-application information transmission, improves the interaction efficiency between users and electronic devices, and provides users with a better browsing experience.

[0124] Figure 2 illustrates the specific process by which a user transmits information to multiple application services simultaneously through the multi-intent service icon in the AnyDoor interface.

[0125] As shown in Figure 2(A), the user interface 17 can be an application in an electronic device. The provided chat interface. User interface 17 may include chat text 171 and function option boxes 172. Wherein:

[0126] The function option box 172 can be displayed by an electronic device in response to user operations on the chat text 172, such as after a long press. Its specific content and function can be referred to the foregoing description of the function option box 172. This application embodiment and subsequent embodiments will not be repeated.

[0127] In some scenarios, the user can have the need to create a new schedule with the schedule information contained in the chat text 171 and simultaneously navigate to the location information contained in the chat text 171 to view the distance from the current location to the location. Therefore, in the embodiments of the present application, the user can long press the chat text 171 and drag it to the side of the screen to make the electronic device display the user interface 18 as shown in (B) of FIG. 2.

[0128] Optionally, the electronic device displays the user interface 18 only when the user long presses the chat text 171 and drags it to the right or left side of the screen by a distance less than a certain threshold.

[0129] As shown in (B) of FIG. 2, the user interface 16 is any door interface mentioned in the foregoing description, which can include a sub-interface 181, an icon area 182, and a text 183. Wherein:

[0130] The text 183 is the text formed by the long press operation of the user on the chat text 171, which can move in the user interface 18 along with the fingertip of the user without the user releasing the hand, and can be displayed on top of the user interface 18 (i.e., the text 183 can cover any element contained in the user interface 18). For example, the text content contained in the text 183 can be the same as the text content contained in the chat text 171. Optionally, the text 183 can be a thumbnail obtained by the electronic device reducing the chat text 171, that is, the text 183 has no difference with the chat text 171 except the size. Optionally, in the foregoing user interface 17, after the chat text 171 is long pressed and dragged to form the text 183, the electronic device can still display the chat text 171 in the user interface 17 and perform a virtualization or blurring process on the chat text 171 (not shown in FIG. 2), that is, the chat text 171 in the user interface 17 can have a lower definition than other elements in the user interface 17 to prompt the user that the chat text 171 is in the selected and dragged state.

[0131] The element content (e.g., text, picture, etc.) displayed in the sub-interface 181 is the same as the element content (except the status bar) displayed in the user interface 17. In fact, the sub-interface 181 can be considered as the interface obtained by the electronic device performing a three-dimensional transformation on all element content (except the status bar) of the original user interface 17.

[0132] The icon area 182 can be used to display one or more application service icons determined by the electronic device based on the information element (i.e. the text 183 or the chat text 171 in the embodiments of the present application) being dragged, which can include single-intent service icons and multi-intent service icons (e.g. double-intent icons). Specifically, the application service icons can include application service icons intelligently recommended by the electronic device for the user in combination with information content, user habits and user historical usage of the device, as well as application service icons customized by the user according to his / her own preferences.

[0133] Optionally, there is a corresponding text description under each icon in the icon area 182, which can be used to explain the specific application name or application service name corresponding to the icon. Taking the multi-intent service icon 182a and the text 182b as an example, the multi-intent service icon 182a can include the icon 1821 of the map navigation service provided by the application program "Map" and the icon 1822 of the new schedule service provided by the application program "Calendar", and the text 182b can include the two-part text "New Schedule" and "Map Navigation". It should be understood that the text under each application service icon is only to facilitate the user to understand the specific application or specific application function corresponding to the icon, but the specific icon style and specific text content are not limited in the present application. For example, in the case of a circular application icon, the multi-intent service icon 182a can only include a circular icon, which can be divided into left and right parts or upper and lower parts, one part of which is used to display the icon of the map navigation service and the other part is used to display the icon of the new schedule service.

[0134] In the user interface 18, after the user places the dragged information element (i.e. the text 183) on the corresponding icon in the icon area 182 and releases the hand, the electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation, and display the application interface corresponding to the application service icon or feedback information.

[0135] Optionally, after the text 183 is dragged into the icon area 182, the electronic device can further reduce the text 183 without changing the text content, so that when the user selects the application service he / she wants in the icon area 182, the text 183 will not cause a large area of the icon and text in the icon area 182 to be blocked, making it more convenient for the user to select the icon.

[0136] In addition, in order to guide the user to accurately drop the dragged element into the application service that the user needs, when the text 183 is close to a certain icon in the icon area 182, or the distance between the text 183 and a certain icon in the icon area 182 is less than a certain threshold, the icon that is close to the text 183 can display a certain special effect, for example, the icon and the text corresponding to the icon can be attracted close to the text 183, and the icon can be enlarged. Taking the icon 183a in the user interface 18 as an example, when the text 183 is close to the multi-intent service icon 182a, the multi-intent service icon 182a is closer to the left than other icons, that is, closer to the text 183 than other icons; in addition, the multi-intent service icon 182a is also enlarged to prompt the user that if the text 183 is released at this position, the text information in the text 183 (which can be part or all of the text contained in the text 183a) will be transmitted to the two application services corresponding to the multi-intent service icon 182a.

[0137] As shown in (C) of FIG. 2, in order to quickly create a new schedule according to the schedule information contained in the text 183 and transmit the location information contained in the text 183 to the map application for navigation, the user can drag the text 183 to the multi-intent service icon 182a and release it. After the user releases it, the electronic device can respond to the user operation and simultaneously transmit the text information contained in the text 183 to the navigation service provided by the “map” application and the new schedule service provided by the “calendar” application (any one of the application services receives all or part of the text contained in the text 183), and display the user interface 19 as shown in (D) of FIG. 2.

[0138] As shown in (D) of FIG. 2, the user interface 19 can include a first display area 191, a second display area 192, and a capsule 193. Among them:

[0139] The first display area 191 (also referred to as a first split-screen window) is used to display a window of the navigation service provided by the application “map”, which can display distance information and route information between the location contained in the text 183 and the current location of the user for the user;

[0140] The second display area 192 (also referred to as a second split-screen window) is used to display a window of the new schedule service provided by the application “calendar”, which can display a schedule intelligently created by the electronic device for the user according to the time, location, and event information contained in the text 183. In the case that the schedule information is correct, the user can directly determine and create the schedule, and in the case that the schedule information is incorrect, the user can also modify the related information of the schedule and then create the schedule. Specifically, the display area and the display area can be displayed in a split-screen form on the display screen of the electronic device, and the total area of the two areas is basically the same as the area of the display screen of the electronic device.

[0141] As shown in (D) of FIG. 2, in the user interface 19, the first display area 191 and the second display area 192 can be displayed in a split-screen manner, and the two areas can substantially cover the display screen of the electronic device (i.e., the total area of the two display areas is substantially equal to the area of the display screen). Optionally, when the electronic device initially displays the user interface 19, the areas of the first display area 191 and the second display area 192 can be equal; in some embodiments, the user can change the sizes of the first display area 191 and the second display area 192 by a drag operation on the split-screen line shown in (D) of FIG. 2 (the proportions of the two display areas in the display screen are changed, but the total area of the two display areas is still substantially equal to the area of the display screen).

[0142] In addition, in some embodiments, the first display area 191 and the second display area 192 can each include an expansion control, a closing control, and a minimizing control (not shown in FIG. 2). The user can also cause the application service window included in any one of the display areas to be displayed full-screen, closed, or displayed in the form of a minimized window (i.e., a capsule) by a user operation on the expansion control, the closing control, or the minimizing control included in the display area, which can be referred to in the related description of subsequent embodiments.

[0143] The capsule 193 can be displayed on the right side of the user interface 19, and can include an icon 193a (the specific icon is not shown in the figure) of the application In addition, the user can change the specific position of the capsule 193 on the side by holding and dragging the capsule 193. It can be understood that, before the user transmits the text 171 to the aforementioned two application services, the display screen of the electronic device displays a chat interface provided by the application Therefore, in order to facilitate the user to browse the chat interface again, the user can cause the aforementioned user interface 17 to be displayed in the form of a small window on top of the user interface 19 by a click operation on the capsule 193. That is, in the embodiments of the present application, if the user drags a text or a picture from an interface provided by an application (assuming APP1) and transmits the text or the picture to multiple application services through the multi-intent service icon in the aforementioned process, after the electronic device displays the interfaces corresponding to the multiple application services in the same interface in a split-screen manner, the electronic device displays a capsule including an application icon of APP1 in the interface, so as to facilitate the user to quickly browse the interface of APP1 originally displayed in the case that the electronic device displays a split-screen interface (such as the aforementioned user interface 19).

[0144] In the embodiments of the present application, the multi-intent service icon provided through the arbitrary door interface enables the electronic device to efficiently and quickly complete the transmission of information to multiple application services and simultaneously display the interfaces of the multiple application services in the interface without the user needing to perform operations such as closing and switching the interface, thereby effectively reducing the operation steps required by the user to complete the cross-application transmission of information, improving the interaction efficiency between the user and the electronic device, and providing a better browsing experience for the user.

[0145] In the embodiments of the present application, the user interface 17 can be referred to as a “first interface”, the user interface 18 can be referred to as a “second interface”, the user interface 19 can be referred to as a “fourth interface”, the chat text 171 can be referred to as “first information”, the text 183 can be referred to as “second information”, the sub-interface 181 can be referred to as a “first sub-interface”, the icon area 182 can be referred to as a first icon area, the multi-intent service icon 182a can be referred to as a “second icon”, the single-intent service icon 18d can be referred to as a “first icon”, the global collection service can be referred to as a “first application service”, the map navigation service can be referred to as a “second application service”, the new navigation service can be referred to as a “third application service”, the WeChat chat service can be referred to as a “fourth application service”, and the icon 193a in the capsule 193 can be referred to as an “application service icon corresponding to the fourth application service”. The first display area 191 can be referred to as a “first area”, and the second display area 192 can be referred to as a “second area”. The long press and drag operation of the user on the chat text 171 can be referred to as a “first operation”, and the operation of the user dragging the text 183 to the intent service icon 182a and then releasing it can be referred to as a “third operation”.

[0146] In some embodiments, when the display screen area of the electronic device is large enough, for example, when the electronic device is a folding screen device (in an unfolded state) or a tablet computer, after the user transmits information to multiple application services through the multi-intent service icon provided by the arbitrary door interface, the interfaces corresponding to the multiple application services can not be displayed in a top-and-bottom split screen manner in the interface, but can be displayed in a left-and-right split screen manner in the interface.

[0147] Next, a folding phone is taken as an example and described in combination with FIG. 3.

[0148] As shown in FIG. 3, (A) and (B) in FIG. 3 respectively show the interface displayed after the user transmits information to multiple application services through a multi-intent service icon when the folding screen phone is in a folded state and an unfolded state.

[0149] As shown in (A) of FIG. 3, the user interface 20 can be an interface displayed by the electronic device (at this time, the electronic device is in the folded state) after the user long-presses and drags a text in a chat interface provided by the WeChat application, and the electronic device displays a multi-intent service icon (here, it is assumed that the multi-intent service icon corresponds to the application services of "map navigation" and "newly created schedule") in any door, and simultaneously transmits information to multiple application services. The interface displayed by the electronic device after the above operation is shown in the user interface 20. Specifically, in the case that the electronic device shown in FIG. 2 is a folding screen device, the user interface 21 can be the user interface 19 described above. The user interface 20 can include a first display area 201, a second display area 202, and a capsule 203. Among them:

[0150] The first display area 201 is used to display a window of the navigation service provided by the application "map";

[0151] The second display area 202 is used to display a window of the newly created schedule service provided by the application "calendar".

[0152] The capsule 203 can be displayed on the right side of the user interface 20, and can include icons of the applications .

[0153] The specific content of the first display area 201, the second display area 202, and the capsule 203 can refer to the related description of the user interface 19 above, and will not be repeated here.

[0154] It needs to be emphasized that in the user interface 20, the display area 201 and the display area 202 are displayed in the form of split screen in the display screen of the electronic device, and the total area of the two areas is basically the same as the area of the display screen of the electronic device.

[0155] It can be understood that since the display screen of most electronic devices (including folding mobile phones in the folded state) can be approximated as a rectangle, and the length and width of the rectangle are generally not equal. Taking (A) of FIG. 3 as an example, when the electronic device is in the folded state, the length of the display screen is L1, and the width is W, and W>L. Therefore, when splitting the screen, if the left and right split screen mode is used to display the interfaces corresponding to the two application services respectively, since the value of L1 is small itself, the left and right split screen mode will make the length of the interfaces corresponding to the two application services smaller, which is likely to bring a bad browsing experience to the user. Therefore, when the electronic device is in the folded state, the electronic device can display the two interfaces corresponding to the application services "map navigation" and "newly created schedule" in the form of split screen.

[0156] When the electronic device is in the unfolded state, or the area of the display screen of the electronic device is large enough (for example, the electronic device is a tablet computer), the electronic device can display the interfaces corresponding to the two application services in the form of left and right split screen.

[0157] As shown in (B) of FIG. 3, the user interface 21 can be the interface displayed by the electronic device (at this time, the electronic device is in the unfolded state) after the user long-presses and drags the text in the chat interface provided by the WeChat application, and the multi-intent service icon (here, it is also assumed that the multi-intent service icon corresponds to the application services of "map navigation" and "newly created schedule") in any door, and simultaneously transmits information to multiple application services. The interface displayed by the electronic device after the above operation. The user interface 21 can include a first display area 211, a second display area 212, and a capsule 213. Among them:

[0158] The first display area 211 is used to display the window of the navigation service provided by the application "map";

[0159] The second display area 212 is used to display the window of the newly created schedule service provided by the application "calendar".

[0160] The capsule 213 can be displayed on the right side of the user interface 19, which can include the icons of the applications .

[0161] The specific content of the first display area 211, the second display area 212, and the capsule 213 can refer to the related description of the user interface 19, which will not be repeated here.

[0162] It needs to be emphasized that in the user interface 21, the display area 211 and the display area 212 are displayed in the form of left-right split screen in the display screen of the electronic device, and the total area of the two areas is basically the same as the area of the display screen of the electronic device. The length of the display screen is L2, and the width is W, and L2 can be equal to 2L1. Therefore, when the electronic device is in the unfolded state, since the value of L2 is relatively large, even if the electronic device displays the interfaces corresponding to the two application services in the form of left-right split screen at this time, the user's browsing experience will not be affected. Therefore, when the electronic device is in the folded state, the electronic device can display the interfaces corresponding to the application services "map navigation" and "newly created schedule" in the form of up-down split screen.

[0163] Of course, after the electronic device displays the aforementioned user interface 20 in a folded state or the aforementioned user interface 21 in an unfolded state, if the user subsequently switches the electronic device from a folded state to an unfolded state or vice versa, the electronic device can promptly switch the display mode of the interface corresponding to each application service according to its own state. For example, after the aforementioned user interface 20 is displayed in a folded state, if the user switches the electronic device from a folded state to an unfolded state, the electronic device will no longer display the two interfaces corresponding to the application services "Map Navigation" and "New Schedule" in a split-screen manner, but will instead display the two interfaces corresponding to the application services "Map Navigation" and "New Schedule" in a split-screen manner as shown in user interface 21.

[0164] In this embodiment of the application, the first display area 201 can be referred to as the "first area", and the second display area 202 can be referred to as the "second area". The first display area 211 can be referred to as the "first area", and the second display area 212 can be referred to as the "second area".

[0165] Furthermore, in this embodiment of the application, when a user opens the door by long-pressing and dragging an element, the icons displayed in the application icon area of ​​the door (whether single-intent service icons or multi-intent service icons) may include application service icons that the electronic device intelligently recommends to the user based on information content, user habits, and the embedded data stored by the electronic device when the user has used the device in the past, or may include multi-intent service icons that the user customizes according to their own preferences.

[0166] Figures 4-6 exemplarily illustrate the user interface involved in the icon types within the icon area for user-defined arbitrary doors.

[0167] As shown in Figure 4(A), the user interface 22 is the interface related to the "Smart Assistant" function in the "System Settings" of the electronic device. In the user interface 22, the user can click the "Anywhere Door" tab 221 to make the electronic device display the user interface 23 shown in Figure 4(B).

[0168] As shown in Figure 4(B), the user interface 23 can display a "Learn More" control and a "Customize Services" tab 231, wherein:

[0169] The "Learn More" control responds to user clicks, causing the electronic device to display a user interface that demonstrates the specific functions and steps of the "Smart Flow" feature.

[0170] The "combined intent split-screen recommendation" tab can include a switch control 232, and in a case where the user turns on the control, the multi-intent service icon is displayed in any door interface displayed by the subsequent electronic device.

[0171] The "custom service" tab 231 can be clicked by the user to cause the electronic device to display the user interface 24 as shown in (C) of FIG. 4.

[0172] As can be known from the foregoing description, among the icons displayed in any door interface, some icons are icons that are fixedly displayed in the icon area by the user, and some icons are icons that are recommended by the electronic device based on the element dragged by the user. Among them, the fixedly displayed icons and the recommended icons by the electronic device can each include a single-intent service icon and a multi-intent service icon. Therefore, in the user interface 24, the icon tab 241 on the left can include two options, i.e., a single service option (a single icon in the single service option can be selected to be a single-intent service icon fixedly displayed in any door) and a combined service option (any two icons in the combined service option can be selected to be a double-intent icon fixedly displayed in any door).

[0173] In some embodiments, the icon tab 241 of the user interface 24 can include both the single-intent service option and the combined service option only in a case where the user has previously turned on the switch control 232 included in the "combined intent split-screen recommendation" tab in the user interface 23. If the user has not previously turned on the switch control 232 included in the "combined intent split-screen recommendation" tab, the icon tab 241 of the user interface 24 can include only the single-intent service option.

[0174] Alternatively, in some embodiments, the icon tab 241 of the user interface 24 can include both the single-intent service option and the combined service option even if the user has not previously turned on the switch control 232 included in the "combined intent split-screen recommendation" tab, so as to allow the user to customize the multi-intent service icon. In a case where the switch control 232 is not turned on, the user-defined multi-intent service icon (and the multi-intent icon recommended by the electronic device) can not be displayed in any door interface. In a case where the user subsequently turns on the switch control 232, the user-defined multi-intent service icon (and the multi-intent icon recommended by the electronic device) can be displayed in any door interface. After entering the user interface 24, the electronic device can display, in the icon tab 241, all application service icons that can be provided by the single service option. At this time, the icon display card 242 on the right includes icons selected and filled in by the user from the icon tab 241, which can include one or more icons that have been set by the user to be fixedly displayed in any door interface, and a plurality of blank icon areas in which a single icon can be filled in by the user.

[0175] As shown in (C) of FIG. 4, at this time, there already exists an application service icon 242a in the icon display card 242 on the right side, which is a globally collected service icon, indicating that the user has set the globally collected application service to be fixedly displayed in the icon area of any door interface; that is, no matter what type of element the user long-presses and drags and what content it contains, the globally collected application service icon will exist in the icon area contained in any door interface displayed by the electronic device in response to the long-pressing and dragging operation.

[0176] In the user interface 24, the user can also click the removal symbol "-" in the upper right corner of any icon in the icon display card 242 to make the icon no longer be fixedly displayed in the icon area of any door interface, which will not be described in detail here.

[0177] Similarly, the user can click the addition symbol "+" in the upper right corner of any icon in the icon tab 241 to make the icon be fixedly displayed in the icon area of any door interface; after being added, the icon will also be displayed in the blank icon area contained in the icon display card 242. For example, if the user wants to fix the icon of the search service to be displayed in the icon area of any door interface, the user can click the addition symbol "+" in the upper right corner of the icon 241a as shown in (C) of FIG. 4 to set the icon to be fixedly displayed in the icon area of any door interface, and make the electronic device display the user interface 25 as shown in (D) of FIG. 4.

[0178] As shown in (D) of FIG. 4, in the user interface 25, the icon 242b of the search service contained in the icon tab 242 indicates that the electronic device has set the icon of the search service to be fixedly displayed in the icon area of any door interface.

[0179] Optionally, since the electronic device has added the icon of the search service to the icon display card 242, in the user interface 25, the icon 241a contained in the icon tab 241 has been blurred, indicating that it has been in an inoperable state.

[0180] In order to fix the multi-intent service icon customized by the user to be displayed in the icon area of any door interface, as shown in (D) of FIG. 4, the user can click the combined service option in the icon tab 241 to switch the single service option displayed in the icon tab 241 to the combined service option, so as to select icons to form a dual-intent icon. Correspondingly, the electronic device can respond to the operation and display the user interface 26 as shown in (A) of FIG. 5.

[0181] As shown in (A) of FIG. 5, the user interface 26 can also include an icon tab 261 and an icon display card 262.

[0182] The specific function and content of the icon tab 261 can refer to the foregoing description of the icon tab 241, and will not be repeated here.

[0183] The user interface 26 can include all icons that have been set by the user to be fixedly displayed in any door interface. However, unlike the foregoing icon display card 242, the icon display card 262 no longer has blank icon areas for the user to fill in a single icon, but instead has several blank icon areas for the user to fill in two icons. Any one of the blank icon areas can be filled in with two application service icons to obtain a dual-purpose icon.

[0184] Optionally, the number of icons that can be contained in the icon tab 262 is 5 (a dual-purpose icon is counted as one icon), that is, the upper limit of the number of icons that the user can set to be fixedly displayed in any door interface is 5.

[0185] Suppose the user needs to set a dual-purpose icon that can simultaneously start and search for text or pictures, then as shown in (A) of FIG. 5, the user can perform a click operation on the addition symbol "+" in the upper right corner of the icon 261a in the icon tab 261, so that the electronic device adds the icon 261a to the first circular blank area contained in the dual-purpose icon 262a in the icon display card 262, and displays the user interface 27 as shown in (B) of FIG. 5. Since the icon 261a is the icon corresponding to the search service provided by the application , in the user interface 27, the text "Search Taobao" can also be displayed below the icon 262a to prompt the user that the dual-purpose icon 262a has successfully added the icon corresponding to the search service provided by the application .

[0186] Similarly, as shown in (B) of FIG. 5, the user can also continue to perform a click operation on the addition symbol "+" in the upper right corner of the icon 261b in the icon tab 261, so that the electronic device adds the icon 261b to the second circular blank area contained in the dual-purpose icon 262a in the icon display card 262, and displays the user interface 28 as shown in (C) of FIG. 5. In the user interface 28, the dual-purpose icon 262a has successfully added the icon corresponding to the search service provided by the application and The search service provided corresponds to an icon, at this time the user has completed the combination of the two application service icons contained in the double-intention icon 262a, and the icon 262a can also display the text "search Taobao" and "search Jingdong" below. It can be understood that the user will long press and drag any element to make the electronic device display any door interface, and the double-intention icon 262a shown in the user interface 28 will exist.

[0187] Similarly, the user can also remove the icon from the display card 262 by clicking the removal symbol "-" in the upper right corner of any icon in the icon display card 262, which will not be described in detail here.

[0188] In addition, in this application, when the user customizes the single-intention icon or the double-intention icon fixedly displayed in any door interface, the user can also search for application icons through the search box provided in the interface to filter the number of icons in the icon display card, so as to facilitate the user to select the icon.

[0189] As shown in (D) of FIG. 5, when autonomously combining and setting a double-intention icon, if the user wants to combine and set a double-intention icon for scanning code payment, the user can input the word "payment" in the search box 283 contained in the user interface 28 and click the search control 284, so that only icons related to "payment" are displayed in the icon display card 262, and the electronic device displays the user interface 29 as shown in (E) of FIG. 5.

[0190] As shown in (E) of FIG. 5, in the user interface 29, only icons related to "payment" are displayed in the icon display card 262. Specifically, it can contain icons whose icon names contain the two words "payment", such as icons with icon names "Scan to Pay Alipay", icons with icon names "Local Payment", etc.; It can also contain icons related to the "payment" function determined by the electronic device through fuzzy search, such as icons with names "Scan to Pay WeChat", icons with names "Payment Code WeChat", etc. Similarly, the user can click the addition symbol "+" in the upper right corner of any two icons in these icons in turn to make the two icons respectively displayed in the blank double-intention icon in the icon display card 262, to obtain a new double-intention icon, which will not be described in detail here.

[0191] It can be understood that for some application services, the type of information that can be received is unique, for example, the navigation service provided by the map application can only receive text type information, and cannot receive other types (such as image type) information. Therefore, when the double-intention icon fixedly displayed in the arbitrary door is autonomously set through the operation similar to that shown in FIG. 5, the electronic device can identify the type of element supported by each application service to receive to ensure that at least one same type of element can be received by the corresponding two application services in the combined double-intention icon, so as to prevent the user-combined double-intention icon displayed in the arbitrary door interface from being an invalid double-intention icon.

[0192] Taking FIG. 6 as an example, as shown in (A) of FIG. 6, the user interface 30 can be the user interface 26 in the foregoing description, which can include an icon tab 301 and an icon display card 302. The specific roles and contents of the icon tab 301 and the icon display card 302 can refer to the related description in the foregoing description, which will not be described here again.

[0193] As shown in (A) of FIG. 6, the user currently clicks the adding symbol "+" in the upper right corner of the icon 301a in the icon tab 301 to make the electronic device add the icon 301a to the first circular blank area of the double-intention icon 302a contained in the icon display card 302, and make the electronic device display the user interface 31 as shown in (B) of FIG. 6.

[0194] Since the icon 301a is an icon corresponding to the car-hailing service provided by the application , in the user interface 31, the text "Car-hailing Gaode" can also be displayed below the double-intention icon 302a to prompt the user that the double-intention icon 302a has successfully added the icon corresponding to the car-hailing service provided by the application .

[0195] In addition, since the element type that can be recognized and received by the car-hailing service is only text, after the electronic device adds the icon 301a to the first circular blank area of the double-intention icon 302a in response to the above user operation, the electronic device can stipulate that the service corresponding to the service icon added by the user to the second circular blank area of the double-intention icon 302a also needs to be able to receive text type information. Therefore, in the icons contained in the icon display card 302 of the user interface 31, the electronic device can perform a virtualization process on the icons corresponding to the services that do not support receiving text type elements to prompt that the icons are currently in a non-selectable state, and the user cannot combine these icons with the icon 301a to form a double-intention icon, for example, the icon 301b corresponding to the scan service (which can only receive image type information elements) provided by the application .

[0196] When the user still attempts to add the icon that cannot be dragged by long pressing to the dual-intention icon 302a by operation, the electronic device can output prompt information to the user to prompt that the two application services corresponding to the dual-intention service icon need to support receiving information elements of the same type.

[0197] As shown in (B) of FIG. 6, the user currently attempts to add the icon 301b to the second circular blank area contained in the dual-intention icon 302a in the icon display card 302 by a click operation on the addition symbol "+" in the upper right corner of the icon 301b in the icon tab 301, and the electronic device can display a user interface 32 as shown in (C) of FIG. 6. The user interface 32 can include the icon tab 301 and the icon display card 302 and a snack bar 323. The snack bar can include prompt information "Combined services only support the same type of services" to prompt the user that the information element types supported by the scan service and the car-hailing service are different, that is, the two services are not the same type of services. Optionally, if the user does not perform any operation on the snack bar 323, the snack bar 323 can also automatically disappear after being displayed for a period of time (for example, 2s-3s); or when the snack bar 323 is displayed in the user interface 32, the user can make the snack bar 323 disappear by performing an operation on the user interface 32 other than the position of the snack bar 323.

[0198] Of course, for the application service that supports receiving both text and pictures, the icon corresponding thereto can still be added to the second circular blank area of the dual-intention icon 302a and form a dual-intention icon for receiving text information elements together with the icon 301a. As shown in (C) of FIG. 6, the user currently attempts to add the icon 301c to the second circular blank area contained in the dual-intention icon 302a in the icon display card 302 by a click operation on the addition symbol "+" in the upper right corner of the icon 301c in the icon tab 301, and since the service corresponding to the icon 301c is an application service that supports receiving both text and pictures, the electronic device can add the icon 301c to the dual-intention icon 302a and display a user interface 33 as shown in (D) of FIG. 6. The search service provided can receive information of both text and picture types, and therefore, the electronic device can add the icon 301c to the dual-intention icon 302a and display a user interface 33 as shown in (D) of FIG. 6. As shown in the user interface 33, the icon 302a has successfully added the icon 301c, and the snack bar 323 can also disappear after being displayed for a period of time (for example, 2s-3s). The icon corresponding to the search service provided and The icon corresponding to the provided car-hailing service. At this time, the user has combined the two application service icons contained in the dual-intention icon 302a, and the text "car-hailing Gaode" and "search Taobao" can also be displayed below the icon 262a. It can be understood that the subsequent text element dragged and held by the user can be transmitted to the two application services through the dual-intention icon 302a displayed in any door at the same time for processing.

[0199] In addition, since the corresponding two application services in the dual-intention icon can each receive at least one element of the same type, there can be a case where the corresponding one of the two application services in the dual-intention icon can only receive one type of element (assuming it is text), but the corresponding other application service in the dual-intention icon can receive another type of element in addition to the type of element (assuming that the application service supports receiving text or images). For details, please refer to the aforementioned dual-intention icon 302a, or both of the corresponding two application services in the dual-intention icon can receive text, but one of the application services can only receive a specific type of text (for example, the Taobao coupon service can only recognize and receive text in a specific format). If the element dragged and held by the user is an image, and the user attempts to transmit the dragged information to the two application services corresponding to the dual-intention icon in the arbitrary door interface through the dual-intention icon, only one of the application services can receive the information, and the other application service cannot receive the information. In this case, when the user drags the element to the dual-intention icon and releases the hand, in combination with the information processing logic of the electronic device, the present embodiment provides three different interface display modes, please refer to FIG. 7. For the convenience of description, it is assumed here that the information dragged and held by the user is text information in the chat interface, and the two services corresponding to the dual-intention icon into which the user drags and drops the text information are the navigation service provided by the application "Map" and the Taobao coupon opening service provided by the application "Taobao".

[0200] For the convenience of description, it is assumed here that the information dragged and held by the user is text information in the chat interface, and the two services corresponding to the dual-intention icon into which the user drags and drops the text information are the navigation service provided by the application "Map" and the Taobao coupon opening service provided by the application "Taobao". For the convenience of description, it is assumed here that the information dragged and held by the user is text information in the chat interface, and the two services corresponding to the dual-intention icon into which the user drags and drops the text information are the navigation service provided by the application "Map" and the Taobao coupon opening service provided by the application "Taobao".

[0201] As shown in (A) of FIG. 7, the user interface 34 is the arbitrary door interface mentioned in the foregoing description, which can include a sub-interface 341, an icon area 342, and text 343, and the text 343 does not contain text in a specific format of a Taobao coupon. The dual-intention icon 342a in the icon area 342 corresponds to two services, which are the navigation service provided by the application "Map" and the Taobao coupon opening service provided by the application "Taobao".

[0202] ​​​When the user drags text 343 onto the dual intent icon 342a and releases it, the interface displayed by the electronic device can be any of the following three forms:

[0203] ①Only the newly opened map navigation interface is displayed, while the original WeChat chat interface is displayed in full screen, and the map navigation interface is displayed in a small window.

[0204] In one possible implementation, when the user drags the text 343 onto the double intention icon 342a and releases it, the electronic device can display the user interface 35 as shown in Figure 7(B).

[0205] The user interface 35 may include a main interface 351 and a sub-interface 352. The main interface 351 may be an application in the electronic device. The chat service window provided, sub-interface 352 is the navigation service window provided by the application "Map". This interface is displayed as a floating window above the main interface 351. Users can drag and drop sub-interface 352 to adjust its specific position in the user interface 35, and users can directly operate on sub-interface 351 and interface 352. As can be seen from the user interface 35, sub-interface 352 can include an expand control 3521, a minimize control 3522, and a close control 3523. Specifically: the minimize control 3522 can respond to user operation to make the electronic device collapse sub-interface 352 and display it in the form of a capsule on the side of the screen; the close control 3523 can respond to user operation to make the electronic device close sub-interface 352; the expand control 3521 can respond to user operation to make the electronic device display the application map navigation interface in full screen, that is, to display sub-interface 352 in full screen.

[0206] Understandably, in this embodiment, since the text 343 does not contain text in the format specified by Taobao Password, when the user drags the text 343 onto the double intention icon 342a and releases it, the Taobao Password activation service corresponding to the double intention icon 342a may not respond to the user's operation, and the electronic device will not display the interface used to introduce specific product information after the Taobao Password is activated.

[0207] ② A new map navigation interface is opened, and the application is launched. The main interface (this is not the interface that displays detailed product information after a Taobao link is successfully opened), and the map navigation interface and application. The home screen is displayed in a split-screen manner within the same interface.

[0208] In one possible implementation, when the user drags the text 343 onto the double intention icon 342a and releases it, the electronic device can display the user interface 36 shown in (C) of FIG7.

[0209] The user interface 36 can include a first display area 361, a second display area 362, and a capsule 363. Among them:

[0210] The first display area 361 is used to display a window of the navigation service provided by the application "Map", which can display distance information between the place contained in the text 343 and the current location of the user and route information for the user;

[0211] The second display area 362 is used to display the first page of the application (i.e. the first page content displayed for the user when the user starts the application ).

[0212] Specifically, in the case that the electronic device is a folding screen device and the electronic device is in a folded state, the display area 361 and the display area 362 can be displayed in the form of split screen up and down in the display screen of the electronic device, and in the case that the electronic device is a folding screen device and the electronic device is in an unfolded state, the display area 361 and the display area 362 can be displayed in the form of split screen left and right in the display screen of the electronic device. For details, please refer to the foregoing description, which will not be repeated here.

[0213] The capsule 363 can be displayed on the right side of the user interface 36, which can contain an icon 363a of the application . In addition, the user can change the specific position of the capsule 363 on the side by holding and dragging it. It can be understood that the history displayed in the screen of the electronic device is the window of the chat service provided by the application . Therefore, in order to facilitate the user to browse the chat interface again, the user can click the capsule 363 to make the aforementioned user interface 34 displayed in the form of a small window on top of the user interface 36.

[0214] ③The interface of the newly opened map navigation is displayed in the same interface in the form of split screen with the original WeChat chat interface.

[0215] In a possible implementation, after the user drags the text 343 to the double-intention icon 342a and releases the hand, the electronic device can display the user interface 37 as shown in (D) of FIG. 7.

[0216] The user interface 37 can include a first display area 371 and a second display area 372. Among them:

[0217] The first display area 371 is used to display a window of the navigation service provided by the application "Map", which can display distance information between the place contained in the text 343 and the current location of the user and route information for the user;

[0218] The second display area 372 is used for displaying an application The window of the chat service provided, that is, the interface obtained after the aforementioned user interface 34 is zoomed out.

[0219] Similarly, in a case where the electronic device is a folding screen device and the electronic device is in a folded state, the display area 371 and the display area 372 can be displayed in a split-screen form from top to bottom in the display screen of the electronic device, and in a case where the electronic device is a folding screen device and the electronic device is in an unfolded state, the display area 371 and the display area 372 can be displayed in a split-screen form from left to right in the display screen of the electronic device. For details, reference can be made to the foregoing description, which will not be repeated here.

[0220] In addition, in actual application scenarios, the electronic device does not randomly select one of the aforementioned three interface display modes for display. Specifically, the electronic device can determine which one of the aforementioned three interface display modes to select for display when the electronic device is manufactured; or, in a subsequent process, the user can also select one of the aforementioned three interface display modes through custom setting to make the electronic device display in one of (B), (C), and (D) in FIG. 7.

[0221] As can be known from the foregoing description, after the user long-presses and drags the information to open the arbitrary door interface, the icons displayed in the arbitrary door interface can include single-intent icons and double-intent icons, and both the single-intent icons and the double-intent icons can include icons that are fixedly displayed by the user and icons that are recommended by the electronic device for the user according to the type and content of the information. In order to display the icons in an orderly manner, in the embodiments of the present application, the electronic device can determine the display order of the icons in the icon area of the arbitrary door interface according to the number of icons corresponding to the services and the source of the icons (that is, whether the icons are fixedly displayed by the user or recommended by the electronic device). Specifically, in the icon area of the arbitrary door, the priority of the display order of the icons can be: double-intent icons recommended by the electronic device > double-intent icons fixedly displayed by the user > single-intent icons fixedly displayed by the user > single-intent icons recommended by the electronic device; wherein the higher the priority of the icons, the higher the icons are displayed in the icon area. For details, refer to FIG. 8.

[0222] As shown in FIG. 8, the user interface 38 is any door interface mentioned in the foregoing description, which can include a sub-interface 381, an icon area 382. Among them: the icon area 382 can be used to display a plurality of application service icons determined by the electronic device based on the user's long press drag information. Specifically, these application icons include icons recommended by the electronic device and icons fixedly displayed by the user. Among them, the double-intent icons (such as double-intent icon 382a) recommended by the electronic device are displayed in the sub-area 3821; the icons fixedly displayed by the user are displayed in the sub-area 3822, and in the sub-area 3822, the double-intent icons autonomously set by the user are displayed above the single-intent icons fixedly displayed by the user (for example, the double-intent icon 382b is displayed above the single-intent icon 382c); the single-intent icons recommended by the electronic device are displayed in the sub-area 3823. In this way, in the icon area 382, the double-intent icons can be displayed in the upper part to facilitate user selection.

[0223] It can be understood that in some embodiments, the priority of the display order between the double-intent icons recommended by the electronic device, the double-intent icons fixedly displayed by the user, the single-intent icons fixedly displayed by the user, and the single-intent icons recommended by the electronic device contained in the icon area can also be set in other forms, which is not limited in the present application.

[0224] In some embodiments, when the electronic device is a folding screen device, if the electronic device is in a folded state, it is likely that the user does not have the user demand to simultaneously display a plurality of application service windows in the display screen at this time, and the user does not want to display a plurality of application interfaces in the screen in the form of split screen. Therefore, in the case that the electronic device is in a folded state, after the user opens any door interface by long press dragging information, the electronic device will not display the recommended double-intent icons for the user in the any door interface, and if the user has autonomously set the double-intent icons fixedly displayed in the any door interface, the electronic device will still display the double-intent icons fixedly displayed in the any door interface by the user in the any door interface.

[0225] Next, take FIG. 9 as an example for description.

[0226] Assuming that the user has not autonomously set any double-intent icons fixedly displayed in the any door interface, as shown in (A) of FIG. 9. The user interface 39 is any door interface mentioned in the foregoing description, which can include a sub-interface 391, an icon area 392. Among them: the icon area 392 can be used to display a plurality of application service icons determined by the electronic device based on the user's long press drag information. Since the electronic device is in a folded state at this time and the user has not autonomously set any double-intent icons fixedly displayed in the any door interface, the icon area 392 does not contain any double-intent icons, but only contains single-intent icons such as 392a.

[0227] Assuming that the user history has autonomously set a dual-intent icon which is fixedly displayed in the arbitrary door interface, and the two application services corresponding to the dual-intent icon are the navigation service provided by the application "Map" and the new schedule service provided by the application "Calendar", then as shown in (B) of FIG. 9, the user interface 40 is the arbitrary door interface mentioned in the foregoing description, which can include a sub-interface 401, an icon area 402. Among them: the icon area 402 can be used to display a plurality of application service icons determined by the electronic device based on the long-press drag information of the user. Since the electronic device is in the folded state at this time, but the user history has autonomously set a dual-intent icon which is fixedly displayed in the arbitrary door interface, therefore the dual-intent icon 402a autonomously set by the user can be displayed in the icon area 402, but any dual-intent icon recommended by the electronic device for the user will not be displayed.

[0228] Assuming that the user history has autonomously set a dual-intent icon which is fixedly displayed in the arbitrary door interface, and the two application services corresponding to the dual-intent icon are the navigation service provided by the application "Map" and the new schedule service provided by the application "Calendar", then as shown in (C) of FIG. 9, the user interface 41 is the arbitrary door interface mentioned in the foregoing description, which can include a sub-interface 411, an icon area 412. Among them: the icon area 412 can be used to display a plurality of application service icons determined by the electronic device based on the long-press drag information of the user. Since the electronic device is in the unfolded state at this time, but the user history has autonomously set a dual-intent icon which is fixedly displayed in the arbitrary door interface, therefore in addition to the dual-intent icon 412c autonomously set by the user, the icon area 412 can also display the dual-intent icons recommended by the electronic device for the user, such as the dual-intent icon 412a and the dual-intent icon 412b, and the dual-intent icon 412a and the dual-intent icon 412b recommended by the electronic device can be displayed above the dual-intent icon 412c autonomously set by the user.

[0229] Optionally, in some embodiments, after the information dragged up by the user is placed on the dual-intent icon in the arbitrary door and the hand is released, and after the two application services corresponding to the dual-intent service icon successfully receive the information, the electronic device can not display the two interfaces corresponding to the two application services in the form of up-down split screen or left-right split screen, which can be specifically referred to FIG. 10 and FIG. 11.

[0230] The electronic device in Figure 10 can be a foldable screen device in its unfolded state. As shown in Figure 10(A), the user interface 42 is the "anywhere door" interface mentioned above, which may include a sub-interface 421, an icon area 422, and text 423. The icon area 422 can be used to display multiple application service icons determined by the user from the WeChat chat interface by long-pressing and dragging the text 423. When the user drags the text 423 onto the double-intent icon 422a and releases it, the electronic device can respond to this operation and display the user interface 43 shown in Figure 10(B).

[0231] As shown in Figure 10(B), since the two application services corresponding to the dual intent icon 422a are a navigation service and a new schedule service, the user interface 43 can include a main interface 431, a sub-interface 432, and a sub-interface 433. The main interface 431 can be an application in the electronic device. The application interface has two sub-interfaces: sub-interface 432 is a small window for navigation services provided by the "Map" application, and sub-interface 433 is a small window for creating new schedules provided by the "Calendar" application. Unlike the split-screen display, the total display area occupied by sub-interfaces 432 and 433 can be much smaller than the screen area (i.e., sub-interfaces 432 and 433 do not need to fill the entire display). Users can adjust their specific positions in the user interface 43 by pressing and dragging sub-interfaces 432 and 433. Specifically, when the electronic device initially displays the user interface 43, sub-interfaces 432 and 433 may not have any overlapping areas, but subsequently, sub-interfaces 432 and 433 may overlap due to user dragging.

[0232] In this embodiment of the application, sub-interface 432 can be referred to as the "first region" and sub-interface 433 can be referred to as the "second region".

[0233] The electronic device in Figure 11 can be a foldable screen device in a folded state or a non-foldable screen device. As shown in Figure 11(A), the user interface 44 is the arbitrary door interface mentioned above, which may include a sub-interface 441, an icon area 442, and an image 443. The icon area 442 can be used to display multiple application service icons determined by the electronic device based on the image 443 that the user drags from the web browsing interface provided by the application "browser". When the user drags the image 443 onto the double intention icon 442a and releases it, the electronic device can respond to the operation and display the user interface 45 shown in Figure 10(C).

[0234] As shown in Figure 11(B), the user interface 45 may include a main interface 451, a sub-interface 452, and a capsule 453.

[0235] wherein:

[0236] The main interface 451 can be a webpage browsing interface of an application "browser" in the electronic device.

[0237] The sub-interface 452 is a small window interface provided by the application , which can be used to display information of all relevant commodities searched by the photo album service after identifying the image 443.

[0238] The capsule 453 can be displayed on the right side of the user interface 45, which can contain an icon 453a of the application . The user can change the specific position of the capsule 453 on the side by holding and dragging it.

[0239] It can be understood that, since the double-intention icon 442a corresponds to two application services, namely the photo album service provided by the application and the photo shopping service provided by the application , the electronic device has displayed information of all relevant commodities searched by the photo album service after identifying the image 443 in the form of a small window. Therefore, in order to facilitate the user to quickly call out information of all relevant commodities searched by the photo shopping service after identifying the image 443, the user can perform a click operation on the capsule 453 as shown in (B) of FIG. 11, so that the electronic device displays the user interface 46 as shown in (C) of FIG. 11.

[0240] As shown in (C) of FIG. 11, the user interface 46 can include a main interface 461, a sub-interface 462, and a capsule 463.

[0241] wherein:

[0242] The main interface 461 can be a webpage browsing interface of an application "browser" in the electronic device.

[0243] The sub-interface 462 is a small window interface provided by the application , which can be used to display information of all relevant commodities searched by the photo shopping service after identifying the image 443.

[0244] The capsule 463 can be displayed on the right side of the user interface 45, which can contain an icon 463a of the application . The user can change the specific position of the capsule 463 on the side by holding and dragging it.

[0245] It can be understood that at this time, the electronic device has displayed the information of all the relevant commodities searched by the Taobao by photo service after identifying the image 443 in the form of a small window. Similarly, in order to facilitate the user to quickly call up the information of all the relevant commodities searched by the Taobao by photo service after identifying the image 443, the user can switch the interface displayed on the display screen of the electronic device from the user interface 46 back to the user interface 45 by a click operation on the capsule 463.

[0246] In the embodiments of the present application, the user interface 44 can be referred to as a "second interface", the dual-purpose icon 442a can be referred to as a "third icon", the user interface 45 can be referred to as a "fifth interface", the user interface 46 can be referred to as a "sixth interface", the image 443 can be referred to as "second information", the sub-interface 441 can be referred to as a "first sub-interface", the Taobao by photo service can be referred to as a "fifth application service", the shopping by photo service can be referred to as a "sixth application service", the sub-interface 452 can be referred to as a "suspended window of the fifth application service", the sub-interface 452 can be referred to as a "suspended window of the sixth application service", and the icon area 442 can be referred to as a "first icon area". The operation of the user dragging and releasing the image 443 on the dual-purpose icon 442a can be referred to as a "fifth operation", and the icon 453a can be referred to as an "application service icon corresponding to the sixth application service". The click operation of the user on the icon 453a can be referred to as a "sixth operation".

[0247] In some embodiments, the number of application services corresponding to the multi-purpose service icon recommended and displayed by the electronic device for the user in any door can also be greater than 2. FIGS. 12-13 exemplarily show the interface change process involved in the information transmission of the user to multiple applications through the multi-purpose icon corresponding to the number of application services greater than 2.

[0248] As shown in FIG. 12, the user interface 47 is an arbitrary door interface mentioned in the foregoing description, which can include a sub-interface 471, an icon area 472, and a text 473. Among them:

[0249] The icon area 472 can be used to display a plurality of application service icons determined by the electronic device based on the user's long press and drag of the text 473 from the WeChat chat interface. Specifically, the icon area 472 can contain a four-purpose icon 4721 corresponding to an application service number of 4. As can be seen from (A) in FIG. 12, the four-purpose icon can be composed of four icons a1, a2, a3 and a4. It is assumed here that the four application services corresponding to the four-purpose icon are a navigation service provided by the application "Map", a new schedule service provided by the application "Calendar", a weather service provided by the application "Weather", and a search service provided by the application "Baidu". The search service provided by the application and the sharing service provided by the application "WeChat" (i.e., the application services corresponding to the icons a1, a2, a3 and a4 are the navigation service provided by the application "Map", the new schedule service provided by the application "Calendar", the application The search service provided by the application and the sharing service provided by the application ), after the user drags the text 473 to the four-intention icon 4721 and releases the text 473, the electronic device can respond to the operation, transmit the text 473 to the application services corresponding to the icons a1, a2, a3 and a4, and display the user interface 48 as shown in (B) of FIG. 12.

[0250] As shown in (B) of FIG. 12, the user interface 48 can include a main interface 481, a sub-interface 482 and an icon area 483. Among them:

[0251] The main interface 481 can be a chat interface of the application in the electronic device.

[0252] The sub-interface 482 is a small window interface, which can be an interface of any one of the application services corresponding to the icons a1, a2, a3 and a4.

[0253] The icon area 483 can be displayed below the sub-interface 482, which can include the icons a1, a2, a3 and a4. Any one of the icons can respond to a user operation to make the electronic device update the interface content of the application service corresponding to the icon in the sub-interface 482, and make the display mode of the icon different from the other three icons (indicating that the sub-interface 482 is the interface of the application service corresponding to the icon at this time).

[0254] As shown in (B) of FIG. 12, the electronic device can default the window of the application service corresponding to the icon a1, i.e., the navigation service provided by the application "Map", as the sub-interface 482. In response to the click operation on the icon a2 in the icon area 483 as shown in (B) of FIG. 12, the electronic device can display the user interface 49 as shown in (C) of FIG. 12.

[0255] As shown in (C) of FIG. 12, the user interface 49 can also include the main interface 481, the sub-interface 482 and the icon area 483. However, the main interface 481 is still the chat interface of the application in the electronic device, and the content displayed in the sub-interface 482 has been updated to the interface content of the application service corresponding to the icon a2, i.e., the window of the new schedule service provided by the application "Calendar" at this time.

[0256] Similarly, the user can also switch the sub-interface 482 to the application the window of the search service provided by the application the window of the sharing service provided by the application

[0257] Optionally, in the embodiments of the present application, the user can also cause the window of the application service displayed in the sub-interface 482 to be displayed in split screen with the WeChat chat interface on the screen through corresponding operation, please refer to FIG. 13 for details.

[0258] The user interface 49 shown in (A) of FIG. 13 can be the user interface 49 shown in (C) of FIG. 12, and the specific content contained therein can refer to the related description of FIG. 12. As shown in (A) of FIG. 13, the user can cause the content currently displayed in the sub-interface 482 and the content currently displayed in the main interface 481 to be displayed in the form of split screen in the display screen through the long press and drag operation on the split screen setting control 4821 contained in the sub-interface 482 (if the electronic device is a tablet computer or a folding screen device in unfolded state, it is displayed in the form of split screen from left to right, please refer to the foregoing description for details), so that the electronic device displays the user interface 50 as shown in (B) of FIG. 13.

[0259] As shown in (B) of FIG. 13, the user interface 50 can include a first display area 501, a second display area 502, and a switching control 503. Among them:

[0260] The first display area 501 is used to display the window of the new schedule service provided by the application "Calendar", so as to facilitate the user to establish a new schedule event;

[0261] The second display area 502 is used to display the window of the chat service provided by the application , that is, the interface obtained by zooming out the foregoing user interface 34.

[0262] The switching control 503 can display all icons contained in the icon area 483 (except icon a2, because the window of the new schedule service corresponding to the icon a2 is currently displayed in the first display area, so there is no need to display the icon a2 for the user to switch the service window displayed in the first display area) in response to the user operation, so as to be selected by the user to switch the service window displayed in the first display area.

[0263] As shown in (B) of FIG. 13, the electronic device can display the user interface 51 as shown in (C) of FIG. 13 in response to the user's click operation on the switching control 503. The user interface 51 can include the first display area 501, the second display area 502, and an icon area 511. Among them:

[0264] The icon area 511 can be displayed at the side of the display screen, which can include the icon a1, the icon a3, the icon a4, and a closing control 511a. The closing control 511a can cause the icon area 511 to be hidden and the electronic device to display the user interface 50 as shown in (B) of FIG. 13 in response to the user's operation. In addition, any one of the icons in the icon area 511 can cause the electronic device to display the interface of the application service corresponding to the icon in the first display area 501 in response to the user's operation.

[0265] As shown in (C) of FIG. 13, the electronic device can display the user interface 52 as shown in (D) of FIG. 13 in response to the user's click operation on the icon a4 included in the icon area 511. The user interface 50 can include the first display area 501, the second display area 502, and the switching control 503. Among them:

[0266] The new schedule interface originally displayed in the first display area 501 will be replaced by the window of the application providing a sharing service for the user to share information to the friends in the WeChat list. After switching the window of the service in the display area, the electronic device can automatically hide the icon area 511 and continue to display 503 in the user interface 52.

[0267] The second display area 502 is still used to display the window of the application providing a chat service, that is, the interface obtained by scaling down the aforementioned user interface 34.

[0268] In addition, when the user transmits information to a single application service through a single-intent icon, if the electronic device also displays the newly opened window of the service in the form of a small window in the main interface, the icon area below the small window can also be included, and the icon area can display other single-intent icons recommended by the electronic device for subsequent user switching of information to other application services. Correspondingly, the interface content displayed in the small window will be switched to the content of the window of the service corresponding to the single-intent icon in response to the user's click operation on the single-intent icon. For details, please refer to the related description of FIG. 12 and FIG. 13 above, which will not be repeated here.

[0269] In the embodiments of the present application, the user interface 47 can be referred to as a "second interface", the icon area 472 can be referred to as a "first icon area", the text 473 can be referred to as "second information", the four-intention icon 4721 can be referred to as a "fourth icon". The operation of the user dragging and releasing the text 473 on the four-intention icon 4721 can be referred to as a "seventh operation", the user interface 48 can be referred to as a "seventh interface", the sub-interface 482 can be referred to as a "floating window of the seventh application service", the four application services corresponding to the four-intention icon 4721 can be referred to as "at least two application services", the application service corresponding to the icon a1 can be referred to as a "seventh application service", the application service corresponding to the icon a1 can be referred to as an "eighth application service", the application service corresponding to the icon a4 can be referred to as a "ninth application service", the clicking operation of the user on the icon a2 can be referred to as an "eighth operation", the dragging operation of the user on the split-screen setting control can be referred to as a "ninth operation", the user interface 50 can be referred to as a "ninth interface", the first display area 501 can be referred to as a "third area", the second display area 502 can be referred to as a "fourth area", the clicking operation of the user on the switching control 503 can be referred to as a "tenth operation", and the clicking operation of the user on the icon a4 can be referred to as an "eleventh operation".

[0270] In addition, most electronic devices now provide a smart assistant service, which can identify information such as images, texts, and voices obtained by the electronic device, and provide corresponding services for the user according to the identification results, for example, providing a control for starting a code scanning function for the user when recognizing that the image is a two-dimensional code, or popping up a browser interface for the user to view the web page content corresponding to the link when recognizing that the text contains a web page link. Therefore, in some embodiments, the icon area of any door interface can contain a smart service icon provided by the electronic device, which can identify the information element dragged and held by the user, and recommend one or more application services to the user according to the identification results. Correspondingly, the smart service will transmit all or part of the information contained in the above information element to each application service according to the specific function of each application service. The user can independently select the service he needs from the one or more application services and start it, and make the electronic device display the corresponding interface for the user to browse the window interface corresponding to each application service. For details, please refer to FIGS. 14-15.

[0271] FIG. 14 exemplarily shows the user interface involved in the process of the user selecting two application services from the multiple application services recommended by the smart service according to the information element.

[0272] As shown in (A) of FIG. 14, the user interface 53 can be an application The provided chat interface. Users can long-press on the chat text 531 and drag it to the side of the screen to display the user interface 54 shown in Figure 14(B).

[0273] As shown in Figure 14(B), the user interface 54 is the "anywhere door" interface mentioned above, which may include a sub-interface 541, an icon area 542, and text 543. The text 543 is the text generated by the user's long-press operation of the aforementioned chat text 531.

[0274] The icon area 542 can be used to display one or more application service icons determined by the electronic device based on the user's long press and drag information element. These application service icons may include the smart assistant icon 542a. Specifically, the smart assistant icon 542a may be a service icon intelligently recommended to the user by combining information content, user habits, and embedded data stored by the electronic device during the user's historical usage of the device. Alternatively, it may be a service icon that the user customizes and displays permanently on the AnyDoor interface according to their preferences.

[0275] In the user interface 54, when the user places the dragged text 543 on the smart assistant and releases it, the electronic device can respond to the user's operation to recognize the text 543 and recommend one or more application services to the user based on the recognition result. Accordingly, the electronic device will transmit all or part of the text contained in the text 543 to each application service according to the specific function of each application service, and display the user interface 55 as shown in (C) of Figure 14.

[0276] As shown in Figure 14(C), the user interface 55 may include a main interface 551, service cards 552, 553, 554, and a confirmation / open control 555. Wherein:

[0277] The main interface 551 can be used for applications The provided chat interface. Optionally, to highlight the content displayed in service cards 552, 553, and 554, the application displayed on the main interface... The provided chat interface can be blurred.

[0278] The service card 552, the service card 553 and the service card 554 are all recommended application services for the user according to the recognition result of the electronic device on the text 543. Since the text 543 contains the location information and the store category name, the electronic device recommends the navigation, the store recommendation and the ride-hailing service for the user in the text 543. Specifically, the service card 552, the service card 553 and the service card 554 can be respectively the navigation service card provided by the application "Map", the store recommendation service card provided by the application "Dianping", and the ride-hailing service card provided by the application "Uber". The ride-hailing service card provided by the application "Uber".

[0279] Optionally, in some embodiments, when the user places the dragged information element on the intelligent assistant and releases the hand, the intelligent assistant can recommend the user to display more or less cards according to the specific content of the information element, which is not limited in the present application. In addition, when the number of recommended service cards is sufficient, the electronic device can view the service cards not displayed in the service card through the downward sliding operation in the screen. The upper right corner of the service card 552, the service card 553 and the service card 554 contains the check control of each (i.e. check control 552a, check control 553a and check control 554a). The check control of any service card can respond to the click operation of the user to make the service card selected by the user. After the user clicks the confirmation opening control 553, the electronic device can open the application service corresponding to all the service cards selected by the user, and display the windows corresponding to these application services in a specific form in the same interface.

[0280] As shown in (C) of FIG. 14, the user can click the check control 552a and the check control 553a in sequence to select the service card 552 and the service card 553, and make the electronic device display the user interface 56 as shown in (D) of FIG. 14. Further, as shown in (D) of FIG. 14, the user can continue to click the confirmation opening control 555 to make the electronic device start the navigation service and the store recommendation service corresponding to the service card 552 and the service card 553, and make the electronic device display the user interface 57 as shown in (E) of FIG. 14.

[0281] As shown in (E) of FIG. 14, the user interface 57 can include a main interface 571 and a sub-interface 572. The main interface 571 can be the window of the navigation service corresponding to the service card 552, and the sub-interface 572 can be the window of the store recommendation service corresponding to the service card 553.

[0282] For example, the main interface 571 can be displayed full screen on the screen of the electronic device, and the sub-interface 572 can be fixedly displayed in the form of a small window in the upper right corner or the upper left corner of the main interface.

[0283] Optionally, in some embodiments, the content in the main interface 571 can be browsed and operated by the user, while the content in the sub-interface 572 only supports being browsed by the user and cannot be operated by the user. For example, the user can copy the text in the main interface 571 on the user interface 57, or click the start navigation control in the main interface 571 to start the navigation process, and the electronic device can start playing the navigation prompt sound; but the user can only browse the content in the sub-interface 572, and cannot directly copy the text content in the sub-interface 572 on the user interface 57, nor can the user click to view the image in the sub-interface 572.

[0284] If the user wants to copy the content in the window of the store recommendation service, or wants to view the text information and image information contained in the window of the store recommendation service in detail, as shown in (E) of FIG. 14, the user can exchange the content displayed in the main interface 571 and the sub-interface 572 by clicking the sub-interface 572, and make the electronic device display the user interface 58 as shown in (F) of FIG. 14. In the user interface 58, the main interface 571 displays the related content of the store recommendation service, and the sub-interface 572 displays the related content of the navigation service.

[0285] In the embodiments of the present application, the user interface 53 can be referred to as a "first interface", the user interface 54 can be referred to as a "second interface", the icon area 542 can be referred to as a "first icon area", the text 531 can be referred to as "first information", the text 543 can be referred to as "second information", and the intelligent assistant icon 542a can be referred to as a "fifth icon". The operation of the user dragging the text 543 to the intelligent assistant icon 542a and releasing can be referred to as a "twelfth operation", the user interface 55 can be referred to as a "tenth interface", the service card 552 and the service card 553 can be referred to as a "first service card" and a "second service card" respectively, and the clicking operation of the user on the check control 552a on the service card 552 and the check control 553a on the service card 553 can be referred to as a "thirteenth operation". The clicking operation of the user on the confirmation opening control 555 can be referred to as a "fourteenth operation". The user interface 57 can be referred to as an "eleventh interface", the main interface 571 can be referred to as a "fifth area", the sub-interface 572 can be referred to as a "sixth area", and the clicking operation of the user on the sub-interface 572 can be referred to as a "fifteenth operation".

[0286] In some embodiments, if the user selects two or more application services according to the information elements recommended by the intelligent service and opens them, the electronic device can display the windows of the opened multiple application services in the interface in other forms. For details, please refer to FIG. 15.

[0287] FIG. 15 illustrates a user interface involved in a process in which a user selects three application services from a plurality of application services recommended by the intelligent service according to information elements.

[0288] As shown in (A) of FIG. 15, the user interface 60 can be a user interface displayed by the electronic device after the user drags the text in the chat interface to the intelligent service icon and releases the text. The user interface 60 can include a main interface 601, a service card 602, a service card 603, a service card 604, and an open confirmation control 605. The main interface 14 can be used to display the chat interface provided by the application. The service card 602, the service card 603, and the service card 604 are all application services recommended by the electronic device for the user according to the recognition result after the electronic device recognizes the text. The specific information of the user interface 60 can refer to the foregoing description of the user interface 55 in FIG. 14, which will not be repeated here.

[0289] As shown in (A) of FIG. 15, after the service card 602, the service card 603, and the service card 604 are selected, the user can perform a click operation on the open confirmation control 605 to make the electronic device start the navigation service, the store recommendation service, and the ride-hailing service corresponding to the service card 602, the service card 603, and the service card 604, and make the electronic device display the user interface 61 as shown in (B) of FIG. 15 or display the user interface 63 as shown in (D) of FIG. 15.

[0290] 1) The electronic device displays the user interface 61 as shown in (B) of FIG. 15

[0291] As shown in (B) of FIG. 15, the user interface 61 can include a sub-interface 611, a sub-interface 612, and a sub-interface 613, which are all displayed in the form of small windows in the user interface 61, and the sub-interfaces that are not top-displayed are blocked by other sub-interfaces, for example, in the user interface 61, the sub-interface 612 and the sub-interface 613 are not completely displayed under the blocking of the sub-interface 611. The sub-interface 611, the sub-interface 612, and the sub-interface 613 can be a window of the navigation service provided by the application "Map", a window of the store recommendation service provided by the application , and a window of the ride-hailing service provided by the application . Any of the sub-interfaces can include an expansion control, a minimize control, and a close control (which can refer to the expansion control 611a, the minimize control 611b, and the close control 611c in the sub-interface 611 for details), so that the user can display the sub-interface in the screen in a collapsed, closed, or full-screen manner. For details, refer to the foregoing description, which will not be repeated here.

[0292] Specifically, in the user interface 61, when the sub-interfaces 611, 612 and 613 are displayed in a stacked manner in the user interface 61, the user can change the display positions of the sub-interfaces in the interface by performing a left swipe operation or a right swipe operation on any one of the sub-interfaces. It can be understood that when a sub-interface is swiped and displayed on top of all other sub-interfaces (i.e., the sub-interface is not blocked by other sub-interfaces). In addition, the user can also click on a sub-interface to make the clicked sub-interface directly displayed on top of all other sub-interfaces. As shown in (B) of FIG. 15, the user can perform a left swipe operation on the sub-interface 611 to make the electronic device display the user interface 62 as shown in (C) of FIG. 15. As can be seen from the user interface 62, with the left swipe operation of the user, the sub-interface 612 originally displayed below the sub-interface 611 has been displayed on top of all other sub-interfaces, and the originally top-displayed sub-interface 611 is currently displayed below the sub-interface 612.

[0293] Optionally, in the user interface 15, the user can directly operate the content of the top-displayed sub-interface (e.g., edit, copy, paste text in the sub-interface, or click to confirm the contained control, etc.), while the user cannot directly operate the content in the non-top-displayed sub-interface, and only after the sub-interface is top-displayed, the user can operate the content displayed therein.

[0294] 2) The electronic device displays the user interface 63 as shown in (D) of FIG. 15.

[0295] As shown in (D) of FIG. 15, the user interface 63 can include a window display area 631 and a window thumbnail display area 632. Among them:

[0296] The window display area 631 can be used to display the window of the application service corresponding to any one of the service cards 602, 603 and 604. Optionally, the window display area 631 can display the window of the navigation service corresponding to the service card 602 by default. Optionally, the content displayed in the window display area 631 can be directly operated by the user and changed under the user operation (e.g., editing, copying, pasting text in the sub-interface, or clicking to confirm the contained control, etc. to change the text content in the window display area 631).

[0297] The window thumbnail display area 632 is used to display the window thumbnails of all the application services except the window of the application service displayed in the window display area 631. For example, in the case that the window display area 631 displays the window of the navigation service corresponding to the service card 602, the window thumbnail display area 632 displays the window thumbnail 6321 of the shop recommendation service corresponding to the service card 603 and the window thumbnail 6322 of the ride-hailing service corresponding to the service card 604. Optionally, the contents in the window thumbnails contained in the window thumbnail display area 632 cannot be directly operated by the user. However, any one of the window thumbnails can be responded to the user operation to display the content displayed in the window thumbnail in the window display area 631, so as to facilitate the user to browse and operate the window of the service; correspondingly, the window of the service originally displayed in the window display area 631 will be displayed in the window thumbnail display area 632 in the form of a window thumbnail. As shown in (D) of FIG. 15, the electronic device can respond to the click operation of the user on the window thumbnail 6321 to display the user interface 64 as shown in (E) of FIG. 15.

[0298] As shown in (E) of FIG. 15, the user interface 64 can include the window display area 631 and the window thumbnail display area 632. Wherein:

[0299] The window display area 631 no longer displays the window of the navigation service provided by the application "Map", but displays the window of the shop recommendation service provided by the application "Shop Recommendation". The user can directly operate the content displayed in the window display area 631 at this time, such as editing, copying, pasting the text therein or clicking the control contained therein.

[0300] Correspondingly, in the case that the window display area 631 displays the window of the shop recommendation service, the window thumbnail display area 632 displays the window thumbnail 6323 of the navigation recommendation service and the window thumbnail 6322 of the ride-hailing service corresponding to the service card 604.

[0301] Similarly, the user can also display the window of the ride-hailing service in the window display area 631 by clicking the window thumbnail 6322 of the ride-hailing service, which will not be described here.

[0302] It can be understood that, in some embodiments, after the user places the dragged information element on the intelligent assistant and releases the hand, the user can select more service cards in the service cards recommended by the intelligent assistant and start the services corresponding to the cards, and the number of the service cards recommended by the intelligent assistant and the number of the service cards selected by the user are not limited in the application. Correspondingly, when the user selects more cards, the electronic device can also adaptively adjust the content in the interface when displaying the corresponding user interface subsequently, for example, more sub-interfaces are displayed in the user interface 61 or more window thumbnails are displayed in the window thumbnail 6322, which will not be illustrated one by one here.

[0303] In addition, Figs. 1-15 only exemplarily show the user interfaces provided by the embodiments of the application, which should not constitute a limitation on the embodiments of the application. For example, in Figs. 1-15, the specific style of the double-intent icon provided by the application can also be manifested as other styles, the icon region in any door interface can not be displayed on the right side but in other positions, and the number of icons contained in the icon region in any door interface can also be other numbers, and the application does not limit this.

[0304] In the embodiments of the application, the service card 602 and the service card 603 can be respectively referred to as a "first service card" and a "second service card", the user interface 60 can be referred to as a "tenth interface", the sub-interface 611 can be referred to as a "fifth region", and the sub-interface 612 can be referred to as a "sixth region".

[0305] Fig. 16 exemplarily shows the structure of the electronic device.

[0306] As shown in Fig. 16, the electronic device 100 can include a processor 110, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, a sensor module 180, a key 190, a display screen 194, and the like. The sensor module 180 can include a pressure sensor 180A, a touch sensor 180K, and the like.

[0307] It can be understood that the structure illustrated in the embodiments of the application does not constitute a specific limitation on the electronic device 100. In other embodiments of the application, the electronic device 100 can include more or fewer components than those illustrated, or combine certain components, or split certain components, or different arrangement of components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0308] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices or integrated in one or more processors.

[0309] The controller can generate operation control signals according to the instruction operation code and the timing signal, and complete the control of fetching and executing instructions.

[0310] The processor 110 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that have just been used or are used repeatedly by the processor 110. If the processor 110 needs to use the instructions or data again, it can directly call from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.

[0311] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0312] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can contain multiple sets of I2C buses. The processor 110 can be coupled to the touch sensor 180K, the charger, the flash, the camera, etc. through different I2C bus interfaces respectively. For example, the processor 110 can be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the electronic device 100.

[0313] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the electronic device 100. In other embodiments of the present application, the electronic device 100 can also use different interface connection modes or combinations of multiple interface connection modes in the above embodiments.

[0314] The charging management module 140 is configured to receive charging input from the charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through the wireless charging coil of the electronic device 100. The charging management module 140 can charge the battery 142 and also supply power to the electronic device through the power management module 141.

[0315] The power management module 141 is configured to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to supply power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160, etc. The power management module 141 can also be configured to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. In other embodiments, the power management module 141 can also be arranged in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be arranged in the same device.

[0316] The electronic device 100 realizes the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0317] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1. In some embodiments, the display screen 194 can be a flexible screen, e.g., the display screen 194 can be a foldable screen.

[0318] The pressure sensor 180A is configured to sense a pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. The pressure sensor 180A can be of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor can include at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the force based on the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view short messages is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

[0319] Touch sensor 180K, also referred to as "touch device". Touch sensor 180K can be disposed on display screen 194, and touch sensor 180K and display screen 194 form a touch screen, also referred to as "touch panel". Touch sensor 180K is used to detect touch operation applied thereon or nearby. Touch sensor 180K can transmit the detected touch operation to application processor to determine the touch event type. Visual output related to the touch operation can be provided through display screen 194. In some other embodiments, touch sensor 180K can also be disposed on the surface of electronic device 100, which is different from the position where display screen 194 is located.

[0320] Keys 190 include power on key, volume key, and the like. Keys 190 can be mechanical keys. They can also be touch keys. Electronic device 100 can receive key input and generate key signal input related to user settings and function control of electronic device 100.

[0321] In the present application, after a user drags an information element in the interface, GPU in the electronic device can perform three-dimensional transformation on the content displayed in display screen 194 according to the content displayed in display screen 194, create a visual effect of the original interface being pushed inwards in the screen, and display recommended application and / or service icons on the side of the screen of the electronic device.

[0322] In addition, in the embodiments of the present application, after a user drags an information element in the interface, processor 110 can identify the information element, including identifying the type of the information element and the specific content in the information element, and determine corresponding application icon and / or application service icon based on the identification result, and generate corresponding program instructions, which can be used to change the display information of display screen 194, for example, update the interface in the display screen to a cross-application transmission interface, and the icons displayed in the cross-application transmission interface are the aforementioned application icon and / or application service icon determined by processor 110 based on the identification result.

[0323] In the embodiments of the present application, the processor 110 can analyze the user historical use of the electronic device 110 to generate the buried point data, for example, learn from the buried point data the application services that are started together by the user habit, and the application services that are most frequently used by the user. Optionally, after the processor 110 analyzes the information element that is dragged by the user, the processor 110 can recommend a plurality of application services that are adapted to the information element according to the analysis result, and display a multi-intent icon corresponding to the plurality of application services in any interface. After the user releases the information element on the multi-intent icon, the electronic device can one-key transfer the information element to the application services and start the windows of the corresponding services. Optionally, the windows of the services can be displayed in the interface in a split-screen manner, or are displayed in the interface in the form of a floating window, or a part is displayed in the form of a floating window and another part is displayed in the form of a capsule in the interface, or are displayed in the interface in other combinations, so as to facilitate the user to simultaneously browse the contents of the windows of the plurality of services or flexibly switch the windows of the application services.

[0324] Optionally, in the case of the electronic device 110 being a folding screen device, at the moment, the processor 110 can also acquire the state of the display screen 194, and control the specific display manner of the interface according to the state of the display screen. For example, when the user transmits the information to two application services through the dual-intent icon, if the display screen 194 is in a folded state at the moment, the processor 110 can control the windows of the two application services to be displayed in the same interface in a split-screen manner; and if the display screen 194 is in an unfolded state at the moment, the processor 110 can control the windows of the two application services to be displayed in the same interface in a split-screen manner.

[0325] The embodiments of the present application also provide an electronic device, which comprises one or more processors and a memory; wherein the memory is coupled with the one or more processors, the memory is used to store computer program codes, the computer program codes comprise computer instructions, and the one or more processors invoke the computer instructions to enable the electronic device to perform the method shown in the foregoing embodiments.

[0326] In the above embodiments, according to the context, the term “when” can be interpreted as meaning “if” or “after” or “in response to determining” or “in response to detecting”. Similarly, according to the context, the phrase “upon determining” or “if detecting (the stated condition or event)” can be interpreted as meaning “if determining” or “in response to determining” or “upon detecting (the stated condition or event)” or “in response to detecting (the stated condition or event)”.

[0327] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions can be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) manner. The computer readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. integrated with one or more available media. The available media can be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk) and the like.

[0328] Those of ordinary skill in the art understand that all or part of the processes in the above embodiments can be implemented by a computer program to instruct the relevant hardware, which can be stored in a computer readable storage medium. The program can include the processes of the above method embodiments when executed. The aforementioned storage medium includes ROM or random access memory (RAM), magnetic disk or optical disk, and various media that can store program codes.

Claims

1. An information processing method, characterized in that, include: Display a first interface, the first interface including first information, the first information including one or more of text, images, videos, audio, files, web pages or links; In response to the user's first operation on the first information, a second interface is displayed. The second interface includes a first sub-interface and a first icon area. The first sub-interface is obtained by modifying the first interface. The first icon area includes a first icon and a second icon. The first icon corresponds to a first application service, and the second icon corresponds to a second application service and a third application service. The icons in the first icon area are associated with the first information. Upon receiving a second operation from the user selecting the first icon, a third interface is displayed, the third interface including the window of the first application service; Upon receiving a third operation from the user selecting the second icon, a fourth interface is displayed. The fourth interface includes a first area and a second area. The first area is used to display the window of the second application service, and the second area is used to display the window of the third application service.

2. The method according to claim 1, characterized in that, The second interface also includes second information, which includes part or all of the content of the first information; wherein, The first operation includes long-pressing and dragging the first information; The second operation includes the user dragging the second information to the first icon and releasing it; The third operation includes the user dragging the second information to the second icon and releasing it.

3. The method according to claim 1 or 2, characterized in that, The first region and the second region are displayed in a split-screen manner on the fourth interface, and there is no overlap between the first region and the second region.

4. The method according to claim 3, characterized in that, The first interface displays a fourth application service in full screen. The fourth interface also includes an application service icon corresponding to the fourth application service. After displaying the fourth interface, the method further includes: Upon receiving a fourth operation from the user on the application service icon corresponding to the fourth application service, a third area is displayed in the fourth interface. The third area is used to display the window of the fourth application service, and the third area is displayed in the third interface as a floating window.

5. The method according to claim 3 or 4, characterized in that, The method is applied to foldable screen devices. When the foldable screen device is in an unfolded state, the first area and the second area are displayed in a left-right split-screen manner on the fourth interface. When the foldable screen device is in a folded state, the first area and the second area are displayed in a top-bottom split-screen manner on the fourth interface.

6. The method according to claim 1 or 2, characterized in that, Both the first region and the second region are displayed as floating windows in the fourth interface.

7. The method according to claim 1 or 2, characterized in that, The first icon area also includes a third icon, which corresponds to the fifth application service and the sixth application service. The method further includes: Upon receiving a fifth operation from the user selecting the third icon, a fifth interface is displayed, which includes a floating window for the fifth application service and an application service icon corresponding to the sixth application service.

8. The method according to claim 7, characterized in that, After displaying the fifth interface, the method further includes: In response to the user's sixth operation on the application service icon corresponding to the sixth application service, a sixth interface is displayed, which includes a floating window of the sixth application service and the application service icon corresponding to the fifth application service.

9. The method according to claim 1 or 2, characterized in that, The first icon area also includes a fourth icon, which corresponds to at least two application services. The method further includes: Upon receiving a seventh operation from the user selecting the fourth icon, a seventh interface is displayed. The seventh interface includes at least two application service icons and a floating window of the seventh application service. The seventh application service is included in the at least two application services, and the at least two application service icons correspond to the at least two application services. In response to the user's eighth operation on the application service icon corresponding to the eighth application service among the at least two application service icons, an eighth interface is displayed, the eighth interface including the at least two application service icons and a floating window of the eighth application service.

10. The method according to claim 9, characterized in that, The first interface displays a fourth application service in full screen, and the floating window of the eighth application service contains split-screen settings controls. After displaying the eighth interface, the method further includes: In response to the user's ninth operation on the split-screen settings control, a ninth interface is displayed. The ninth interface includes a third area and a fourth area, which are displayed in a split-screen manner. The third area is used to display the window of the eighth application service, and the fourth area is used to display the window of the fourth application service.

11. The method according to claim 10, characterized in that, The ninth interface further includes a switching control, which corresponds to an application service other than the eighth application service among the at least two application services. After displaying the ninth interface, the method further includes: In response to the user's tenth operation on the switching control, the corresponding application service icon of the ninth application service is displayed in the ninth interface, and the ninth application service is included in the at least two application services; In response to the eleventh operation on the application service icon corresponding to the ninth application service, the window of the eighth application service in the third area is replaced with the window of the ninth application service.

12. The method according to claim 1 or 2, characterized in that, The first icon area also includes a fifth icon, and the method further includes: Upon receiving the twelfth operation of selecting the fifth icon by the user, the tenth interface is displayed. The interface contains multiple service card confirmation controls corresponding to two or more application services; In response to the thirteenth operation on the first service card and the second service card and the fourteenth operation on the confirmation open control, the eleventh interface is displayed. The first service card and the second service card are included in the plurality of service cards. The first service card and the second service card correspond to the tenth application service and the eleventh application service in the two or more application services, respectively. The eleventh interface includes a fifth area and a sixth area, which are displayed in a split-screen manner. The fifth area is used to display the window of the tenth application service and contains a thumbnail of the window of the eleventh application service; or, the fifth area and the sixth area are both displayed in the eleventh interface as floating windows, with the fifth area and the sixth area both used to display the window of the tenth application service.

13. The method according to claim 11, characterized in that... In the case where the fifth region and the sixth region are displayed in a split-screen manner on the eleventh interface, the method further includes: In response to the user's fifteenth operation on the thumbnail of the eleventh application service window, the window of the tenth application service in the fifth region is replaced with the window of the eleventh application service, and the thumbnail of the eleventh application service window in the sixth region is replaced with the thumbnail of the tenth application service window.

14. The method according to any one of claims 1-13, characterized in that, The method is applied to foldable screen devices. When the foldable screen device is in an unfolded state, the first icon area includes icons of multiple application services that are displayed by the user and icons of multiple application services that are recommended to the user by the foldable screen device based on the first information. When the foldable screen device is in a folded state, the first icon area does not include icons of the multiple application services that the foldable screen device recommends to the user based on the first information.

15. An electronic device, characterized in that, The electronic device includes: one or more processors, memory, and a display screen; The memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the method as described in any one of claims 1-14.

16. A chip system, characterized in that, The chip system is applied to an electronic device, the chip system including one or more processors, the processors being configured to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1-14.

17. A computer-readable storage medium comprising instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the method as described in any one of claims 1-14.

Images