Information transmission method and electronic device
By displaying a cross-application transmission interface on the smart device, users can directly drag and drop information elements to the application service icon for transmission, solving the complexity of information transmission across applications in the prior art, and improving interaction efficiency and user experience.
Patent Information
- Application Number
- PCT/CN2024/081308
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-16
- Filing Date
- 2024-03-13
- Publication Date
- 2024-12-19
AI Technical Summary
When existing smart devices transmit information across applications, users need to perform complex and tedious operations, resulting in inefficient interactions and affecting user experience.
Provides an information transmission method. By displaying a cross-application transmission interface on an electronic device, users can directly drag and drop information elements to the application service icon for transmission, reducing operation steps and improving interaction efficiency.
It realizes efficient and fast information transmission across applications, and improves the interaction efficiency and user experience between users and electronic devices.
Smart Images

Figure CN2024081308_19122024_PF_FP_ABST
Abstract
Description
Information transmission method and electronic device
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on June 16, 2023, with application number 202310725366.4 and application name “Information Transmission Method and Electronic Device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of terminal technology, and in particular to an information transmission method and an electronic device. Background Art
[0003] With the continuous development of electronic information technology, smart devices such as mobile phones and tablets have become indispensable products in our daily lives, work, and entertainment. When using smart devices, users often open multiple applications on the device simultaneously to work together. Users also often use smart devices to transfer information across applications, that is, to share or upload information from one application through another application.
[0004] However, when users need to transfer information across applications, they often have to perform complex and tedious operations to complete the process. For example, when a user needs to forward text or images from a webpage in a browser to a WeChat friend, they typically need to copy or save the text, image, and other information in the browser first, then switch to WeChat before sharing or uploading the information. This information transmission method makes the interaction between users and smart devices inefficient and seriously affects the user experience.
[0005] Therefore, it is necessary to study more efficient and convenient information transmission methods.
[0006] Summary of the Invention
[0007] The purpose of this application is to provide an information transmission method and electronic device. By implementing this method, an electronic device can directly respond to a user's operation on information by displaying multiple application service icons on its interface, so that the user can place information into a target application service, enabling the electronic device to efficiently and quickly complete information transmission between applications, effectively reducing the number of steps required for the user to complete cross-application information transmission, improving the efficiency of interaction between the user and the electronic device, and thereby enhancing the user experience.
[0008] The above-mentioned and other objects are achieved by the features of the independent claims. Further implementations are given in the dependent claims, the description and the drawings.
[0009] In a first aspect, the present application provides an information transmission method, the method comprising: displaying a first interface, the first interface comprising a first sub-interface and a second sub-interface, the first sub-interface being used to display an application interface of a first application, the second sub-interface being used to display an application interface of a second application, the first sub-interface comprising first information, the second sub-interface being used to transmit the first information to the second application under a first operation on the first information; displaying a second interface in response to a second operation on the first information; the second interface comprising the first information and at least one application service icon; and transmitting the first information to the application service corresponding to the target icon in response to a third operation on the first information, the target icon being any one of the at least one application service icons.
[0010] In this method, the first interface can be a smart multi-window interface displayed by an electronic device, that is, there are multiple windows in the first interface, each of which corresponds to a sub-interface, and the applications corresponding to the application interfaces displayed by each sub-interface can be different. The first sub-interface and the second sub-interface are two sub-interfaces among the multiple sub-interfaces corresponding to the multiple windows. Optionally, the number of the multiple windows can be 2, and the sub-interfaces corresponding to these two windows are the first sub-interface and the second sub-interface.
[0011] In the first interface, information elements displayed in any of the sub-interfaces corresponding to the multiple windows can be moved to another sub-interface by dragging it by the user, thereby completing cross-application information transfer. For example, when the user drags the first information in the first sub-interface to the second sub-interface, the information element can be transferred from the application corresponding to the first sub-interface to the application corresponding to the second sub-interface.
[0012] However, due to the limited display area of the electronic device, the number of windows (sub-interfaces) in the first interface is limited, and the number of application interfaces that can be displayed is limited. In addition, the user needs to open these applications in advance through corresponding user operations and need to display the application interfaces of these applications in split screen. When the user wants to share the element dragged in the first interface to an application that is not opened (i.e., the application interface is not displayed in the first interface), the sub-interface displayed in the first interface cannot meet this need.
[0013] Therefore, in this method, the second operation can be used to cause the electronic device to display the "cross-application transfer interface" provided in this application, that is, the second interface is used to share the information element of the first interface to an application that is not opened (that is, the application interface is not displayed in the first interface). In the "cross-application transfer interface", the side of the interface can display the service icon of the application recommended by the electronic device for the information element; then, the user places the dragged information element on the icon and releases it, and the information element can be transferred to the application service corresponding to the icon and the corresponding application service function is activated.
[0014] The second operation can be used to select the first information. Specifically, the second operation can be an operation of long pressing the first information and then dragging it to the side of the first interface (i.e., the side of the display screen). If the user does not let go, the dragged first information moves in the first interface with the user's fingertips. When the user drags the first information to a distance less than a certain threshold from the right or left edge of the screen, the electronic device can display the second interface. In the second interface, the application services corresponding to the at least one application service icon are all application services that can receive the above-mentioned first information. For example, when the above-mentioned first information is an image, The friend chat service can send the image, The Moments service can be used to share the image. The beautification service provided by the electronic device can beautify the image, and the search service provided by the electronic device can perform intelligent search on the image, etc. Therefore, the at least one application service icon may include application service icons corresponding to these services.
[0015] Optionally, the at least one application service icon may include multiple application service icons corresponding to one application. It should be noted that the at least one application service icon is an application service icon rather than an application icon, and the at least one application service icon may not be displayed in the first interface. When a user drags the dragged information (such as the first information) onto one of the at least one application service icons, the information may be directly received by the application service corresponding to the icon.
[0016] In the second interface, if the user associates the first information with the target icon through the third operation, the electronic device can transmit the first information to the application service corresponding to the target icon in response to the third operation. Specifically, the third operation can be an operation of dragging the first information close to the target icon, or an operation of dragging the first information onto the target icon and releasing it, or other operations of associating the first information with the target icon, as long as the third operation can select the target icon required by the user from the at least one application service icon and associate the first information with the target icon.
[0017] It can be understood that the information transmission process provided by this application is continuous from the time the user drags up the first information to the time the first information is placed into the application service corresponding to the target icon. The "continuous" here means that the user does not need to perform operations such as copying and pasting, nor does he need to switch applications. The user's fingers do not need to leave the screen of the electronic device during the entire operation process. The operation is simple and fast, which can effectively improve the user's efficiency in transmitting information across applications and enhance the user experience.
[0018] Optionally, the second interface may also display a third sub-interface. The element content displayed in the third sub-interface is the same as the element content displayed in the first interface (except the status bar). In fact, the third sub-interface displayed in the second interface can be considered as the interface obtained by the electronic device after performing a three-dimensional transformation of all the element content of the first interface (except the status bar). In the second interface, the sub-interface can create a visual effect on the screen that the original interface (i.e., the first interface) is pushed inward. It is understandable that this "opening the door" visual effect metaphorically represents the behavior of transmitting elements (i.e., the first information), which is more intuitive than copying and pasting, and this information transmission method ensures the effective browsing area of the user interface, and can transmit the first information to other application services while viewing the historical application interface (i.e., the first interface) through the sub-interface, which can further enhance the user experience. Optionally, in the second interface, the background behind the sub-interface can be set to the desktop background of the electronic device (i.e., the desktop wallpaper) superimposed with a blurred effect to provide users with better visual effects.
[0019] In combination with the first aspect, in one possible embodiment, the first sub-interface and the second sub-interface are displayed in a top-bottom split screen or a left-right split screen; or, the first sub-interface and the second sub-interface are displayed in a picture-in-picture format.
[0020] In this embodiment, when the first sub-interface and the second sub-interface are displayed in a vertical split-screen or a left-right split-screen manner, this application does not limit the relative positions of the first sub-interface and the second sub-interface within the first sub-interface. For example, the first sub-interface can be displayed above the second sub-interface or below the second sub-interface.
[0021] When the first sub-interface and the second sub-interface are displayed in the form of picture-in-picture, the first sub-interface is an interface displayed in full screen, then the second sub-interface can be an interface displayed in a floating window (small window); the first sub-interface can also be an interface displayed in a floating window (small window), then the second sub-interface can be an interface displayed in full screen, and this application does not limit this. Accordingly, when information is transmitted between the two applications corresponding to the first sub-interface and the second sub-interface, the user can drag the information elements in the interface displayed in the floating window (small window) to the interface displayed in full screen, or drag the information elements in the interface displayed in full screen to the interface displayed in the floating window (small window). When using the "cross-application transmission interface" provided by this application to share the information elements in the first interface to other applications that do not display application interfaces in the first interface, the user can also drag the information elements in the interface displayed in the floating window (small window) or the information elements in the interface displayed in full screen to the side of the screen so that the electronic device displays the "cross-application transmission interface", that is, the second interface.
[0022] In combination with the first aspect, in a possible implementation manner, the second operation is an operation of associating the first information with the target icon.
[0023] In combination with the first aspect, in a possible implementation manner, the second operation is an operation of moving the first information to the target icon.
[0024] Specifically, in this embodiment, moving the first information to the target icon may be moving the first information around the target icon so that the target icon is the icon closest to the first information among the at least one application service icon; or, moving the first information to the target icon may be moving the first information above the target icon. It should be understood that "above" here means that the first information overlaps with the target icon, and the first information is displayed over the target icon.
[0025] Optionally, the second operation may also include leaving the first information on (or around) the target icon for a period of time (for example, 120ms), or dragging the first information onto (or around) the target icon and then directly releasing it, so as to trigger the transmission of the first information to the application service corresponding to the target icon.
[0026] In combination with the first aspect, in one possible implementation, in the process of moving the first information to the target icon, the target icon is enlarged and / or the position of the target icon in the first interface is moved, and the direction of moving the target icon is opposite to the direction of moving the first information.
[0027] In this embodiment, in order to guide the user to accurately place the first information into the application service they need, in the process of dragging the first information to the target icon, when the first information is close to the target icon (here it is assumed that the target icon is always the icon closest to the first information among the at least one application service icon during the entire dragging process), the target icon can be enlarged, and the target icon can be moved in the second interface to make the target icon closer to the first information, creating a visual effect in the second interface that the target icon is absorbed by the first information (that is, the moving direction of the first information is opposite to the moving direction of the target icon, and both are approaching each other), so as to prompt the user that the first information has been associated with the target icon. If the user lets go here, the first information will be transmitted to the application service corresponding to the target icon.
[0028] Optionally, the electronic device will enlarge the target icon in the second interface and / or move the position of the target icon in the first interface only when the distance between the first information and the target icon is less than a first threshold.
[0029] In combination with the first aspect, in one possible implementation, the at least one application service icon includes at least one first icon, and the at least one first icon is an application service icon recommended based on the first information.
[0030] In this embodiment, the electronic device can recommend icons to the user based on the content contained in the first information. Specifically, for this part of the icons recommended by the electronic device to the user, the electronic device can first identify the first information that is dragged up (the electronic device has not yet displayed the second user interface at this time), and obtain the application service icon that meets the user's needs in the second interface based on the identification result. The identification result may include the type of the first information and the element content contained in the first information. For example, assuming that the first information is a picture containing a QR code image, the electronic device can identify the QR code image in the first information, and display the application service icon that can scan the QR code to the user in the second interface, such as WeChat-Scan, Alipay-Scan, etc.; assuming that the first information is a picture containing a face image, the user can identify the face image in the first information, and display the application service icon that can beautify the image or can be used to share the image in the second interface, such as Meitu-Portrait Beautification, WeChat-Friends Circle, etc. For another example, assuming that the first information is text containing location information, the electronic device can recognize the location information in the text and display application service icons for the user to navigate or take a taxi based on the location information in the second interface, such as AutoNavi Map-Navigation, AutoNavi Map-One-click Taxi, etc.; assuming that the above-mentioned first information is text containing time and location information, the electronic device recommends schedule-related application service icons to the user, such as Schedule-Add Schedule, etc.
[0031] That is, when a user drags up two information elements in succession, even if the two information elements are of the same type (for example, both are text or both are images), if the content contained in the two information elements is different (for example, the image content is different or the text has different characters), then the at least one application service icon displayed on the electronic device based on the two elements may also be different; it should be understood that the "different" mentioned here may include different icon types and different icon orders. Optionally, the icon of the application service recommended to the user (i.e., the at least one first icon) is displayed in the icon area; among the at least one first icon, the icon corresponding to the application service that is more in line with the current user's intention will be located at the top of the icon area. The current user's intention can be determined based on the content of the elements contained in the dragged information. For example, when the information is an image and contains a QR code image, icons corresponding to application services such as WeChat-Scan and Alipay-Scan can be displayed at the top of the at least one application service icon; when the information is text and contains location information, icons corresponding to application services such as AutoNavi Map-Navigation and AutoNavi Map-One-Click Taxi can be displayed at the top of the at least one application service icon.
[0032] In combination with the first aspect, in one possible embodiment, after transmitting the first information to the application service corresponding to the target icon, the method also includes: displaying a third interface, the third interface including all the contents of the first interface, and the third interface also includes any one of a floating window and an information feedback bar, the floating window is used to display the target icon or the application service interface corresponding to the target icon, and the information feedback bar is used to prompt the electronic device of the transmission result of the first information.
[0033] In this embodiment, after the information is transmitted across applications through the second interface, the electronic device can also provide the user with different prompt methods and display different interface effects according to the type of application service entered by the information and the result of the information transmission, so as to prompt the user to know the transmission result of the first information and proceed to the next step.
[0034] In combination with the first aspect, in one possible embodiment, the third interface includes a floating window, which is used to display the target icon. The third interface also includes second information. After displaying the third interface, the method also includes: in response to a fourth operation on the second information, transmitting the second information to the application service corresponding to the target icon, and the fourth operation is an operation of associating the second information with the floating window.
[0035] In this embodiment, it is understood that, except for the floating window, the content of the third interface is the same as that of the first interface. The floating window is a minimized floating window that may not display the application interface but only the target icon. The floating window may be displayed close to the right or left edge of the third interface to reduce obstruction of the third interface, so that the user can continue to transfer information in the third interface (such as the second information) to the application service corresponding to the target icon.
[0036] Optionally, in this embodiment, the floating window can be expanded in response to a user's click operation. After being expanded, the floating window can be displayed in the third interface (at this time, the floating window can no longer be displayed edge to edge, but it is still not displayed in full screen), and it can display an expansion control, which can respond to user operations to display the application interface in the floating window in full screen on the screen.
[0037] In combination with the first aspect, in one possible embodiment, the third interface includes a floating window, which is used to display the application service interface corresponding to the target icon, and the floating window includes an expansion control. After displaying the third interface, the method also includes: in response to a fifth operation on the expansion control, displaying the application service interface displayed in the floating window in full screen.
[0038] When the target icon corresponds to an application service such as navigation or search, which requires displaying a new application service interface, the electronic device needs to immediately display the application service interface corresponding to the target icon to the user. Therefore, in this embodiment, the floating window is a floating window that is displayed on top of the third interface. The third interface can still display the content of the first interface, while the floating window can display the application service interface corresponding to the target icon.
[0039] In combination with the first aspect, in one possible embodiment, the third interface includes an information feedback bar, the information feedback bar includes a jump control, and after displaying the third interface, the method further includes: in response to a sixth operation on the jump control, displaying a fourth interface, the fourth interface being the application service interface corresponding to the target icon.
[0040] When the target icon corresponds to an application service such as a global favorite, after such an application service receives the first information, the user may not need to understand and browse the interface of the application service, but only needs to know whether the electronic device has successfully received the first information. Therefore, in this embodiment, after the first information is transmitted to the application service corresponding to the target icon, the electronic device does not need to directly jump to its corresponding application interface, but only needs to inform the user of the result of the information transmission. Therefore, the information feedback bar can be displayed in the third interface to prompt the user of the result of the first information transmission. The information feedback bar is a jump bar, which can include the jump control, so that the user can quickly enter the application service interface corresponding to the target icon by clicking the jump control to view the processing result of the application service corresponding to the target icon on the first information.
[0041] In combination with the first aspect, in one possible embodiment, the first interface also includes a first trigger area and a second trigger area, the first trigger area is larger than the second trigger area, the second operation includes a first sub-operation and a second sub-operation, the first sub-operation is an operation of moving the first information to the first trigger area, and the second sub-operation is an operation of moving the first information to the second trigger area, and the second interface is displayed in response to the second operation on the first information in the first interface, including: in response to the first sub-operation, when the first information stays in the first trigger area for a first time length, displaying a light band guide special effect in the first interface, the light band guide special effect being used to indicate that the first information is moved to the second trigger area; in response to the second sub-operation, displaying the second interface.
[0042] Since dragging information between different sub-interfaces in the first interface can also complete cross-application transmission of information, and in the daily use of electronic devices, users often drag some elements, these dragging operations may not be for the purpose of transferring the dragged elements across applications (for example, dragging text in document editing to change the position or paragraph of text), therefore, how to combine user operations and user operating habits to guide users to use the transmission method provided in this application, and set the trigger rules of the "cross-application transmission interface" in this method for users, is the key to further improving the efficiency of user interaction with electronic devices.
[0043] Therefore, in this embodiment, the first interface may include the first trigger area and the second trigger area. Optionally, the specific size and position of the first trigger area and the second trigger area may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of the two areas in the first interface. The size and position of the two areas can only be stored in the electronic device in a form that is perceptible to the electronic device (such as program code). When the user drags the first information into the first trigger area, the electronic device may display a special effect in the first interface (such as the edge of the first interface) to prompt the user to drag the image further in the direction closer to the second trigger area; the special effect may be a user-visible special effect such as a luminous special effect, a shadow special effect, or other user-perceptible special effect, which is not limited in this application; optionally, the electronic device may display a special effect in the first interface only after the user drags the first information into the first trigger area and keeps the first information in the first trigger area for a period of time T. Specifically, T can be set to 600 milliseconds.
[0044] When the user continues to drag the first information to the second trigger area, the electronic device can immediately respond to the operation and display the second interface.
[0045] In an optional embodiment, the second interface further includes a door-closing trigger area. When the user drags the first information into the door-closing trigger area, the electronic device may stop displaying the second interface and redisplay the first interface. If the user does not release the first information, the first information remains in the state of being dragged by the user in the first interface when the first interface is redisplayed, so that the user can reselect a method for transferring the information across applications.
[0046] In combination with the first aspect, in one possible embodiment, when the first sub-interface and the second sub-interface are displayed in a split-screen manner, the first trigger area exists in both the first interface and the second sub-interface, and the second trigger area exists in both the first interface and the second sub-interface.
[0047] In this embodiment, no matter which sub-interface the element dragged by the user belongs to, when the first trigger area exists in both the first interface and the second sub-interface, and the second trigger area exists in both the first interface and the second sub-interface, the electronic device can respond to the user operation in a timely manner to guide the opening of the "cross-application transmission interface".
[0048] In combination with the first aspect, in one possible embodiment, the second interface also includes an icon area, and the at least one application service icon is displayed in the icon area. The at least one application service icon also includes at least one second icon, and the at least one second icon is a custom-displayed application service icon. The at least one first icon is displayed above the at least one second icon.
[0049] In this embodiment, the at least one application service icon is displayed in the icon area, and the at least one application service icon in the second interface can be divided into two parts, one of which is an icon that is fixedly displayed on the right (i.e., the at least one second icon), and the other part of the icon can be an application service icon recommended to the user based on the first information. Optionally, a dividing line can be displayed between the two parts of icons for distinction. Among them, the at least one second icon is an icon that the user customizes based on his or her own usage habits and frequency of use. Regardless of what information the user shares based on the electronic device, the electronic device can include this part of icons in the icons displayed based on the information to meet the user's needs as much as possible; and the at least one first icon is recommended by the electronic device based on the elements contained in the first information. When the user shares other information through this method, the recommended application service icon can be different from the icon in the at least one first icon.
[0050] In combination with the first aspect, in one possible embodiment, the at least one application service icon includes at least one icon displayed in the icon area and at least one icon not displayed in the icon area, the target icon is not displayed in the icon area, and the second interface also includes a third trigger area. Before responding to the second operation on the first information, the method also includes: in response to a seventh operation on the first information, updating the at least one icon displayed in the icon area until the target icon is displayed in the icon area, and the seventh operation is an operation to move the first information to the third trigger area.
[0051] The electronic device can recommend multiple application services that can receive the first information to the user based on the first information, and display the icons of these application services on the right side of the second interface. Specifically, the upper limit of the number of these application service icons can be 20. In this embodiment, when the number of these application service icons exceeds a certain threshold (for example, 7), in order to ensure the neatness and visibility of the interface, the electronic device can only display a part of these application service icons (for example, 7) in the second interface at the same time; when the icons currently displayed on the second interface are not the application services expected by the user, the user can also place the first information in the third trigger area to enable the electronic device to update the icons in the icon area. Specifically, the third trigger area can be set directly above and / or directly below the icon area.
[0052] In combination with the first aspect, in a possible implementation manner, an area of the first information in the second interface is smaller than an area of the first information in the first interface.
[0053] It is understood that in the method provided in this application, the first information in the second interface contains the same content as the first information in the first interface. However, in order to reduce the large area of the at least one application service icon blocked by the first information in the second interface, in this embodiment, after entering the second interface, the area of the first information can be reduced to facilitate the user's selection of the application service icon.
[0054] In combination with the first aspect, in a possible implementation manner, the first information is any one of an image, text, an audio file, a video file, and a document file.
[0055] In second aspect, the present application provides a method for information transmission, including: in response to any one of a global screenshot operation, a local screenshot operation, and a long screenshot operation on a fifth interface, displaying a sixth interface, wherein the sixth interface includes a first image obtained by screenshotting the fifth interface; in response to an eighth operation on the first image in the sixth interface, displaying a seventh interface; the seventh interface includes the first image and at least one application service icon; in response to a ninth operation on the first image in the seventh interface, transmitting the first image to the application service corresponding to the target icon, wherein the target icon is any one of the at least one application service icon.
[0056] Currently, most smart devices provide users with a quick screenshot function. For example, in some scenarios, users can double-click the screen or swipe down with three fingers to take a full-screen screenshot of the current interface of the electronic device. In some embodiments, the electronic device can also temporarily display the image captured by the user through the full-screen screenshot operation as a thumbnail in the interface. Therefore, in this embodiment, after the user captures an image through the full-screen screenshot operation, the image is displayed as a thumbnail in the first interface. The user can use the quick screenshot function and the transmission method provided in this application to more quickly transfer the captured image to the application service corresponding to the target icon.
[0057] In combination with the second aspect, in a possible embodiment, the first image is an image obtained by performing a global screenshot operation on the fifth interface, and the display of the seventh interface in response to the eighth operation on the first image in the six interfaces includes: in response to a click operation on the first image in the sixth interface, an editing interface is displayed, the editing interface includes the first image and an editing option, and the editing option is used to edit the first image; in response to the editing operation on the first image through the editing option, after the image content of the first image in the editing interface is updated, in response to the move operation on the first image in the editing interface, the seventh interface is displayed, and the eighth operation includes the click operation, the editing operation and the move operation.
[0058] It is understandable that after using the quick screenshot function to capture an image, the user may also need to edit the obtained image, such as further capturing the captured image to change its image area, or marking important content in the image with a brush, and then sharing or uploading the edited image to other applications. Therefore, in this embodiment, after the electronic device briefly displays the image captured by the user through the full-screen screenshot operation in the form of a thumbnail (i.e., the first image) in the sixth interface, the user can enter the image editing interface through the click operation; in the editing interface, the user can edit the first image accordingly. After the editing operation is completed, the electronic device still displays the editing interface, and the user can directly use the move operation in the editing interface to make the electronic device display the second interface, and transmit the edited image (i.e., the first information) to the application service corresponding to the target icon through the ninth operation.
[0059] In the third aspect, the present application provides a method for information transmission, including: in response to a partial screenshot operation on an eighth interface, displaying a ninth interface, the ninth interface including a second image obtained by performing a partial screenshot operation on the eighth interface and a text recognition control, the text recognition control being used to recognize the text contained in the second image; in response to a click operation on the text recognition control, displaying a tenth interface, the tenth interface including first text information obtained by recognizing the second image; in response to a tenth operation on the first text information in the tenth interface, displaying an eleventh interface; the eleventh interface including the first text information and at least one application service icon; in response to the eleventh operation on the first text information in the eleventh interface, transmitting the first text information to the application service corresponding to the target icon, the target icon being any one of the at least one application service icon.
[0060] After the user takes a screenshot, some smart devices also provide the user with a recognition function in this scenario, which is used to identify the image captured by the user (for example, extracting text from the image or translating text, etc.). Therefore, with respect to the screenshot function provided by the electronic device, in this method, the electronic device can quickly obtain the image selected by the user using the knuckle frame through the partial screenshot operation, and display the ninth interface. In the ninth interface, the user can identify the text information contained in the image selected by the partial screenshot frame by clicking the text recognition control; thereafter, the user can perform the tenth operation on the first text information obtained by the recognition to make the electronic device display the "cross-application transmission interface" provided by this application, that is, the tenth interface, and transmit the text information (that is, the first information) to the application service corresponding to the target icon through the eleventh operation.
[0061] Optionally, after using the text recognition control to identify the text information, the text information contained in the image selected by the local screenshot box can be selected by the first cursor and the last cursor box. The user can also adjust the position of the first cursor and the last cursor to further filter the text information to obtain the first text information that he needs to transmit.
[0062] In a fourth aspect, the present application provides an electronic device, comprising: one or more processors and a memory; the memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code comprising computer instructions, the one or more processors calling the computer instructions to enable the electronic device to execute the method in the first aspect or any possible implementation of the first aspect, the method in the second aspect or any possible implementation of the second aspect, and the method in the third aspect.
[0063] In a fifth aspect, the present application provides a chip system, which is applied to an electronic device, and the chip system includes one or more processors, and the processors are used to call computer instructions to enable the electronic device to execute the method in the first aspect or any possible implementation of the first aspect, the method in the second aspect or any possible implementation of the second aspect, and the method in the third aspect.
[0064] In a sixth aspect, the present application provides a computer-readable storage medium comprising instructions, which, when the instructions are executed on an electronic device, enables the electronic device to execute the method in the first aspect or any possible implementation of the first aspect, the method in the second aspect or any possible implementation of the second aspect, and the method in the third aspect.
[0065] In the seventh aspect, the present application provides a computer program product comprising instructions, which, when the above-mentioned computer program product is run on an electronic device, enables the above-mentioned electronic device to execute the method in the first aspect or any possible implementation of the first aspect, the method in the second aspect or any possible implementation of the second aspect, and the method in the third aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0066] FIG1 is a schematic diagram of a process for transmitting information across applications according to an embodiment of the present application;
[0067] FIG2 is a schematic diagram of a process for transmitting information across applications according to an embodiment of the present application;
[0068] FIG3 is a schematic diagram of a process for transmitting an image across applications according to an embodiment of the present application;
[0069] FIG4 is a schematic diagram of a process for transmitting text across applications according to an embodiment of the present application;
[0070] FIG5 is a schematic diagram of a process for transmitting information across applications in a horizontal screen state according to an embodiment of the present application;
[0071] FIG6 is a schematic diagram of a process for transmitting a global screenshot image across applications according to an embodiment of the present application;
[0072] FIG7 is a schematic diagram of a process for transmitting a partial screenshot image across applications according to an embodiment of the present application;
[0073] FIG8 is a schematic diagram of a process for transmitting text in a partial screenshot image across applications according to an embodiment of the present application;
[0074] FIG9 is a schematic diagram of a process of triggering a “cross-application transmission interface” operation according to an embodiment of the present application;
[0075] FIG10 is a schematic diagram of an operation process of closing a “cross-application transmission interface” provided in an embodiment of the present application;
[0076] FIG11 is a schematic diagram of an operation process of closing a “cross-application transfer interface” provided in an embodiment of the present application;
[0077] FIG12 is an interface diagram of some cross-application transmissions through the split-screen function provided in an embodiment of the present application;
[0078] FIG13 is an interface diagram of cross-application transmission via the “cross-application transmission interface” in some split-screen states provided by an embodiment of the present application;
[0079] FIG14 is an interface diagram of some picture-in-picture functions for cross-application transmission provided in an embodiment of the present application;
[0080] FIG15 is an interface diagram of cross-application transmission via the “cross-application transmission interface” in some picture-in-picture states provided by an embodiment of the present application;
[0081] FIG16 is an interface diagram of a snack bar for feedback after some information is transmitted across applications according to an embodiment of the present application;
[0082] FIG17 is a schematic diagram of an interface for providing feedback in the form of capsules after information is transmitted across applications according to an embodiment of the present application;
[0083] FIG18 is a schematic diagram of a process of performing secondary transmission through a capsule and then expanding the capsule according to an embodiment of the present application;
[0084] FIG19 is a schematic diagram of an interface for providing feedback in a floating window after some information is transmitted across applications according to an embodiment of the present application;
[0085] FIG20 is a schematic diagram of an interface for providing feedback via a snackbar after some information is transmitted across devices according to an embodiment of the present application;
[0086] FIG21 is a schematic diagram of an interface for providing toast feedback after some information cross-device transmission fails according to an embodiment of the present application;
[0087] FIG22 is a schematic diagram of a process for updating icons in an icon area according to an embodiment of the present application;
[0088] FIG23 is an interface diagram showing some application service icons for users based on location information provided by an embodiment of the present application;
[0089] FIG24 is an interface diagram showing some application service icons for users based on location and time information provided by an embodiment of the present application;
[0090] FIG25 is an interface diagram of some application service icons displayed to users based on QR code images provided in an embodiment of the present application;
[0091] FIG26 is an interface diagram showing some application service icons for users based on facial images provided by an embodiment of the present application;
[0092] FIG27 is an interface diagram of some information transmission via chat interface thumbnails in the “cross-application transmission interface” provided by an embodiment of the present application;
[0093] FIG28 is an interface diagram of some cross-application information transmission via sidebar icons provided in an embodiment of the present application;
[0094] FIG29 is an interface diagram of some custom sidebar icons provided in an embodiment of the present application;
[0095] FIG30 is a schematic diagram of a process for transmitting a screen recording file across applications according to an embodiment of the present application;
[0096] FIG31 is a schematic diagram of a process for transmitting an edited screenshot image across applications according to an embodiment of the present application;
[0097] FIG32 is a schematic diagram of a process for transmitting a long screenshot image across applications according to an embodiment of the present application;
[0098] FIG33 is a diagram of a system setting interface related to some “smart transfer” functions provided in an embodiment of the present application;
[0099] FIG34 is a diagram of a system setting interface related to some “smart transfer” functions provided in an embodiment of the present application;
[0100] FIG35 is a diagram illustrating an electronic device according to an embodiment of the present application;
[0101] Figure 36 is a flowchart of an information transmission method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0102] The terms used in the following examples of the present application are for the purpose of describing specific embodiments only and are not intended to limit the present application. As used in the specification and appended claims of the present application, the singular expressions "a," "an," "said," "above," "the," and "this" are intended to include plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used in the present application refers to and encompasses any or all possible combinations of one or more of the listed items.
[0103] To facilitate understanding, the following first introduces the relevant terms involved in the embodiments of this application.
[0104] (1) Information transmission across applications and devices
[0105] Cross-app information transfer refers to the transfer of information between two apps on the same device. This means obtaining target information through one app and sharing, saving, or editing it through another app. For example, you can forward text or images from a webpage in a browser to a WeChat friend, or send a picture sent by a WeChat friend to a QQ friend.
[0106] Cross-device information transmission occurs when two devices establish a communication connection via Wi-Fi, Bluetooth, or a cellular network. For example, a user might use Bluetooth to transfer a picture between two devices, or share a picture from a mobile phone to a PC on the same network.
[0107] Specifically, the above information can be pictures, text, video, voice, links, documents, etc.
[0108] (2) Cross-application transmission interface
[0109] In this application, the "cross-application transmission interface" (or cross-application transmission interface) is an interactive method provided by an electronic device based on the user's demand for cross-application and cross-device information transmission. In some embodiments of this application, this function can also be called "smart flow". As its name suggests, in any interface displayed by an electronic device, when the user needs to transmit information in the interface across applications or across devices, the user only needs to long press the information element in the interface and drag it to the edge of the screen. The electronic device will transform the original interface displayed on the screen into three dimensions, creating a visual effect of pushing the original interface inward on the screen, and display the electronic device's recommended icon for the element on the side of the screen (for details, please refer to the relevant description of the subsequent embodiments, which will not be repeated here). The recommended icon can be the service icon of the application; after that, the user places the dragged information element on the icon and lets go, and the information element can be transferred to the application service corresponding to the icon and start the corresponding application service function. Specifically, in this application, an application APP installed in an electronic device may have multiple application services. In the cross-application transmission interface provided by this application, the service icons of the applications displayed may include some or all of the application service icons provided by the same application APP. This application does not limit this.
[0110] (3) Small windows, capsules, snack bars, toast feedback, and side app bars
[0111] "Small window" is a system tool of smart devices. It can float the operation window of an application above the interface or on the desktop, allowing users to easily switch between recently used applications. As a reduced application interface, the floating window can be displayed on top of other application interfaces (such as the application interface displayed in full screen), and the small window can still display the interface style and function list inherent to its corresponding application. Users can directly operate the controls in the floating window interface to use the corresponding functions without closing or exiting the application interface of other applications. For example, when playing games or watching videos in full screen, you suddenly receive a message from WeChat, QQ, etc., and its corresponding chat interface can be directly above the game interface in the form of a floating window. Users can view and reply to messages in the chat interface displayed in the small window without switching or exiting the currently open application.
[0112] "Capsule" is a form of mini-window after minimization, named because of its capsule-like shape. Unlike mini-windows, it generally cannot display the inherent interface style and function list of its corresponding application, and will only be displayed as a small icon on the side of the electronic device screen. Users can expand the capsule by clicking on it. After expansion, the capsule will be displayed at the top of the screen in the form of an application interface (such as a mini-window).
[0113] "Toast feedback" is a lightweight feedback method and a form of non-modal pop-up window. Common toast feedback is expressed as text or a combination of icon and text. The location of the page will be designed at the top, middle or bottom of the page according to different scenarios. It will automatically disappear after a certain time interval (3s to 5s), or it will automatically disappear when the user clicks elsewhere. Toast feedback will not interrupt the user's current operation process and will cause minimal disturbance to the user. Its disadvantage is that it is easily ignored by users and is not suitable for displaying too much information. It may disappear before the user has finished reading the information.
[0114] "Snack bar" is a lightweight feedback method that is slightly heavier than toast. It contains a line of text related to the ongoing operation and may contain corresponding jump controls to facilitate users to browse the application interface related to the aforementioned ongoing operation. Snack bar is also a non-modal pop-up window, generally used to notify users that the program is undergoing or is about to undergo a process. Its content must be related to the user's current operation. It usually appears briefly at the bottom of the screen, does not interrupt the user experience, does not require any user operation, and will automatically disappear after a period of time. In addition, in some embodiments, if a snack bar appears in the interface, the user can make the snack bar disappear by clicking an area outside the snack bar.
[0115] The "Sidebar" is a quick-access area displayed on the side of an electronic device screen that can hold multiple app icons. Users can customize the types of apps in the sidebar and the order of the app icons. In any interface, users can swipe inward from the edge of the screen and pause to call up the sidebar. Click an app icon to open the corresponding app, and once opened, the app will generally be displayed at the top of the interface in the form of a small window.
[0116] (4) Global Collection
[0117] Global Collection is an application service provided by embodiments of the present application. It can be used to collect elements such as pictures, text, audio, and web pages that users have viewed on electronic devices. After adding elements to the global collection application service, users can also edit the collected elements, such as adding tags to highlight key points in the collected videos, so that users can efficiently review the key information contained in the elements when replaying them.
[0118] The user can add an element to the global collection application service by swiping down with three fingers, or by using the cross-application transfer interface provided in this application. After successfully adding an element to the global collection application service, the electronic device can display the capsule corresponding to the global collection application service in the interface, making it easier for the user to add other elements in the interface to the global collection application service. Please refer to the relevant description of the subsequent embodiments for details, which will not be repeated here.
[0119] With the continuous development of electronic information technology, smart devices such as mobile phones and tablets have become indispensable products in our daily lives, work, and entertainment. When using smart devices, users often open multiple applications simultaneously to work together. Users also frequently use smart devices to transfer information across applications, processing, sharing, and uploading information from one application through another. However, when users need to transfer information across applications, they need to perform complex and tedious operations to complete the process.
[0120] FIG1 shows a specific process in which a user adds text from the application “Novel Reading” to the application “Notes”.
[0121] The user interface 01 shown in (A) of FIG1 is the interface displayed by the electronic device after the user opens a novel in the "Novel Reading" application. The user interface 01 includes a status bar 011, text information 012, a text option list 013, and a navigation bar 014, where:
[0122] The status bar 011 may include the name of the operator (eg, China Mobile), time, WI-FI icon, signal strength, and current remaining power.
[0123] The text information 012 can be divided into two parts. The text information "ABCDEFGHIJKLMN" is the text that the user wishes to transfer to another application (for example, to copy to a note-taking application), so this part of the text has been selected by the user and is in the dark area. The text information "OPQRSTUVWXYZ" has not been selected by the user and is therefore not in the dark area. It should be understood that although not shown in Figure 1, when selecting text, the user can long-press the text information 012, and after the first cursor 0121 and the last cursor 0122 appear, adjust the position of the first cursor 0121 and the last cursor 0122 to complete the text selection.
[0124] Text option list 013 includes a copy option, a select all option, a search option, a translate option, and a share option. The copy option is used to copy the text information selected by the user. After copying, the user can paste the selected text information into other text boxes on the electronic device; the select all option is used to select all text information in interface 01 with one click; the search option is used to call the search function provided by the electronic device to search for the text selected by the user; the translate option is used to translate the text selected by the user, such as from Chinese to English or from English to Chinese; and the share option is used to share the text selected by the user. Any option can be used to respond to a user operation, such as a click operation, causing the electronic device to perform the corresponding operation.
[0125] The navigation bar 014 may include system navigation keys such as a return button 0141, a home screen button 0142, and an outgoing task history button 0143. When it is detected that the user clicks the above-mentioned return button 0141, the electronic device may display the previous user interface of the current user interface. When it is detected that the user clicks the above-mentioned home screen button 0142, the electronic device may display the home screen interface set by the user for the electronic device. When it is detected that the user clicks the outgoing task history button 0143, the electronic device may display the tasks that the user has recently opened. The names of the navigation keys may also be other, for example, the above-mentioned return button may be called Back Button, the above-mentioned home screen button may be called Home button, and the above-mentioned outgoing task history button may be called Menu Button, and this application does not impose any restrictions on this. In addition, the navigation keys in the above-mentioned navigation bar are not limited to virtual buttons, and may also be implemented as physical buttons.
[0126] After the user selects the text, the user can first copy the selected text information by clicking the copy option as shown in (A) of Figure 1. Afterwards, in order to put the copied text information into the excerpt page of the note application, the user clicks the main interface button 0142 as shown in (A) of Figure 1 to make the electronic device exit the current user interface 01 and display the main interface. The specific style of the main interface can refer to the user interface 02 shown in (B) of Figure 1. The user interface 02 may include a status bar 021, a calendar and weather widget 022, an application area 023, a dock area 024, and a navigation bar 025, wherein:
[0127] The specific functions of the status bar 021 and the navigation bar 025 can be referred to the aforementioned description of the user interface 01 and will not be repeated here.
[0128] The calendar weather widget 022 can be used to indicate the current time, such as date, day of the week, hour and minute information, etc., and can be used to indicate the weather type, such as cloudy to sunny, light rain, etc. It can also be used to indicate information such as temperature and can also be used to indicate location.
[0129] The application area 023 may include, for example, an application icon for "Novel Reading" or an application icon 0231 for "Notes," and may also include icons of other applications, which are not limited in this embodiment of the present application. Any application icon can be used to respond to a user operation, such as a touch operation, to enable the electronic device to launch the application corresponding to the icon.
[0130] The dock area 024 may include, for example, an icon for "Phone," an icon for "SMS," an icon for "Browser," and an icon for "Camera," and may also include icons for other applications, which are not limited in this embodiment of the present application. Any application icon may be used to respond to a user operation, such as a touch operation, so that the electronic device launches the application corresponding to the icon. Regardless of how the user switches the screen interface, the size of the dock area 024 and the applications it contains on the screen interface never change and are always displayed on the current interface.
[0131] To place previously selected and copied text information into the excerpt page of the app note, as shown in FIG1(B), the user first needs to open the "Note" app by clicking on the app icon 0231. In response to the user clicking on the app icon 0231, the electronic device may display the user interface 03 shown in FIG1(C). In the user interface 03, the user may first long-press a blank area in the input area 031 to bring up the input option box 032, and then click the paste option in the input option box 032 to paste the previously selected text information into the input area 031.
[0132] After the text information is pasted, the interface displayed by the electronic device can refer to user interface 04 shown in (D) of Figure 1. As shown in user interface 04, the text information selected by the user in the "Novel Reading" application has been successfully entered into the "Notes" application. Subsequently, the electronic device can save the user's newly created note in response to the user clicking the confirmation control 042.
[0133] From the specific process of text cross-application transmission shown in Figure 1, it can be seen that this method of information cross-application transmission requires multiple operation steps when executed, and involves jumping between multiple applications and pages. The interaction efficiency between the user and the electronic device is very low, which seriously affects the user experience.
[0134] FIG2 shows a specific process in which a user uses the split-screen function provided by an electronic device to add a picture in the application “Album” to the application “Notes”.
[0135] As shown in (A) of FIG2 , the user interface 05 includes a first display area 051 and a second display area 052. The first display area 051 is used to display the application interface of the application "Notes", and the second display area 052 is used to display the application interface of the application "Album". Specifically:
[0136] The first display area 051 includes an input area 0511 and a function list 052, wherein:
[0137] The input area 0511 is used to receive and display note information such as text, images, etc. input by the user.
[0138] The function list 052 may include a share option, a favorite option, a delete option, and more options. Any of the options may respond to a user's click operation, causing the electronic device to execute the function corresponding to the option for the current note.
[0139] The second display area 052 includes an image display area and an image thumbnail set 0522, wherein:
[0140] The image display area 0521 is used to display images saved by the user in the gallery;
[0141] Image thumbnail set 0522 is a thumbnail set formed after the user selects multiple images from the image display area 0521 and drags them up (that is, the images that the user currently wants to put into the note). The number "3" displayed in the superscript in the upper left corner indicates that the user has selected three images in total.
[0142] As shown in FIG2(A), a user can press and hold image thumbnail set 0522, drag it to first display area 051, and then release it to add multiple images corresponding to image thumbnail set 0522 to the application "Notes". For details, please refer to user interface 06 shown in FIG2(B). It should be noted that in user interface 06, due to the limited area of first display area 061, although the three images selected by the user (i.e., the three images corresponding to image thumbnail set 0522) have all been added to the application "Notes", they are not fully displayed in first display area 061.
[0143] Although the process of information transmission across applications shown in FIG2 simplifies the user's operation steps to a certain extent, the electronic device needs to keep two application interfaces displayed at the same time during the process, and the user's reading effect is poor; in addition, the user also needs to operate the electronic screen to display the two application interfaces in split screen. The operations required for this process are also very cumbersome, and the interaction efficiency between the user and the electronic device has not been improved, and the user experience is still poor.
[0144] In response to the defects of the information cross-application transmission method in Figures 1 and 2, the present application provides an information transmission method and an electronic device, which can be used to implement the method. When implementing the method, the electronic device can display a cross-application transmission interface, so that the electronic device can efficiently and quickly complete the information transmission between applications, effectively reducing the number of operating steps required for users to complete cross-application information transmission, improving the interaction efficiency between users and electronic devices, and thereby improving user experience.
[0145] Specifically, in any interface displayed by an electronic device, when the user needs to transfer information in the interface across applications or across devices, the user can long press the information element in the interface and drag it to the edge of the screen. The electronic device will transform the interface originally displayed on the screen into three dimensions, creating a visual effect of the original interface being pushed inward on the screen, and display the recommended application service icon on the side of the screen of the electronic device. At this time, the user interface displayed by the electronic device is the cross-application transmission interface. Afterwards, the user places the dragged information element on the application service icon and lets go, and the information can be transferred to the application service corresponding to the icon and the corresponding application service function can be started. It should be noted that the above-mentioned information elements can be elements such as pictures, text, video, voice, links, documents, etc., and can also be other elements, which are not limited in this application. In addition, "cross-application transmission interface" is just some names used in the embodiments of this application. The meanings they represent have been recorded in the embodiments of this application, and their names do not constitute any limitations on this embodiment.
[0146] The following describes the user interface provided by the embodiments of the present application.
[0147] First, the user interface involved in the triggering process of the above-mentioned cross-application transmission interface is introduced.
[0148] FIG3 is a schematic diagram of the process of changing the electronic device interface when a user transfers an image across applications based on the cross-application transfer interface.
[0149] As shown in (A) of FIG3 , the user interface 07 can be an application interface of an application “browser” in an electronic device, or an application The application interface of the present invention may be an application interface of another application, which is not limited in this application. The user interface 07 may include an image 071, text 072, text 073, and a status bar 074. The electronic device may respond to a user operation on the image 071, such as a long press operation shown in (A) of FIG3, and display the user interface 08 shown in (B) of FIG3.
[0150] As shown in (B) in FIG3 , in user interface 08 , the original image 071 forms image 081 under the user's long press operation. If the user does not let go, image 081 can move with the user's fingertip in user interface 08 , and image 081 can be displayed on top of user interface 08 (i.e., image 081 can cover any element in user interface 08 ). It should be understood that the image content displayed by image 081 is the same as the image content displayed by image 071 . Optionally, image 081 can be a thumbnail obtained by the electronic device after reducing image 071 , that is, image 081 and image 071 have no difference except for the size. Optionally, after image 071 is dragged up to form image 081 , the electronic device can still display image 071 in user interface 08 and perform a virtual or blurred processing on image 071 , i.e., the clarity of image 071 in user interface 08 can be lower than the clarity of image 071 in user interface 07 , to prompt the user that image 071 has been selected and dragged up.
[0151] The electronic device may display the user interface 09 as shown in FIG. 3(C) in response to a user operation on the image 081 , such as a drag operation as shown in FIG. 3(B) .
[0152] Optionally, when the user drags image 081 to a point where the distance from the right or left edge of the screen is less than a certain threshold, the electronic device displays user interface 09, which will be described in detail later and will not be repeated here. As shown in (C) in Figure 3, user interface 09 is the cross-application transmission interface mentioned in the above description, which may include sub-interface 091, icon area 092, and image 093. Among them:
[0153] The element content (such as text, pictures, etc.) displayed in the sub-interface 091 is the same as the element content displayed in the user interface 07 (except the status bar). In fact, the sub-interface 091 can be considered as the interface obtained by the electronic device after performing a three-dimensional transformation on all the element contents (except the status bar) of the original user interface 07. In the user interface 09, the sub-interface 091 can create a visual effect on the screen that the original interface (i.e., the user interface 07) is pushed inward. It is understandable that this visual effect of "opening the door" is a metaphor for the behavior of transmitting elements (information), which is more intuitive than copying and pasting. Optionally, in the user interface 09, the background behind the sub-interface 091 can be set to the desktop background of the electronic device (i.e., the desktop wallpaper) with a blurred effect superimposed on it.
[0154] The icon area 092 can be used to display application service icons recommended by one or more electronic devices based on the information element selected by the user (ie, image 071 in the embodiment of the present application).
[0155] Optionally, each icon in the icon area 092 has a corresponding text description below, which can be used to explain the specific application name or application service name corresponding to the icon. When the icon 0921 is an application, the text 0922 can be "WeChat"; when the icon 0921 is an application When the application service icon of the application service "Friends Circle" is used, the text 0922 can be "Friends Circle" or "WeChat Friends Circle". When the application service icon of the application service "Scan" is displayed, the text 0922 can be "Scan" or "WeChat Scan". It should be understood that the text below each application service icon is only for the purpose of helping users understand the specific application or specific application function corresponding to the icon, but this application does not limit the specific icon style and specific text content.
[0156] The image content displayed by image 093 is the same as that displayed by image 071 and image 081. Alternatively, image 093 may be a thumbnail of image 081 reduced by the electronic device. Similarly, image 093 is identical to images 081 and 071 except for their size. This way, when a user selects a desired application service in icon area 092, image 093 will not obstruct the icons and text in icon area 092, making it easier for the user to select the icon.
[0157] It should be noted that, unlike the reduction process of image 071, after image 081 is reduced to image 093, image 081 may no longer be displayed in user interface 09. That is, image 081 can be considered an image obtained by the electronic device copying image 071 and then reducing it, while image 093 can be considered an image obtained by the electronic device directly reducing image 081.
[0158] In the user interface 09, the user places the dragged information element (i.e., image 093) on the corresponding icon in the icon area 092 and lets go. The electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon. This will be explained in more detail later and will not be repeated here.
[0159] In addition, in order to guide the user to accurately place the dragged element into the application service they need, when image 093 is close to an icon in icon area 092, or when the distance between image 093 and an icon in icon area 092 is less than a certain threshold, the icon approached by image 093 can display certain special effects, such as the icon and the text corresponding to the icon can be attracted and drawn close by image 093, and the icon and the text corresponding to the icon can be enlarged. Taking icon 0923 and its corresponding text 0924 in user interface 09 as an example, when image 093 is close to icon 0923, icon 0923 and text 0924 are further to the left than other icons and text, that is, closer to image 093 than other icons and text; in addition, icon 0923 is also enlarged to remind the user that if they let go here, image 093 (or image 071) will be transferred to the application service corresponding to icon 094.
[0160] It can be understood that the cross-application information sharing process shown in Figure 3 is continuous from the user dragging up the element to the element placing the element into the target application service. The "continuous" here means that the user does not need to perform operations such as copying and pasting, nor does he need to switch applications. The user's fingers do not need to leave the screen of the electronic device during the entire operation process, and the operation is simple and fast. This information transmission method ensures the effective browsing area of the user interface, which can effectively improve the efficiency of the user's cross-application information transmission and enhance the user experience.
[0161] FIG4 is a schematic diagram of the interface change process of the electronic device when the user transfers text across applications based on the “cross-application transfer interface”.
[0162] As shown in (A) of FIG4 , the user interface 11 may be an application interface of an application “browser” in an electronic device, or an application The user interface 11 may include text 111, text 112, image 113, and text option list 114, wherein:
[0163] Text 111 is the text that the user wants to transfer to other applications, so this part of the text has been selected by the user and is in the dark area; correspondingly, text 112 is the unselected text. It should be understood that, unlike the independence of pictures, text itself has continuity. For a whole paragraph of text, the user may often only need a part of the text in the whole paragraph when sharing the text. Therefore, although not shown in Figure 4, when selecting text in the user interface 11, the user can perform a long press operation on any text information in the user interface 11, and after the first cursor 111A and the last cursor 111B appear, complete the selection of the text by adjusting the position of the first cursor 111A and the last cursor 111B. As shown in (A) in Figure 4, the user has selected text 111 by adjusting the position of the first cursor 111A and the last cursor 111B.
[0164] The text option list 114 includes a copy option, a select all option, a search option, a translation option, and a share option. Any of the options can be used to respond to a user's operation, such as a click operation, so that the electronic device performs the operation corresponding to the option.
[0165] Like the operation of dragging the picture, the electronic device can also respond to the user's operation on the text 111, such as the long press and drag operation shown in (A) of FIG4, and display the user interface 12 shown in (B) of FIG4.
[0166] As shown in (B) in FIG4 , in the user interface 12, the original text 111 is lifted up by the user's long press operation. If the user does not let go, the text 121 can move with the user's fingertip in the user interface 12, and the text 121 can be displayed on top of the user interface 12 (i.e., the text 121 can cover any element in the user interface 08). It should be understood that the text content contained in the text 111 is the same as the text content contained in the text 121. Optionally, the text 121 can also be the text obtained after the electronic device shrinks the text 111, and after the text 111 is dragged up to form the text 121, the electronic device can still display the text 111 in the user interface 12 and perform a virtual or blurred processing on the text 111, i.e., the clarity of the text 111 in the user interface 12 can be lower than the clarity of the image text 111 in the user interface 11, to prompt the user that the text 111 has been selected and dragged up.
[0167] The electronic device may display a user interface 13 as shown in FIG4(C) in response to a user operation on the text 121, such as the drag operation shown in FIG4(B). As shown in FIG4(C), the user interface 13 is the cross-application transmission interface mentioned in the above description, which may include a sub-interface 131, an icon area 132, and text 133. Among them:
[0168] The specific styles and functions of the sub-interface 131 and the icon area 132 can be referred to the aforementioned description of the user interface 09 in FIG. 3 , which will not be repeated here.
[0169] It should be noted that the text content contained in text 133 is the same as the text content contained in text 111 and text 121. However, as can be seen from user interfaces 12 and 13, text 133 is the text obtained by the electronic device shrinking text 121; that is, after the "cross-application transfer interface" is opened, the electronic device also shrinks the text dragged by the user to a certain extent. In this way, text 133 does not cause a large area of blocking the icons and text in icon area 132, making it easier for the user to select.
[0170] Similarly, in the user interface 13, the user places the dragged information element (i.e., text 133) on the corresponding icon in the icon area 132 and lets go. The electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon.
[0171] Of course, when the electronic device is in landscape mode, the user can still transfer elements on the current interface across applications through the "cross-application transfer interface". The specific process and interface style can refer to the aforementioned descriptions of Figures 2 and 3 and user interface 14 and user interface 15 shown in Figure 5, and no further details will be given here.
[0172] It should be understood that most smart devices currently provide users with a quick screenshot function. For example, in some scenarios, users can double-click the screen or swipe down with three fingers to take a full-screen screenshot of the current interface of the electronic device. In addition, after the user takes a screenshot, some smart devices also provide users with a recognition function in this scenario to identify the user's screenshot (for example, extract text from the image or translate text, etc.). Therefore, with respect to the screenshot function provided by the electronic device, the following describes the process of using the cross-application transmission interface to transmit the captured image or text in the captured image across applications in the screenshot scenario in conjunction with Figures 6 and 7.
[0173] FIG6 is a schematic diagram of the interface change process of the electronic device when the user transmits the captured image across applications based on the cross-application transmission interface.
[0174] As shown in (A) of FIG6 , the user interface 16 may be an application interface of a “browser” application in an electronic device, or an application interface of a browser. In response to a user's quick screenshot operation on user interface 16, such as a double-click operation with a knuckle as shown in FIG6 (A), the electronic device can quickly capture a full-screen image of user interface 16 and display user interface 17 as shown in FIG6 (B).
[0175] As shown in FIG6(B), user interface 17 may include a screenshot image 171. Screenshot image 171 is an image obtained by the electronic device in response to a user taking a knuckle screenshot of user interface 16. After the screenshot is taken, screenshot image 171 may be displayed in user interface 17 for two to three seconds, allowing the user to directly click on screenshot image 171 to edit, save, or perform other operations on it. If the user does not perform any operations on screenshot image 171, the electronic device may automatically save it to the photo album.
[0176] In the embodiment of the present application, during the period when the electronic device displays the screenshot image 171 in the user interface 17, the user can long-press the screenshot image 171 and then drag it, or directly drag it to the side of the electronic device screen, and then transfer it across applications through the "cross-application transfer interface". As shown in Figure 6 (B), the electronic device can respond to the user's operation of dragging the screenshot image 171 to the side by displaying the user interface 18 shown in Figure 6 (C).
[0177] As shown in (C) of FIG6 , the user interface 18 is the cross-application transmission interface. The user interface 18 may include a sub-interface 181, an icon area 182, and an image 183, wherein:
[0178] The specific content and functions of the sub-interface 181 and the icon area 182 can be referred to the above description and will not be repeated here.
[0179] Similarly, in order to avoid excessive occlusion of the icon area 182 , when the screenshot image 171 approaches the icon area, the electronic device reduces the original screenshot image 171 to obtain image 183 .
[0180] Similarly, in the user interface 18, the user places the image 183 on the corresponding icon in the icon area 182 and lets go. The electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon.
[0181] If the user releases the image 183 before placing it on the corresponding icon in the icon area 182 , the electronic device may redisplay the user interface 17 in response to the operation.
[0182] In an embodiment of the present application, user interface 16 can be called the "fifth interface", user interface 17 can be called the "sixth interface", screenshot image 171 or image 183 can both be called the "first image", user interface 18 can be called the "seventh interface", and the operation of the user placing image 183 on the corresponding icon in the icon area 182 and releasing it can be called the "ninth operation".
[0183] FIG7 is a schematic diagram of the interface change process of the electronic device when the user transmits the text in the captured image across applications based on the cross-application transmission interface.
[0184] As shown in (A) of FIG7 , the user interface 19 can be an application interface of an application “browser” in an electronic device, or an application In response to a user's quick screenshot operation on the user interface 19, such as the knuckle frame selection operation shown in FIG7 (A) (i.e., using a knuckle to draw an area on the screen), the electronic device can quickly capture the image selected by the user using the knuckle frame and display the user interface 20 shown in FIG7 (B).
[0185] As shown in FIG7 (B), the user interface 20 may include a thumbnail 201, a partial screenshot box 202, an identification control 203, a sharing control 205, and a shape option box 204.
[0186] The thumbnail 201 may be a thumbnail of the aforementioned user interface 19 .
[0187] The partial screenshot frame 202 is the screenshot area determined by the electronic device in response to the user's finger joint selection screenshot operation on the user interface 19. The user can adjust the edges of the partial screenshot frame 202 by dragging the edges of the partial screenshot frame, and can also press and hold the center area of the partial screenshot frame 202 to adjust the specific position of the partial screenshot frame in the thumbnail 201. It should be understood that for the electronic device, the partial screenshot frame 202 is only used to select the image in the thumbnail 211, and the electronic device cannot obtain the information (such as text information) contained in the image in the partial screenshot frame 202.
[0188] The recognition control 203 is used to recognize text information contained in the image in the partial screenshot frame 202 .
[0189] The sharing control 205 is used to share the image in the partial screenshot frame 202 .
[0190] The shape option box 204 includes a free graphic option, a rectangle option, an ellipse option, and a heart option. The electronic device can adjust the specific shape of the partial screenshot box 202 to the shape corresponding to the option in response to a user's touch operation on any option, such as a click operation.
[0191] As shown in (B) of FIG7 , the electronic device can recognize the text information contained in the image in the partial screenshot frame 202 in response to the user clicking the recognition control 203. After the text information is recognized, the text information contained in the image in the partial screenshot frame 202 can be selected by the first cursor and the last cursor boxes. For details, please refer to the content displayed in the text box 212 in the user interface 21 in (C) of FIG7 . Afterwards, the user can long-press the recognized text information and drag it to the side of the electronic device screen to transfer the recognized text across applications through the "cross-application transfer interface."
[0192] As shown in FIG. 7 (C), the user interface 21 may include a thumbnail 211, a partial screenshot frame 202, text 2121, and text information 213, wherein:
[0193] The thumbnail 211 may be a thumbnail of the aforementioned user interface 19 .
[0194] The partial screenshot frame 202 is the partial screenshot frame 202 mentioned above. The text information in the image framed by the partial screenshot frame 202 has been recognized and extracted by the electronic device, and this part of the text is the text 2121 shown in (C) in FIG7 .
[0195] Text 213 is the text that is dragged up after the user performs a long press operation (not shown in FIG. 7 ) on text information 211. As shown in FIG. 7 (C), after the user drags text 213 up, the user can drag text information 213 to the side of the electronic device screen. In response to the user operation, the electronic device displays user interface 22 as shown in FIG. 7 (D).
[0196] As shown in (D) of FIG7 , the user interface 22 is the cross-application transmission interface. The user interface 22 may include a sub-interface 221, an icon area 222, and text 223, wherein:
[0197] The specific contents and functions of the sub-interface 221 and the icon area 222 can be referred to the above description and will not be repeated here.
[0198] Similarly, in order to avoid excessive obstruction in the icon area 222 , when the text 223 is close to the icon, the electronic device shrinks the text 213 to obtain the text 223 .
[0199] Similarly, in the user interface 22, the user places text 223 on the corresponding icon in the icon area 222 and lets go. The electronic device can transmit the text 223 to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon.
[0200] In an embodiment of the present application, the user interface 19 can be called the "eighth interface", the user interface 20 can be called the "ninth interface", the text 2121, text 223, and text 213 can all be called "first text information", the recognition control 203 can be called the "text recognition control", the user interface 21 can be called the "tenth interface", and the operation of the user dragging the text information 213 to the side of the electronic device screen can be called the "tenth operation", the user interface 22 can be called the "eleventh interface", and the operation of the user placing the text 223 on the corresponding icon in the icon area 222 and letting go can be called the "eleventh operation".
[0201] Of course, the image captured by the user through the partial screenshot function can also be transmitted through the cross-application transmission interface. Figure 8 shows the process of the user sharing the image captured by the partial screenshot function through the cross-application transmission interface.
[0202] The user interface 20 shown in (A) of FIG8 is the user interface 20 shown in (B) of FIG7 above. In combination with FIG8 and the above description, it can be seen that the user interface 20 may include a thumbnail 201, a partial screenshot frame 202, an identification control 203, a sharing control 205, and a shape option box 204. Among them, the partial screenshot frame 202 is the screenshot area determined by the electronic device in response to the user's finger joint frame selection screenshot operation on the user interface 19. It should be understood that although the partial screenshot frame 202 contains text, since the user does not click on the identification control 203 at this time, the partial screenshot frame 202 captures an image containing text. Similarly, as shown in (A) of FIG8, the user can long press and drag the image captured by the partial screenshot frame 202, and drag it to the side of the electronic device screen, and transmit the image captured by the partial screenshot frame 202 across applications through the "cross-application transmission interface".
[0203] As shown in (B) of FIG8 , the user interface 23 is the cross-application transmission interface. The user interface 23 may include a sub-interface 231, an icon area 232, and an image 233, wherein:
[0204] The specific contents and functions of the sub-interface 231 and the icon area 232 can be referred to the above description and will not be repeated here.
[0205] Similarly, to avoid excessive obstruction of icon area 232, when the image in partial screenshot frame 202 is dragged and brought close to the icon, the electronic device can reduce the image in partial screenshot frame 202 to obtain image 233. It should be noted that when the image in partial screenshot frame 202 is shared using the "cross-application transfer interface", the shape of partial screenshot frame 202 is retained, that is, the shape of image 233 is the same as the shape displayed by partial screenshot frame 202.
[0206] Similarly, in the user interface 23, the user places the image 233 on the corresponding icon in the icon area 232 and lets go. The electronic device can transmit the image 233 to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon.
[0207] In an embodiment of the present application, the user interface 20 can be called the "sixth interface", the user interface 23 can be called the "seventh interface", and the operation of the user placing the image 233 on the corresponding icon in the icon area 232 and releasing it can be called the "ninth operation".
[0208] It should be understood that in the daily use of electronic devices, users often drag and drop some elements. Therefore, how to determine the corresponding trigger rules for the cross-application transfer interface based on user operations and guide users to trigger the electronic device to display the "cross-application transfer interface" based on their operating habits is the key to further improving the efficiency of user interaction with electronic devices. Therefore, the trigger rules of the cross-application transfer interface will be explained below with reference to Figures 9-11.
[0209] FIG9 is a schematic diagram provided in an embodiment of the present application for illustrating triggering rules for a cross-application transmission interface.
[0210] As shown in (A) of FIG9 , the user interface 24 may be an application interface of a “browser” application in an electronic device, or an application interface of a browser. The application interface may also be the application interface of other applications, which is not limited in this application.
[0211] Next, we will use image 241 of user interface 24 as an example. As shown in FIG9(A), combined with the above description, it can be seen that the user can long-press image 241 to drag image 241 upward. In response to the user dragging image 241 upward, the electronic device can display user interface 25 as shown in FIG9(B).
[0212] As shown in FIG. 9B , the user interface 25 may include an image 241, an image 251, a left trigger area 252L, and a right trigger area 252R. In the embodiment of the present application, the left trigger area 252L and the right trigger area 252R may be collectively referred to as a “first trigger area”, where:
[0213] Image 251 is a thumbnail formed after the user drags up image 241. If the user does not let go, image 251 can move in the user interface 08 along with the user's fingertips. For details, please refer to the above-mentioned relevant instructions, which will not be repeated here.
[0214] The left trigger area 252L is a rectangular area bounded by the left edge of the electronic screen, and the right trigger area 252R is a rectangular area bounded by the right edge of the electronic screen. Specifically, the length of the left trigger area 252L can be d1 and the width can be W; the length of the right trigger area 252R can be d1 and the width can be W. Wherein, d1 can be set to 25% of the width of the electronic device screen, as shown in FIG9 (A), where the screen width is L, and W can be the height of the electronic device screen, as shown in FIG9 (A), where the screen height is h. It should be noted that in the user interface 25, the left trigger area 252L and the right trigger area 252R are displayed as dark transparent areas only to facilitate the user's understanding of the specific location and area of these two areas. In actual application scenarios, the specific size and location of these two areas may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of these two areas in the user interface 25. The size and location of these two areas may be stored in the electronic device only in a form that is perceptible to the electronic device (e.g., program code).
[0215] When the user drags the image 251 to the left trigger area 252L or the right trigger area 252R, the electronic device may display a special effect at the edge of the screen. Optionally, after the user drags the image 251 to the left trigger area 252L or the right trigger area 252R and the image remains in the left trigger area 252L or the right trigger area 252R for a period of time T, the electronic device may display a special effect at the edge of the screen to prompt the user to drag the image further toward the side of the screen. Specifically, the above-mentioned T may be set to 600 milliseconds.
[0216] It should be understood that “dragging the image 251 into the left trigger area 252L or the right trigger area 252R” mentioned here means that after the user drags the image 251, the contact point between the user's finger and the screen (i.e., the anchor point) enters the left trigger area 252L or the right trigger area 252R, and does not mean that the image 251 completely enters the left trigger area 252L or the right trigger area 252R.
[0217] As shown in FIG9(B), when the user drags image 241 into right trigger area 252R, the electronic device may respond to this operation by displaying user interface 26 as shown in FIG9(C). User interface 26 may include image 241, image 251, and special effects area 261. Special effects area 261 may display user-visible special effects such as luminous effects and shadow effects, or other user-perceivable special effects, which are not limited in this application.
[0218] In combination with the above description, it can be seen that the above-mentioned special effects area 261 can prompt the user to further drag the image closer to the side of the screen to trigger the "cross-application transfer interface" interface to transfer the element to other applications. Therefore, in an embodiment of the present application, after the element is dragged up, a door opening area is also provided in the user interface. When the user drags the dragged element further to the door opening area, the electronic device can respond to the operation and display the cross-application transfer interface. As shown in (C) in Figure 9, when the user drags the image 251 to the right until it enters the door opening area, the electronic device can respond to the operation and display the user interface 27 shown in (D) in Figure 9.
[0219] As shown in the user interface 27 shown in (D) of FIG9 , the user interface 27 may include an image 241, an image 251, a left door opening area 271L, and a right door opening area 271R. In the embodiment of the present application, the left door opening area 271L and the right door opening area 271R may be collectively referred to as a “second triggering area”, wherein:
[0220] The left door area 271L is a rectangular area bounded by the left border of the electronic screen, and the right door area 271R is a rectangular area bounded by the right border of the electronic screen. Specifically, the length of the left door area 271L is d2, and the width is W; and the length of the right door area 271R is also d2, and the width is W, wherein d2 can be set to 36 pixel units, and W can be the height of the electronic device screen. It should be noted that in the user interface 27, the left door area 271L and the right door area 271R are displayed as dark transparent areas only to facilitate readers to understand the specific positions and areas of the two areas. In actual application scenarios, the specific sizes and positions of the two areas may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of the two areas in the user interface 27. The sizes and positions of the two areas can only be stored in the electronic device in a form that is perceptible to the electronic device (such as program code).
[0221] When the user drags the image 251 to the left door area 271L or the right door area 271R, the electronic device can immediately respond to the operation by displaying the cross-application transmission interface, that is, the user interface 28 shown in (E) of Figure 9. As shown in (E) of Figure 9, the user interface 28 includes a sub-interface 281, an icon area 282, and an image 283. Among them:
[0222] The elements displayed in the sub-interface 281, such as text, pictures, etc., are the same as the elements displayed in the user interface 24 (except for the status bar). The specific content and functions of the sub-interface 281 can be referred to the above related descriptions and will not be repeated here.
[0223] The electronic device can display one or more application service icons recommended based on the element selected by the user (i.e., image 241 in the embodiment of the present application) in the icon area 282. In addition, the icon area 282 can be a rectangular area bounded by the right border of the electronic screen. Specifically, the length and width of the icon area 282 can be d3 and W, respectively, where d3 is greater than the aforementioned d2. Specifically, d3 can be set to 120 pixel units, and W can be the height of the electronic device screen (i.e., h in the aforementioned description). Similarly, in the user interface 28, the icon area 282 is displayed as a dark transparent area only to facilitate the user to understand the specific position and area of the area. In actual application scenarios, the specific size and position of the area may not be displayed in the user interface, that is, the user cannot directly observe the specific outline of the area in the user interface 28. The size and position of the area can be stored in the electronic device only in a form that is perceptible to the electronic device (such as program code).
[0224] The image content displayed by image 283 is the same as that displayed by image 251 and image 241, except for the difference in area size. It should be noted that compared with image 51 in user interface 25 to user interface 27, image 283 in user interface 28 is smaller in area. This is because when the electronic device displays user interface 28, image 251 in the original user interface 27 is reduced to prevent the image from being too large from blocking the icons and text in icon area 282 and interfering with the user's selection. In other words, image 241 can be reduced twice during the entire cross-application transmission process. The first time occurs when the user drags it up, specifically refer to image 251 and image 241 in (B) of Figure 9, and the second time occurs when the electronic device starts to display the "cross-application transmission interface", specifically refer to image 251 shown in (D) of Figure 9 and image 283 shown in (E) of Figure 9.
[0225] In the user interface 28, the user places the dragged information element (i.e., image 283) on the corresponding icon in the icon area 282 and lets go. The electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon. This will be explained in more detail later and will not be repeated here.
[0226] In addition, in order to guide users to accurately place the dragged elements into the application services they need, in the user interface 28, when the user drags the image 283 close to an icon in the icon area 282, or when the distance between the image 283 and an icon in the icon area 282 is less than a certain threshold, the icon approached by the image 283 can display certain special effects, for example, the icon and the text corresponding to the icon can be adsorbed close to the image 283 and can be enlarged.
[0227] As shown in (E) of FIG9 , in user interface 28, after the user drags image 283 toward the “Friends WeChat” icon, the electronic device may display user interface 29 as shown in (F) of FIG9 . It can be seen from icon area 282 of user interface 29 that when image 283 approaches “Friends WeChat” icon 284, “Friends WeChat” icon 284 and its corresponding text 285 are further to the left than other icons and text, i.e., closer to image 283 than other icons and text; in addition, “Friends WeChat” icon 284 is also enlarged to remind the user that if they let go of the image 283 (or image 241) here, it will be transferred to the application (i.e., WeChat) or application service (WeChat-Friend Chat) corresponding to the “Friends WeChat” icon.
[0228] In addition, when the cross-application transmission interface is opened, the user can also exit the cross-application transmission interface through corresponding operations. Please refer to Figures 10 and 11 for details.
[0229] FIG10 shows the process of a user exiting the cross-application transmission interface through a door closing area.
[0230] As shown in (A) of FIG10 , the user interface 31 may be the cross-application transfer interface displayed by the electronic device after the user drags an image from the history interface to the side. The user interface 31 includes a sub-interface 311, an icon area 312, a door closing area 313, and an image 314, wherein:
[0231] The sub-interface 311 is an interface obtained by transforming the original interface where the image 314 is located;
[0232] Icon area 312 is an area for displaying application service icons recommended by one or more electronic devices based on the element selected by the user (i.e., image 314 in this embodiment of the application). Its specific style and function can be referred to the relevant description of Figure 9 above, and will not be repeated here.
[0233] The door closing area 313 can be a rectangular area bounded by the left border of the electronic screen. Specifically, the length and width of the door closing area 313 can be d4 and W respectively. Specifically, d4 can be set to half of the width of the electronic device screen (i.e., L in the above description), and W can be the height of the electronic device screen (i.e., h in the above description). Similarly, in the user interface 31, the icon area 312 and the door closing area 313 are displayed as dark transparent areas only to facilitate the user to understand the specific position and area of the area. In actual application scenarios, the specific size and position of these two areas may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of the two areas in the user interface 31. The size and position of the two areas can be stored in the electronic device only in a form that is perceptible to the electronic device (such as program code).
[0234] As shown in (A) in Figure 10, after the user drags the image 314 to the door closing area 313, if the user still holds down the image 314, the electronic device can close the "cross-application transmission interface" and display the user interface 32 as shown in (B) in Figure 10.
[0235] As shown in FIG. 10(B), the user interface 32 may include images 321 and 322, wherein:
[0236] Image 321 is the thumbnail image immediately after the user drags up image 322. Unlike image 314, image 321 is the thumbnail image obtained by the electronic device reducing image 322 once, while image 314 is the thumbnail image obtained by the electronic device reducing image 321 twice after the cross-application transfer interface is opened.
[0237] In the case that the user does not release the image 321 , the user may drag the image 321 to the side of the screen to trigger the display of the cross-application transmission interface again.
[0238] FIG11 shows the process of the user exiting the cross-application transmission interface by directly releasing the finger.
[0239] As shown in (A) of FIG11 , the user interface 33 may be the cross-application transfer interface displayed by the electronic device after the user drags an image from the history interface to the side. The user interface 33 includes a sub-interface 331, an icon area 332, a door closing area 333, and an image 334, wherein:
[0240] The specific functions of the sub-interface 331 and the door closing area 333 can be referred to the aforementioned related descriptions and will not be repeated here.
[0241] It is easy to understand that when the total length of d4 and d3 is less than the width L of the electronic screen, there is still a portion of the user interface 33 that does not belong to the icon area 332 or the door closing area 333. In the user interface 33, this portion of the area can be a rectangular area 335 with a length of d5 and a width of h.
[0242] As shown in (A) of FIG11 , after the user drags the image 334 into the rectangular area 335 , if the user lets go directly at this time, the electronic device can close the “cross-application transfer interface” and display the user interface 34 as shown in (B) of FIG11 .
[0243] As shown in (B) of Figure 11 , user interface 34 is the original interface where image 314 is located. It may include image 341. Unlike user interface 32 described above, since the user has released the image, the thumbnail resulting from dragging image 341 is no longer displayed in user interface 34. If the user later wishes to transfer image 341 to another app through the "cross-app transfer interface," the user must again long-press image 341 to drag it to the corresponding thumbnail, and then drag the thumbnail to the side of the screen to trigger the cross-app transfer interface again.
[0244] In subsequent embodiments, the specific operation of the user triggering the "cross-application transmission interface" and closing the "cross-application transmission interface" and the corresponding interface change process of the electronic device can refer to the relevant description of the previous embodiment and will not be repeated later.
[0245] It should be understood that in the daily use of electronic devices, users often drag and drop some elements. For example, after a user uses the "smart split screen" function to open two application interfaces, or opens two application interfaces in the form of small windows or "picture-in-picture", the user will often transfer information across applications in this mode; and in the embodiment of the present application, in the split-screen state and the small window state, the user can directly complete the cross-application transmission of information through the split-screen function, or use the "cross-application transmission interface" provided by this application to complete the cross-application transmission of information. Combined with the aforementioned description of the triggering rules of the "cross-application transmission interface", the following describes different ways for electronic devices to transfer information across applications in the split-screen state and the small window state. Please refer to Figures 12-15 for details.
[0246] FIG12 shows the process of a user completing cross-application information transmission through the split-screen function of an electronic device in the split-screen state.
[0247] As shown in (A) of Figure 12, the user interface 35 includes a first display area 351 and a second display area 352. The first display area 351 is used to display the application interface of the "Notes" application, and the second display area 352 is used to display the application interface of the "Album" application. In this embodiment of the application, the user interface 35 can be referred to as the "first interface", the first display area 351 can be referred to as the "second sub-interface", and the second display area 352 can be referred to as the "first sub-interface".
[0248] At this time, the user long-presses the image 3521 in the second display area 352 and drags it up, obtaining a thumbnail 3522 of the image 3521. In an embodiment of the present application, the image 3521 or the thumbnail 3522 may be referred to as "first information". In addition, in combination with the foregoing description, it can be seen that after the image 3521 is dragged up, there may be two pairs of determination areas in the user interface 35, namely, area 353L and area 353R in the user interface 35, and area 354L and area 354R selected in the dotted box in the user interface 35. Among them, area 353L and area 353R are the left trigger area and the right trigger area, respectively; area 354L and area 354R are the left door opening area and the right door opening area, respectively. In an embodiment of the present application, area 353L and area 353R can be collectively referred to as the "first trigger area", and area 354L and area 354R can be collectively referred to as the "second trigger area". Combined with the above description, it can be seen that when the user drags the image 3522 to the left trigger area 354L or the right trigger area 354R and stays there for a period of time T, the electronic device can display special effects at the edge of the screen; when the user continues to drag the image 3522 to the left door area 354L or the right door area 354R, the electronic device will respond to the operation and display the corresponding cross-application transmission interface. However, if the user drags the image 3522 from the second display area 352 to the first display area 351 without letting the image 3522 touch the left door area 354L and the right door area 354R, the electronic device can still transfer the image 3522 (or image 3521) to the "Notes" application and display it in the first display area 351.
[0249] As shown in (A) of FIG12 , the user can drag the image 3522 to the first display area 351 in the direction indicated by the dotted arrow shown in (A) of FIG12 . In the embodiment of the present application, the operation of dragging the image 3522 to the first display area 351 can be referred to as the “first operation”; in this process, as long as the image 3522 does not touch the left door area 354L and the right door area 354R, the image 3522 can directly transfer the image 3522 (or image 3521) to the “Notes” application without opening the “cross-application transmission interface” and display it in the first display area 351. For details, please refer to the user interface 36 shown in (B) of FIG12 . It should be noted that even if the image 3522 briefly touches the left door area 354L or the right door area 354R during this process, the electronic device will only display the corresponding special effects on the side and will not directly trigger the “cross-application transmission interface”.
[0250] Also taking the user interface 35 in the above description as an example, FIG13 shows the process of a user completing cross-application transmission of information through the “cross-application transmission interface” of the electronic device in the split-screen state.
[0251] As shown in (A) in FIG13 , the content of the elements contained in the user interface 35 and the functions of each element can be referred to the aforementioned description of FIG12 and will not be repeated here. However, unlike the dragging method of the selected element (i.e., image 3522) shown in FIG12 , since the user now wants to transfer the image 3522 to other applications through the “cross-application transfer interface”, this application may not be the “notes” application. Therefore, as shown in (A) and (B) in FIG13 , the user can drag the image 3522 to the right door opening area 354R in the direction indicated by the dotted arrow shown in (A) in FIG13 ; When the image 3522 enters the right door opening area 354R, the electronic device can immediately display the user interface 37 shown in (C) in FIG13 .
[0252] As shown in (C) of FIG13 , the user interface 37 may include a sub-interface 371 , an icon area 372 , and an image 373 .
[0253] The specific content and functions of sub-interface 371 can be found in the aforementioned description and will not be further elaborated here. However, it should be noted that in the split-screen state, after the user triggers the "cross-application transfer interface" through an operation, the display screen in sub-interface 371 remains in split-screen mode and still includes two display areas, namely the first display area 3711 and the second display area 3712 shown in (C) of Figure 13.
[0254] The specific content and functions of the icon area 372 can be referred to the aforementioned related descriptions and will not be repeated here.
[0255] The image content displayed by image 373 is the same as the image content displayed by images 3521 and 3522, except for the difference in area size.
[0256] In the user interface 37, the user places the dragged information element, i.e., image 373, on the corresponding icon in the icon area 372 and lets go. The electronic device can then transmit the information element to the application service corresponding to the icon in response to the user operation and display the corresponding application interface. In the embodiment of the present application, the user interface 35 can be referred to as the "first interface", the image 3521 thumbnail 3522, or the image 373 can be referred to as the "first information", the operation of dragging the image 3522 to the right door opening area 354R can be referred to as the "second operation", the operation of placing the image 373 on the corresponding icon in the icon area 372 and letting go can be referred to as the "third operation", the user interface 37 can be referred to as the "second interface", and the icon displayed in the icon area 372 in the user interface 37 can be referred to as "at least one application service icon".
[0257] Similarly, when the electronic device is in a multi-window state with a small window, the user can also complete the process of cross-application transmission of information through the multi-window function or the "cross-application transmission interface". Figures 14 and 15 respectively show the process of the user completing the cross-application transmission of information through the split-screen function of the electronic device and the "cross-application transmission interface" in the small window state. In the small window state, the user interface displayed by the electronic device may include the application interfaces of two different applications, where the application interface of one application is displayed in full screen, and the application interface of the other application is displayed in a small window (floating window) on top. When information is transmitted across applications in the small window state, the user can directly drag and drop elements from one application interface to another application interface through the multi-window function. The specific operation process is similar to the operation process of cross-application transmission in the split-screen state in Figure 12. It can be understood that in the small window state, the method of transmitting information can be dragging from the small window (floating window) on top to the full-screen interface, or dragging from the full-screen interface to the small window (floating window) on top. In addition, in the small window state, users can also transfer through the "cross-application transfer interface". The specific operation process is similar to the operation process shown in Figure 13, so no further details will be given here. Please refer to Figures 14 and 15 for details, and combine them with the aforementioned relevant explanations of Figures 12 and 13 for understanding.
[0258] After using the "cross-application transfer interface" to transfer information across applications, the electronic device can also provide users with different prompts and display different interface effects based on the type of application service the information enters and the results of the information transfer. The following describes the possible interface styles that the electronic device may display after the user uses the "cross-application transfer interface" to transfer information across applications, using Figures 16-21.
[0259] ① After the transfer is completed, the snack bar is used to prompt the user, see Figure 16.
[0260] As shown in (A) of Figure 16 , the user interface 41 is a cross-application transmission interface for a user to transmit an image 411. The user is currently placing the dragged information element, i.e., the image 411, on the "note" icon on the right.
[0261] As the user releases the image, the electronic device may transmit the image 411 to the "Notes" application service in response to the user operation; if the transmission is successful, the electronic device may display the user interface 42 as shown in (B) in FIG. 16 .
[0262] As shown in (B) of FIG16 , a snack bar 421 may be displayed below the user interface 42. Specifically, the snack bar 421 may include prompt information 4211 and a jump control 4212, wherein:
[0263] The prompt information 4211 may include four characters “Transfer successful” to prompt the user that the electronic device has successfully transferred the image 411 to the “Notes” application service.
[0264] The jump control 4212 can respond to the user's touch operation to enable the electronic device to jump from the current interface to the interface of the application service "Notes".
[0265] In addition, if the user does not perform any operation on the snack bar 421, the snack bar 421 may automatically disappear after being displayed for a period of time (e.g., 2s-3s); or, when the snack bar 421 is still displayed in the user interface 42, the user may make the snack bar 421 disappear by going to other locations in the electronic user interface 42 except where the snack bar 421 is located.
[0266] As shown in FIG16(B), after the user clicks jump control 4212, the electronic device may respond to this operation by displaying user interface 43 as shown in FIG16(C). User interface 43 is the interface of the application service "Notes", and it can be seen from user interface 43 that image 411 has been transferred to "Notes" by the electronic device.
[0267] It should be understood that Figure 16 is merely an example of the user interface provided by the embodiment of the present application and should not constitute a limitation on the embodiment of the present application. For example, when the user transfers the dragged element to an application service in another immersive scenario, the electronic device can still use the snack bar in the interface to prompt the user.
[0268] ② After the transmission is completed, a capsule is generated to prompt the user, please refer to Figures 17 and 18.
[0269] As shown in (A) of Figure 17 , user interface 44 is a cross-application transfer interface for a user to transfer an image 441. The user may be placing the dragged information element, i.e., image 441, on the "global collection" icon on the right.
[0270] As the user releases the image, the electronic device can transfer the image 441 to the global collection (i.e., add the image 441 to the global collection folder) in response to the user operation; if the collection is successful, the electronic device can display the user interface 45 shown in (B) in Figure 16.
[0271] As shown in (B) in Figure 17, if the electronic device successfully collects the image 411 into the global favorites, a capsule 451 may be displayed on the right side of the user interface 45. Specifically, a "global favorites" icon 4511 may be displayed in the capsule 451. In addition, the user can change the specific position of the capsule 451 on the right side by pressing and holding it and dragging it. In addition, the user can also click on the capsule 451 as shown in (B) in Figure 17 to make the electronic device jump from the current interface to the interface of the application service "global favorites". The interface of the "global favorites" after the jump can be specifically referred to the user interface 43 shown in (B) in Figure 16 and the aforementioned related instructions, which will not be repeated here.
[0272] Optionally, capsule 451 may automatically disappear after being displayed on the side of the screen for a period of time. Alternatively, if the user does not actively close capsule 451, capsule 451 may remain displayed on the side of the screen, allowing the user to continue dragging other information elements contained in the current display interface of the electronic device and placing them in the "global collection". Please refer to Figure 18 for details.
[0273] As shown in (A) in Figure 18 , the user interface 45 is the user interface 45 shown in (B) in Figure 17 above. It is understandable that at this time the user has already collected the image 441 into the "global collection", and the capsule 451 is still displayed in the user interface 45. If the user wants to collect other elements in the interface into the "global collection" next, the user can drag the elements in the interface and move them to the capsule 451 and let go. As shown in (A) in Figure 18 , after the user selects the text 452, the user can long press the text 452 to drag it up and directly drag it to the capsule 451. The electronic device can respond to the user operation and display the user interface 46 shown in (B) in Figure 18 .
[0274] As shown in (B) of FIG18 , in user interface 46, after text 452 is dragged onto capsule 451, the electronic device may enlarge capsule 451 to facilitate user operation, i.e., capsule 451 in user interface 46 may be larger than capsule 451 in user interface 45, and the electronic device may reduce the original text 452 to text 461 in user interface 46. At this time, if the user releases text 461, the electronic device may, in response to the user operation, transfer text 461 (or text 452) to the global collection (i.e., add text 461 to the global collection). If the collection is successful, the electronic device may display user interface 47 as shown in (C) of FIG18 .
[0275] As shown in FIG18(C), capsule 451 is still displayed in user interface 47. The user can click capsule 451 as shown in FIG18(C) to open the "Global Favorites" interface of the application service. As a possible embodiment, after the user clicks capsule 451, the electronic device can display the "Global Favorites" interface of the application service in the form of a small window on the interface. For details, please refer to user interface 48 shown in FIG18(D).
[0276] As shown in (D) of FIG18 , the user interface 48 may include a main interface 481 and a sub-interface 482. The main interface 481 may be the application interface of the "browser" application in the electronic device, and the sub-interface 482 may be the small window interface of the application service "global collection." As can be seen from the user interface 48, the sub-interface 482 may include an image 4821, text 4822, and a function expansion control 4823, among which:
[0277] Image 4821 corresponds to image 441 in the above description;
[0278] The text 4822 corresponds to the text 452 or the text 461 in the above description;
[0279] The function expansion control 4823 can respond to a user's touch operation, such as a click operation as shown in (D) in FIG. 18 , to cause the electronic device to display a user interface 49 as shown in (E) in FIG. 18 .
[0280] As shown in (E) of FIG. 18 , in the user interface 49 , the sub-interface 482 displays an expand control 4824 , a minimize control 4825 , and a close control 4826 , wherein:
[0281] The minimization control 4825 can respond to a user operation to cause the electronic device to collapse the sub-interface 482 and display it in the form of a capsule on the side of the screen.
[0282] The close control 4826 can respond to user operation to cause the electronic device to close the sub-interface 482.
[0283] In response to a user operation, the expansion control 4824 can cause the electronic device to display the "Global Favorites" interface of the application service in full screen. As shown in FIG18(E), the electronic device can display the user interface 50 shown in FIG18(F) in response to the user clicking the expansion control 4824. As can be seen from the user interface 50, the electronic device has now displayed the "Global Favorites" interface of the application service in full screen, and the text image 441 and text 452 previously favorited by the user are also displayed accordingly in the user interface 50.
[0284] ③ After the transfer is complete, display the application window in the original interface or directly display the new application interface in full screen, see Figure 19.
[0285] As shown in FIG. 19(A), the user interface 51 is The user can long-press the text 511, drag the text 511 containing the location information, and drag it to the side of the electronic screen; the electronic device can respond to this operation and display the user interface 52 shown in (B) in FIG19 .
[0286] As shown in (B) of Figure 19, the user interface 52 is the cross-application transmission interface. In combination with the above description, it can be seen that the user can drag the text 521 obtained by shrinking the text 511 to any icon in the icon bar on the right side of the user interface 52 and then let go, and the text 521 (or text 511) can be transferred to the application service corresponding to the icon. As shown in (B) of Figure 19, when the user drags the text 521 to the "Map Navigation" icon 522 and then lets go, the electronic device can respond to the user operation and display the user interface 53 shown in (C) of Figure 19.
[0287] As shown in (C) of FIG19 , the user interface 53 may include a main interface 531 and a sub-interface 532. The main interface 531 may be an application interface in an electronic device. The application interface, sub-interface 532 is the application The user can adjust the specific position of the sub-interface 532 in the user interface 53 by pressing and dragging it. As can be seen from the user interface 53, the sub-interface 532 may include an expansion control 5321, a minimize control 5322, and a close control 5323, wherein:
[0288] The minimization control 5322 can respond to user operations to cause the electronic device to collapse the sub-interface 532 and display it in the form of a capsule on the side of the screen.
[0289] The close control 5323 can respond to user operation to cause the electronic device to close the sub-interface 532.
[0290] The expansion control 5321 can respond to user operations to enable the electronic device to display the application in full screen. As shown in (C) of FIG19 , the electronic device can respond to the user's click operation on the expansion control 4824 to display the user interface 54. It can be seen from the user interface 54 that the electronic device has now displayed the application in full screen. interface.
[0291] Optionally, after the user places the text 521 on the "Map Navigation" icon 522 and lets go, in response to the user operation, the electronic device may not display the user interface 53 as shown in (C) in Figure 19, but directly display the user interface 54 as shown in (D) in Figure 19, that is, directly display the new application interface in full screen.
[0292] ④ After the cross-device transfer is completed, the snack bar is displayed in the original interface to prompt the user, and the other devices are controlled to use small application windows or directly display the new application interface in full screen, see Figure 20.
[0293] It should be noted in advance that in the embodiments of the present application, after the electronic device establishes a communication connection with other smart devices, the electronic device can also transmit information across devices based on the "cross-application transmission interface" provided by the present application.
[0294] Figure 20 exemplifies the specific process of an electronic device using the "cross-application transmission interface" to send text information containing location information in WeChat to the vehicle-mounted terminal when a communication connection is established with the vehicle-mounted terminal, and using the vehicle-mounted terminal to navigate to the location information.
[0295] As shown in Figure 20, the electronic device 1900 has established a communication connection with the vehicle terminal via Bluetooth, Wi-Fi, etc. Among them, the electronic device 1900 can be an electronic device that supports the "cross-application transmission interface" interaction mode provided in the embodiment of the present application.
[0296] As shown in FIG. 20(A), the user interface 55 is The user can long-press the text 551 to drag the text 551 containing the location information to the side of the electronic device screen; the electronic device 1900 can respond to this operation by displaying the user interface 56 shown in (B) of FIG. 20 .
[0297] As shown in FIG20(B), the specific functions of the elements included in user interface 56 can be referred to in the aforementioned description of user interface 52 in FIG19. Text 561 corresponds to text 521, and the "Driving Navigation" icon 562 corresponds to the "Map Navigation" icon 522. "Driving Navigation" is a vehicle navigation service provided by electronic device 1900. After electronic device 1900 establishes a communication connection with another vehicle terminal, such as vehicle terminal 1901, the user can control the vehicle terminal for navigation using the "Driving Navigation" service provided by electronic device 1900. As shown in FIG20(B), if the user places text 561 on "Driving Navigation" icon 562 and then releases it, electronic device 1900 responds to the user's action by displaying user interface 57 as shown in FIG20(C), and transmits text 561 to vehicle terminal 1901, causing vehicle terminal 1901 to display user interface 58 as shown in FIG20(D).
[0298] As shown in (C) of FIG20 , a snack bar 571 may be displayed below the user interface 57. Specifically, the snack bar 571 may be used to display a prompt message “Successfully opened, please go to the associated device to view”, prompting the user that the electronic device 1900 has successfully sent the text 561 containing the location information to the vehicle-mounted terminal 1901, and that the vehicle-mounted terminal 1901 has opened a navigation application based on the received text 561 and is navigating to the location information.
[0299] As shown in (D) of FIG20 , the user interface 58 is the user interface displayed after the vehicle terminal 1901 receives the text transmitted by the electronic device 1900 based on the “cross-application transmission interface”. Specifically, the user interface 58 can be a navigation application installed in the vehicle terminal 1901 (e.g. The user interface 58 may also display an information bar 582, which may be used to prompt the user of the source device of the location information and prompt the user to confirm whether to navigate to the location corresponding to the location information.
[0300] ⑤ If the cross-device information transmission fails, a toast feedback prompt will be displayed on the original interface to prompt the user. Please refer to Figure 21.
[0301] It should be understood that for the electronic device provided by this application, not every cross-application transmission of information using the "cross-application transmission interface" will be successful. For example, when the size of an information element exceeds the upper limit specified by the target application service, or the format of the information element does not comply with the regulations of the target application service, the information element cannot be transmitted to the target application service through the "cross-application transmission interface". In this case, the electronic device can display toast feedback in the interface to prompt the user that the information has not been successfully transmitted.
[0302] As shown in (A) of FIG21 , user interface 60 is an application interface for the "Album" application, which displays 11 images, images 601 to 611. Among them, images 601 to 610 are images that have been selected by the user. The user can long press any of the 10 images (e.g., image 610 shown in (A) of FIG21 ) and then drag it to the side to cause the electronic device to display user interface 61 as shown in (B) of FIG21 .
[0303] As shown in (B) of FIG21, the user interface 61 is the cross-application transfer interface. In the user interface 61, the image thumbnail set 612 is the thumbnail set formed after the user drags and pulls up the image 601 to the image 610 in the user interface 60. The number "10" displayed in the upper left corner indicates that the user has selected a total of 10 images. If the transfer is successful, the electronic device can display The contact interface of the application is used to facilitate the user to share all the images contained in the image thumbnail set 612 with WeChat friends. However, since WeChat has a limit on the number of images that a user can send at a time (here it is assumed that the number does not exceed 9), and the image thumbnail set 612 contains a total of 10 images, which has exceeded the number limit specified by WeChat, the transmission process of images 601-610 through the "cross-application transmission interface" will not be successful. Therefore, after the user can press and hold the image thumbnail set 612 and drag it to the application service icon of "Friends WeChat" and then release it, in response to this operation, the electronic device can display the user interface 62 shown in (C) in Figure 21.
[0304] As shown in (C) of Figure 21, toast feedback 621 may be displayed below the user interface 62. Specifically, toast feedback 621 may display a prompt message "File has exceeded the transfer limit" to inform the user that the number of files being transferred exceeds the limit of the target application service, and therefore the transfer process has failed. Unlike the snack bar 421 mentioned in the previous description, toast feedback 621 generally does not display controls for jumping to other interfaces.
[0305] In addition, if the user does not perform any operation on the toast feedback 621, the toast feedback 621 may automatically disappear after being displayed for a period of time (for example, 2s-3s); or, when the toast feedback 621 is still displayed in the user interface 62, the user may make the toast feedback 621 disappear by clicking other locations in the electronic user interface 62 except the location where the toast feedback 621 is located.
[0306] In addition, when the user transmits information through the "cross-application transmission interface", the electronic device can recommend multiple application services that can receive the information to the user based on the information, and display the icons of these application services on the right side of the cross-application transmission interface. Specifically, the upper limit of the number of these application service icons can be 20; optionally, when the number of these application service icons exceeds a certain threshold (for example, 7), in order to ensure the neatness and visibility of the interface, the electronic device can only display a part of these application service icons (for example, 7) at the same time in the cross-application transmission interface when displaying; when the icons currently displayed on the cross-application transmission interface are not the application services expected by the user, the user can also place the dragged element in the blank space above or below the "cross-application transmission interface" icon area to enable the electronic device to update the icons in the icon area. Please refer to Figure 22 for details.
[0307] As shown in (A) of FIG22 , user interface 63 is a cross-application transfer interface for a user to transfer an image 631. In icon area 632 of user interface 63, seven icons are displayed: a "Global Favorites" icon 6321, a "Search" icon 6322, an "Edit" icon 6323, a "Print" icon 6324, a "Friends WeChat" icon 6325, a "Scan" icon 6326, and an "Email" icon 6327.
[0308] Assuming that the application services corresponding to the icons displayed in the user interface 63 at this time are not the user's target application services, then in the user interface 64 shown in (B) of Figure 22, the user can drag the image 631 to the bottom of the icon area 6321, and the electronic device can respond to the user operation, update the icons in the icon area 632 (scroll up to update), and display the user interface 65 shown in (C) of Figure 22.
[0309] As shown in (C) in Figure 22, in the user interface 65, seven icons are also displayed in the icon area 632, namely, the "Search" icon 6322, the "Edit" icon 6323, the "Print" icon 6324, the "Friends WeChat" icon 6325, the "Scan" icon 6326, the "Mail" icon 6327 and the "Taobao" icon 6328. In combination with the user interface 63 shown in (A) of Figure 22, it can be seen that the "Global Favorites" icon 6321 originally displayed at the top of the icon area 632 is no longer displayed in the user interface 65 due to the update, and compared with the user interface 63, in the user interface 65, the original "Search" icon 6322, "Edit" icon 6323, "Print" icon 6324, "Friends WeChat" icon 6325, "Scan" icon 6326 and "Mail" icon 6327 have all moved up one position, and the bottom position is the newly displayed icon, namely the "Taobao" icon 6328.
[0310] Similarly, as shown in the user interface 66 shown in (D) of Figure 22, the user can also drag the image 631 to the top of the icon area 6321. The electronic device can respond to the user operation, update the icons in the icon area 632 (scroll down to update), and display the user interface 67 shown in (E) of Figure 22.
[0311] As shown in (E) in Figure 22, in the user interface 67, seven icons are also displayed in the icon area 632, namely, the "Print" icon, the "Global Favorites" icon 6321, the "Search" icon 6322, the "Edit" icon 6323, the "Print" icon 6324, the "Friends WeChat" icon 6325 and the "Scan" icon 6326. In combination with the user interface 63 shown in (A) of Figure 22, it can be seen that the "Mail" icon 6327 originally displayed at the bottom of the icon area 632 is no longer displayed in the user interface 65 due to the update, and compared with the user interface 63, in the user interface 65, the original "Global Favorites" icon 6321, "Search" icon 6322, "Edit" icon 6323, "Print" icon 6324, "Friends WeChat" icon 6325 and "Scan" icon 6326 have all moved down one position, and the top position is the newly displayed icon, namely the "Notes" icon 6329.
[0312] In addition, in some embodiments, the electronic device may further divide the icon area into two parts, wherein one part of the area is used to display fixed icons, and the other part of the area is used to display icons that the electronic device recommends to the user. Specifically, for this part of the icons that the electronic device recommends to the user, the electronic device may first identify the dragged information element, and based on the identification result, obtain an application service icon that meets the user's needs in the cross-application transmission interface. That is, when the user drags up two elements successively, even if the two elements are of the same type (for example, both are text or both are images), if the content contained in the two elements is different (for example, the image content is different or the text is different), then in the two user interfaces of the "cross-application transmission interface" displayed by the electronic device based on the two elements, the icons in the icon area of each user interface may also be different; it should be understood that the "different" here may include different types of icons and different orders of icons. In an embodiment of the present application, the electronic device may display the icon that is more in line with the user's current needs at the top of the icon area. Please refer to Figures 23-26 for details.
[0313] Figure 23 is a schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on location information contained in text, provided by an embodiment of the present application.
[0314] As shown in FIG. 23(A), the user interface 68 is The chat interface of the application. The user can long press the text 681 to drag up the text 681 containing the location information. After the user drags up the text 681, the electronic device can respond to the operation and identify the text information; after the electronic device recognizes that the text 681 contains location information, the electronic device determines based on the location information that the user currently has the intention to travel to the location. At this time, the electronic device will recommend corresponding application services to the user based on the user's intention, and in the subsequent "cross-application transmission interface" interface, the icons of the application services recommended to the user will be displayed in the icon area, and sorted according to the application services. The icons corresponding to the application services that are more in line with the current user's intention will be located higher in the icon area.
[0315] As shown in (A) of FIG. 23 , after the user drags the text 681 and drags it to the side of the electronic screen, the electronic device may display a user interface 69 as shown in (B) of FIG. 23 in response to the operation.
[0316] As shown in (B) of Figure 23, user interface 69 is a cross-application transfer interface. In user interface 69, text 691 is the text obtained by reducing text 681. The icon area on the right can be divided into a fixed icon area 692 and a recommended icon area 693. The two areas can be distinguished by a dividing line 694;
[0317] Fixed icon area 692 may include a "global favorites" icon 6921 and a "search" icon 6922. It is understood that no matter what element a user shares on an electronic device, the electronic device will display a cross-application transfer interface based on that element in fixed icon area 692, and the icons contained therein are both the "global favorites" icon 6921 and the "search" icon 6922.
[0318] Recommended icon area 693 may include a "Map Navigation" icon 6931, a "One-Click Taxi" icon 6932, a "Driving Navigation" icon 6933, a "WeChat" icon 6934, and a "Memo" icon 6935. Specifically, the "Map Navigation" icon 6931 may be used to open the map software on the electronic device for location navigation and enter the navigation application interface; the "One-Click Taxi" icon 6932 may be used to enter the taxi service application interface based on the taxi service provided by the map software; and the "Driving Navigation" icon 6933 is primarily used to transmit the aforementioned location information across devices to an in-vehicle terminal that is communicatively connected to the electronic device. For details, please refer to the aforementioned description of FIG. 20 . It is understandable that because the text information 681 contains location information, the electronic device can determine that the user currently intends to travel to the location based on the location information. Therefore, in the recommended icon area 693, the "Map Navigation" icon 6931, the "One-click Taxi" icon 6932, and the "Driving Navigation" icon 6933 are displayed in the upper position of the recommended icon area 693 because they best meet the current user's intention, so that the user can make a selection.
[0319] Figure 24 is a schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on information such as time and location contained in a text, provided by an embodiment of the present application.
[0320] As shown in (A) of Figure 24, the user interface 70 is the application interface of the application "browser". The user can long press the text 701 to drag up the text 701 containing the location information. After the user drags up the text 701, the electronic device can respond to the operation and identify the text information; after the electronic device recognizes that the text 701 contains time and location information, the electronic device determines that the text information may contain specific schedule information based on the time and location information. At this time, the electronic device will recommend the corresponding application service to the user based on the user's intention, and in the subsequent "cross-application transmission interface" interface, the icon of the application service recommended to the user will be displayed in the icon area, and sorted according to the application service. The icon corresponding to the application service that is more in line with the current user's intention will be located higher in the icon area.
[0321] As shown in (A) of FIG. 24 , after the user drags the text 701 and drags it to the side of the electronic screen, the electronic device may display a user interface 71 as shown in (B) of FIG. 24 in response to the operation.
[0322] As shown in (B) of Figure 24, user interface 71 is a cross-application transfer interface. In user interface 71, text 711 is the text obtained by reducing text 711. The icon area on the right can be divided into a fixed icon area 712 and a recommended icon area 713. The two areas can be distinguished by a dividing line 714; wherein:
[0323] Fixed icon area 712 may include a "global favorites" icon 7121 and a "search" icon 7122. It is understood that no matter what element a user shares on an electronic device, the electronic device will display the cross-application transmission interface based on that element in fixed icon area 712, and the icons contained therein are both "global favorites" icon 7121 and "search" icon 7122.
[0324] Recommended icon area 713 may include a "Share" icon 7131, a "Schedule" icon 7132, a "Friends WeChat" icon 7133, a "Print" icon 7134, and a "Translate" icon 7135. The "Share" icon 7131 may be used to share text 701 with other devices via Bluetooth, email, or the like based on a sharing service provided by the electronic device; the "Schedule" icon 7132 may be used to add the time and location information in text 701 to a schedule; and the "Friends WeChat" icon 7133 may be used to send text 701 to WeChat friends via the WeChat chat interface. It is understandable that because the text 701 contains time and location information, the electronic device can determine that the text information may contain specific schedule information based on the time and location information, and the user currently has the intention to share or add the schedule. Therefore, in the recommended icon area 713, the "Share" icon 7131, the "Schedule" icon 7132, and the "Friend WeChat" icon 7133 are displayed in the upper position of the recommended icon area 713 because they best meet the current user's intention, so that the user can make a selection.
[0325] Figure 25 is a schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on a QR code image contained in an image provided by an embodiment of the present application.
[0326] As shown in (A) of FIG25 , user interface 72 is the interface of the "Browser" application. The user can long-press image 721 to drag up image 721 containing a QR code image 7211 (the QR code image 7211 shown in FIG25 is for ease of understanding only and may be presented in other forms in actual application scenarios, which is not limited in this application). After the user drags up image 721, the electronic device can respond to this operation and identify image 721. After the electronic device recognizes that image 721 contains a QR code image, the electronic device determines based on the QR code image that the user is likely to need to scan the QR code in image 721. At this time, the electronic device will recommend corresponding application services to the user based on the user's intention, and in the subsequent "Cross-Application Transfer Interface" interface, the icons of the recommended application services are displayed in the icon area, and the icons corresponding to the application services that are more in line with the current user's intention will be located higher in the icon area.
[0327] As shown in (A) of FIG. 25 , after the user drags up the image 721 and drags it to the side of the electronic screen, the electronic device may display a user interface 73 as shown in (B) of FIG. 25 in response to the operation.
[0328] As shown in (B) of Figure 25, user interface 73 is a cross-application transfer interface. In user interface 73, image 731 is a zoomed-out image of image 721. The icon area on the right can be divided into a fixed icon area 732 and a recommended icon area 733. The two areas can be distinguished by a dividing line 734.
[0329] The specific functions of the fixed icon area 732 can be referred to the aforementioned description of the fixed icon area 712 and will not be repeated here.
[0330] Recommended icon area 733 may include a "Scan with Camera" icon 7331, a "Print" icon 7332, a "Share" icon 7333, a "Friends WeChat" icon 7334, and an "Album" icon 7335. Among them, "Scan with Camera" icon 7331 can be used to scan image 731 using the "Scan" service provided by the "Camera" application; "Print" icon 7332 is mainly used to send image 731 to a printing device for printing; and "Share" icon 7333 can be used to share image 731 with other devices via Bluetooth, email, etc. using the sharing service provided by the electronic device. It is understandable that because image 721 contains a QR code, the electronic device can determine based on the QR code image that the user may need to scan the image, or the user wants to print or share the image. Therefore, in the recommended icon area 733, the "Scan Camera" icon 7331, the "Print" icon 7332, and the "Share" icon 7333 are displayed in the upper position of the recommended icon area 733 because they best meet the current user's intentions, so that the user can make a selection.
[0331] Figure 26 is a schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on a facial image contained in an image provided by an embodiment of the present application.
[0332] As shown in (A) of Figure 26, user interface 74 is the interface of the "Camera" application. The user can long-press image 741 to drag up image 741 containing a facial image. After the user drags up image 741, the electronic device can respond to the operation and identify image 741; after the electronic device recognizes that image 741 contains a facial image, the electronic device can determine based on the facial image that the user is likely to need to beautify image 741 or share it to social software. At this time, the electronic device will recommend corresponding application services to the user based on the user's intention, and in the subsequent "Cross-Application Transfer Interface" interface, the icons of the application services recommended to the user will be displayed in the icon area, and sorted according to the application services. The icons corresponding to the application services that are more in line with the current user's intention will be located higher in the icon area.
[0333] As shown in (A) of FIG. 26 , after the user drags up the image 741 and drags it to the side of the electronic screen, the electronic device may display a user interface 75 as shown in (B) of FIG. 26 in response to the operation.
[0334] As shown in (B) of Figure 26, user interface 75 is a cross-application transfer interface. In user interface 75, image 751 is a zoomed-out image of image 751. The icon area on the right can be divided into a fixed icon area 752 and a recommended icon area 753. The two areas can be distinguished by a dividing line 754.
[0335] The specific functions of the fixed icon area 752 can be referred to the aforementioned description of the fixed icon area 712, which will not be repeated here.
[0336] Recommended icon area 753 may include a "Meitu" icon 7531, a "Friends Circle" icon 7532, a "QQ Space" icon 7533, a "Friends WeChat" icon 7534, and a "Share" icon 7535. "Meitu" icon 7531 can be used to beautify image 751; "Friends Circle" icon 7532 is primarily used to share image 751 to WeChat's Moments; and "QQ" icon 7533 can be used to share image 751 to QQ Space. As can be appreciated, because image 751 contains a QR code, the electronic device, based on the facial image, can determine that the user may want to beautify image 751 or share it to social media. Therefore, in recommended icon area 753, "Meitu" icon 7531, "Friends Circle" icon 7532, and "QQ Space" icon 7533 are displayed near the top of recommended icon area 753, as they best align with the user's current intent, for easier selection.
[0337] In some embodiments, the icon area in the cross-application transfer interface can be used to display thumbnails of application interfaces of applications running in the background of the electronic device, in addition to displaying application service icons. When the user drops a dragged information element on a thumbnail and releases it, the information element is transferred to the application interface corresponding to the thumbnail. See Figure 27 for details.
[0338] As shown in FIG. 27(A), the user interface 76 is The user swipes upwards at the lower edge of the electronic device screen; the electronic device may respond to this operation by displaying a user interface 77 as shown in FIG. 27 (B).
[0339] As shown in FIG27 (B), the user interface 77 is an application navigation interface, in which the application interface thumbnails of all applications currently opened by the electronic device can be displayed, wherein the application interface thumbnail 771 is The thumbnail of the chat interface of a friend (Xiao Ming) in the application, and the application interface thumbnail 772 is a thumbnail of the web browsing interface in the application "browser". Here, the application corresponding to the application interface displayed by the electronic device is called the foreground application, and the application that has been opened but has not displayed the application interface on the electronic screen is called the background application. Then in the user interface 77, the user can click on any application interface thumbnail displayed in the user interface 77 to switch the application corresponding to the application interface thumbnail to the foreground application, and display the application interface thumbnail in full screen on the screen. As shown in (B) in Figure 27, the user can click on the application interface thumbnail 772 to make the electronic device switch the application "browser" to the foreground application. It should be understood that at this time, the application If it is not closed, it will run in the background. When the user opens the application through the application navigation interface When switching to the foreground application, the electronic device will still display the user interface 76 on the screen. In response to the user operation of switching the application "browser" to the foreground application, the electronic device can display the user interface 78 shown in (C) in Figure 27.
[0340] As shown in (C) in Figure 27, the user interface 78 can be the application interface of the "browser" application in the electronic device. The user can long press and drag the image 781 in the user interface 78 to make the electronic device display the user interface 79 shown in (D) in Figure 27.
[0341] As shown in (D) of FIG27 , user interface 79 may include a sub-interface 791, an image 792, an application interface thumbnail 793, and a text description 794. Image 792 is a thumbnail of image 781 that is reduced in size, and text description 794 may be used to explain to the user the application and contact corresponding to application interface thumbnail 793. Application interface thumbnail 793 is the thumbnail of the aforementioned user interface 76. When the user drags image 792 onto application interface thumbnail 793 and releases it, the electronic device may, in response to the user operation, display user interface 80 as shown in (E) of FIG27 .
[0342] As shown in (E) of Figure 27, user interface 80 can be a chat interface for a friend (Xiao Ming) of the WeChat application. As can be seen from user interface 80, the user has already sent image 781 obtained from the application "Browser" to WeChat friend "Xiao Ming". In other words, when the user drags image 792 from user interface 79 onto application interface thumbnail 793 and releases the image, the electronic device can automatically send image 792 (or image 781) to WeChat friend Xiao Ming without the user having to perform any other operations.
[0343] It should be understood that FIG27 is only an example of the user interface provided by the embodiment of the present application, and it should not constitute a limitation on the embodiment of the present application. Background applications such as can also be displayed in the cross-application transmission interface, and this application does not limit this.
[0344] In addition, in some embodiments, after the user drags up the information element, the electronic device can directly call out the side application bar and display the corresponding application service icon for the user in the side application bar. The following is explained with reference to Figures 28 and 29.
[0345] FIG. 28 shows two different ways of bringing up the side application bar of an electronic device.
[0346] First, the user can bring up the side application bar of the electronic device by conventionally swiping inward on the side of the screen.
[0347] As shown in (A) of FIG28 , the user interface 81 may be an application interface of a “browser” application in an electronic device, or an application interface of a browser. The user can swipe left on the right side of the screen (without releasing the swipe) to bring up the icon 811 of the electronic device's side application bar; if the user then releases the swipe, the electronic device can respond to the swipe by displaying the user interface 82 shown in FIG. 28 (B).
[0348] As shown in FIG28 (B), a side application bar 821 may be displayed in the user interface 82. The side application bar 821 may display one or more application icons added to the side application bar 821 by the user, such as the one shown in FIG28 (B). Icon 8211, icon 8212. Not limited to this, the user can also continue to add other application icons to the side application bar 821 through the application list control 8213. Any icon can respond to user operations to enable the electronic device to open the corresponding application. When the user opens another application through the side application bar 821 in the current application interface, the electronic device can display the two application interfaces in split screen. The user can transfer information elements provided by one application to another application based on the two interfaces (for details, please refer to the relevant description of Figure 2 above). This is the "smart multi-window function" provided by the electronic device.
[0349] Secondly, users can long press and drag the information elements in the interface to bring up the side application bar of the electronic device.
[0350] As shown in (C) of FIG. 28 , the user interface 83 may be an application interface of a “browser” application in an electronic device, or an application interface of a browser. The application interface of the present application may also be the application interface of other applications, which is not limited in this application; specifically, the user interface 83 may be the same interface as the user interface 81 described above. The user can long press the text 831 that the user has selected in the user interface 83 to drag the text 831 up; after the user drags the text 831 up (without dragging it to the side), the electronic device can respond to the operation and display the user interface 84 shown in (D) of Figure 28.
[0351] As shown in (D) of FIG28 , the user interface 84 may display text 842 and a side application bar 821. The text 842 is the text obtained by dragging and shrinking the text 831. The side application bar 841 may include an application list control 8414, a smart flow icon area 8411, and a smart multi-window icon area 8412. These two areas may be separated by a dividing line 8413, where:
[0352] The smart flow icon area 8411 can display multiple application service icons. It should be understood that the icons displayed in the smart flow icon area 8411 can all be used to transmit the elements dragged by the user (i.e., text 842) across applications without the need for the split-screen function provided by the electronic device. This transmission method and the transmission method through the "cross-application transmission interface" user and interface in the aforementioned embodiment can be referred to as the "smart flow" function of the electronic device in this application. Optionally, the icons displayed in the smart flow icon area 8411 may also include fixed display icons set by the user and icons recommended and displayed to the user by the electronic device based on the content in the text 842. For example, in the “Global Favorites” icon 84111, the “Search” icon 84112, the “Schedule” icon 84113, and the “Memo” icon 84114 shown in (D) in Figure 28, the “Global Favorites” icon 84111 and the “Search” icon 84112 may be fixed display icons, while the “Schedule” icon 84113 and the “Memo” icon 84114 may be icons recommended and displayed to the user by the electronic device based on the content in the text 842.
[0353] The smart multi-window icon area 8412 can display one or more application icons, which can be all or part of the icons contained in the side application bar 821 in the user interface 82 shown in Figure 28 (B). Unlike the smart flow icon area 8411, the icons in this area cannot be used to transfer text 842 across applications, and are only displayed in the user interface 84. In addition, if the electronic device recommends more than a certain number of application service icons for the text 842, the side application bar can give priority to displaying the application service icons recommended by the electronic device for the text 842, and the smart multi-window icon area 8412 and the application icons contained therein are no longer displayed.
[0354] The application list control 8414 can be used to display icons that can be added to the side application bar 841, including application service icons that can be added to the smart flow icon area 8411 for fixed display, and application icons that can be added to the smart multi-window icon area 8412. Please refer to Figure 29 for details.
[0355] FIG. 29 shows the specific process of a user adding an icon to the side application bar.
[0356] In response to a user clicking an application list control in the side application bar (e.g., application list control 8213 or application list control 8414 in the aforementioned description), the electronic device may display user interface 8A as shown in (A) of FIG29 . User interface 8A may include a side application bar 8A1 and an icon display interface 8A2, wherein:
[0357] The side application bar 8A1 may include a smart flow icon area 8A11, a smart multi-window icon area 8A12, and an add control 8A13 for adding icons to the icons in the side application bar 8A1.
[0358] The icon display interface 8A2 can display a smart multi-window icon display area 8A21 and a smart flow icon display area 8A22. It is understood that the icons in the smart multi-window icon display area 8A21 can be added to the smart multi-window icon area 8A12 in the side app bar 8A1; and the icons in the smart flow icon display area 8A22 can be added to the smart flow icon area in the side app bar 8A1.
[0359] As shown in FIG29(A), in response to the electronic device clicking the add control 8A11, the electronic device may display a user interface 8B as shown in FIG29(B). As shown in user interface 8B, a symbol to be added is displayed in the upper right corner of each icon displayed in the icon display interface 8B2, and blank spaces are displayed in the smart flow icon area 8B11 and the smart multi-window icon area 8B12 in the side app bar 8B1 for storing the newly added icon.
[0360] Specifically, the user can click on any icon in the smart multi-window icon display area 8B21 or the smart flow icon display area 8B22 to add the icon to the blank icon position in the smart flow icon area 8B11 or the smart multi-window icon area 8B12. For example, the user can click on the "memo" icon in the smart multi-window icon display area 8B21 to add it to the blank position 8B121 in the smart multi-window icon area 8B12, or the user can click on the "scan camera" icon in the smart flow icon display area 8B22 to add it to the blank position 8B111 in the smart flow icon area 8B11. Afterwards, the user can click on the confirmation control 8B14 in the side application bar 8B1, and the electronic device can save the icon option added by the user, and the newly added icon will be displayed in the side application bar the next time the side application bar is displayed.
[0361] Currently, most smart devices also provide users with a quick screen recording function. For example, in some scenarios, users can double-click the screen with two knuckles to record the current interface demonstration process of the electronic device. Therefore, with reference to the quick screen recording function provided by the electronic device, the following describes the process of using the cross-application transfer interface to transfer the recorded video across applications in the screen recording scenario with reference to Figure 30.
[0362] FIG30 is a schematic diagram of the interface change process of the electronic device when the user transfers the recorded video across applications based on the cross-application transfer interface.
[0363] As shown in (A) of FIG30 , the user interface 85 may be an application interface of an application “browser” in an electronic device, or an application The application interface can also be the application interface of other applications, which is not limited in this application. At this time, the user has turned on the screen recording function of the electronic device through relevant operations. In the user interface 85, the screen recording function box may include a microphone control 8511, a time control 8512 and an option control 8513, wherein;
[0364] The microphone control 8511 can respond to user operations to enable the electronic device to start / stop recording external sounds;
[0365] The time control 8512 can be used to display the duration of the recording in real time, and it can also respond to user operations to stop the electronic device from recording the screen;
[0366] The option control 8513 can respond to user operations to enable the electronic device to display more screen recording setting options, such as whether to record the user's operation trajectory on the screen.
[0367] For example, as shown in (A) in FIG. 30 , in response to a user clicking on the time control 8512 , the electronic device may stop the screen recording process and display a user interface 86 as shown in (B) in FIG. 30 .
[0368] As shown in (B) of FIG30 , user interface 86 may include video file 861. Video file 861 is the video recorded by the electronic device in response to the user's screen recording operation. After the screen is recorded, video file 861 may be displayed in user interface 86 for two to three seconds, so that the user can directly click on video file 861 to edit, save, or perform other operations on it. If the user does not operate on video file 861, the electronic device may automatically save it to the photo album.
[0369] In the embodiment of the present application, while the electronic device displays video file 861 in user interface 86, the user can long-press video file 861, drag it to the side of the electronic device screen, and then transfer it across applications through the "cross-application transfer interface." As shown in FIG30 (B), the electronic device can respond to the user's long-pressing and dragging of video file 861 to the side by displaying user interface 87 as shown in FIG30 (C).
[0370] As shown in (C) of FIG30 , the user interface 87 is the cross-application transmission interface. The user interface 87 may include a sub-interface 871, an icon area 872, and a video file 873, wherein:
[0371] The specific content and functions of the sub-interface 871 and the icon area 872 can be referred to the above description and will not be repeated here.
[0372] Similarly, in order to avoid excessive occlusion of the icon area 872 , when the video file 861 is close to the icon area, the electronic device shrinks the original video file 861 to obtain a video file 873 .
[0373] Similarly, in the user interface 87, the user places the video file 873 on the corresponding icon in the icon area 872 and lets go. The electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation and display the corresponding application interface.
[0374] In addition, after the user uses the quick screenshot function to capture an image of the electronic device, the user can also edit the captured image and use the "cross-application transfer interface" in the editing page to transfer the edited image. Please refer to Figure 31 for details.
[0375] As shown in (A) of FIG31, the user interface 88 can be an application interface of an application "browser" in an electronic device, or an application In response to a user's quick screenshot operation on user interface 88, such as a double-click operation with a knuckle as shown in FIG31 (A), the electronic device can quickly capture a full-screen image of user interface 88 and display user interface 89 as shown in FIG31 (B).
[0376] As shown in FIG31(B), the user interface 89 may include a screenshot image 891. The screenshot image 891 is an image obtained by the electronic device in response to the user taking a knuckle screenshot of the user interface 88. After the screenshot is taken, the screenshot image 891 may be displayed in the user interface 89 and generally remains for two to three seconds, allowing the user to directly click on the screenshot image 891 to edit, save, or perform other operations on it. If the user does not perform any operations on the screenshot image 891, the electronic device may automatically save it to the photo album.
[0377] In the embodiment of the present application, during the period in which the electronic device displays the screenshot image 891 in the user interface 89, the electronic device may respond to a user click operation on the screenshot image 891 as shown in (B) of FIG31 and display the user interface 90 as shown in (C) of FIG31. The user interface 90 is an editing interface for the screenshot image 891, which may include a thumbnail 901 and a graffiti option 902, wherein:
[0378] The thumbnail 901 may be a thumbnail of the aforementioned user interface 88 .
[0379] The graffiti option 902 can respond to a user operation, so that the electronic device responds to the user's touch operation on the screen and draws the user's touch track on the screen onto the thumbnail 901.
[0380] As shown in (C) of FIG31 , the user can doodle on the thumbnail 901 according to the trajectory indicated by the directional dotted line shown in (D) of FIG31 . The electronic device can respond to the user operation (in the embodiment of the present application, the operation can be referred to as the "eighth operation"), draw the trajectory indicated by the directional dotted line onto the thumbnail 901, and display the user interface 91 shown in (D) of FIG31 . Optionally, in the user interface 90, the image contained in the thumbnail 901 can also be long-pressed and dragged by the user to cause the electronic device to display the cross-application transmission interface provided by the present application, and transmit based on the cross-application transmission interface; when the user clicks on the text recognition control in the user interface 90, the electronic device can also recognize the text contained in the image 901, and the text can also be long-pressed and dragged by the user to cause the electronic device to display the cross-application transmission interface provided by the present application, and transmit based on the cross-application transmission interface. For details, please refer to the aforementioned relevant descriptions of FIG7 and FIG8 , which will not be repeated here.
[0381] As shown in (D) of FIG. 31 , in the user interface 91 , a triangle pattern 911 drawn by the user is already displayed on the thumbnail 901 .
[0382] It is understandable that user interface 91 is still an image editing interface. In user interface 91, the user can also long-press thumbnail 901, drag it to the side of the electronic device screen, and transfer it across applications through the "cross-application transfer interface". As shown in (D) of Figure 31, the electronic device can respond to the user's long-press and drag operation on thumbnail 901 (at this time, thumbnail 901 already has a user-drawn pattern, namely, triangle pattern 911) to the side, and display user interface 92 as shown in (E) of Figure 31.
[0383] As shown in (E) of FIG31 , the user interface 92 is the cross-application transmission interface. The user interface 92 may include a sub-interface 921, an icon area 922, and an image 923, wherein:
[0384] The specific content and functions of the sub-interface 921 and the icon area 922 can be referred to the above description and will not be repeated here.
[0385] Similarly, in order to avoid excessive occlusion of the icon area 922, when the thumbnail 901 is close to the icon area, the electronic device further reduces the original thumbnail 901 to obtain image 923 (image 923 also contains a pattern drawn by the user, namely, a triangle pattern 911).
[0386] Similarly, in the user interface 92, the user places the image 923 on the corresponding icon in the icon area 922 and lets go. The electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation and display the corresponding application interface.
[0387] In an embodiment of the present application, user interface 88 can be called the "fifth interface", user interface 89 can be called the "sixth interface", user interface 91 can be called the "seventh interface", user interface 90 can be called the "editing interface", image 891 and image 901 can be called the "first image", user interface 95 can be called the "seventh interface", and the user's click operation on the screenshot image 891, the user's operation of graffiti on the thumbnail 901 according to the trajectory indicated by the directional dotted line shown in (D) in Figure 31, and the user's operation of long pressing the thumbnail 901 and dragging it to the side of the electronic device screen can be collectively referred to as the "eighth operation".
[0388] In addition, in some embodiments, the electronic device also provides the user with a long screenshot function. Long screenshot, also known as scrolling screenshot, is an effective method to capture the current content of the interface, which can obtain all the content in the interface, rather than just the visible part. It can be widely used in web browsing scenarios and is very useful for investigating web information or collecting materials. Generally, the process of scrolling screenshot is to first use the scrolling function to scroll the web page and continuously capture the web page content. After the web page content is captured, the program will automatically combine all the content together to form a complete long picture. The "cross-application transmission interface" provided in this application is also applicable to images captured by users through the long screenshot function. Please refer to Figure 32 for details.
[0389] As shown in FIG. 32 (A), the user interface 93 may be an application interface of an application "browser" in an electronic device, or an application The application interface may be an application interface of another application, and this application does not limit this. In response to the user's long screenshot operation on the user interface 93, such as the operation of drawing an "S" trajectory after tapping with the knuckles as shown in (A) in Figure 32, the electronic device can quickly scroll the web page and continuously capture the web page content. When the user clicks the screen again (this operation is not shown in (A) in Figure 32), it means that the web page content required by the user has been captured. After that, the electronic device will combine all the captured content to form a complete long picture and display the user interface 94 as shown in (B) in Figure 32.
[0390] As shown in FIG32(B), the user interface 94 may include a long screenshot image 941. The long screenshot image 941 is an image obtained by the electronic device in response to the user performing a long screenshot operation on the user interface 93. After the long screenshot is taken, the user can edit, save, and perform other operations on the long screenshot image 941 through the relevant editing options in the user interface 94.
[0391] In an embodiment of the present application, the electronic device can also display a user interface 95 as shown in (C) in Figure 32 in response to the user long pressing and dragging the long screenshot image 941 to the side as shown in (B) in Figure 32.
[0392] As shown in (C) of FIG32 , the user interface 95 is the cross-application transmission interface. The user interface 95 may include a sub-interface 951, an icon area 952, and an image 953, wherein:
[0393] The specific content and functions of the sub-interface 951 and the icon area 952 can be referred to the above description and will not be repeated here.
[0394] Similarly, in order to avoid excessive occlusion of the icon area 952 , the electronic device shrinks the long screenshot image 941 when it approaches the icon area, thereby obtaining image 953 .
[0395] Similarly, in the user interface 95, the user places the image 953 on the corresponding icon in the icon area 952 and lets go. The electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation and display the corresponding application interface.
[0396] Optionally, when the size of long screenshot image 941 exceeds the upper limit specified by the application service, or the format of long screenshot image 941 does not comply with the requirements of the target application service, long screenshot image 941 cannot be transmitted to the target application service through the "cross-application transmission interface". In this case, the electronic device can also display toast feedback in the interface to prompt the user that the information transmission failed successfully.
[0397] For example, when the transmission of the long screenshot image 941 fails, the electronic device may display a user interface 96 as shown in (D) of FIG32 . A toast feedback 961 may be displayed below the user interface 96. Specifically, the toast feedback 961 may display a prompt message "The image exceeds the upper limit of the smart stream transmission. Please crop it before transmitting." to prompt the user that the transmitted image exceeds the limit of the target application service, and therefore the transmission process has failed.
[0398] Similarly, if the user does not perform any operation on the toast feedback 961, the toast feedback 961 may automatically disappear after being displayed for a period of time (e.g., 2s-3s); or, when the toast feedback is still displayed in the user interface 96, the user may make the toast feedback 961 disappear by going to a location other than the location of the toast feedback 961 in the electronic user interface 96.
[0399] In an embodiment of the present application, user interface 93 can be called the "fifth interface", user interface 94 can be called the "sixth interface", long screenshot image 941 or image 953 can be called the "first image", user interface 95 can be called the "seventh interface", and the operation of the user placing image 953 on the corresponding icon in the icon area 952 and releasing it can be called the "ninth operation".
[0400] The following introduces the system setting interface involved in the "Smart Flow" function.
[0401] First, the user interface involved in enabling the “Smart Flow” function of an electronic device will be introduced with reference to FIG33 .
[0402] As shown in (A) of FIG33 , the user interface 97 may be a navigation interface displayed to the user when the electronic device is turned on for the first time after leaving the factory. In the user interface 97, the smart flow service tab 971 may include a switch control 9711, which may be set to the on state by default, that is, the electronic device has the "smart flow" function turned on by default. Of course, the user can also turn off the "smart flow" function of the electronic device by clicking the switch control 9711.
[0403] In addition, during the daily use of electronic devices by users, users can also turn on or off the "Smart Flow" function through the relevant interface in the electronic device system settings. As shown in (B) in Figure 33, the user can open the "Smart Flow" setting interface in the system settings, that is, the user interface 98, and turn on or off the "Smart Flow" function by manipulating the switch control 9811 in the "Smart Flow" tab 981. If the switch control 9711 is displayed as off at this time, the user can turn on the "Smart Flow" function by clicking the switch control 9811, and the electronic device will respond to the user operation and display the user interface 99 shown in (C) in Figure 33.
[0404] As shown in FIG33(C), the user interface 99 may include a prompt box 991, which may be used to ask the user whether to agree to open the electronic device screen to "Smart Flow". The prompt box 991 may include an "Always Allow" option 9911, a "Allow Only During Use" option 9912, and a "Prohibit" option 9913. When the user clicks the "Always Allow" option 9911 or the "Allow Only During Use" option 9912, the electronic device can successfully enable the "Smart Flow" function; when the user clicks the "Prohibit" option 9913, the electronic device will not be able to enable the "Smart Flow" function.
[0405] Figure 34 shows some system setting interfaces for understanding the "Smart Flow" function and editing the application service icons in the Smart Flow page.
[0406] As shown in (A) of FIG34 , user interface 00 is an interface related to the "Smart Assistant" function in the "System Settings" of the electronic device. In user interface 00, the user can click the "Smart Flow" tab to cause the electronic device to display user interface 38 as shown in (B) of FIG34 .
[0407] As shown in (B) of FIG34 , the user interface 38 may be the same as the user interface 98 described above. In the user interface 38 , a “Learn More” control 381 and a “Customize Service” tab 382 may be displayed, wherein:
[0408] The "Learn Details" control 381 can respond to a user's click operation to cause the electronic device to display a user interface 39 as shown in (C) of FIG34 . User interface 39 is a user interface provided by the system settings, which can be used to show the user the specific functions and specific operation steps of the "Smart Flow" function.
[0409] The "Customized Services" tab 382 can respond to a user's click operation to cause the electronic device to display the user interface 40 shown in (D) of Figure 34. As can be seen from the above description, among the icons displayed in the cross-application transmission interface, some icons are user-defined and fixedly displayed in the icon area, while other icons are recommended by the electronic device to the user based on the elements dragged by the user. Therefore, in the user interface 40, the icons displayed in the icon display card 401 are the icons that the user has determined to be fixedly displayed in the icon area, while the icons displayed in the icon display card 402 are the icons that the user has not yet set to be fixedly displayed in the icon area. The user can click the removal symbol "-" in the upper right corner of any icon in the icon display card 401 to stop the icon from being fixedly displayed in the icon area of the cross-application transmission interface; similarly, the user can click the addition symbol "+" in the upper right corner of any icon in the icon display card 402 to make the icon fixedly displayed in the icon area of the cross-application transmission interface (after being added, the icon will also be displayed in the blank icon area of the icon display card 401, such as 4011).
[0410] It should be understood that Figures 33 and 34 merely illustrate user interfaces related to "System Settings" provided in embodiments of the present application and should not be construed as limiting the embodiments of the present application. For example, icon display card 402 may include more or fewer application service icons, and this application does not limit this.
[0411] Next, the electronic device provided by this application is introduced.
[0412] The electronic device may be a mobile phone, a tablet computer, a wearable device, an in-vehicle device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), or a dedicated camera (such as a SLR camera or a compact camera). This application does not impose any restrictions on the specific type of the electronic device.
[0413] FIG35 exemplarily shows the structure of the electronic device.
[0414] As shown in Figure 35, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 151, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0415] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0416] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0417] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0418] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0419] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.
[0420] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C bus lines. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, and the like via different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K via the I2C interface, enabling communication between the processor 110 and the touch sensor 180K via the I2C bus interface, thereby implementing the touch function of the electronic device 100.
[0421] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.
[0422] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0423] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface, enabling the function of playing music through Bluetooth headphones.
[0424] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the electronic device 100. The processor 110 and the display 194 communicate via the DSI interface to implement the display function of the electronic device 100.
[0425] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0426] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as augmented reality devices.
[0427] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.
[0428] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.
[0429] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 151, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0430] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0431] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0432] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0433] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0434] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0435] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0436] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0437] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.
[0438] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
[0439] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.
[0440] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0441] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0442] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.
[0443] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.
[0444] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.
[0445] The internal memory 151 can be used to store computer executable program codes, which include instructions. The internal memory 151 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 151 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 151 and / or instructions stored in a memory provided in the processor.
[0446] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0447] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.
[0448] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.
[0449] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.
[0450] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.
[0451] The headphone jack 170D is used to connect a wired headphone and can be the USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0452] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be located on display screen 194. There are many types of pressure sensors 180A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force acts on pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the touch intensity based on pressure sensor 180A. Electronic device 100 can also calculate the touch location based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch location but with different touch intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, a command to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, a command to create a new short message is executed.
[0453] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.
[0454] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude using the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.
[0455] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover based on the magnetic sensor 180D. Based on the detected opening and closing status of the case or flip cover, features such as automatic unlocking of the flip cover can be configured.
[0456] Accelerometer 180E can detect the magnitude of acceleration of electronic device 100 in all directions (generally three axes). It can also detect the magnitude and direction of gravity when electronic device 100 is stationary. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.
[0457] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance using infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.
[0458] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user is holding the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.
[0459] Ambient light sensor 180L is used to sense ambient light brightness. Electronic device 100 can adaptively adjust the brightness of display screen 194 based on the perceived ambient light. Ambient light sensor 180L can also be used to automatically adjust white balance when taking photos. Ambient light sensor 180L can also work with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent accidental touches.
[0460] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0461] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to prevent the electronic device 100 from shutting down abnormally due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 boosts the output voltage of the battery 142 to prevent abnormal shutdown due to low temperature.
[0462] The touch sensor 180K is also called a "touch-sensitive device." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, at a location different from that of the display screen 194.
[0463] The bone conduction sensor 180M can obtain vibration signals. In some embodiments, the bone conduction sensor 180M can obtain vibration signals from the vibrating bones of the human body. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure pulse signals. In some embodiments, the bone conduction sensor 180M can also be set in headphones to form bone conduction headphones. The audio module 170 can parse out voice signals based on the vibration signals of the vibrating bones of the human body obtained by the bone conduction sensor 180M to implement voice functions. The application processor can parse heart rate information based on the blood pressure pulse signals obtained by the bone conduction sensor 180M to implement heart rate detection functions.
[0464] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.
[0465] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0466] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level change, messages, missed calls, notifications, etc.
[0467] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 100 by inserting it into or removing it from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0468] In the present application, after the user drags up an information element in the interface, the GPU in the electronic device can perform a three-dimensional transformation on the content according to the content displayed on the display screen 194, creating a visual effect of the original interface being pushed inward on the screen, and displaying recommended application and / or service icons on the side of the screen of the electronic device.
[0469] In addition, in an embodiment of the present application, after the user drags up an information element in the interface, the processor 110 can identify the information element, including identifying the type of the information element and the specific content in the information element, and determine the corresponding application icon and / or application service icon based on the identification result, and generate corresponding program instructions. The program instructions can be used to change the display information of the display screen 194, such as updating the interface in the display screen to a cross-application transmission interface. The icon displayed in the cross-application transmission interface is the application icon and / or application service icon determined by the aforementioned processor 110 based on the identification result.
[0470] In some embodiments, after the user completes the transmission of information using the "cross-application transmission interface", the processor 110 can also obtain the application service to which the user transmits the information, and generate corresponding program instructions based on the obtained results, and combine with the GPU to display the corresponding interface on the screen (for example, the interface can display a snack bar, capsules, small windows, etc.) to feedback the results of the information element transmission to the user.
[0471] Next, we will introduce a method for transmitting information provided by this application. When this method is implemented, the electronic device can display the corresponding application service icon for the user in the interface when the user performs a user operation of long pressing and dragging an information element. The user can place the dragged element on the corresponding icon to transfer the element to the application service corresponding to the icon. This method enables electronic devices to complete information transmission between applications efficiently and quickly, effectively reducing the number of operation steps required for users to complete cross-application information transmission, improving the interaction efficiency between users and electronic devices, and thus improving user experience. As shown in Figure 36, this method may include but is not limited to the following steps:
[0472] S101: The electronic device displays a first interface.
[0473] The electronic device may be the electronic device 100 described above. The first interface includes a first sub-interface and a second sub-interface, the first sub-interface being used to display an application interface of a first application, the second sub-interface being used to display an application interface of a second application, the first sub-interface including first information, and the second sub-interface being used to transmit the first information to the second application under a first operation on the first information.
[0474] The above-mentioned first information is any one of an image, text, audio file, video file, and document file, and can also be other forms of information, which is not limited in this application.
[0475] S102: The electronic device displays a second interface in response to a second operation on the first information.
[0476] The second operation can be used to select the first information. Specifically, the second operation can be an operation of long pressing the first information and then dragging it to the side of the first interface (i.e., the side of the display screen). If the user does not let go, the dragged first information moves in the first interface with the user's fingertips. When the user drags the above-mentioned first information to a distance less than a certain threshold from the right or left edge of the screen, the electronic device can display the above-mentioned second interface. In the above-mentioned second interface, the application services corresponding to the above-mentioned at least one application service icon are all application services that can receive the above-mentioned first information. For example, when the above-mentioned first information is an image, The friend chat service can send the image, The Moments service can be used to share the image. The portrait beautification service can beautify the image, and the search service provided by the electronic device can perform intelligent search on the image, etc. Therefore, the at least one application service icon can include application service icons corresponding to these services.
[0477] In one possible embodiment, the at least one application service icon may include at least one first icon, which is an application service icon recommended based on the first information. Optionally, the second interface further includes an icon area, in which the at least one application service icon is displayed. The at least one application service icon further includes at least one second icon, which is a custom-displayed application service icon, and the at least one first icon is displayed above the at least one second icon.
[0478] That is to say, at least one application service icon in the second interface can be divided into two parts, one of which is a fixedly displayed icon on the right (i.e., the at least one second icon), and the other part of the icon can be an application service icon recommended to the user based on the first information. Optionally, a dividing line can be displayed between the two parts of the icon for distinction. Among them, the at least one second icon is an icon customized by the user based on his or her own usage habits and frequency of use. Regardless of what information the user shares based on the electronic device, the electronic device can include this part of the icons in the icons displayed based on the information to meet the user's needs as much as possible; and the at least one first icon is recommended by the electronic device based on the elements contained in the first information. When the user shares other information through this method, the recommended application service icon can be different from the icon in the at least one first icon. For details, please refer to the aforementioned relevant descriptions of Figures 23 to 26, which will not be repeated here.
[0479] It should be understood that in the daily use of electronic devices, users often drag and drop some elements. These drag operations may not be for the purpose of transferring the dragged elements across applications (for example, dragging text to change the position or paragraph of text in document editing). Therefore, how to combine user operations and user operating habits to guide users to use the transmission method provided in this application, and set the triggering rules of this method for users, is the key to further improving the efficiency of user interaction with electronic devices. Therefore, in one possible embodiment, the first interface further includes a first trigger area and a second trigger area, the first trigger area is larger than the second trigger area, the second operation includes a first sub-operation and a second sub-operation, the first sub-operation is an operation of moving the first information to the first trigger area, and the second sub-operation is an operation of moving the first information to the second trigger area. The second interface is displayed in response to the second operation on the first information in the first interface, including: in response to the first sub-operation, when the first information stays in the first trigger area for a first time period, a light band guide effect is displayed in the first interface, and the light band guide effect is used to indicate that the first information is moved to the second trigger area; in response to the second sub-operation, the second interface is displayed.
[0480] In this embodiment, the first interface may include the first trigger area and the second trigger area. Optionally, the specific size and position of the first trigger area and the second trigger area may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of the two areas in the first interface. The size and position of the two areas may be stored in the electronic device only in a form perceptible to the electronic device (such as program code). When the user drags the first information into the first trigger area, the electronic device may display a special effect in the first interface (such as the edge of the first interface) to prompt the user to drag the image further in the direction closer to the second trigger area; the special effect may be a user-visible special effect such as a luminous effect or a shadow effect, or other user-perceptible special effect, which is not limited in this application; optionally, the electronic device may display the special effect in the first interface only after the user drags the first information into the first trigger area and keeps the first information in the first trigger area for a period of time T. Specifically, the T may be set to 600 milliseconds. When the user continues to drag the first information to the second trigger area, the electronic device can immediately respond to the operation and display the second interface.
[0481] In an optional embodiment, the second interface further includes a door closing trigger area. When the user drags the first information into the third trigger area, the electronic device may no longer display the second interface and redisplay the first interface. If the user does not release the first information, the first information remains in the state of being dragged by the user when the first interface is redisplayed, allowing the user to reselect a method for transferring the information across applications. For details, please refer to the aforementioned descriptions of Figures 9 to 15, which will not be repeated here.
[0482] S103: In response to the third operation on the first information, the electronic device transmits the first information to the application service corresponding to the target icon.
[0483] Optionally, the third operation is an operation of associating the first information with the target icon. For example, the third operation is an operation of moving the first information to the target icon.
[0484] In the second interface, the user associates the first information with the target icon through the third operation, and the electronic device can transmit the first information to the application service corresponding to the target icon in response to the third operation. Specifically, the third operation can be an operation of dragging the first information close to the target icon, or an operation of dragging the first information onto the target icon and releasing it, or other operations of associating the first information with the target icon, as long as the third operation can select the target icon required by the user from the at least one application service icon and associate the first information with the target icon.
[0485] It can be understood that the information transmission process provided by this application is continuous from the time the user drags up the above-mentioned first information to the time the above-mentioned first information is placed into the application service corresponding to the above-mentioned target icon. The "continuous" here means that the user does not need to perform operations such as copying and pasting, nor does he need to perform application switching operations. The user's fingers do not need to leave the screen of the electronic device during the entire operation process. The operation is simple and fast, which can effectively improve the user's efficiency in transmitting information across applications and enhance the user experience.
[0486] Optionally, the second interface may also display a sub-interface. The element content displayed in the sub-interface is the same as the element content displayed in the first interface (except the status bar). In fact, the sub-interface displayed in the second interface may be considered as the interface obtained by the electronic device after performing a three-dimensional transformation of all the element content of the first interface (except the status bar). In the second interface, the sub-interface may create a visual effect on the screen that the original interface (i.e., the first interface) is pushed inward. It is understandable that this "door-opening" visual effect metaphorically represents the behavior of transmitting elements (i.e., the first information), which is more intuitive than copying and pasting, and this information transmission method ensures the effective browsing area of the user interface, and can transmit the first information to other application services while viewing the historical application interface (i.e., the first interface) through the sub-interface, which can further enhance the user experience. Optionally, in the second interface, the background behind the sub-interface may be set to the desktop background of the electronic device (i.e., the desktop wallpaper) with a blurred effect superimposed on it, to provide users with better visual effects.
[0487] It is understood that the electronic device can recommend multiple application services that can receive the first information to the user based on the first information, and display the icons of these application services on the right side of the second interface. Specifically, the upper limit of the number of these application service icons can be 20. In one possible embodiment, the at least one application icon includes at least one icon displayed in the icon area and at least one icon not displayed in the icon area, the target icon is not displayed in the icon area, and the second interface also includes a third trigger area. The electronic device can update the at least one icon displayed in the icon area in response to the seventh operation on the first information until the target icon is displayed in the icon area, and the seventh operation is an operation to move the first information to the third trigger area. That is, when the number of these application service icons exceeds a certain threshold (for example, 7), in order to ensure the neatness and visibility of the interface, the electronic device can only display a portion of these application service icons (for example, 7) in the second interface at the same time; when none of the icons currently displayed on the second interface are the application services desired by the user, the user can also place the first information in the third trigger area to cause the electronic device to update the icons in the icon area. Specifically, the third trigger area may be set directly above and / or directly below the icon area. For details, please refer to the aforementioned description of FIG. 22 .
[0488] In order to guide the user to accurately place the above-mentioned first information into the application service they need, in the process of dragging the above-mentioned first information to the above-mentioned target icon, when the above-mentioned first information is close to the above-mentioned target icon (here it is assumed that the above-mentioned target icon has always been the icon closest to the above-mentioned first information among the at least one application icon during the entire dragging process), the above-mentioned target icon can be enlarged, and the above-mentioned target icon can be moved in the above-mentioned second interface so that the above-mentioned target icon is closer to the above-mentioned first information, creating a visual effect in the above-mentioned second interface that the above-mentioned target icon is adsorbed by the above-mentioned first information (that is, the moving direction of the above-mentioned first information is opposite to the moving direction of the above-mentioned target icon, and both are approaching each other) to prompt the user that the above-mentioned first information has been associated with the above-mentioned target icon. If you let go here, the above-mentioned first information will be transmitted to the application service corresponding to the above-mentioned target icon. Optionally, the electronic device will only enlarge the above-mentioned target icon in the above-mentioned second interface and / or move the position of the above-mentioned target icon in the above-mentioned first interface when the distance between the above-mentioned first information and the above-mentioned target icon is less than a first threshold.
[0489] After transmitting the above-mentioned first information to the application service corresponding to the above-mentioned target icon, the electronic device can also display a third interface. The above-mentioned third interface can be set to different interface effects according to the type of application service entered by the above-mentioned first information and the result of the information transmission. For example, the above-mentioned third interface can display one or more of a floating window, a capsule (minimized floating window), a snack bar, toast feedback, and the application service interface (full screen display) corresponding to the above-mentioned target icon to prompt the user to know the transmission result of the above-mentioned first information and facilitate the user to proceed to the next step. For details, please refer to the aforementioned relevant descriptions of Figures 16 to 21, which will not be repeated here.
[0490] An embodiment of the present application also provides an electronic device, which includes: one or more processors and a memory; wherein the memory is coupled to the one or more processors, and the memory is used to store computer program code, and the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method shown in the aforementioned embodiment.
[0491] As used in the above embodiments, the term “when…” may be interpreted to mean “if…” or “after…” or “in response to determining…” or “in response to detecting…”, depending on the context. Similarly, the phrases “upon determining…” or “if (stated condition or event) is detected” may be interpreted to mean “if determining…” or “in response to determining…” or “upon detecting (stated condition or event)” or “in response to detecting (stated condition or event)”, depending on the context.
[0492] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk).
[0493] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
Claims
1. An information transmission method, characterized in that: The method comprises: Displaying a first interface, the first interface including a first sub-interface and a second sub-interface, the first sub-interface being used to display an application interface of a first application, the second sub-interface being used to display an application interface of a second application, the first sub-interface including first information, and the second sub-interface being used to transmit the first information to the second application under a first operation on the first information; In response to a second operation on the first information, displaying a second interface; the second interface includes the first information and at least one application service icon; In response to a third operation on the first information, the first information is transmitted to an application service corresponding to a target icon, where the target icon is any one of the at least one application service icon.
2. The method according to claim 1, characterized in that In the first interface, The first sub-interface and the second sub-interface are displayed in a top-bottom split screen or a left-right split screen; Alternatively, the first sub-interface and the second sub-interface are displayed in a picture-in-picture format.
3. The method according to claim 1 or 2, characterized in that: The third operation is an operation of associating the first information with the target icon.
4. The method according to any one of claims 1 to 3, characterized in that: The third operation is an operation of moving the first information to the target icon.
5. The method according to claim 3 or 4, characterized in that: In the process of moving the first information to the target icon, the target icon is enlarged and / or the position of the target icon in the first interface is moved, and the direction of moving the target icon is opposite to the direction of moving the first information.
6. The method according to any one of claims 1 to 5, characterized in that: The at least one application service icon includes at least one first icon, and the at least one first icon is an application service icon recommended based on the first information.
7. The method according to any one of claims 1 to 6, characterized in that: The target icon includes a corresponding text description, and the text description is used to prompt the application or application service function corresponding to the target icon.
8. The method according to any one of claims 1 to 7, characterized in that: After transmitting the first information to the application service corresponding to the target icon, the method further includes: A third interface is displayed, wherein the third interface includes all the contents of the first interface, and the third interface also includes any one of a floating window and an information feedback bar, wherein the floating window is used to display the target icon or an application service interface corresponding to the target icon, and the information feedback bar is used to prompt the electronic device for the transmission result of the first information.
9. The method according to claim 8, characterized in that The third interface includes a floating window, the floating window is used to display the target icon, the third interface also includes second information, and after displaying the third interface, the method further includes: In response to a fourth operation on the second information, the second information is transmitted to the application service corresponding to the target icon, and the fourth operation is an operation of associating the second information with the floating window.
10. The method according to claim 8, characterized in that The third interface includes a floating window, the floating window is used to display the application service interface corresponding to the target icon, the floating window includes an expansion control, and after displaying the third interface, the method further includes: In response to a fifth operation on the expansion control, the application service interface displayed in the floating window is displayed in full screen.
11. The method according to claim 8, characterized in that The third interface includes an information feedback bar, the information feedback bar includes a jump control, and after displaying the third interface, the method further includes: In response to a sixth operation on the jump control, a fourth interface is displayed, where the fourth interface is an application service interface corresponding to the target icon.
12. The method according to any one of claims 1 to 11, characterized in that: The first interface further includes a first trigger area and a second trigger area, the first trigger area is larger than the second trigger area, the second operation includes a first sub-operation and a second sub-operation, the first sub-operation is an operation of moving the first information to the first trigger area, and the second sub-operation is an operation of moving the first information to the second trigger area, and the displaying of the second interface in response to the second operation on the first information in the first interface includes: In response to the first sub-operation, when the first information stays in the first trigger area for a first time period, a light guide effect is displayed in the first interface, where the light guide effect is used to indicate that the first information is moved to the second trigger area; In response to the second sub-operation, the second interface is displayed.
13. The method according to claim 12, characterized in that When the first sub-interface and the second sub-interface are displayed in a split-screen manner, the first trigger area exists in both the first interface and the second sub-interface, and the second trigger area exists in both the first interface and the second sub-interface.
14. The method according to any one of claims 6 to 13, characterized in that: The second interface also includes an icon area, and the at least one application service icon is displayed in the icon area. The at least one application service icon also includes at least one second icon, and the at least one second icon is a custom displayed application service icon. The at least one first icon is displayed above the at least one second icon.
15. The method according to claim 14, characterized in that The at least one application service icon includes at least one icon displayed in the icon area and at least one icon not displayed in the icon area, the target icon is not displayed in the icon area, the second interface further includes a third trigger area, and before responding to the second operation on the first information, the method further includes: In response to a seventh operation on the first information, the at least one icon displayed in the icon area is updated until the target icon is displayed in the icon area, and the seventh operation is an operation of moving the first information to the third trigger area.
16. The method according to any one of claims 1 to 15, characterized in that: An area of the first information in the second interface is smaller than an area of the first information in the first interface.
17. A method for information transmission, characterized in that: include: In response to any one of a global screenshot operation, a partial screenshot operation, and a long screenshot operation on the fifth interface, displaying a sixth interface, wherein the sixth interface includes a first image obtained by taking a screenshot of the fifth interface; In response to an eighth operation on the first image in the six interfaces, displaying a seventh interface; the seventh interface includes the first image and at least one application service icon; In response to a ninth operation on the first image in the seventh interface, the first image is transmitted to an application service corresponding to a target icon, where the target icon is any one of the at least one application service icon.
18. The method according to claim 17, characterized in that The first image is an image obtained by performing a global screenshot operation on the fifth interface, and in response to an eighth operation on the first image in the six interfaces, displaying the seventh interface includes: In response to a click operation on the first image in the sixth interface, an editing interface is displayed, the editing interface including the first image and editing options, the editing options being used to edit the first image; In response to the editing operation of the first image through the editing option, after the image content of the first image in the editing interface is updated, in response to the moving operation of the first image in the editing interface, the seventh interface is displayed, and the eighth operation includes the click operation, the editing operation and the moving operation.
19. A method for information transmission, characterized in that: include: In response to a partial screenshot operation on the eighth interface, a ninth interface is displayed, wherein the ninth interface includes a second image obtained by performing a partial screenshot operation on the eighth interface and a text recognition control, wherein the text recognition control is used to recognize text contained in the second image; In response to a click operation on the text recognition control, a tenth interface is displayed, wherein the tenth interface includes first text information obtained by recognizing the second image; In response to the tenth operation on the first text information in the tenth interface, displaying an eleventh interface; the eleventh interface includes the first text information and at least one application service icon; In response to an eleventh operation on the first text information in the eleventh interface, the first text information is transmitted to an application service corresponding to a target icon, where the target icon is any one of the at least one application service icon.
20. An electronic device, characterized in that: The electronic device comprises: one or more processors, a memory and a display screen; The memory is coupled to the one or more processors, and the memory is used to store computer program codes, wherein the computer program codes include computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method according to any one of claims 1 to 19.
21. A chip system, characterized in that: The chip system is applied to an electronic device, and the chip system includes one or more processors, and the processor is used to call computer instructions so that the electronic device executes the method as described in any one of claims 1-19.
22. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device is caused to execute the method as claimed in any one of claims 1 to 19.
Citation Information
Patent Citations
Information sharing method and device, electronic equipment and computer readable medium
CN114840128A
Data processing method, intelligent terminal and storage medium
CN116185239A
Device, Method, and Graphical User Interface for Editing Screenshot Images
US20190147026A1
Method for combining multiple applications and for simultaneously starting multiple applications, and electronic device
WO2023051111A1
