Information transmission method and electronic equipment
By displaying the cross-application transmission interface on the smart device, users can directly drag and drop information on the application service icon to let go, solving the complexity of information transmission across applications and improving interaction efficiency and user experience.
Patent Information
- Application Number
- CN202310725366.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-16
- Publication Date
- 2024-12-17
AI Technical Summary
In the prior art, users need complex and tedious operations when transmitting information across applications on smart devices, resulting in low interaction efficiency and affecting user experience.
By displaying the cross-application transmission interface on the electronic device, users can directly drag and drop information elements to the application service icon displayed on the side to let go, realizing the rapid transmission of information to the target application service, reducing operational steps and improving interaction efficiency.
It simplifies the information transmission process across applications, improves the interaction efficiency between users and devices, improves the user experience, and realizes the rapid and convenient transmission of information.
Smart Images

Figure CN119148893A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to an information transmission method and an electronic device. Background Art
[0002] With the continuous development of electronic information technology, smart devices such as mobile phones and tablets have become indispensable products in our daily life, work and entertainment. When users use smart devices, they usually open multiple applications in the smart devices at the same time to work together. Users also often use smart devices to transmit information across applications, that is, to share and upload information in one application through another application.
[0003] However, when users need to transfer information across applications, they usually need to perform complex and cumbersome operations to complete the information transfer. For example, when a user needs to forward text or images on a web page in a browser to a WeChat friend, they usually need to copy or save the text, image and other information in the browser first, and then switch to WeChat before they can share or upload the information through WeChat. This information transmission method makes the interaction between users and smart devices inefficient and seriously affects the user experience.
[0004] Therefore, it is necessary to study more efficient and convenient information transmission methods. Summary of the invention
[0005] The purpose of the present application is to provide an information transmission method and an electronic device. By implementing the method, the electronic device can directly respond to the user's operation on the information and display multiple application service icons in the interface, so that the user can put the information into the target application service, so that the electronic device can efficiently and quickly complete the information transmission between applications, effectively reduce the operation steps required for the user to complete the cross-application information transmission, improve the interaction efficiency between the user and the electronic device, and thus improve the user experience.
[0006] The above-mentioned and other objects are achieved by the features of the independent claims. Further implementations are reflected in the dependent claims, the description and the drawings.
[0007] In a first aspect, the present application provides an information transmission method, the method comprising: displaying a first interface, the first interface comprising a first sub-interface and a second sub-interface, the first sub-interface being used to display an application interface of a first application, the second sub-interface being used to display an application interface of a second application, the first sub-interface comprising first information, and the second sub-interface being used to transmit the first information to the second application under a first operation on the first information; displaying a second interface in response to a second operation on the first information; the second interface comprising the first information and at least one application service icon; and transmitting the first information to an application service corresponding to a target icon in response to a third operation on the first information, the target icon being any one of the at least one application service icons.
[0008] In this method, the first interface may be a smart multi-window interface displayed by an electronic device, that is, there are multiple windows in the first interface, each of which corresponds to a sub-interface, and the applications corresponding to the application interfaces displayed by each sub-interface may be different. The first sub-interface and the second sub-interface are two sub-interfaces among the multiple sub-interfaces corresponding to the multiple windows. Optionally, the number of the multiple windows may be 2, and the sub-interfaces corresponding to the two windows are the first sub-interface and the second sub-interface.
[0009] In the first interface, the information element displayed in any of the sub-interfaces corresponding to the multiple windows can be moved to another sub-interface under the drag of the user to complete the cross-application transmission of information. For example, when the user drags the first information in the first sub-interface to the second sub-interface, the information element can be transferred from the application corresponding to the first sub-interface to the application corresponding to the second sub-interface.
[0010] However, due to the limitation of the display area of the electronic device, the number of windows (sub-interfaces) in the first interface is limited, the number of application interfaces that can be displayed is limited, and the user needs to open these applications in advance through corresponding user operations, and the application interfaces of these applications need to be displayed in split screens. When the user wants to share the element dragged in the first interface to an application that is not opened (i.e., the application interface cannot be displayed in the first interface), the sub-interface displayed in the first interface cannot meet his needs.
[0011] Therefore, in this method, the second operation can be used to make the electronic device display the "cross-application transmission interface" provided in this application, that is, the second interface is used to share the information element of the first interface to an unopened application (that is, the application interface cannot be displayed in the first interface). In the "cross-application transmission interface", the side of the interface can display the service icon of the application recommended by the electronic device for the information element; then, the user places the dragged information element on the icon and releases it, and the information element can be transferred to the application service corresponding to the icon and the corresponding application service function is started.
[0012] The second operation can be used to select the first information. Specifically, the second operation can be an operation of long pressing the first information and then dragging it to the side of the first interface (i.e., the side of the display screen). If the user does not let go, the dragged first information moves in the first interface along with the user's fingertips. When the user drags the first information to a distance less than a certain threshold from the right or left side of the screen, the electronic device can display the second interface. In the second interface, the application services corresponding to the at least one application service icon are all application services that can receive the above-mentioned first information. For example, when the above-mentioned first information is an image, The image can be sent to the friend chat service. The Moments service can be used to share the image. The beautification service provided by the electronic device can beautify the image, and the search service provided by the electronic device can perform intelligent search on the image, etc. Therefore, the at least one application service icon can include application service icons corresponding to these services.
[0013] Optionally, the at least one application service icon may include multiple application service icons corresponding to one application at the same time. It should be noted that the at least one application service icon is an application service icon rather than an application icon, and the at least one application service icon may not be displayed in the first interface. When the user drags the dragged information (such as the first information) to an icon among the at least one application service icon, the information may be directly received by the application service corresponding to the icon.
[0014] In the second interface, the user needs to associate the first information with the target icon through the third operation, and the electronic device can transmit the first information to the application service corresponding to the target icon in response to the third operation. Specifically, the third operation can be an operation of dragging the first information close to the target icon, or an operation of dragging the first information onto the target icon and releasing it, or other operations of associating the first information with the target icon, as long as the third operation can select the target icon required by the user from the at least one application service icon and associate the first information with the target icon.
[0015] It can be understood that the information transmission process provided by the present application is continuous from the time the user drags up the first information to the time the first information is placed into the application service corresponding to the target icon. The "continuous" mentioned here means that the user does not need to perform operations such as copying and pasting, nor does he need to switch applications. The user's fingers do not need to leave the screen of the electronic device during the entire operation process. The operation is simple and fast, which can effectively improve the user's efficiency in transmitting information across applications and improve the user experience.
[0016] Optionally, the second interface may also display a third sub-interface. The element content displayed in the third sub-interface is the same as the element content displayed in the first interface (except the status bar). In fact, the third sub-interface displayed in the second interface can be considered as the interface obtained by the electronic device after three-dimensional transformation of all the element content of the first interface (except the status bar). In the second interface, the sub-interface can create a visual effect of the original interface (i.e., the first interface) being pushed inward on the screen. It is understandable that this "opening door" visual effect metaphorically transmits the behavior of the element (i.e., the first information), which is more intuitive than copying and pasting, and this information transmission method ensures the effective browsing area of the user interface, and can transmit the first information to other application services while viewing the historical application interface (i.e., the first interface) through the sub-interface, which can further enhance the user experience. Optionally, in the second interface, the background behind the sub-interface can be set to the desktop background (i.e., desktop wallpaper) of the electronic device, and the resulting picture after the blur effect is superimposed, so as to provide users with better visual effects.
[0017] In combination with the first aspect, in a possible implementation, the first sub-interface and the second sub-interface are displayed in a top-bottom split screen or a left-right split screen; or, the first sub-interface and the second sub-interface are displayed in a picture-in-picture format.
[0018] In this embodiment, when the first sub-interface and the second sub-interface are displayed in a vertical split screen or a left-right split screen, the present application does not limit the relative positions of the first sub-interface and the second sub-interface in the first sub-interface. For example, the first sub-interface can be displayed above the second sub-interface, or below the second sub-interface.
[0019] When the first sub-interface and the second sub-interface are displayed in the form of picture-in-picture, the first sub-interface is a full-screen interface, and the second sub-interface can be an interface displayed in a floating window (small window); the first sub-interface can also be an interface displayed in a floating window (small window), and the second sub-interface can be an interface displayed in a full-screen interface, and this application does not limit this. Correspondingly, when information is transmitted between two applications corresponding to the first sub-interface and the second sub-interface, the user can drag the information elements in the interface displayed in the floating window (small window) to the full-screen interface, or drag the information elements in the interface displayed in the full-screen interface to the interface displayed in the floating window (small window). When using the "cross-application transmission interface" provided by this application to share the information elements in the first interface with other applications that do not display application interfaces in the first interface, the user can also drag the information elements in the interface displayed in the floating window (small window) or the information elements in the interface displayed in the full-screen to the side of the screen, so that the electronic device displays the "cross-application transmission interface", that is, the second interface.
[0020] In combination with the first aspect, in a possible implementation manner, the second operation is an operation of associating the first information with the target icon.
[0021] In combination with the first aspect, in a possible implementation manner, the second operation is an operation of moving the first information to the target icon.
[0022] Specifically, in this embodiment, moving the first information to the target icon may be moving the first information around the target icon so that the target icon is the icon closest to the first information among the at least one application service icon; or, moving the first information to the target icon may be moving the first information above the target icon. It should be understood that "above" here means that the first information overlaps with the target icon, and the first information is displayed over the target icon.
[0023] Optionally, the second operation may also include leaving the first information on (or around) the target icon for a period of time (for example, 120ms), or dragging the first information onto (or around) the target icon and then directly releasing it, so as to trigger the transmission of the first information to the application service corresponding to the target icon.
[0024] In combination with the first aspect, in a possible implementation, in the process of moving the first information to the target icon, the target icon is enlarged and / or the position of the target icon in the first interface is moved, and the direction of moving the target icon is opposite to the direction of moving the first information.
[0025] In this embodiment, in order to guide the user to accurately place the first information into the application service they need, in the process of dragging the first information to the target icon, when the first information is close to the target icon (it is assumed here that the target icon is always the icon closest to the first information among the at least one application service icon during the entire dragging process), the target icon can be enlarged, and the target icon can be moved in the second interface to make the target icon closer to the first information, creating a visual effect in the second interface that the target icon is absorbed by the first information (that is, the moving direction of the first information is opposite to the moving direction of the target icon, and both are approaching each other), so as to prompt the user that the first information has been associated with the target icon. If the user lets go here, the first information will be transmitted to the application service corresponding to the target icon.
[0026] Optionally, the electronic device will enlarge the target icon in the second interface and / or move the position of the target icon in the first interface only when the distance between the first information and the target icon is less than a first threshold.
[0027] In combination with the first aspect, in a possible implementation, the at least one application service icon includes at least one first icon, and the at least one first icon is an application service icon recommended based on the first information.
[0028] In this embodiment, the electronic device can recommend icons to the user based on the content contained in the first information. Specifically, for the icons recommended by the electronic device to the user, the electronic device can first identify the first information that is dragged up (the electronic device has not yet displayed the second user interface), and obtain the application service icon that meets the user's needs in the second interface based on the identification result. The identification result may include the type of the first information and the element content contained in the first information. For example, assuming that the first information is a picture containing a QR code image, the electronic device can identify the QR code image in the first information, and display the application service icon that can scan the QR code for the user in the second interface, such as WeChat-Scan, Alipay-Scan, etc.; assuming that the first information is a picture containing a face image, the user can identify the face image in the first information, and display the application service icon that can beautify the image or can be used to share the image in the second interface, such as Meitu-Portrait Beautification, WeChat-Friends Circle, etc. For another example, assuming that the first information is text containing location information, the electronic device can recognize the location information in the text and display application service icons for the user in the second interface that can navigate to the location information or take a taxi, such as Amap-Navigation, Amap-One-click Taxi, etc.; assuming that the above-mentioned first information is text containing time and location information, the electronic device recommends schedule-related application service icons to the user, such as Schedule-Add Schedule, etc.
[0029] That is to say, when the user drags up two information elements successively, even if the two information elements are of the same type (for example, both are text or both are images), if the contents contained in the two information elements are different (for example, the image contents are different or the characters in the text are different), then the at least one application service icon displayed on the electronic device based on the two elements may also be different; it should be understood that the "different" mentioned here may include different icon types and different icon orders. Optionally, the icon of the application service recommended to the user (that is, the at least one first icon) is displayed in the icon area; among the at least one first icon, the icon corresponding to the application service that is more in line with the current user's intention will be located at the top of the icon area, and the current user's intention can be determined according to the content of the elements contained in the dragged information. For example, when the information is an image and contains a QR code image, the icons corresponding to application services such as WeChat-Scan, Alipay-Scan, etc. can be displayed at the top of the at least one application service icon; when the information is text and contains location information, the icons corresponding to application services such as AutoNavi Map-Navigation, AutoNavi Map-One-Click Taxi, etc. can be displayed at the top of the at least one application service icon.
[0030] In combination with the first aspect, in a possible implementation, after transmitting the first information to the application service corresponding to the target icon, the method also includes: displaying a third interface, the third interface including all the contents of the first interface, and the third interface also includes any one of a floating window and an information feedback bar, the floating window is used to display the target icon or the application service interface corresponding to the target icon, and the information feedback bar is used to prompt the electronic device of the transmission result of the first information.
[0031] In this embodiment, after the information is transmitted across applications through the second interface, the electronic device can also provide the user with different prompt methods and display different interface effects according to the type of application service entered by the information and the result of the information transmission, so as to prompt the user to know the transmission result of the first information and proceed to the next step.
[0032] In combination with the first aspect, in a possible implementation, the third interface includes a floating window, which is used to display the target icon. The third interface also includes second information. After displaying the third interface, the method also includes: in response to a fourth operation on the second information, transmitting the second information to an application service corresponding to the target icon, and the fourth operation is an operation of associating the second information with the floating window.
[0033] In this embodiment, it is understandable that, except for the floating window, the content of the third interface is the same as that of the first interface. The floating window is a minimized floating window, which may not display the application interface but only the target icon, and the floating window may be displayed close to the right or left edge of the third interface to reduce the obstruction of the third interface, so that the user can continue to transmit the information in the third interface (such as the second information) to the application service corresponding to the target icon.
[0034] Optionally, in this embodiment, the floating window can be expanded in response to a user's click operation. After being expanded, the floating window can be displayed in the third interface (at this time, the floating window can no longer be displayed edge to edge, but it is still not displayed in full screen), and it can display an expansion control, which can display the application interface in the floating window in full screen on the screen in response to user operation.
[0035] In combination with the first aspect, in a possible implementation, the third interface includes a floating window, which is used to display the application service interface corresponding to the target icon, and the floating window includes an expansion control. After displaying the third interface, the method also includes: in response to a fifth operation on the expansion control, displaying the application service interface displayed in the floating window in full screen.
[0036] When the application service corresponding to the target icon is an application service such as navigation or search that requires displaying a new application service interface, the electronic device needs to immediately display the application service interface corresponding to the target icon to the user. Therefore, in this embodiment, the floating window is a floating window that is displayed on top of the third interface. The third interface can still display the content in the first interface, and the floating window can display the application service interface corresponding to the target icon.
[0037] In combination with the first aspect, in a possible implementation, the third interface includes an information feedback bar, the information feedback bar includes a jump control, and after displaying the third interface, the method also includes: in response to a sixth operation on the jump control, displaying a fourth interface, the fourth interface being an application service interface corresponding to the target icon.
[0038] When the target icon corresponds to an application service such as global favorites, after such application service receives the above-mentioned first information, the user may not need to understand and browse the interface of the application service, but only needs to know whether the electronic device has successfully received the first information. Therefore, in this embodiment, after the first information is transmitted to the application service corresponding to the target icon, the electronic device does not need to directly jump to its corresponding application interface, but only needs to inform the user of the result of the information transmission. Therefore, the information feedback bar can be displayed in the third interface to prompt the user of the result of the first information transmission. The information feedback bar is a jump bar, which can include the jump control, so that the user can quickly enter the application service interface corresponding to the target icon by clicking the jump control to view the processing result of the application service corresponding to the target icon on the first information.
[0039] In combination with the first aspect, in a possible embodiment, the first interface also includes a first trigger area and a second trigger area, the first trigger area is larger than the second trigger area, the second operation includes a first sub-operation and a second sub-operation, the first sub-operation is an operation of moving the first information to the first trigger area, and the second sub-operation is an operation of moving the first information to the second trigger area, and the second interface is displayed in response to the second operation on the first information in the first interface, including: in response to the first sub-operation, when the first information stays in the first trigger area for a first time length, displaying a light band guide effect in the first interface, the light band guide effect is used to indicate that the first information is moved to the second trigger area; in response to the second sub-operation, displaying the second interface.
[0040] Since dragging information between different sub-interfaces in the first interface can also complete cross-application transmission of information, and in the daily use of electronic devices, users often drag some elements, these dragging operations may not be for the purpose of transferring the dragged elements across applications (for example, dragging text to change the position or paragraph of text in document editing), therefore, how to combine user operations and user operating habits to guide users to use the transmission method provided in this application, and set the trigger rules of the "cross-application transmission interface" in this method for users, is the key to further improving the efficiency of user interaction with electronic devices.
[0041] Therefore, in this embodiment, the first interface may include the first trigger area and the second trigger area. Optionally, the specific size and position of the first trigger area and the second trigger area may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of the two areas in the first interface, and the size and position of the two areas may be stored in the electronic device only in a form perceptible to the electronic device (such as program code). When the user drags the first information to the first trigger area, the electronic device may display special effects in the first interface (such as the edge of the first interface) to prompt the user to further drag the image closer to the second trigger area; the special effect may be a user-visible special effect such as a luminous special effect, a shadow special effect, or other user-perceptible special effects, which is not limited in this application; optionally, the electronic device may also display special effects in the first interface only after the user drags the first information to the first trigger area and keeps the first information in the first trigger area for a period of time T. Specifically, T may be set to 600 milliseconds.
[0042] When the user continues to drag the first information to the second trigger area, the electronic device can immediately respond to the operation and display the second interface.
[0043] In an optional implementation, the second interface also includes a door closing trigger area. When the user drags the first information to the door closing trigger area, the electronic device may no longer display the second interface, but redisplay the first interface, and if the user does not let go, when the first interface is redisplayed, the first information in the first interface is still in the state of being dragged by the user, so that the user can reselect the method of transmitting the information across applications.
[0044] In combination with the first aspect, in a possible implementation, when the first sub-interface and the second sub-interface are displayed in a split-screen manner, the first trigger area exists in both the first interface and the second sub-interface, and the second trigger area exists in both the first interface and the second sub-interface.
[0045] In this embodiment, no matter which sub-interface the element dragged by the user belongs to, when the first trigger area exists in both the first interface and the second sub-interface, and the second trigger area exists in both the first interface and the second sub-interface, the electronic device can respond to the user operation in a timely manner to guide the opening of the "cross-application transmission interface".
[0046] In combination with the first aspect, in a possible implementation, the second interface also includes an icon area, the at least one application service icon is displayed in the icon area, the at least one application service icon also includes at least one second icon, the at least one second icon is a custom displayed application service icon, and the at least one first icon is displayed above the at least one second icon.
[0047] In this embodiment, the at least one application service icon is displayed in the icon area, and the at least one application service icon in the second interface can be divided into two parts, one of which is a fixedly displayed icon (i.e., the at least one second icon), and the other part of the icon can be an application service icon recommended to the user based on the first information. Optionally, a dividing line for distinguishing between the two parts of icons can be displayed. Among them, the at least one second icon is an icon that the user customizes to display according to his own usage habits and frequency of use. No matter what information the user shares based on the electronic device, the electronic device can include this part of icons in the icons displayed based on the information to meet the needs of the user as much as possible; and the at least one first icon is recommended by the electronic device based on the elements contained in the first information. When the user shares other information through this method, the recommended application service icon can be different from the icon in the at least one first icon.
[0048] In combination with the first aspect, in one possible implementation, the at least one application service icon includes at least one icon displayed in the icon area and at least one icon not displayed in the icon area, the target icon is not displayed in the icon area, the second interface also includes a third trigger area, and before responding to the second operation on the first information, the method also includes: in response to a seventh operation on the first information, updating the at least one icon displayed in the icon area until the target icon is displayed in the icon area, and the seventh operation is an operation to move the first information to the third trigger area.
[0049] The electronic device can recommend multiple application services that can receive the first information to the user based on the first information, and display the icons of these application services on the right side of the second interface. Specifically, the upper limit of the number of these application service icons can be 20. In this embodiment, when the number of these application service icons exceeds a certain threshold (for example, 7), in order to ensure the neatness and visibility of the interface, the electronic device can only display a part of these application service icons (for example, 7) in the second interface at the same time when displaying; when none of the icons currently displayed on the second interface are the application services expected by the user, the user can also place the first information in the third trigger area to enable the electronic device to update the icons in the icon area. Specifically, the third trigger area can be set directly above and / or directly below the icon area.
[0050] In combination with the first aspect, in a possible implementation manner, an area of the first information in the second interface is smaller than an area of the first information in the first interface.
[0051] It is understandable that, in the method provided by the present application, the first information in the second interface contains the same content as the first information in the first interface. However, in order to reduce the large-area occlusion of the at least one application service icon by the first information in the second interface, in this embodiment, after entering the second interface, the area of the first information can be reduced to facilitate the user to select the application service icon.
[0052] In combination with the first aspect, in a possible implementation manner, the first information is any one of an image, text, an audio file, a video file, and a document file.
[0053] In second aspect, the present application provides a method for information transmission, including: in response to any one of a global screenshot operation, a local screenshot operation, and a long screenshot operation on a fifth interface, displaying a sixth interface, the sixth interface including a first image obtained by screenshotting the fifth interface; in response to an eighth operation on the first image in the sixth interface, displaying a seventh interface; the seventh interface including the first image and at least one application service icon; in response to a ninth operation on the first image in the seventh interface, transmitting the first image to the application service corresponding to the target icon, the target icon being any one of the at least one application service icon.
[0054] At present, most smart devices provide users with a quick screenshot function. For example, in some scenarios, users can double-click the screen or slide down with three fingers to take a full-screen screenshot of the current interface of the electronic device; in some embodiments, the electronic device can also temporarily display the image captured by the user through the full-screen screenshot operation in the form of a thumbnail in the interface. Therefore, in this embodiment, after the user captures an image through the full-screen screenshot operation, the image is displayed in the first interface in the form of a thumbnail, and the user can use the quick screenshot function and the transmission method provided by this application to more quickly transmit the captured image to the application service corresponding to the target icon.
[0055] In combination with the second aspect, in a possible implementation, the first image is an image obtained by performing a global screenshot operation on the fifth interface, and the display of the seventh interface in response to the eighth operation on the first image in the six interfaces includes: in response to a click operation on the first image in the sixth interface, an editing interface is displayed, the editing interface includes the first image and editing options, and the editing options are used to edit the first image; in response to the editing operation on the first image through the editing option, after the image content of the first image in the editing interface is updated, in response to the move operation on the first image in the editing interface, the seventh interface is displayed, and the eighth operation includes the click operation, the editing operation and the move operation.
[0056] It is understandable that after using the quick screenshot function to capture an image, the user may also need to edit the obtained image, such as further capturing the captured image to change its image area, or marking important content in the image with a brush, and then sharing or uploading the edited image to other applications. Therefore, in this embodiment, after the electronic device briefly displays the image captured by the user through the full-screen screenshot operation in the form of a thumbnail (i.e., the first image) in the sixth interface, the user can enter the image editing interface through the click operation; in the editing interface, the user can edit the first image accordingly, and after the editing operation is completed, the electronic device still displays the editing interface, and the user can directly use the move operation in the editing interface to make the electronic device display the second interface, and transmit the edited image (i.e., the first information) to the application service corresponding to the target icon through the ninth operation.
[0057] In the third aspect, the present application provides a method for information transmission, including: in response to a partial screenshot operation on an eighth interface, displaying a ninth interface, the ninth interface including a second image obtained by performing a partial screenshot operation on the eighth interface and a text recognition control, the text recognition control being used to recognize the text contained in the second image; in response to a click operation on the text recognition control, displaying a tenth interface, the tenth interface including first text information obtained by recognizing the second image; in response to a tenth operation on the first text information in the tenth interface, displaying an eleventh interface; the eleventh interface including the first text information and at least one application service icon; in response to the eleventh operation on the first text information in the eleventh interface, transmitting the first text information to the application service corresponding to the target icon, the target icon being any one of the at least one application service icon.
[0058] After the user takes a screenshot, some smart devices also provide the user with a recognition function in this scenario, which is used to recognize the image captured by the user (for example, extracting text from the image or translating text, etc.). Therefore, with respect to the screenshot function provided by the electronic device, in this method, the electronic device can quickly obtain the image selected by the user using the knuckle frame through the local screenshot operation, and display the ninth interface. In the ninth interface, the user can recognize the text information contained in the image selected by the local screenshot frame by clicking the text recognition control; thereafter, the user can perform the tenth operation on the first text information obtained by the recognition so that the electronic device displays the "cross-application transmission interface" provided in this application, that is, the tenth interface, and transmit the text information (that is, the first information) to the application service corresponding to the target icon through the eleventh operation.
[0059] Optionally, after using the text recognition control to recognize the text information, the text information contained in the image selected by the local screenshot box can be selected by the first cursor and the last cursor box, and the user can also adjust the position of the first cursor and the last cursor to further filter the text information to obtain the first text information that he needs to transmit.
[0060] In a fourth aspect, the present application provides an electronic device, comprising: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method in the first aspect or any possible implementation of the first aspect, the method in the second aspect or any possible implementation of the second aspect, and the method in the third aspect.
[0061] In a fifth aspect, the present application provides a chip system, which is applied to an electronic device, and the chip system includes one or more processors, and the processors are used to call computer instructions so that the electronic device executes the method in the first aspect or any possible implementation of the first aspect, the method in the second aspect or any possible implementation of the second aspect, and the method in the third aspect.
[0062] In a sixth aspect, the present application provides a computer-readable storage medium comprising instructions. When the instructions are executed on an electronic device, the electronic device executes the method in the first aspect or any possible implementation of the first aspect, the method in the second aspect or any possible implementation of the second aspect, and the method in the third aspect.
[0063] In the seventh aspect, the present application provides a computer program product comprising instructions, which, when the above-mentioned computer program product is run on an electronic device, enables the above-mentioned electronic device to execute the method in the first aspect or any possible implementation of the first aspect, the method in the second aspect or any possible implementation of the second aspect, and the method in the third aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0064] Figure 1 A schematic diagram of a process for transmitting information across applications provided in an embodiment of the present application;
[0065] Figure 2 A schematic diagram of a process for transmitting information across applications provided in an embodiment of the present application;
[0066] Figure 3 A schematic diagram of a process for transmitting an image across applications provided in an embodiment of the present application;
[0067] Figure 4 A schematic diagram of a process for transmitting text across applications provided in an embodiment of the present application;
[0068] Figure 5 A schematic diagram of a process for transmitting information across applications in a horizontal screen state provided in an embodiment of the present application;
[0069] Figure 6 A schematic diagram of a process for transmitting a global screenshot image across applications provided in an embodiment of the present application;
[0070] Figure 7 A schematic diagram of a process for transmitting a partial screenshot image across applications provided in an embodiment of the present application;
[0071] Figure 8 A schematic diagram of a process for transmitting text in a partial screenshot image across applications provided by an embodiment of the present application;
[0072] Fig. 9 A schematic diagram of a process of triggering a "cross-application transmission interface" operation provided in an embodiment of the present application;
[0073] Fig.10 A schematic diagram of a process of closing a "cross-application transmission interface" provided in an embodiment of the present application;
[0074] Fig.11 A schematic diagram of a process of closing a "cross-application transmission interface" provided in an embodiment of the present application;
[0075] Fig.12 Some interface diagrams for cross-application transmission through the split-screen function provided in the embodiments of the present application;
[0076] Fig.13 Interface diagram of cross-application transmission via the “cross-application transmission interface” in some split-screen states provided in the embodiments of the present application;
[0077] Fig.14 Interface diagram for cross-application transmission of some picture-in-picture functions provided in embodiments of the present application;
[0078] Fig.15 Interface diagram of cross-application transmission via the “cross-application transmission interface” in some picture-in-picture states provided in the embodiments of the present application;
[0079] Fig.16 An interface diagram showing a snack bar used for feedback after some information is transmitted across applications provided in an embodiment of the present application;
[0080] Fig.17A schematic diagram of an interface for providing feedback in the form of capsules after some information is transmitted across applications provided in an embodiment of the present application;
[0081] Fig.18 A schematic diagram of a process of performing secondary transmission through a capsule and then unfolding the capsule provided in an embodiment of the present application;
[0082] Fig.19 A schematic diagram of an interface for providing feedback in a floating window after some information is transmitted across applications provided in an embodiment of the present application;
[0083] Fig. 20 A schematic diagram of an interface for providing feedback in a snackbar after some information is transmitted across devices according to an embodiment of the present application;
[0084] Fig.21 A schematic diagram of an interface for providing feedback in the form of toast after some information fails to be transmitted across devices according to an embodiment of the present application;
[0085] Fig. 22 A schematic diagram of a process for updating icons in an icon area provided in an embodiment of the present application;
[0086] Fig.23 Some interface diagrams for displaying application service icons to users based on location information provided in embodiments of the present application;
[0087] Fig.24 Some interface diagrams for displaying application service icons to users based on location and time information provided in the embodiments of the present application;
[0088] Fig.25 Some interface diagrams for displaying application service icons to users based on QR code images provided in the embodiments of the present application;
[0089] Fig.26 Some interface diagrams for displaying application service icons to users based on face images provided in the embodiments of the present application;
[0090] Fig. 27 Some interface diagrams for transmitting information through chat interface thumbnails in the "cross-application transmission interface" provided in the embodiments of the present application;
[0091] Fig.28 Some interface diagrams for transmitting information across applications through sidebar icons provided in embodiments of the present application;
[0092] Fig.29 Interface diagrams of some custom sidebar icons provided in embodiments of the present application;
[0093] Fig.30 A schematic diagram of a process for transmitting a screen recording file across applications provided in an embodiment of the present application;
[0094] Fig.31 A schematic diagram of a process for transmitting an edited screenshot image across applications provided by an embodiment of the present application;
[0095] Fig.32 A schematic diagram of a process for transmitting a long screenshot image across applications provided in an embodiment of the present application;
[0096] Fig.33 Some system setting interface diagrams related to the "smart flow" functions provided in the embodiments of the present application;
[0097] Fig.34 Some system setting interface diagrams related to the "smart flow" functions provided in the embodiments of the present application;
[0098] Fig.35 An architecture diagram of an electronic device provided in an embodiment of the present application;
[0099] Fig.36 A flowchart of an information transmission method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0100] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more listed items.
[0101] To facilitate understanding, the relevant terms involved in the embodiments of the present application are first introduced below.
[0102] (1) Information transmission across applications and devices
[0103] Cross-application information transmission refers to the transmission of information between two applications in the same device, that is, obtaining target information through one application and sharing, collecting or editing the target information through another application. For example, forwarding text or images on a web page in a browser to a WeChat friend, or sending pictures sent by a WeChat friend to a QQ friend, etc.
[0104] Cross-device information transmission refers to the transmission of information between two devices after establishing a communication connection based on Wi-Fi, Bluetooth, cellular networks, etc. For example, users use Bluetooth to transfer pictures between two devices, or share pictures on a mobile phone to a personal computer in the same network environment.
[0105] Specifically, the above information may be pictures, texts, videos, voices, links, documents, etc.
[0106] (2) Cross-application transmission interface
[0107] In the present application, the "cross-application transmission interface" (or cross-application transmission interface) is an interactive method provided by the electronic device based on the user's demand for cross-application and cross-device information transmission. In some embodiments of the present application, this function can also be called "smart flow". As its name suggests, in any interface displayed by the electronic device, when the user needs to transmit the information in the interface across applications or across devices, the user only needs to long press the information element in the interface and drag it to the edge of the screen. The electronic device will transform the original interface displayed on the screen in three dimensions, create a visual effect of the original interface being pushed inward on the screen, and display the electronic device's recommended icon for the element on the side of the screen (for details, please refer to the relevant description of the subsequent embodiments, which will not be repeated here). The recommended icon can be the service icon of the application; after that, the user places the dragged information element on the icon and lets go, and the information element can be transferred to the application service corresponding to the icon and the corresponding application service function is started. Specifically, in the present application, an application APP installed in an electronic device may have multiple application services. In the cross-application transmission interface provided by the present application, the service icons of the applications displayed may include some or all of the application service icons provided by the same application APP. The present application does not limit this.
[0108] (3) Small windows, capsules, snack bars, toast feedback, and side app bars
[0109] "Small window" is a system tool of smart devices. It can float the operation window of the application above the interface or on the desktop, allowing users to easily switch the most recently used application. As a reduced application interface, the floating window can be displayed on top of other application interfaces (such as the application interface displayed in full screen), and the small window can still display the inherent interface style and function list of its corresponding application. Users can directly operate the controls in the floating window interface to use the corresponding functions of the controls without closing or exiting the application interface of other applications. For example, when playing games or watching videos in full screen, you suddenly receive messages from WeChat, QQ, etc., and the corresponding chat interface can be directly above the game interface in the form of a floating window. Users can view and reply to messages in the chat interface displayed in the small window without switching or exiting the currently open application.
[0110] "Capsule" is a form of mini-window after mini-window is minimized, and it is named because of its shape similar to a capsule. Unlike mini-window, it generally cannot display the inherent interface style and function list of its corresponding application, and will only be displayed as a small icon on the side of the electronic device screen. Users can expand the capsule by clicking on it, and after the capsule is expanded, it will be displayed on the top of the screen in the form of an application interface (such as a mini-window).
[0111] "Toast feedback" is a lightweight feedback method and a form of non-modal pop-up window. Common toast feedback is expressed in the form of text or a combination of icon + text. The location of the page will be designed at the top, middle or bottom of the page according to different scenarios. It will disappear automatically after a certain time interval (3s to 5s), or it will disappear automatically when the user clicks on other locations. Toast feedback will not interrupt the user's current operation process and will cause minimal disturbance to the user. Its disadvantage is that it is easily ignored by users and is not suitable for displaying too much information. It may disappear before the user has finished reading the information.
[0112] "Snack bar" is a lightweight feedback method that is slightly heavier than toast. It contains a line of text related to the ongoing operation and may contain corresponding jump controls to facilitate users to browse the application interface related to the aforementioned ongoing operation. Snack bar is also a non-modal pop-up window, generally used to notify users of the process that is occurring or about to occur in the program, and its content must be related to the user's current operation. It usually appears briefly at the bottom of the screen, does not interrupt the user experience, does not require any user operation, and disappears automatically after a period of time. In addition, in some embodiments, if a snack bar appears in the interface, the user can make the snack bar disappear by clicking an area outside the snack bar.
[0113] The "sidebar" is a quick function area displayed on the side of the electronic device screen that can accommodate multiple application icons, and users can customize the types of applications in the sidebar and the order of application icons. In any interface, users can swipe inward from the edge of the screen and pause to call out the sidebar, click on the application icon, and open the corresponding application. After the application is opened, it will generally be displayed at the top of the interface in the form of a small window.
[0114] (4) Global Collection
[0115] Global collection is an application service provided by the embodiment of the present application, which can be used to collect elements such as pictures, texts, voices, web pages, etc. that users have browsed based on electronic devices. After adding elements to the global collection application service, users can also edit the collected elements, such as adding tags to the collected videos to mark key points, so that users can efficiently review the key information carried by the elements when they watch them again.
[0116] The user can perform a three-finger swipe operation on the element to add the element to the global collection application service, or add the element to the global collection application service through the cross-application transmission interface provided by this application. After successfully adding the element to the global collection application service, the electronic device can display the capsule corresponding to the global collection application service in the interface, so that the user can add other elements in the interface to the global collection application service. Please refer to the relevant description of the subsequent embodiments for details, which will not be repeated here.
[0117] With the continuous development of electronic information technology, smart devices such as mobile phones and tablets have become indispensable products in our daily life, work and entertainment. When users use smart devices, they usually open multiple applications in the smart devices at the same time to work together. Users also often use smart devices to transfer information across applications, that is, to process, share, upload, etc. information in one application through another application. However, when users need to transfer information across applications, they need to perform complex and tedious operations to complete the information transfer.
[0118] Figure 1 It shows the specific process of a user adding text in the application "Novel Reading" to the application "Notes".
[0119] Figure 1 The user interface 01 shown in (A) is the interface displayed by the electronic device after the user opens a novel in the application "Novel Reading". The user interface 01 includes a status bar 011, text information 012, a text option list 013 and a navigation bar 014, wherein:
[0120] The status bar 011 may include the name of the operator (eg, China Mobile), time, WI-FI icon, signal strength, and current remaining power.
[0121] The text information 012 can be divided into two parts. The text information "ABCDEFGHIJKLMN" is the text that the user wants to transfer to other applications (for example, to the note application), so this part of the text has been selected by the user and is in the dark area; while the text information "OPQRSTUVWXYZ" is not selected by the user, so it is not in the dark area. It should be understood that although Figure 1Not shown, when selecting text, the user can complete the text selection by long pressing the text information 012, and after the first cursor 0121 and the last cursor 0122 appear, adjusting the positions of the first cursor 0121 and the last cursor 0122.
[0122] The text option list 013 includes a copy option, a select all option, a search option, a translation option, and a share option. Among them, the copy option is used to copy the text information selected by the user. After copying, the user can paste this part of the selected text information in other text boxes of the electronic device; the select all option is used to select all the text information in the interface 01 with one click; the search option is used to call the search function provided by the electronic device to search the text selected by the user; the translation option is used to translate the text selected by the user, such as Chinese to English or English to Chinese, etc.; the share option is used to share the text selected by the user. Any option can be used to respond to the user's operation, such as a click operation, so that the electronic device performs the operation corresponding to the option.
[0123] The navigation bar 014 may include system navigation keys such as a return button 0141, a home screen button 0142, and an outgoing task history button 0143. When it is detected that the user clicks the above-mentioned return button 0141, the electronic device may display the previous user interface of the current user interface. When it is detected that the user clicks the above-mentioned home screen button 0142, the electronic device may display the home screen interface set by the user for the electronic device. When it is detected that the user clicks the outgoing task history button 0143, the electronic device may display the tasks that the user has recently opened. The names of the navigation keys may also be other names, for example, the above-mentioned return button may be called Back Button, the above-mentioned home screen button may be called Home button, and the above-mentioned outgoing task history button may be called Menu Button, and this application does not impose any restrictions on this. In addition, the navigation keys in the above-mentioned navigation bar are not limited to virtual buttons, and may also be implemented as physical buttons.
[0124] After the user selects the text, the user can Figure 1 The user clicks the copy option shown in (A) to copy the selected text information. Then, in order to put the copied text information into the excerpt page of the note application, the user clicks Figure 1 The main interface button 0142 shown in (A) is clicked to cause the electronic device to exit the current user interface 01 and display the main interface. The specific style of the main interface can be referred to Figure 1 The user interface 02 shown in (B) in FIG. The user interface 02 may include a status bar 021, a calendar weather widget 022, an application area 023, a dock area 024, and a navigation bar 025, wherein:
[0125] The specific functions of the status bar 021 and the navigation bar 025 can be found in the aforementioned description of the user interface 01 and will not be repeated here.
[0126] The calendar weather widget 022 can be used to indicate the current time, such as date, day of the week, hour and minute information, etc., and can be used to indicate the weather type, such as cloudy to sunny, light rain, etc., and can also be used to indicate information such as temperature, and can also be used to indicate location.
[0127] The application area 023 may include, for example, an application icon for "novel reading", an application icon 0231 for "notes", etc., and may also include icons of other applications, which are not limited in the present embodiment. Any application icon may be used to respond to a user operation, such as a touch operation, so that the electronic device starts the application corresponding to the icon.
[0128] The dock area 024 may include, for example, an icon for "phone", an icon for "text message", an icon for "browser", and an icon for "camera", and may also include icons for other applications, which are not limited in the embodiments of the present application. Any icon of an application may be used to respond to a user's operation, such as a touch operation, so that the electronic device starts the application corresponding to the icon. No matter how the user switches the screen interface, the size of the dock area 024 and the applications it contains on the screen interface will never change and will always be displayed on the current interface.
[0129] To place the previously selected and copied text information into the excerpt page of the application note, such as Figure 1 As shown in (B) in FIG. 1 , the user needs to first open the application “Notes” by clicking on the application icon 0231; the electronic device may respond to the user’s clicking on the application icon 0231 by displaying the following Figure 1 In the user interface 03 shown in (C) in FIG. 03 , the user can first long-press a blank area in the input area 031 to call out the input option box 032 , and then click the paste option in the input option box 032 to paste the previously selected text information into the input area 031 .
[0130] After the text information is pasted, the interface displayed by the electronic device can refer to Figure 1 As shown in the user interface 04, the text information selected by the user in the application "Novel Reading" has been successfully input into the application "Notes". Afterwards, the electronic device can save the latest note created by the user in response to the user clicking the confirmation control 042.
[0131] from Figure 1It can be seen from the specific process of text transmission across applications that this method of information transmission across applications requires multiple operation steps when executed, and involves jumping between multiple applications and pages. The interaction efficiency between the user and the electronic device is very low, which seriously affects the user experience.
[0132] Figure 2 It shows the specific process of a user adding pictures in the application "Album" to the application "Notes" by using the split-screen function provided by the electronic device.
[0133] like Figure 2 As shown in (A), the user interface 05 includes a first display area 051 and a second display area 052. The first display area 051 is used to display the application interface of the application "Notes", and the second display area 052 is used to display the application interface of the application "Album". Specifically:
[0134] The first display area 051 includes an input area 0511 and a function list 052, wherein:
[0135] The input area 0511 is used to receive and display the note information such as text, images, etc. input by the user.
[0136] The function list 052 may include a share option, a favorite option, a delete option, and more options. Any of the options may respond to a click operation by the user, so that the electronic device executes the function corresponding to the option for the current note.
[0137] The second display area 052 includes an image display area and an image thumbnail set 0522, wherein:
[0138] The image display area 0521 is used to display the images saved by the user in the gallery;
[0139] Image thumbnail set 0522 is a thumbnail set formed when the user selects and drags multiple images from the image display area 0521 (i.e., the images that the user currently wants to put into the note). The number "3" displayed in the superscript in the upper left corner indicates that the user has selected three images in total.
[0140] like Figure 2 As shown in (A) in FIG. 1 , the user can press and hold the image thumbnail set 0522 and drag it to the first display area 051 and then release it, so that the multiple images corresponding to the image thumbnail set 0522 can be placed in the application "Notes". For details, please refer to Figure 2It should be noted that in the user interface 06, due to the limitation of the area of the first display area 061, the three images selected by the user (i.e., the three images corresponding to the image thumbnail set 0522) have all been added to the application "Notes", but they are not fully displayed in the first display area 061.
[0141] Although Figure 2 The process of cross-application information transmission shown simplifies the user's operation steps to a certain extent, but during the process the electronic device needs to keep two application interfaces displayed at the same time, and the user's reading effect is not good; in addition, the user also needs to operate the electronic screen to display the two application interfaces in split screen. The operations required for this process are also very cumbersome, and the interaction efficiency between the user and the electronic device has not been improved, and the user experience is still poor.
[0142] against Figure 1 and Figure 2 In order to address the defects of the method for transmitting information across applications, the present application provides a method for transmitting information and an electronic device. The electronic device can be used to implement the method. When implementing the method, the electronic device can display a cross-application transmission interface, so that the electronic device can efficiently and quickly complete the information transmission between applications, effectively reducing the number of operation steps required for users to complete the cross-application information transmission, improving the interaction efficiency between users and electronic devices, and thus improving user experience.
[0143] Specifically, in any interface displayed by an electronic device, when a user needs to transfer information in the interface across applications or across devices, the user can long press the information element in the interface and drag it to the edge of the screen. The electronic device will transform the interface originally displayed on the screen in three dimensions, create a visual effect of the original interface being pushed inward on the screen, and display the recommended application service icon on the side of the screen of the electronic device. At this time, the user interface displayed by the electronic device is the cross-application transmission interface. After that, the user places the dragged information element on the application service icon and lets go, and the information can be transferred to the application service corresponding to the icon, and the corresponding application service function is started. It should be noted that the above-mentioned information elements can be elements such as pictures, texts, videos, voices, links, documents, etc., and can also be other elements, which are not limited in this application. In addition, "cross-application transmission interface" is just some names used in the embodiments of this application, and the meanings represented by them have been recorded in the embodiments of this application, and their names cannot constitute any limitation on this embodiment.
[0144] The following introduces the user interface provided by the embodiment of the present application.
[0145] First, the user interface involved in the triggering process of the above-mentioned cross-application transmission interface is introduced.
[0146] Figure 3This is a schematic diagram of the process of electronic device interface changes when a user transfers an image across applications based on the cross-application transfer interface.
[0147] like Figure 3 As shown in (A), the user interface 07 may be an application interface of an application "browser" in an electronic device, or an application The user interface 07 may include an image 071, text 072, text 073, and a status bar 074. The electronic device may respond to a user operation on the image 071, such as Figure 3 The long press operation shown in (A) in the figure displays Figure 3 User interface 08 shown in (B) .
[0148] like Figure 3 As shown in (B), in the user interface 08, the original image 071 forms an image 081 under the user's long press operation. If the user does not let go, the image 081 can move in the user interface 08 with the user's fingertips, and the image 081 can be displayed on top in the user interface 08 (that is, the image 081 can cover any element in the user interface 08). It should be understood that the image content displayed by the image 081 is the same as the image content displayed by the image 071. Optionally, the image 081 can be a thumbnail obtained by the electronic device after reducing the image 071, that is, there is no difference between the image 081 and the image 071 except for the size of the area. Optionally, after the image 071 is dragged up to form the image 081, the electronic device can still display the image 071 in the user interface 08, and perform a virtual or blurred processing on the image 071, that is, the clarity of the image 071 in the user interface 08 can be lower than the clarity of the image 071 in the user interface 07, to prompt the user that the image 071 has been selected and dragged up.
[0149] The electronic device may respond to a user operation on the image 081, for example Figure 3 The drag operation shown in (B) in the figure shows Figure 3 User interface 09 shown in (C).
[0150] Optionally, when the user drags the image 081 to a distance less than a certain threshold from the right side or the left side of the screen, the electronic device displays a user interface 09, which will be described in detail later and will not be described here. Figure 3 As shown in (C), the user interface 09 is the cross-application transmission interface mentioned in the above description, which may include a sub-interface 091, an icon area 092, and an image 093. Among them:
[0151] The element content (such as text, pictures, etc.) displayed in sub-interface 091 is the same as the element content (except the status bar) displayed in user interface 07. In fact, sub-interface 091 can be considered as the interface obtained by the electronic device after a three-dimensional transformation of all the element contents (except the status bar) of the original user interface 07. In user interface 09, sub-interface 091 can create a visual effect of the original interface (i.e., user interface 07) being pushed inward on the screen. Understandably, this "opening the door" visual effect metaphorically transmits the behavior of elements (information), which is more intuitive than copying and pasting. Optionally, in user interface 09, the background behind sub-interface 091 can be set to the desktop background (i.e., desktop wallpaper) of the electronic device, and the resulting picture after the blur effect is superimposed.
[0152] The icon area 092 may be used to display application service icons recommended by one or more electronic devices based on the information element (ie, image 071 in the embodiment of the present application) selected by the user.
[0153] Optionally, each icon in the icon area 092 has a corresponding text description below it, and these text descriptions can be used to explain the specific application name or application service name corresponding to the icon. When the icon 0921 is an application When the icon 0921 is an application service icon of the application service "Friends Circle", the text 0922 can be "Friends Circle" or "WeChat Friends Circle". When the application service icon of the application service "Scan" is displayed, the text 0922 can be "Scan" or "WeChat Scan". It should be understood that the text below each application service icon is only for the user to understand the specific application or specific application function corresponding to the icon, but the specific icon style and specific text content are not limited in this application.
[0154] The image content displayed by image 093 is the same as that displayed by image 071 and image 081. Optionally, image 093 may be a thumbnail obtained by reducing image 081 by the electronic device. Similarly, image 093 is the same as image 081 and image 071 except for the size. In this way, when the user selects the application service he wants in icon area 092, image 093 will not cause a large area of blocking of the icons and texts in icon area 092, making it more convenient for the user to select the icon.
[0155] It should be noted that, unlike the reduction process of image 071, after image 081 is reduced to obtain image 093, image 081 may no longer be displayed in user interface 09. That is, image 081 may be regarded as an image obtained by the electronic device after copying image 071 and then reducing it, while image 093 may be regarded as an image obtained by the electronic device directly reducing image 081.
[0156] In the user interface 09, the user places the dragged information element (i.e., image 093) on the corresponding icon in the icon area 092 and lets go. The electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon. This will be explained in more detail later and will not be repeated here.
[0157] In addition, in order to guide the user to accurately place the dragged element into the application service they need, when image 093 is close to an icon in icon area 092, or the distance between image 093 and an icon in icon area 092 is less than a certain threshold, the icon approached by image 093 can display certain special effects, for example, the icon and the text corresponding to the icon can be adsorbed by image 093, and the icon and the text corresponding to the icon can be enlarged. Take icon 0923 and its corresponding text 0924 in user interface 09 as an example, when image 093 is close to icon 0923, icon 0923 and text 0924 are further to the left than other icons and texts, that is, closer to image 093 than other icons and texts; in addition, icon 0923 is also enlarged to remind the user that if he lets go here, image 093 (or image 071) will be transmitted to the application service corresponding to icon 094.
[0158] Understandable, Figure 3 The cross-application information sharing process shown is continuous from the time the user drags up the element to the time the element is placed in the target application service. The "continuous" here means that the user does not need to perform operations such as copying and pasting, nor does he need to switch applications. The user's fingers do not need to leave the screen of the electronic device during the entire operation process, and the operation is simple and fast. This information transmission method ensures the effective browsing area of the user interface, which can effectively improve the efficiency of the user's cross-application information transmission and enhance the user experience.
[0159] Figure 4 This is a schematic diagram of the interface change process of the electronic device when the user transfers text across applications based on the "cross-application transfer interface".
[0160] like Figure 4 As shown in (A) in FIG. 1 , the user interface 11 may be an application interface of an application “browser” in an electronic device, or an application The application interface may also be the application interface of other applications, which is not limited in this application.
[0161] The user interface 11 may include text 111, text 112, image 113, and text option list 114, wherein:
[0162] Text 111 is the text that the user wants to transfer to other applications, so this part of the text has been selected by the user and is in the dark area; correspondingly, text 112 is the unselected text. It should be understood that, unlike the independence of pictures, text itself has continuity. For a whole paragraph of text, users may only need part of the whole paragraph when sharing the text. Therefore, although Figure 4 As not shown, when selecting text in the user interface 11, the user can long press any text information in the user interface 11, and after the first cursor 111A and the last cursor 111B appear, the user can complete the text selection by adjusting the positions of the first cursor 111A and the last cursor 111B. Figure 4 As shown in (A) in FIG. 1 , the user has selected the text 111 by adjusting the positions of the first cursor 111A and the last cursor 111B.
[0163] The text option list 114 includes a copy option, a select all option, a search option, a translation option, and a share option. Any one of the options can be used to respond to a user's operation, such as a click operation, so that the electronic device performs an operation corresponding to the option.
[0164] Similar to the operation of dragging the picture, the electronic device can also respond to the user's operation on the text 111, for example Figure 4 The long press and drag operation shown in (A) in the figure shows Figure 4 The user interface 12 shown in (B) in FIG.
[0165] like Figure 4As shown in (B), in the user interface 12, the original text 111 obtains the lifted text 121 under the user's long press operation. If the user does not let go, the text 121 can move in the user interface 12 with the user's fingertips, and the text 121 can be displayed on top in the user interface 12 (that is, the text 121 can cover any element in the user interface 08). It should be understood that the text content contained in the text 111 is the same as the text content contained in the text 121. Optionally, the text 121 can also be the text obtained after the electronic device shrinks the text 111, and after the text 111 is dragged up to form the text 121, the electronic device can still display the text 111 in the user interface 12, and the text 111 is virtualized or blurred, that is, the clarity of the text 111 in the user interface 12 can be lower than the clarity of the image text 111 in the user interface 11, to prompt the user that the text 111 has been selected and dragged up.
[0166] The electronic device may respond to a user operation on the text 121, for example Figure 4 The drag operation shown in (B) in the figure shows Figure 4 The user interface 13 shown in (C) in FIG. Figure 4 As shown in (C), the user interface 13 is the cross-application transmission interface mentioned in the above description, which may include a sub-interface 131, an icon area 132 and text 133. Among them:
[0167] The specific styles and functions of the sub-interface 131 and the icon area 132 can refer to the above Figure 3 The relevant description of the user interface 09 will not be repeated here.
[0168] It should be noted that the text content contained in text 133 is the same as the text content contained in text 111 and text 121. However, it can be seen from user interface 12 and user interface 13 that text 133 is the text obtained by the electronic device after shrinking text 121; that is, after the "cross-application transmission interface" is opened, the electronic device also shrinks the text dragged by the user to a certain extent, so that text 133 will not cause a large area of blocking the icons and texts in icon area 132, making it easier for users to select.
[0169] Similarly, in the user interface 13, the user places the dragged information element (i.e., text 133) on the corresponding icon in the icon area 132 and lets go. The electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon.
[0170] Of course, when the electronic device is in landscape mode, the user can still use the "cross-application transfer interface" to transfer elements on the current interface across applications. The specific process and interface style can refer to the above Figure 2 , Figure 3 Related instructions and Figure 5 The user interface 14 and the user interface 15 shown are not described in detail here.
[0171] It should be understood that most smart devices currently provide users with a quick screenshot function. For example, in some scenarios, users can double-click the screen or swipe down with three fingers to take a full-screen screenshot of the current interface of the electronic device. In addition, after the user takes a screenshot, some smart devices also provide users with a recognition function in this scenario to recognize the image captured by the user (for example, extract text from the image or translate text, etc.). Therefore, for the screenshot function provided by the electronic device, the following is combined with Figure 6 as well as Figure 7 The process of using the cross-application transmission interface to transmit the captured image or text in the captured image across applications in the screenshot scenario is described.
[0172] Figure 6 This is a schematic diagram of the interface change process of the electronic device when the user transmits the captured image across applications based on the cross-application transmission interface.
[0173] like Figure 6 As shown in (A) in FIG. 1 , the user interface 16 may be an application interface of an application “browser” in an electronic device, or an application In response to the user's quick screenshot operation on the user interface 16, for example Figure 6 By performing the double-click operation of the knuckles shown in (A) in FIG. 1 , the electronic device can quickly obtain a full-screen image of the user interface 16 and display the image as shown in FIG. Figure 6 The user interface 17 shown in (B) in FIG.
[0174] like Figure 6 As shown in (B) in FIG. 1 , the user interface 17 may include a screenshot image 171. The screenshot image 171 is an image obtained by the electronic device in response to the user taking a knuckle screenshot of the user interface 16. After the screenshot is taken, the screenshot image 171 may be displayed in the user interface 17 and generally lasts for two to three seconds, so that the user can directly click on the screenshot image 171 to edit, save, etc. the screenshot image; if the user does not operate the screenshot image 171, the electronic device may automatically save it to the photo album.
[0175] In the embodiment of the present application, during the period of time when the electronic device displays the screenshot image 171 in the user interface 17, the user can long-press the screenshot image 171 and then drag it or directly drag it to the side of the electronic device screen, and then transfer it across applications through the "cross-application transfer interface". Figure 6 As shown in (B) in FIG. 1 , the electronic device may display a display as shown in FIG. 1 in response to the user dragging the screenshot image 171 to the side. Figure 6 The user interface 18 shown in (C) .
[0176] like Figure 6 As shown in (C), the user interface 18 is the cross-application transmission interface. The user interface 18 may include a sub-interface 181, an icon area 182, and an image 183, wherein:
[0177] The specific content and functions of the sub-interface 181 and the icon area 182 can be referred to the above description and will not be repeated here.
[0178] Similarly, in order to avoid excessive occlusion of the icon area 182 , when the screenshot image 171 is close to the icon area, the electronic device shrinks the original screenshot image 171 to obtain image 183 .
[0179] Similarly, in the user interface 18, when the user places the image 183 on the corresponding icon in the icon area 182 and releases it, the electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon.
[0180] If the user releases the hand before placing the image 183 on the corresponding icon in the icon area 182 , the electronic device can redisplay the user interface 17 in response to the operation.
[0181] In this embodiment of the present application, user interface 16 can be called the "fifth interface", user interface 17 can be called the "sixth interface", screenshot image 171 or image 183 can both be called the "first image", user interface 18 can be called the "seventh interface", and the operation of the user placing image 183 on the corresponding icon in the icon area 182 and releasing it can be called the "ninth operation".
[0182] Figure 7 It is a schematic diagram of the interface change process of the electronic device when the user transmits the text in the captured image across applications based on the cross-application transmission interface.
[0183] like Figure 7 As shown in (A) in FIG. 1 , the user interface 19 may be an application interface of an application “browser” in an electronic device, or an application In response to the user's quick screenshot operation on the user interface 19, for example Figure 7 The knuckle frame selection operation shown in (A) in FIG. 1 (i.e., using the knuckles to draw an area on the screen) can be used by the electronic device to quickly obtain the image selected by the user using the knuckle frame and display the image as shown in FIG. Figure 7 The user interface 20 shown in (B) in FIG.
[0184] like Figure 7 As shown in (B) in FIG. 1 , the user interface 20 may include a thumbnail 201, a partial screenshot box 202, an identification control 203, a sharing control 205, and a shape option box 204. Among them:
[0185] The thumbnail 201 may be a thumbnail of the aforementioned user interface 19 .
[0186] The partial screenshot frame 202 is the screenshot area determined by the electronic device in response to the user's finger joint frame selection screenshot operation on the user interface 19. The user can adjust the edge of the partial screenshot frame 202 by dragging the edge of the partial screenshot frame, and can also press and hold the center area of the partial screenshot frame 202 to adjust the specific position of the partial screenshot frame in the thumbnail 201. It should be understood that for the electronic device, the partial screenshot frame 202 is only used to frame the image in the thumbnail 211, and the electronic device cannot obtain the information (such as text information) contained in the image in the partial screenshot frame 202.
[0187] The recognition control 203 is used to recognize text information contained in the image in the partial screenshot frame 202 .
[0188] The sharing control 205 is used to share the image in the partial screenshot frame 202 .
[0189] The shape option box 204 includes a free graphic option, a rectangular option, an elliptical option and a heart-shaped option. The electronic device can adjust the specific shape of the partial screenshot box 202 to a shape corresponding to the option in response to a user's touch operation, such as a click operation, on any option.
[0190] like Figure 7 As shown in (B) in FIG. 1 , the electronic device can recognize the text information contained in the image in the partial screenshot frame 202 in response to the user's click operation on the recognition control 203. After the text information is recognized, the text information contained in the image in the partial screenshot frame 202 can be selected by the first cursor and the last cursor. For details, please refer to Figure 7(C) The content displayed in the text box 212 in the user interface 21. Afterwards, the user can long press the recognized text information and drag it to the side of the electronic device screen to transfer the recognized text across applications through the "cross-application transfer interface".
[0191] like Figure 7 As shown in (C) in FIG. 1 , the user interface 21 may include a thumbnail 211, a partial screenshot frame 202, text 2121, and text information 213, wherein:
[0192] The thumbnail 211 may be a thumbnail of the aforementioned user interface 19 .
[0193] The partial screenshot frame 202 is the partial screenshot frame 202 in the above description. The text information in the image framed by the partial screenshot frame 202 has been recognized and extracted by the electronic device. Figure 7 Text 2121 shown in (C).
[0194] Text 213 is a user long pressing operation on text information 211 ( Figure 7 (not shown) after dragging the text. Figure 7 As shown in (C) in FIG. 1 , after the user drags the text 213, the user can drag the text information 213 to the side of the electronic device screen, and the electronic device can respond to the user operation and display the following Figure 7 The user interface 22 shown in (D) in FIG.
[0195] like Figure 7 As shown in (D) in FIG. 1 , the user interface 22 is the cross-application transmission interface. The user interface 22 may include a sub-interface 221, an icon area 222, and text 223, wherein:
[0196] The specific contents and functions of the sub-interface 221 and the icon area 222 can be referred to the above description and will not be repeated here.
[0197] Similarly, in order to avoid excessive obstruction in the icon area 222 , when the text 223 is close to the icon, the electronic device shrinks the text 213 to obtain the text 223 .
[0198] Similarly, in the user interface 22, when the user places text 223 on the corresponding icon in the icon area 222 and releases it, the electronic device can transmit the text 223 to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon.
[0199] In the embodiment of the present application, user interface 19 can be called the "eighth interface", user interface 20 can be called the "ninth interface", text 2121, text 223, and text 213 can all be called "first text information", recognition control 203 can be called "text recognition control", user interface 21 can be called the "tenth interface", and the operation of the user dragging the text information 213 to the side of the electronic device screen can be called the "tenth operation", user interface 22 can be called the "eleventh interface", and the operation of the user placing text 223 on the corresponding icon in the icon area 222 and releasing it can be called the "eleventh operation".
[0200] Of course, the images captured by the user through the partial screenshot function can also be transmitted through the cross-application transmission interface. Figure 8 It shows the process of a user sharing an image captured by the partial screenshot function through the cross-application transmission interface.
[0201] like Figure 8 The user interface 20 shown in (A) is the previous Figure 7 The user interface 20 shown in (B) in FIG. Figure 8 As can be seen from the above description, the user interface 20 may include a thumbnail 201, a partial screenshot frame 202, an identification control 203, a sharing control 205, and a shape option box 204. The partial screenshot frame 202 is the screenshot area determined by the electronic device in response to the user's finger joint frame selection screenshot operation on the user interface 19. It should be understood that although the partial screenshot frame 202 contains text, since the user did not click the identification control 203 at this time, the partial screenshot frame 202 captures an image containing text. Similarly, if Figure 8 As shown in (A), the user can long press and drag the image captured by the local screenshot frame 202, and drag it to the side of the electronic device screen, and transfer the image captured by the local screenshot frame 202 across applications through the "cross-application transmission interface".
[0202] like Figure 8 As shown in (B) in FIG. 1 , the user interface 23 is the cross-application transmission interface. The user interface 23 may include a sub-interface 231, an icon area 232, and an image 233, wherein:
[0203] The specific content and functions of the sub-interface 231 and the icon area 232 can be referred to the above description and will not be repeated here.
[0204] Similarly, in order to avoid excessive occlusion in the icon area 232, when the image in the partial screenshot frame 202 is dragged up and close to the icon, the electronic device can reduce the image in the partial screenshot frame 202 to obtain the image 233. It should be noted that when the image in the partial screenshot frame 202 is shared using the "cross-application transmission interface", the shape of the partial screenshot frame 202 will be retained, that is, the shape of the image 233 is the same as the shape displayed by the partial screenshot frame 202.
[0205] Similarly, in the user interface 23, the user places the image 233 on the corresponding icon in the icon area 232 and releases it. The electronic device can transmit the image 233 to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon.
[0206] In this embodiment of the present application, the user interface 20 can be called the "sixth interface", the user interface 23 can be called the "seventh interface", and the operation of the user placing the image 233 on the corresponding icon in the icon area 232 and releasing it can be called the "ninth operation".
[0207] It should be understood that in the process of daily use of electronic devices, users often drag and drop some elements. Therefore, how to determine the corresponding trigger rules for the cross-application transfer interface based on user operations, and guide users to trigger the electronic device to display the "cross-application transfer interface" based on user operation habits, is the key to further improving the efficiency of user interaction with electronic devices. Figure 9-11 , to explain the triggering rules of the cross-application transmission interface.
[0208] Fig. 9 A schematic diagram for illustrating cross-application transmission interface triggering rules is provided in an embodiment of the present application.
[0209] like Fig. 9 As shown in (A) in FIG. 1 , the user interface 24 may be an application interface of an application “browser” in an electronic device, or an application The application interface may also be the application interface of other applications, which is not limited in this application.
[0210] Next, the image 241 of the user interface 24 is used as an example for description. Fig. 9 As shown in (A) of FIG. 1 , combined with the above description, it can be seen that the user can drag the image 241 by long pressing the image 241. In response to the user's dragging operation on the image 241, the electronic device can display the following Fig. 9 The user interface 25 shown in (B) in FIG.
[0211] like Fig. 9As shown in (B) in FIG. 1 , the user interface 25 may include an image 241, an image 251, a left trigger area 252L, and a right trigger area 252R. In the embodiment of the present application, the left trigger area 252L and the right trigger area 252R may be collectively referred to as a “first trigger area”, wherein:
[0212] Image 251 is a thumbnail formed when the user drags up image 241. If the user does not let go, image 251 can move in the user interface 08 along with the user's fingertips. For details, please refer to the above-mentioned related instructions, which will not be repeated here.
[0213] The left trigger area 252L is a rectangular area bounded by the left border of the electronic screen, and the right trigger area 252R is a rectangular area bounded by the right border of the electronic screen. Specifically, the length of the left trigger area 252L can be d1, and the width can be W; the length of the right trigger area 252R can be d1, and the width can be W. Among them, d1 can be set to 25% of the width of the electronic device screen, such as Fig. 9 As shown in (A), the width of the screen is L, and W can be the height of the electronic device screen, such as Fig. 9 As shown in (A), the height of the screen is h. It should be noted that in the user interface 25, the left trigger area 252L and the right trigger area 252R are displayed as dark transparent areas only to facilitate the user to understand the specific positions and areas of the two areas. In actual application scenarios, the specific sizes and positions of the two areas may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of the two areas in the user interface 25, and the sizes and positions of the two areas may only be stored in the electronic device in a form that is perceptible to the electronic device (such as program code).
[0214] When the user drags the image 251 to the left trigger area 252L or the right trigger area 252R, the electronic device can display special effects at the edge of the screen; optionally, after the user drags the image 251 to the left trigger area 252L or the right trigger area 252R and the image stays in the left trigger area 252L or the right trigger area 252R for a period of time T, the electronic device can display special effects at the edge of the screen to prompt the user to further drag the image closer to the side of the screen. Specifically, the above T can be set to 600 milliseconds.
[0215] It should be understood that “dragging the image 251 to the left trigger area 252L or the right trigger area 252R” mentioned here means that after the user drags the image 251, the contact point between the user's finger and the screen (i.e., the anchor point) enters the left trigger area 252L or the right trigger area 252R, and does not mean that the image 251 completely enters the left trigger area 252L or the right trigger area 252R.
[0216] like Fig. 9 As shown in (B) in FIG. 1 , when the user drags the image 241 into the right trigger area 252R, the electronic device may respond to the operation by displaying a Fig. 9 The user interface 26 shown in (C) in FIG. 2 may include an image 241, an image 251, and a special effect area 261. The special effect area 261 may display special effects visible to the user, such as a luminous special effect and a shadow special effect, or may display other special effects perceptible to the user, which is not limited in the present application.
[0217] Combined with the above description, it can be known that the special effect area 261 can prompt the user to further drag the image closer to the side of the screen to trigger the "cross-application transfer interface" interface to transfer the element to other applications. Therefore, in the embodiment of the present application, after the element is dragged up, the user interface is also provided with a door opening area. When the user further drags the dragged element to the door opening area, the electronic device can respond to the operation and display the cross-application transfer interface. Fig. 9 As shown in (C) in FIG. 1 , when the user drags the image 251 to the right until it enters the door opening area, the electronic device can respond to the operation and display the following Fig. 9 The user interface 27 shown in (D) in FIG.
[0218] like Fig. 9 As shown in the user interface 27 shown in (D), the user interface 27 may include an image 241, an image 251, a left door opening area 271L, and a right door opening area 271R. In the embodiment of the present application, the left door opening area 271L and the right door opening area 271R may be collectively referred to as a "second trigger area", wherein:
[0219] The left door opening area 271L is a rectangular area bounded by the left border of the electronic screen, and the right door opening area 271R is a rectangular area bounded by the right border of the electronic screen. Specifically, the length of the left door opening area 271L is d2, and the width is W; and the length of the right door opening area 271R is also d2, and the width is also W, wherein d2 can be set to 36 pixel units, and W can be the height of the electronic device screen. It should be noted that in the user interface 27, the left door opening area 271L and the right door opening area 271R are displayed as dark transparent areas only to facilitate readers to understand the specific positions and areas of these two areas. In actual application scenarios, the specific size and position of these two areas may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of the two areas in the user interface 27, and the size and position of these two areas can only be stored in the electronic device in a form that is perceptible to the electronic device (such as program code).
[0220] When the user drags the image 251 to the left door area 271L or the right door area 271R, the electronic device can immediately respond to the operation and display the cross-application transmission interface, that is, Fig. 9 The user interface 28 shown in (E) in FIG. Fig. 9 As shown in (E) in FIG. 1 , the user interface 28 includes a sub-interface 281, an icon area 282, and an image 283. Among them:
[0221] The elements displayed in the sub-interface 281, such as text, pictures, etc., are the same as the elements displayed in the user interface 24 (except the status bar). The specific content and functions of the sub-interface 281 can refer to the above-mentioned related descriptions, which will not be repeated here.
[0222] The electronic device can display one or more application service icons recommended based on the element selected by the user (i.e., image 241 in the embodiment of the present application) in the icon area 282. In addition, the icon area 282 can be a rectangular area bounded by the right border of the electronic screen. Specifically, the length and width of the icon area 282 can be d3 and W, respectively, where d3 is greater than the aforementioned d2. Specifically, d3 can be set to 120 pixel units, and W can be the height of the electronic device screen (i.e., h in the aforementioned description). Similarly, in the user interface 28, the icon area 282 is displayed as a dark transparent area only to facilitate the user to understand the specific position and area of the area. In actual application scenarios, the specific size and position of the area may not be displayed in the user interface, that is, the user cannot directly observe the specific outline of the area in the user interface 28, and the size and position of the area can be stored in the electronic device only in a form that is perceptible to the electronic device (e.g., program code).
[0223] The image content displayed by image 283 is the same as the image content displayed by image 251 and image 241, but the area is different. It should be noted that compared with image 51 in user interfaces 25 to 27, image 283 in user interface 28 is smaller. This is because when the electronic device displays user interface 28, image 251 in the original user interface 27 is reduced in size to prevent the image from being too large and blocking the icons and text in icon area 282, thereby interfering with the user's selection. In other words, image 241 can be reduced twice during the entire cross-application transmission process. The first time occurs when the user drags it up. For details, please refer to Fig. 9 The second time occurs when the electronic device starts to display the "cross-application transmission interface" in the image 251 and the image 241 in (B). For details, please refer to Fig. 9 The image 251 shown in (D) and Fig. 9 Image 283 shown in (E).
[0224] In the user interface 28, the user places the dragged information element (i.e., image 283) on the corresponding icon in the icon area 282 and lets go. The electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon. This will be explained in more detail later and will not be repeated here.
[0225] In addition, in order to guide the user to accurately place the dragged elements into the application services they need, in the user interface 28, when the user drags the image 283 close to an icon in the icon area 282, or when the distance between the image 283 and an icon in the icon area 282 is less than a certain threshold, the icon approached by the image 283 can display certain special effects, for example, the icon and the text corresponding to the icon can be attracted close to the image 283 and can be enlarged.
[0226] like Fig. 9 As shown in (E) in the user interface 28, after the user drags the image 283 to the "Friend WeChat" icon, the electronic device may display the following Fig. 9 The user interface 29 shown in (F) in FIG. 29. It can be seen from the icon area 282 in the user interface 29 that when the image 283 approaches the "Friends WeChat" icon 284, the "Friends WeChat" icon 284 and its corresponding text 285 are further to the left than other icons and texts, that is, closer to the image 283 than other icons and texts; in addition, the "Friends WeChat" icon 284 is also enlarged to remind the user that if the user lets go here, the image 283 (or image 241) will be transmitted to the application (i.e., WeChat) or application service (WeChat-Friend Chat) corresponding to the "Friends WeChat" icon.
[0227] In addition, when the cross-app transfer interface is opened, the user can also exit the cross-app transfer interface through corresponding operations. For details, please refer to Fig.10 and Fig.11 .
[0228] Fig.10 It shows the process of the user exiting the cross-application transmission interface through the door closing area.
[0229] like Fig.10 As shown in (A) in FIG. 1 , the user interface 31 may be a cross-application transmission interface displayed by the electronic device after the user drags an image in the history interface and drags it to the side. The user interface 31 includes a sub-interface 311, an icon area 312, a door closing area 313, and an image 314, wherein:
[0230] The sub-interface 311 is an interface obtained by transforming the original interface where the image 314 is located;
[0231] The icon area 312 is an area for displaying application service icons recommended by one or more electronic devices based on the element selected by the user (i.e., image 314 in this embodiment of the application). Fig. 9 The relevant instructions will not be repeated here.
[0232] The door closing area 313 can be a rectangular area bounded by the left border of the electronic screen. Specifically, the length and width of the door closing area 313 can be d4 and W, respectively. Specifically, d4 can be set to half the width of the electronic device screen (i.e., L in the above description), and W can be the height of the electronic device screen (i.e., h in the above description). Similarly, in the user interface 31, the icon area 312 and the door closing area 313 are displayed as dark transparent areas only to facilitate the user to understand the specific position and area of the area. In actual application scenarios, the specific size and position of these two areas may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of the two areas in the user interface 31, and the size and position of these two areas can only be stored in the electronic device in a form that is perceptible to the electronic device (such as program code).
[0233] like Fig.10 As shown in (A) in FIG. 3 , after the user drags the image 314 to the door closing area 313, if the user still holds the image 314, the electronic device can close the "cross-application transmission interface" and display the following Fig.10 The user interface 32 shown in (B) in FIG.
[0234] like Fig.10 As shown in (B) in FIG. 1 , the user interface 32 may include an image 321 and an image 322, wherein:
[0235] Image 321 is the thumbnail obtained when the user just drags up image 322. Unlike image 314, image 321 is a thumbnail obtained by the electronic device shrinking image 322 once, while image 314 is a thumbnail obtained by the electronic device shrinking image 321 twice after the cross-application transmission interface is opened.
[0236] If the user does not release the image 321 , the user may drag the image 321 to the side of the screen to trigger the display of the cross-application transmission interface again.
[0237] Fig.11 It shows the process of the user exiting the cross-application transfer interface by directly releasing the finger.
[0238] like Fig.11As shown in (A) in FIG. 1 , the user interface 33 may be a cross-application transmission interface displayed by the electronic device after the user drags an image in the history interface and drags it to the side. The user interface 33 includes a sub-interface 331, an icon area 332, a door closing area 333, and an image 334, wherein:
[0239] The specific functions of the sub-interface 331 and the door closing area 333 can be referred to the aforementioned related descriptions and will not be repeated here.
[0240] It is easy to understand that when the total length of d4 and d3 is less than the width L of the electronic screen, there is still a part of the area in the user interface 33, which does not belong to the icon area 332 or the door closing area 333. In the user interface 33, this part of the area can be a rectangular area 335 with a length of d5 and a width of h.
[0241] like Fig.11 As shown in (A) in FIG. 3 , after the user drags the image 334 into the rectangular area 335, if the user lets go directly at this time, the electronic device can close the "cross-application transmission interface" and display the following Fig.11 The user interface 34 shown in (B) in FIG.
[0242] like Fig.11 As shown in (B) in the figure, user interface 34 is the original interface where image 314 is located. It may include image 341. Unlike user interface 32 in the above description, since the user has let go, the thumbnail obtained by the user dragging up image 341 is no longer displayed in user interface 34. If the user wants to transfer image 341 to other applications again through the "cross-application transfer interface", the user needs to long-press image 341 again to drag it up to obtain the corresponding thumbnail, and drag the thumbnail to the side of the screen to trigger the cross-application transfer interface again.
[0243] In subsequent embodiments, the specific operation of the user triggering the "cross-application transmission interface" and closing the "cross-application transmission interface" as well as the corresponding interface change process of the electronic device can refer to the relevant description of the aforementioned embodiments, which will not be repeated later.
[0244] It should be understood that in the daily use of electronic devices, users often drag and drop some elements. For example, after a user uses the "smart split screen" function to open two application interfaces, or opens two application interfaces in the form of small windows or "picture-in-picture", the user will often transfer information across applications in this mode; and in an embodiment of the present application, in the split-screen state and the small window state, the user can directly complete the cross-application transmission of information through the split-screen function, or use the "cross-application transmission interface" provided in this application to complete the cross-application transmission of information. Combined with the aforementioned description of the triggering rules of the "cross-application transmission interface", the following describes the different ways in which electronic devices transfer information across applications in the split-screen state and the small window state. For details, please refer to Figure 12-Figure 15 .
[0245] Fig.12 It shows the process of a user completing cross-application information transmission through the split-screen function of an electronic device in split-screen state.
[0246] like Fig.12 As shown in (A), the user interface 35 includes a first display area 351 and a second display area 352. The first display area 351 is used to display the application interface of the application "Notes", and the second display area 352 is used to display the application interface of the application "Album". In the embodiment of the present application, the user interface 35 can be referred to as the "first interface", the first display area 351 can be referred to as the "second sub-interface", and the second display area 352 can be referred to as the "first sub-interface".
[0247] At this time, the user long-presses the image 3521 in the second display area 352 and drags it up, obtaining a thumbnail 3522 of the image 3521. In the embodiment of the present application, the image 3521 or the thumbnail 3522 may be referred to as "first information". In addition, in combination with the foregoing description, after the image 3521 is dragged up, there may be two pairs of determination areas in the user interface 35, namely, area 353L and area 353R in the user interface 35, and area 354L and area 354R selected in the dotted box in the user interface 35. Among them, area 353L and area 353R are the left trigger area and the right trigger area, respectively; area 354L and area 354R are the left door opening area and the right door opening area, respectively. In the embodiment of the present application, area 353L and area 353R can be collectively referred to as the "first trigger area", and area 354L and area 354R can be collectively referred to as the "second trigger area". Combined with the above description, it can be seen that when the user drags the image 3522 to the left trigger area 354L or the right trigger area 354R and stays there for a period of time T, the electronic device can display special effects at the edge of the screen; when the user continues to drag the image 3522 to the left door area 354L or the right door area 354R, the electronic device will respond to the operation and display the corresponding cross-application transmission interface. However, if the user drags the image 3522 from the second display area 352 to the first display area 351 without letting the image 3522 touch the left door area 354L and the right door area 354R, the electronic device can still transfer the image 3522 (or image 3521) to the "Notes" application and display it in the first display area 351.
[0248] like Fig.12 As shown in (A) in the figure, users can follow Fig.12 Drag the image 3522 to the first display area 351 in the direction indicated by the dotted arrow shown in (A). In the embodiment of the present application, the operation of dragging the image 3522 to the first display area 351 can be referred to as the "first operation"; in this process, as long as the image 3522 does not touch the left door area 354L and the right door area 354R, the image 3522 (or image 3521) can be directly transferred to the "Notes" application without opening the "Cross-Application Transfer Interface" and displayed in the first display area 351. For details, please refer to Fig.12 It should be noted that even if the image 3522 briefly touches the left door opening area 354L or the right door opening area 354R during this process, the electronic device will only display the corresponding special effects on the side and will not directly trigger the "cross-application transmission interface".
[0249] Also taking the user interface 35 in the above description as an example, Fig.13 It shows the process of a user completing cross-application information transmission through the "cross-application transmission interface" of an electronic device in split-screen state.
[0250] like Fig.13 As shown in (A) of FIG. 1 , the elements and functions of the user interface 35 can be referred to in the foregoing description of Fig.12 The relevant description is not repeated here. However, it is different from Fig.12 As shown in the dragging method of the selected element (i.e., image 3522), since the user now wants to transfer image 3522 to another application through the "cross-application transfer interface", this application may not be the "note" application, so, Fig.13 As shown in (A) and (B) in the figure, users can Fig.13 Drag the image 3522 to the right door opening area 354R in the direction indicated by the dotted arrow shown in (A) of FIG. 35; when the image 3522 enters the right door opening area 354R, the electronic device can immediately display the following Fig.13 The user interface 37 shown in (C) in FIG.
[0251] like Fig.13 As shown in (C) in FIG. 3 , the user interface 37 may include a sub-interface 371, an icon area 372, and an image 373. Among them:
[0252] The specific content and functions of sub-interface 371 can be referred to the above related descriptions, which will not be repeated here. However, it should be noted that in the split-screen state, after the user triggers the "cross-application transfer interface" through operation, the display screen in sub-interface 371 is still in split-screen mode, and it still includes two display areas, namely Fig.13 The first display area 3711 and the second display area 3712 shown in (C) in FIG.
[0253] The specific content and functions of the icon area 372 can be referred to the aforementioned related descriptions and will not be repeated here.
[0254] The image content displayed by image 373 is the same as the image content displayed by image 3521 and image 3522, except for the difference in area size.
[0255] In the user interface 37, the user places the dragged information element, i.e., image 373, on the corresponding icon in the icon area 372 and lets go, and the electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation and display the corresponding application interface. In the embodiment of the present application, the user interface 35 can be referred to as the "first interface", the image 3521 thumbnail 3522, or the image 373 can be referred to as the "first information", the operation of dragging the image 3522 to the right door opening area 354R can be referred to as the "second operation", the operation of placing the image 373 on the corresponding icon in the icon area 372 and letting go can be referred to as the "third operation", the user interface 37 can be referred to as the "second interface", and the icon displayed in the icon area 372 in the user interface 37 can be referred to as "at least one application service icon".
[0256] Similarly, when the electronic device is in a multi-window state with small windows, the user can also complete the process of cross-application transmission of information through the multi-window function or the "cross-application transmission interface". Fig.14 and Fig.15 The following diagram shows the process of a user completing cross-application information transmission through the split-screen function of an electronic device and the "cross-application transmission interface" in a small window state. In a small window state, the user interface displayed by the electronic device may include application interfaces of two different applications, where the application interface of one application is displayed in full screen, and the application interface of the other application is displayed in a small window (floating window) on top. When transferring information across applications in a small window state, users can use the multi-window function to directly drag elements from one application interface to another application interface. The specific operation process is the same as Fig.12 The operation process of cross-application transmission in the split-screen state is similar. It can be understood that in the small window state, the information transmission method can be dragged from the top small window (floating window) to the full-screen display interface, or from the full-screen display interface to the top small window (floating window). In addition, in the small window state, users can also transmit through the "cross-application transmission interface". The specific operation process is Fig.13 The operation process shown is similar, so I will not go into details here. For details, please refer to Fig.14 and Fig.15 , and combined with the above Fig.12 , Fig.13 for more information.
[0257] After using the "cross-application transmission interface" to transmit information across applications, the electronic device can also provide users with different prompts and display different interface effects based on the type of application service the information enters and the result of the information transmission. Figure 16-Figure 21The following describes the interface styles that may be displayed by an electronic device after a user uses the "cross-application transfer interface" to transfer information across applications.
[0258] ① After the transfer is completed, the snack bar will be used to prompt the user. Please refer to Fig.16 .
[0259] like Fig.16 As shown in (A) in FIG. 4 , the user interface 41 is a cross-application transmission interface for a user to perform cross-application transmission of an image 411. At this time, the user is placing the dragged information element, that is, the image 411, on the icon of “notes” on the right.
[0260] As the user releases the hand, the electronic device may transmit the image 411 to the "note" application service in response to the user operation; if the transmission is successful, the electronic device may display the following: Fig.16 The user interface 42 shown in (B) in FIG.
[0261] like Fig.16 As shown in (B) in FIG. 4 , a snack bar 421 may be displayed below the user interface 42. Specifically, the snack bar 421 may include a prompt message 4211 and a jump control 4212, wherein:
[0262] The prompt information 4211 may include four characters “Transfer successful” to prompt the user that the electronic device has successfully transferred the image 411 to the “Notes” application service.
[0263] The jump control 4212 can respond to the user's touch operation to make the electronic device jump from the current interface to the interface of the application service "Notes".
[0264] In addition, if the user does not perform any operation on snack bar 421, snack bar 421 may automatically disappear after being displayed for a period of time (e.g., 2s-3s); or, when snack bar 421 is still displayed in user interface 42, the user may make snack bar 421 disappear through other locations in electronic user interface 42 except where snack bar 421 is located.
[0265] like Fig.16 As shown in (B) in FIG. 1 , after the user clicks the jump control 4212, the electronic device may respond to the operation by displaying the following Fig.16 The user interface 43 shown in (C) in FIG. The user interface 43 is the interface of the application service "Notes". It can be seen from the user interface 43 that the image 411 has been transferred to the "Notes" by the electronic device.
[0266] Need to understand, Fig.16The user interface provided by the embodiment of the present application is only exemplified, and it should not constitute a limitation on the embodiment of the present application. For example, when the user transfers the dragged element to an application service in another immersive scene, the electronic device can still use the snack bar in the interface to prompt the user.
[0267] ②After the transfer is completed, a capsule is generated to prompt the user. Please refer to Figure 17-Figure 18 .
[0268] like Fig.17 As shown in (A) in FIG. 4 , the user interface 44 is a cross-application transmission interface for the user to perform cross-application transmission of the image 441. The user can place the dragged information element, that is, the image 441, on the icon of "global collection" on the right.
[0269] As the user releases the hand, the electronic device may transmit the image 441 to the global collection (ie, add the image 441 to the global collection folder) in response to the user operation; if the collection is successful, the electronic device may display the following: Fig.16 The user interface 45 shown in (B) in FIG.
[0270] like Fig.17 As shown in (B) in FIG. 4 , if the electronic device successfully collects image 411 into the global favorites, a capsule 451 may be displayed on the right side of the user interface 45. Specifically, a "global favorites" icon 4511 may be displayed in capsule 451. In addition, the user may change the specific position of capsule 451 on the right side by pressing and dragging it. In addition, the user may also Fig.17 The click operation on the capsule 451 shown in (B) in the figure causes the electronic device to jump from the current interface to the interface of the application service "global collection". The interface of the "global collection" after the jump can be specifically referred to Fig.16 The user interface 43 shown in (B) and the aforementioned related instructions are not repeated here.
[0271] Optionally, capsule 451 may automatically disappear after being displayed on the side of the screen for a period of time. Alternatively, if the user does not actively close capsule 451, capsule 451 may continue to be displayed on the side of the screen, so that the user can continue to drag up other information elements contained in the current display interface of the electronic device and put them into the "global collection". For details, please refer to Fig.18 .
[0272] like Fig.18 As shown in (A) in FIG. 1 , the user interface 45 is the aforementioned Fig.17As shown in the user interface 45 in (B) in FIG. 1 , it can be understood that the user has already added image 441 to the "global collection", and capsule 451 is still displayed in the user interface 45. If the user wants to add other elements in the interface to the "global collection", the user can drag the element in the interface and move it to capsule 451 and then release it. Fig.18 As shown in (A) in FIG. 1 , after the user selects the text 452, the user can press and hold the text 452 to drag it up and directly drag it to the capsule 451, and the electronic device can respond to the user operation and display the following Fig.18 The user interface 46 shown in (B) in FIG.
[0273] like Fig.18 As shown in (B) in the figure, in the user interface 46, after the text 452 is dragged onto the capsule 451, in order to facilitate the user's operation, the electronic device can enlarge the capsule 451, that is, the capsule 451 in the user interface 46 can be larger than the capsule 451 in the user interface 45, and the electronic device can reduce the original text 452 to the text 461 in the user interface 46. At this time, if the user lets go of the text 461, the electronic device can respond to the user operation and transfer the text 461 (or the text 452) to the global collection (that is, to collect the text 461 to the global collection). If the collection is successful, the electronic device can display the following Fig.18 The user interface 47 shown in (C) in FIG.
[0274] like Fig.18 As shown in (C) in FIG. 4 , capsule 451 is still displayed in user interface 47. The user can Fig.18 The click operation on capsule 451 shown in (C) in the figure opens the interface of the application service "Global Favorites". As a possible implementation, after the user clicks capsule 451, the electronic device can display the interface of the application service "Global Favorites" in the form of a small window in the interface. For details, please refer to Fig.18 The user interface 48 shown in (D) in FIG.
[0275] like Fig.18 As shown in (D) in the figure, the user interface 48 may include a main interface 481 and a sub-interface 482. The main interface 481 may be an application interface of the application "browser" in the electronic device, and the sub-interface 482 is a small window interface of the application service "global collection". It can be seen from the user interface 48 that the sub-interface 482 may include an image 4821, text 4822, and a function expansion control 4823, wherein:
[0276] Image 4821 corresponds to image 441 in the above description;
[0277] The text 4822 corresponds to the text 452 or the text 461 in the above description;
[0278] Function expansion control 4823 can respond to the user's touch operation, such as Fig.18 The click operation shown in (D) in the figure causes the electronic device to display the following Fig.18 User interface 49 shown in (E) in FIG.
[0279] like Fig.18 As shown in (E) in the user interface 49, the sub-interface 482 displays an expansion control 4824, a minimize control 4825, and a close control 4826, wherein:
[0280] The minimization control 4825 can respond to a user operation to cause the electronic device to collapse the sub-interface 482 and display it in a capsule form on the side of the screen.
[0281] The close control 4826 can respond to user operation to cause the electronic device to close the sub-interface 482.
[0282] The expansion control 4824 can respond to the user operation to enable the electronic device to display the interface of the application service "global favorites" in full screen. Fig.18 As shown in (E) in FIG. 1 , the electronic device may display the following in response to the user's click operation on the expansion control 4824: Fig.18 The user interface 50 shown in (F) in FIG. 5 shows that the electronic device has displayed the interface of the application service “global favorites” in full screen at this time, and the text image 441 and text 452 previously favorited by the user are also displayed in the user interface 50 accordingly.
[0283] ③ After the transfer is complete, display the application window in the original interface or directly display the new application interface in full screen. Fig.19 .
[0284] like Fig.19 As shown in (A) in FIG. 1 , the user interface 51 is The user can long-press the text 511, drag the text 511 containing the location information, and drag it to the side of the electronic screen; the electronic device can respond to this operation and display the following Fig.19 The user interface 52 shown in (B) in FIG.
[0285] like Fig.19 As shown in (B) in the figure, user interface 52 is the cross-application transmission interface. In combination with the above description, it can be known that the user can drag the text 521 obtained by shrinking the text 511 to any icon in the icon bar on the right side of user interface 52 and then release the text 521 (or text 511) to the application service corresponding to the icon. Fig.19 As shown in (B) in FIG. 1 , when the user drags the text 521 onto the “map navigation” icon 522 and then lets go, the electronic device can respond to the user operation and display the following Fig.19 The user interface 53 shown in (C) in FIG.
[0286] like Fig.19 As shown in (C) in FIG. 5 , the user interface 53 may include a main interface 531 and a sub-interface 532. The main interface 531 may be an application interface in an electronic device. The application interface of The user can adjust the specific position of the sub-interface 532 in the user interface 53 by pressing and dragging the sub-interface 532. As can be seen from the user interface 53, the sub-interface 532 may include an expansion control 5321, a minimize control 5322, and a close control 5323, wherein:
[0287] The minimization control 5322 can respond to user operations to cause the electronic device to collapse the sub-interface 532 and display it in the form of a capsule on the side of the screen.
[0288] The close control 5323 can respond to user operation to cause the electronic device to close the sub-interface 532.
[0289] The expansion control 5321 can respond to user operations to enable the electronic device to display the application in full screen. The interface of the sub-interface 532 is displayed in full screen. Fig.19 As shown in (C) of FIG. 4 , the electronic device may respond to the user's click operation on the expansion control 4824 by displaying the user interface 54. As can be seen from the user interface 54, the electronic device has now displayed the application in full screen. interface.
[0290] Optionally, after the user places the text 521 on the "map navigation" icon 522 and releases it, in response to the user operation, the electronic device may not display the following information: Fig.19 Instead of the user interface 53 shown in (C) in FIG. Fig.19 The user interface 54 shown in (D) directly displays the new application interface in full screen.
[0291] ④ After the cross-device transfer is completed, the snack bar is displayed in the original interface to prompt the user, and other devices are controlled to display the small application window or directly display the new application interface in full screen. Please refer to Fig. 20 .
[0292] It should be noted in advance that in the embodiments of the present application, after the electronic device establishes a communication connection with other smart devices, the electronic device can also perform cross-device transmission of information based on the "cross-application transmission interface" provided by the present application.
[0293] Fig. 20 The example shows the specific process of an electronic device using the "cross-application transmission interface" to send text information containing location information in WeChat to the vehicle-mounted terminal when a communication connection is established with the vehicle-mounted terminal, and using the vehicle-mounted terminal to navigate to the location information.
[0294] like Fig. 20 As shown, the electronic device 1900 has established a communication connection with the vehicle-mounted terminal through Bluetooth, Wi-Fi, etc. Among them, the electronic device 1900 can be an electronic device supporting the "cross-application transmission interface" interaction mode provided in the embodiment of the present application.
[0295] like Fig. 20 As shown in (A) in FIG. 1 , the user interface 55 is The user can long-press the text 551 to drag the text 551 containing the location information and drag it to the side of the electronic device screen; the electronic device 1900 can respond to the operation and display the following Fig. 20 The user interface 56 shown in (B) in FIG.
[0296] like Fig. 20 As shown in (B) in FIG. 5 , the specific functions of the elements included in the user interface 56 can refer to the aforementioned Fig.19 The relevant description of the user interface 52 in FIG. 5, wherein the text 561 corresponds to the aforementioned text 521, and the "driving navigation" icon 562 corresponds to the aforementioned "map navigation" icon 522. Among them, "driving navigation" is a vehicle navigation service provided by the electronic device 1900. After the electronic device 1900 establishes a communication connection with other vehicle terminals, such as the vehicle terminal 1901, the user can control the vehicle terminal to navigate through the "driving navigation" service provided by the electronic device 1900. Fig. 20 As shown in (B) in FIG. 1 , the user places the text 561 on the “driving navigation” icon 562 and then releases the text 561. The electronic device 1900 can respond to the user operation and display the following Fig. 20 The user interface 57 shown in (C) in FIG. 10 and the text 561 are transmitted to the vehicle terminal 1901 so that the vehicle terminal 1901 displays the following Fig. 20 User interface 58 shown in (D) in FIG.
[0297] like Fig. 20As shown in (C) in FIG. 5 , a snack bar 571 may be displayed below the user interface 57. Specifically, the snack bar 571 may be used to display a prompt message “Successfully opened, please go to the associated device to view”, which is used to prompt the user that the electronic device 1900 has successfully sent the text 561 containing the location information to the vehicle terminal 1901, and the vehicle terminal 1901 has opened the navigation application based on the received text 561 and navigated to the above location information.
[0298] like Fig. 20 As shown in (D) in FIG. 1 , the user interface 58 is a user interface displayed after the vehicle terminal 1901 receives the text transmitted by the electronic device 1900 based on the “cross-application transmission interface”. Specifically, the user interface 58 may be a navigation application (e.g. The user interface 58 may also display an information bar 582, which may be used to prompt the user of the source device of the location information and prompt the user to confirm whether to navigate to the location corresponding to the location information.
[0299] ⑤ If the information is not successfully transferred across devices, a toast feedback will be displayed in the original interface to prompt the user. Please refer to Fig.21 .
[0300] It should be understood that for the electronic device provided by this application, not every cross-application transmission of information using the "cross-application transmission interface" will be successful. For example, when the size of an information element exceeds the upper limit specified by the target application service, or the format of the information element does not comply with the regulations of the target application service, the information element cannot be transmitted to the target application service through the "cross-application transmission interface". In this case, the electronic device can display toast feedback in the interface to prompt the user that the information has not been successfully transmitted.
[0301] like Fig.21 As shown in (A) of FIG. 1 , user interface 60 is an application interface of the application "Album", which displays 11 images, image 601 to image 611. Among them, image 601 to image 610 are the images that have been selected by the user. The user can select any image among the 10 images (for example, Fig.21 The image 610 shown in (A) is long pressed and then dragged to the side, so that the electronic device displays the following Fig.21 The user interface 61 shown in (B) in FIG.
[0302] like Fig.21As shown in (B) in the figure, user interface 61 is the cross-application transmission interface. In user interface 61, image thumbnail set 612 is the thumbnail set formed after the user drags and pulls up images 601 to 610 in user interface 60. The number "10" displayed in the upper left corner indicates that the user has selected a total of 10 images. If the transmission is successful, the electronic device can display The contact interface of the application is used to allow the user to share all the images contained in the image thumbnail set 612 with their WeChat friends. However, since WeChat has a limit on the number of images that a user can send at a time (here it is assumed that the number does not exceed 9), and the image thumbnail set 612 contains a total of 10 images, which has exceeded the number limit specified by WeChat, the transmission process of image 601-image 610 through the "cross-application transmission interface" will not be successful. Therefore, after the user can press and hold the image thumbnail set 612 and drag it to the application service icon of "Friends WeChat" and then release it, in response to this operation, the electronic device can display the following Fig.21 The user interface 62 shown in (C) in FIG.
[0303] like Fig.21 As shown in (C) in the figure, toast feedback 621 may be displayed below the user interface 62. Specifically, toast feedback 621 may display a prompt message "The file has exceeded the transfer limit" to prompt the user that the number of files transferred exceeds the limit of the target application service, so the transfer process fails. The difference from the snack bar 421 mentioned in the above description is that toast feedback 621 generally does not display controls for interface jumps.
[0304] In addition, if the user does not perform any operation on the toast feedback 621, the toast feedback 621 may automatically disappear after being displayed for a period of time (e.g., 2s-3s); or, when the toast feedback 621 is still displayed in the user interface 62, the user may make the toast feedback 621 disappear through other locations in the electronic user interface 62 except the location where the toast feedback 621 is located.
[0305] In addition, when a user transmits information through the "cross-application transmission interface", the electronic device can recommend multiple application services that can receive the information to the user based on the information, and display the icons of these application services on the right side of the cross-application transmission interface. Specifically, the upper limit of the number of these application service icons can be 20; optionally, when the number of these application service icons exceeds a certain threshold (for example, 7), in order to ensure the neatness and visibility of the interface, the electronic device can only display a part of these application service icons (for example, 7) at the same time in the cross-application transmission interface when displaying; when the icons currently displayed on the cross-application transmission interface are not the application services expected by the user, the user can also place the dragged element in the blank space above or below the "cross-application transmission interface" icon area to enable the electronic device to update the icons in the icon area. For details, please refer to Fig. 22 .
[0306] like Fig. 22 As shown in (A) in the figure, the user interface 63 is a cross-application transmission interface for the user to transmit the image 631 across applications. In the icon area 632 in the user interface 63, there are seven icons, namely, an icon 6321 of "global collection", an icon 6322 of "search", an icon 6323 of "edit", an icon 6324 of "print", an icon 6325 of "friends WeChat", an icon 6326 of "scan", and an icon 6327 of "mail".
[0307] Assuming that the application services corresponding to the icons displayed in the user interface 63 are not the target application services of the user, then Fig. 22 In the user interface 64 shown in (B), the user can drag the image 631 to the bottom of the icon area 6321, and the electronic device can respond to the user operation by updating the icons in the icon area 632 (scrolling up to update) and displaying the following: Fig. 22 The user interface 65 shown in (C) in FIG.
[0308] like Fig. 22 As shown in (C) in the user interface 65, seven icons are also displayed in the icon area 632, namely, an icon 6322 for "search", an icon 6323 for "edit", an icon 6324 for "print", an icon 6325 for "friends WeChat", an icon 6326 for "scan", an icon 6327 for "mail", and an icon 6328 for "Taobao". Fig. 22It can be seen from the user interface 63 shown in (A) that the “Global Favorites” icon 6321 originally displayed at the top of the icon area 632 is no longer displayed in the user interface 65 due to the update, and compared with the user interface 63, in the user interface 65, the original “Search” icon 6322, “Edit” icon 6323, “Print” icon 6324, “Friends WeChat” icon 6325, “Scan” icon 6326 and “Mail” icon 6327 are all moved up one position, and the bottom position is the newly displayed icon, namely the “Taobao” icon 6328.
[0309] Similarly, if Fig. 22 As shown in the user interface 66 shown in (D), the user can also drag the image 631 to the top of the icon area 6321, and the electronic device can respond to the user operation, update the icons in the icon area 632 (scroll down to update), and display the following Fig. 22 The user interface 67 shown in (E) in FIG.
[0310] like Fig. 22 As shown in (E) in the user interface 67, seven icons are also displayed in the icon area 632, namely, a "print" icon, a "global collection" icon 6321, a "search" icon 6322, an "edit" icon 6323, a "print" icon 6324, a "friend WeChat" icon 6325, and a "scan" icon 6326. Fig. 22 It can be seen from the user interface 63 shown in (A) that the “Mail” icon 6327 originally displayed at the bottom of the icon area 632 is no longer displayed in the user interface 65 due to the update, and compared with the user interface 63, in the user interface 65, the original “Global Favorites” icon 6321, “Search” icon 6322, “Edit” icon 6323, “Print” icon 6324, “Friends WeChat” icon 6325 and “Scan” icon 6326 have all moved down one position, and the top position is the newly displayed icon, namely the “Notes” icon 6329.
[0311] In addition, in some embodiments, the electronic device may also divide the icon area into two parts, one part of which is used to display fixed icons, and the other part of which is used to display icons that the electronic device recommends to the user. Specifically, for this part of the icons that the electronic device recommends to the user, the electronic device may first identify the dragged information element, and obtain application service icons that meet the user's needs in the cross-application transmission interface based on the identification result. That is, when the user drags up two elements successively, even if the two elements are elements of the same type (for example, both are text or both are images), if the two elements contain different contents (for example, different image contents or different characters in the text), then in the two user interfaces of the "cross-application transmission interface" displayed by the electronic device based on the two elements, the icons in the icon area of each user interface may also be different; it should be understood that the "different" mentioned here may include different types of icons and different icon orders. In an embodiment of the present application, the electronic device may display the icons that are more in line with the user's current needs at the top of the icon area. For details, please refer to Figure 23-Figure 26 .
[0312] Fig.23 A schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on location information contained in text provided in an embodiment of the present application.
[0313] like Fig.23 As shown in (A) in FIG. 1 , the user interface 68 is The chat interface of the application. The user can long press the text 681 to drag up the text 681 containing the location information. After the user drags up the text 681, the electronic device can respond to the operation and identify the text information; after the electronic device recognizes that the text 681 contains location information, the electronic device determines based on the location information that the user currently has the intention to travel to the location. At this time, the electronic device will recommend corresponding application services to the user based on the user's intention, and in the subsequent "cross-application transmission interface" interface, the icons of the application services recommended to the user are displayed in the icon area, and are sorted according to the application services. The icons corresponding to the application services that are more in line with the current user's intention will be located higher in the icon area.
[0314] like Fig.23 As shown in (A) in FIG. 1 , when the user drags the text 681 and drags it to the side of the electronic screen, the electronic device can respond to the operation and display the following Fig.23 The user interface 69 shown in (B) in FIG.
[0315] like Fig.23As shown in (B) in the figure, user interface 69 is a cross-application transmission interface. In user interface 69, text 691 is the text obtained by reducing text 681, and the icon area on the right can be divided into a fixed icon area 692 and a recommended icon area 693, and a separator line 694 can be used to distinguish the two areas; wherein:
[0316] The fixed icon area 692 may include a "global collection" icon 6921 and a "search" icon 6922. It is understandable that no matter what element the user shares based on the electronic device, the electronic device will display the cross-application transmission interface based on the element and the fixed icon area 692 will be displayed, and the icons contained therein are the "global collection" icon 6921 and the "search" icon 6922.
[0317] The recommended icon area 693 may include an icon 6931 for "map navigation", an icon 6932 for "one-click taxi", an icon 6933 for "driving navigation", an icon 6934 for "WeChat", and an icon 6935 for "memo". The icon 6931 for "map navigation" can be used to open the map software in the electronic device to navigate to the location and enter the navigation application interface; the icon 6932 for "one-click taxi" can be used to enter the application interface of the taxi service based on the taxi service provided by the map software; the icon 6933 for "driving navigation" is mainly used to transmit the above location information across devices to the vehicle terminal connected to the electronic device for communication. For details, please refer to the aforementioned Fig. 20 It is understandable that because the text information 681 includes location information, the electronic device can determine that the user currently has the intention to go to the location based on the location information. Therefore, in the recommended icon area 693, the "map navigation" icon 6931, the "one-click taxi" icon 6932, and the "driving navigation" icon 6933 are displayed at the upper position of the recommended icon area 693 because they best meet the current user's intention, so as to facilitate the user to make a selection.
[0318] Fig.24 A schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on information such as time and location contained in a text provided in an embodiment of the present application.
[0319] like Fig.24As shown in (A), user interface 70 is the application interface of the application "browser". The user can long press text 701 to drag up text 701 containing location information. After the user drags up text 701, the electronic device can respond to the operation and identify the text information; after the electronic device recognizes that text 701 contains time and location information, the electronic device determines that the text information may contain specific schedule information based on the time and location information. At this time, the electronic device will recommend corresponding application services to the user based on the user's intention, and in the subsequent "cross-application transmission interface" interface, the icons of the application services recommended to the user are displayed in the icon area, and the application services are sorted according to the order. The icons corresponding to the application services that are more in line with the current user's intention will be located higher in the icon area.
[0320] like Fig.24 As shown in (A) in FIG. 1 , when the user drags the text 701 and drags it to the side of the electronic screen, the electronic device can respond to the operation and display the following Fig.24 The user interface 71 shown in (B) in FIG.
[0321] like Fig.24 As shown in (B) in the figure, user interface 71 is a cross-application transmission interface. In user interface 71, text 711 is the text obtained by reducing text 711, and the icon area on the right can be divided into a fixed icon area 712 and a recommended icon area 713, and a separator line 714 can be used to distinguish between the two areas; wherein:
[0322] The fixed icon area 712 may include a "global collection" icon 7121 and a "search" icon 7122. It is understandable that no matter what element the user shares based on the electronic device, the electronic device will display the cross-application transmission interface based on the element and the fixed icon area 712 will be displayed, and the icons contained therein are the "global collection" icon 7121 and the "search" icon 7122.
[0323] The recommended icon area 713 may include a "share" icon 7131, a "schedule" icon 7132, a "friend WeChat" icon 7133, a "print" icon 7134, and a "translation" icon 7135. The "share" icon 7131 may be used to share the text 701 to other devices via Bluetooth, email, etc. based on the sharing service provided by the electronic device; the "schedule" icon 7132 is mainly used to add the time and location information in the text 701 to the schedule; and the "friend WeChat" icon 7133 may be used to send the text 701 to WeChat friends via the WeChat chat interface. It is understandable that because the text 701 contains time and location information, the electronic device can determine that the text information may contain specific schedule information based on the time and location information, and the user currently has the intention to share or add the schedule. Therefore, in the recommended icon area 713, the "Share" icon 7131, the "Schedule" icon 7132, and the "Friend WeChat" icon 7133 are displayed in the upper position of the recommended icon area 713 because they best meet the current user's intention, so that the user can make a selection.
[0324] Fig.25 A schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on a QR code image contained in an image provided in an embodiment of the present application.
[0325] like Fig.25 As shown in (A) of FIG. 1 , the user interface 72 is the interface of the application "browser". The user can long press the image 721 to display the QR code image 7211 ( Fig.25 The QR code image 7211 shown in the figure is only for ease of understanding. It can be expressed in other forms in actual application scenarios, and this application does not limit it). After the user drags up image 721, the electronic device can respond to the operation and identify image 721; after the electronic device recognizes that image 721 contains a QR code image, the electronic device determines based on the QR code image that the user is likely to need to scan the QR code in image 721 at this time. At this time, the electronic device will recommend corresponding application services to the user based on the user's intention, and in the subsequent "cross-application transmission interface" interface, the icons of the application services recommended to the user are displayed in the icon area, and according to the application service sorting, the icons corresponding to the application services that are more in line with the current user's intention will be located higher in the icon area.
[0326] like Fig.25 As shown in (A) in FIG. 1 , when the user drags the image 721 and drags it to the side of the electronic screen, the electronic device can respond to the operation and display the following Fig.25 The user interface 73 shown in (B) in FIG.
[0327] like Fig.25 As shown in (B) in the figure, user interface 73 is a cross-application transmission interface. In user interface 73, image 731 is an image obtained by reducing image 721, and the icon area on the right can be divided into a fixed icon area 732 and a recommended icon area 733, and a separator line 734 can be used to distinguish between the two areas; wherein:
[0328] The specific functions of the fixed icon area 732 can refer to the above-mentioned related description of the fixed icon area 712, which will not be repeated here.
[0329] The recommended icon area 733 may include a "Scan Camera" icon 7331, a "Print" icon 7332, a "Share" icon 7333, a "Friends WeChat" icon 7334, and an "Album" icon 7335. The "Scan Camera" icon 7331 may be used to scan an image 731 based on a "Scan" service provided by the "Camera" application; the "Print" icon 7332 is mainly used to send the image 731 to a printing device for printing; and the "Share" icon 7333 may be used to share the image 731 with other devices via Bluetooth, email, etc. based on a sharing service provided by an electronic device. It is understandable that because image 721 contains a QR code, the electronic device can determine based on the QR code image that the user may need to scan the image, or the user wants to print or share the image. Therefore, in the recommended icon area 733, the "Scan Camera" icon 7331, the "Print" icon 7332, and the "Share" icon 7333 are displayed in the upper position of the recommended icon area 733 because they best meet the current user's intentions, so as to facilitate user selection.
[0330] Fig.26 A schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on a facial image contained in an image provided in an embodiment of the present application.
[0331] like Fig.26 As shown in (A) in the figure, user interface 74 is the interface of the "Camera" application. The user can long-press image 741 to drag up image 741 containing a face image. After the user drags up image 741, the electronic device can respond to the operation and identify image 741; after the electronic device recognizes that image 741 contains a face image, the electronic device can determine based on the face image that the user is likely to beautify image 741 or share it to social software at this time. At this time, the electronic device will recommend corresponding application services to the user based on the user's intention, and in the subsequent "Cross-Application Transfer Interface" interface, the icons of the application services recommended to the user are displayed in the icon area, and are sorted according to the application services. The icons corresponding to the application services that are more in line with the current user's intention will be located higher in the icon area.
[0332] like Fig.26 As shown in (A) in FIG. 1 , when the user drags the image 741 and drags it to the side of the electronic screen, the electronic device can respond to the operation and display the following Fig.26 The user interface 75 shown in (B) in FIG.
[0333] like Fig.26 As shown in (B) in the figure, user interface 75 is a cross-application transmission interface. In user interface 75, image 751 is an image obtained by reducing image 751, and the icon area on the right can be divided into a fixed icon area 752 and a recommended icon area 753, and a separator line 754 can be used to distinguish between the two areas; wherein:
[0334] The specific functions of the fixed icon area 752 can refer to the aforementioned related description of the fixed icon area 712, which will not be repeated here.
[0335] The recommended icon area 753 may include an icon 7531 of "Meitu", an icon 7532 of "Friends Circle", an icon 7533 of "QQ Space", an icon 7534 of "Friends WeChat", and an icon 7535 of "Share". Among them, the icon 7531 of "Meitu" can be used to beautify the image 751; the icon 7532 of "Friends Circle" is mainly used to share the image 751 to the WeChat Friends Circle; and the icon 7533 of "QQ" can be used to share the image 751 to the QQ Space. It can be understood that because the image 751 includes a QR code, the electronic device can determine that the user may need to beautify the image 741 or share it to social software based on the face image, so in the recommended icon area 753, the icon 7531 of "Meitu", the icon 7532 of "Friends Circle", and the icon 7533 of "QQ Space" are displayed at the upper position of the recommended icon area 753 because they are most in line with the current user's intention, so as to facilitate the user to select.
[0336] In some embodiments, the icon area in the cross-application transmission interface can be used to display thumbnails of application interfaces of applications running in the background of the electronic device in addition to the icons of application services. When the user drops the dragged information element on the thumbnail and lets go, the information element will be transferred to the application interface corresponding to the thumbnail. For details, please refer to Fig. 27 .
[0337] like Fig. 27 As shown in (A) in FIG. 1 , the user interface 76 is The user slides upward at the lower border of the electronic device screen; the electronic device can respond to the operation and display the following Fig. 27 User interface 77 shown in (B) in FIG.
[0338] like Fig. 27 As shown in (B) in FIG. 1 , the user interface 77 is an application navigation interface, in which the application interface thumbnails of all applications currently opened by the electronic device can be displayed, wherein the application interface thumbnail 771 is The application interface thumbnail 772 is a thumbnail of the web browsing interface in the application "browser". The application corresponding to the application interface displayed by the electronic device is called the foreground application, and the application that has been opened but has not displayed the application interface on the electronic screen is called the background application. In the user interface 77, the user can click on any application interface thumbnail displayed in the user interface 77 to switch the application corresponding to the application interface thumbnail to the foreground application and display the application interface thumbnail in full screen on the screen. Fig. 27 As shown in (B) in FIG. 1 , the user can click on the application interface thumbnail 772 to switch the electronic device to the foreground application of the application "browser". It should be understood that at this time, the application It is not closed, it will run in the background. When the user opens the application through the application navigation interface When switching to the foreground application, the electronic device will still display the user interface 76 on the screen. In response to the user operation of switching the application "browser" to the foreground application, the electronic device can display the following Fig. 27 User interface 78 shown in (C) .
[0339] like Fig. 27 As shown in (C) in FIG. 1 , the user interface 78 may be an application interface of a “browser” application in an electronic device. The user may long-press and drag an image 781 in the user interface 78 to cause the electronic device to display a browser as shown in FIG. Fig. 27 User interface 79 shown in (D) in FIG.
[0340] like Fig. 27 As shown in (D) in FIG. 7 , user interface 79 may include sub-interface 791, image 792, application interface thumbnail 793, and text description 794. Image 792 is a thumbnail obtained by reducing image 781, and text description 794 may be used to explain to the user the application and contact corresponding to application interface thumbnail 793. Application interface thumbnail 793 is the thumbnail of user interface 76. When the user drags image 792 onto application interface thumbnail 793 and releases it, the electronic device may respond to the user operation by displaying the following information: Fig. 27 The user interface 80 shown in (E) in FIG.
[0341] like Fig. 27As shown in (E) in the figure, the user interface 80 may be a chat interface of a friend (Xiao Ming) of the "WeChat" application. It can be seen from the user interface 80 that the user has sent the image 781 obtained from the application "browser" to the WeChat friend "Xiao Ming". That is, when the user drags the image 792 in the user interface 79 to the application interface thumbnail 793 and lets go, the user does not need to perform other operations, and the electronic device can spontaneously send the image 792 (or image 781) to the WeChat friend Xiao Ming.
[0342] Need to understand, Fig. 27 The user interface provided in the embodiment of the present application is only exemplified and should not be construed as limiting the embodiment of the present application. Background applications such as can also be displayed in the cross-application transmission interface, and this application does not limit this.
[0343] In addition, in some embodiments, after the user drags up the information element, the electronic device can directly call out the side application bar and display the corresponding application service icon for the user in the side application bar. Figure 28-Figure 29 Provide explanation.
[0344] Fig.28 Two different methods for bringing up the side application bar of an electronic device are shown.
[0345] First, the user can bring up the side application bar of the electronic device by conventionally swiping inward on the side of the screen.
[0346] like Fig.28 As shown in (A) in FIG. 1 , the user interface 81 may be an application interface of an application “browser” in an electronic device, or an application The application interface may also be the application interface of other applications, which is not limited in this application. The user can call out the icon 811 of the application bar on the side of the electronic device by sliding leftward from the right side of the screen (without releasing the hand at this time); then, if the user releases the hand, the electronic device can respond to the operation and display the following Fig.28 The user interface 82 shown in (B).
[0347] like Fig.28 As shown in (B) in FIG. 8 , a side application bar 821 may be displayed in the user interface 82. The side application bar 821 may display one or more application icons added to the side application bar 821 by the user, for example Fig.28 As shown in (B) Icon 8211, The user can also continue to add other application icons to the side application bar 821 through the application list control 8213. Any of the icons can respond to user operations to enable the electronic device to open the corresponding application. When the user opens another application through the side application bar 821 in the current application interface, the electronic device can display the two application interfaces in split screens. The user can transfer information elements provided by one application to another application based on the two interfaces (for details, please refer to the aforementioned Figure 2 This is the “smart multi-window function” provided by electronic devices.
[0348] Secondly, users can call out the side application bar of the electronic device by long pressing and dragging the information elements in the interface.
[0349] like Fig.28 As shown in (C) in FIG. 1 , the user interface 83 may be an application interface of an application “browser” in an electronic device, or an application The user interface 83 may be an application interface of another application, which is not limited in this application; specifically, the user interface 83 may be the same interface as the user interface 81 in the above description. The user can long press the text 831 that the user has selected in the user interface 83 to drag the text 831 up; after the user drags the text 831 up (without dragging it to the side), the electronic device can respond to the operation and display the following Fig.28 The user interface 84 shown in (D).
[0350] like Fig.28 As shown in (D) in the figure, the user interface 84 may display text 842 and a side application bar 821. The text 842 is the text obtained by dragging and shrinking the text 831. The side application bar 841 may include an application list control 8414 and two areas, a smart flow icon area 8411 and a smart multi-window icon area 8412. The two areas may be separated by a separator line 8413, wherein:
[0351] The smart flow icon area 8411 can display multiple application service icons. It should be understood that the icons displayed in the smart flow icon area 8411 can be used to transfer the elements dragged by the user (i.e., text 842) across applications without the need for the split-screen function provided by the electronic device. This transmission method and the transmission method through the "cross-application transmission interface" user and interface in the aforementioned embodiment can be referred to as the "smart flow" function of the electronic device in this application. Optionally, the icons displayed in the smart flow icon area 8411 may also include fixed display icons set by the user and icons recommended and displayed to the user by the electronic device based on the content in the text 842. For example, in Fig.28Among the “Global Favorites” icon 84111, the “Search” icon 84112, the “Schedule” icon 84113, and the “Memo” icon 84114 shown in (D), the “Global Favorites” icon 84111 and the “Search” icon 84112 may be fixedly displayed icons, while the “Schedule” icon 84113 and the “Memo” icon 84114 may be icons that the electronic device recommends to the user based on the content in the text 842.
[0352] The smart multi-window icon area 8412 may display one or more application icons. Fig.28 All or part of the icons contained in the side application bar 821 in the user interface 82 shown in (B). Unlike the smart flow icon area 8411, the icons in this area cannot be used to transfer the text 842 across applications, and are only displayed in the user interface 84. In addition, if the electronic device recommends more than a certain number of application service icons for the text 842, the side application bar can give priority to displaying the application service icons recommended by the electronic device for the text 842, and the smart multi-window icon area 8412 and the application icons contained therein are no longer displayed.
[0353] The application list control 8414 can be used to display icons that can be added to the side application bar 841, including application service icons that can be added to the fixed display in the smart flow icon area 8411, and application icons that can be added to the smart multi-window icon area 8412. For details, please refer to Fig.29 .
[0354] Fig.29 The specific process of a user adding an icon to the side application bar is shown.
[0355] In response to a user clicking an application list control in the side application bar (eg, application list control 8213 or application list control 8414 in the foregoing description), the electronic device may display a Fig.29 The user interface 8A shown in (A) in FIG. The user interface 8A may include a side application bar 8A1 and an icon display interface 8A2, wherein:
[0356] The side application bar 8A1 may include a smart flow icon area 8A11, a smart multi-window icon area 8A12, and an adding control 8A13 for adding icons to the icons in the side application bar 8A1.
[0357] The icon display interface 8A2 may display a smart multi-window icon display area 8A21 and a smart flow icon display area 8A22. It is understandable that the icons in the smart multi-window icon display area 8A21 may be added to the smart multi-window icon area 8A12 in the side application bar 8A1; the icons in the smart flow icon display area 8A22 may be added to the smart flow icon area in the side application bar 8A1.
[0358] like Fig.29 As shown in (A) in FIG. 1 , in response to the electronic device clicking the add control 8A11, the electronic device may display the following Fig.29 As shown in the user interface 8B, a symbol to be added is displayed in the upper right corner of each icon displayed in the icon display interface 8B2, and the smart flow icon area 8B11 and the smart multi-window icon area 8B12 in the side application bar 8B1 are both displayed with blank spaces for storing icons newly added by the user.
[0359] Specifically, the user can click on any icon in the smart multi-window icon display area 8B21 or the smart flow icon display area 8B22 to add the icon to the blank icon position of the smart flow icon area 8B11 or the smart multi-window icon area 8B12. For example, the user can click on the "memo" icon in the smart multi-window icon display area 8B21 to add it to the blank position 8B121 in the smart multi-window icon area 8B12, or the user can click on the "scan camera" icon in the smart flow icon display area 8B22 to add it to the blank position 8B111 in the smart flow icon area 8B11. Afterwards, the user can click on the confirmation control 8B14 in the side application bar 8B1, and the electronic device can save the icon option added by the user, and the newly added icon will be displayed in the side application bar when the side application bar is displayed next time.
[0360] At present, most smart devices also provide users with a quick screen recording function. For example, in some scenarios, users can double-click the screen with two knuckles to record the current interface demonstration process of the electronic device. Fig.30 This section describes the process of using the cross-application transmission interface to transmit recorded videos across applications in a screen recording scenario.
[0361] Fig.30 This is a schematic diagram of the interface change process of the electronic device when the user transfers the recorded video across applications based on the cross-application transmission interface.
[0362] like Fig.30As shown in (A) in FIG. 1 , the user interface 85 may be an application interface of an application “browser” in an electronic device, or an application The application interface may also be the application interface of other applications, which is not limited in this application. At this time, the user has turned on the screen recording function of the electronic device through relevant operations. In the user interface 85, the screen recording function box may include a microphone control 8511, a time control 8512, and an option control 8513, wherein;
[0363] The microphone control 8511 can respond to user operations to enable the electronic device to start / stop recording external sounds;
[0364] The time control 8512 can be used to display the duration of the recording in real time, and it can also respond to user operations to stop the electronic device from recording the screen;
[0365] The option control 8513 can respond to user operations to enable the electronic device to display more screen recording setting options, such as whether to record the user's operation trajectory on the screen.
[0366] For example Fig.30 As shown in (A) in FIG. 8 , in response to a user clicking on the time control 8512, the electronic device may stop the screen recording process and display the following Fig.30 The user interface 86 shown in (B) in FIG.
[0367] like Fig.30 As shown in (B) in FIG. 8 , the user interface 86 may include a video file 861. The video file 861 is a video recorded by the electronic device in response to the user's screen recording operation. After the screen is recorded, the video file 861 may be displayed in the user interface 86 and generally lasts for two to three seconds, so that the user can directly click on the video file 861 to edit, save, etc. the video file; if the user does not operate the video file 861, the electronic device may automatically save it to the album.
[0368] In the embodiment of the present application, during the time when the electronic device displays the video file 861 in the user interface 86, the user can long press the video file 861, drag it to the side of the electronic device screen, and then transfer it across applications through the "cross-application transfer interface". Fig.30 As shown in (B) in FIG. 1 , the electronic device may respond to the user's operation of long pressing and dragging the video file 861 to the side, and display the following Fig.30 User interface 87 shown in (C) .
[0369] like Fig.30 As shown in (C) in FIG. 8 , the user interface 87 is the cross-application transmission interface. The user interface 87 may include a sub-interface 871, an icon area 872, and a video file 873, wherein:
[0370] The specific content and functions of the sub-interface 871 and the icon area 872 can be referred to the above description and will not be repeated here.
[0371] Similarly, in order to avoid excessive occlusion of the icon area 872 , when the video file 861 is close to the icon area, the electronic device shrinks the original video file 861 to obtain a video file 873 .
[0372] Similarly, in the user interface 87, when the user places the video file 873 on the corresponding icon in the icon area 872 and lets go, the electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation and display the corresponding application interface.
[0373] In addition, after the user uses the quick screenshot function to capture an image of the electronic device, the user can also edit the captured image and use the "cross-application transfer interface" on the editing page to transfer the edited image. For details, please refer to Fig.31 .
[0374] like Fig.31 As shown in (A) in FIG. 1 , the user interface 88 may be an application interface of an application “browser” in an electronic device, or an application In response to the user's quick screenshot operation on the user interface 88, for example Fig.31 By performing the double-click operation of the knuckle as shown in (A) in FIG. 1 , the electronic device can quickly obtain a full-screen image of the user interface 88 and display the image as shown in FIG. Fig.31 User interface 89 shown in (B) .
[0375] like Fig.31 As shown in (B) in FIG. 8 , the user interface 89 may include a screenshot image 891. The screenshot image 891 is an image obtained by the electronic device in response to the user taking a knuckle screenshot of the user interface 88. After the screenshot is taken, the screenshot image 891 may be displayed in the user interface 89 and generally lasts for two to three seconds, so that the user can directly click on the screenshot image 891 to edit, save, etc. the screenshot image; if the user does not operate the screenshot image 891, the electronic device may automatically save it to the album.
[0376] In the embodiment of the present application, during the time period when the electronic device displays the screenshot image 891 in the user interface 89, the electronic device may respond to the following Fig.31 The user clicks on the screenshot image 891 as shown in (B) in FIG. Fig.31The user interface 90 shown in (C) in FIG. The user interface 90 is an editing interface of the screenshot image 891, which may include a thumbnail 901 and a doodle option 902, wherein:
[0377] Thumbnail 901 may be a thumbnail of the aforementioned user interface 88 .
[0378] The graffiti option 902 may respond to a user operation, so that the electronic device responds to the user's touch operation on the screen and draws the user's touch track on the screen onto the thumbnail 901 .
[0379] like Fig.31 As shown in (C) in the figure, users can follow Fig.31 The electronic device may respond to the user operation (in the embodiment of the present application, the operation may be referred to as the "eighth operation") by drawing the track shown by the dotted line with a direction on the thumbnail 901 and displaying the track shown by the dotted line with a direction on the thumbnail 901. Fig.31 Optionally, in the user interface 90, the image contained in the thumbnail 901 can also be long-pressed and dragged up by the user to make the electronic device display the cross-application transmission interface provided by the present application, and transmit based on the cross-application transmission interface; when the user clicks the text recognition control in the user interface 90, the electronic device can also recognize the text contained in the image 901, and the text can also be long-pressed and dragged up by the user to make the electronic device display the cross-application transmission interface provided by the present application, and transmit based on the cross-application transmission interface. For details, please refer to the aforementioned Figure 7 and Figure 8 The relevant instructions will not be repeated here.
[0380] like Fig.31 As shown in (D) in FIG. 9 , in the user interface 91 , a triangle pattern 911 drawn by the user is already displayed on the thumbnail 901 .
[0381] It can be understood that the user interface 91 is still an image editing interface. In the user interface 91, the user can also long-press the thumbnail 901, drag it to the side of the electronic device screen, and transfer it across applications through the "cross-application transfer interface". Fig.31 As shown in (D) in FIG. 1 , the electronic device may respond to the user's long pressing and dragging operation of the thumbnail 901 (at this time, the thumbnail 901 already has a pattern drawn by the user, that is, a triangle pattern 911) to the side, and display the following Fig.31 User interface 92 shown in (E) in FIG.
[0382] like Fig.31As shown in (E) in FIG. 1 , the user interface 92 is the cross-application transmission interface. The user interface 92 may include a sub-interface 921, an icon area 922, and an image 923, wherein:
[0383] The specific content and functions of the sub-interface 921 and the icon area 922 can be referred to the above description and will not be repeated here.
[0384] Similarly, in order to avoid excessive occlusion of the icon area 922, when the thumbnail 901 is close to the icon area, the electronic device further reduces the original thumbnail 901 to obtain an image 923 (the image 923 also contains a pattern drawn by the user, namely, a triangle pattern 911).
[0385] Similarly, in the user interface 92, when the user places the image 923 on the corresponding icon in the icon area 922 and releases it, the electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation and display the corresponding application interface.
[0386] In the embodiment of the present application, user interface 88 may be referred to as the "fifth interface", user interface 89 may be referred to as the "sixth interface", user interface 91 may be referred to as the "seventh interface", user interface 90 may be referred to as the "editing interface", image 891 and image 901 may be referred to as the "first image", user interface 95 may be referred to as the "seventh interface", and the user clicks on the screenshot image 891, and the user may click on the screenshot image 891. Fig.31 The operation of graffiti on thumbnail 901 along the trajectory indicated by the directional dotted line shown in (D) and the operation of the user long pressing thumbnail 901 and dragging it to the side of the electronic device screen can be collectively referred to as the "eighth operation".
[0387] In addition, in some embodiments, the electronic device also provides the user with a long screenshot function. Long screenshot, also known as scrolling screenshot, is an effective method to capture the current content of the interface, which can obtain all the content in the interface, rather than just capturing the visible part. It can be widely used in web browsing scenarios, and is very useful for investigating web information or collecting materials. In general, the process of scrolling screenshot is to first scroll the web page using the scrolling function, and continuously capture the web page content. After the web page content is captured, the program will automatically combine all the content together to form a complete long picture. The "cross-application transmission interface" provided in this application is also applicable to images captured by users through the long screenshot function. For details, please refer to Fig.32 .
[0388] like Fig.32 As shown in (A) in Fig.32As shown in (A) in FIG. 1 , the user interface 93 may be an application interface of an application “browser” in an electronic device, or an application In response to the user's long screenshot operation on the user interface 93, for example Fig.32 As shown in (A) of the figure, the user taps the screen to draw an "S" shape. The electronic device can quickly scroll the web page and continuously capture the web page content. When the user taps the screen again ( Fig.32 (A) in the figure does not show this operation), which means that the webpage content required by the user has been intercepted. After that, the electronic device will combine all the intercepted content together to form a complete long picture and display it as follows: Fig.32 User interface 94 shown in (B) in FIG.
[0389] like Fig.32 As shown in (B) in FIG. 1 , the user interface 94 may include a long screenshot image 941. The long screenshot image 941 is an image obtained by the electronic device in response to the user performing a long screenshot operation on the user interface 93. After the long screenshot, the user can edit, save, and perform other operations on the long screenshot image 941 through relevant editing options in the user interface 94.
[0390] In the embodiment of the present application, the electronic device may also respond to the following Fig.32 The user long presses and drags the long screenshot image 941 to the side as shown in (B) in FIG. Fig.32 User interface 95 shown in (C) in FIG.
[0391] like Fig.32 As shown in (C) in FIG. 1 , the user interface 95 is the cross-application transmission interface. The user interface 95 may include a sub-interface 951, an icon area 952, and an image 953, wherein:
[0392] The specific content and functions of the sub-interface 951 and the icon area 952 can be referred to the above description and will not be repeated here.
[0393] Similarly, in order to avoid excessive occlusion of the icon area 952 , when the long screenshot image 941 is close to the icon area, the electronic device shrinks it to obtain image 953 .
[0394] Similarly, in the user interface 95, when the user places the image 953 on the corresponding icon in the icon area 952 and releases it, the electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation and display the corresponding application interface.
[0395] Optionally, when the size of the long screenshot image 941 exceeds the upper limit specified by the application service, or the format of the long screenshot image 941 does not comply with the requirements of the target application service, the long screenshot image 941 cannot be transmitted to the target application service through the "cross-application transmission interface". In this case, the electronic device can also display toast feedback in the interface to prompt the user that the information has not been successfully transmitted.
[0396] For example, when the transmission of the long screenshot image 941 fails, the electronic device can Fig.32 The user interface 96 shown in (D) in FIG. 9A . A toast feedback 961 may be displayed below the user interface 96. Specifically, the toast feedback 961 may display a prompt message "The image exceeds the upper limit of the smart stream transmission, please crop it before transmitting." to prompt the user that the transmitted image exceeds the limit of the target application service, so the transmission process fails.
[0397] Similarly, if the user does not perform any operation on toast feedback 961, toast feedback 961 may automatically disappear after being displayed for a period of time (e.g., 2s-3s); or, when toast feedback is still displayed in user interface 96, the user may make toast feedback 961 disappear through other locations in electronic user interface 96 except for the location where toast feedback 961 is located.
[0398] In an embodiment of the present application, user interface 93 can be called the "fifth interface", user interface 94 can be called the "sixth interface", long screenshot image 941 or image 953 can be called the "first image", user interface 95 can be called the "seventh interface", and the operation of the user placing image 953 on the corresponding icon in the icon area 952 and releasing it can be called the "ninth operation".
[0399] The following introduces the system setting interface involved in the "Smart Flow" function.
[0400] First combine Fig.33 Introduce the user interface involved in enabling the "smart flow" function of electronic devices.
[0401] like Fig.33 As shown in (A) in the figure, the user interface 97 may be a navigation interface displayed by the electronic device to the user when the user first turns on the electronic device after the electronic device leaves the factory. In the user interface 97, the smart flow service tab 971 may include a switch control 9711, which may be set to an on state by default, that is, the electronic device has turned on the "smart flow" function by default. Of course, the user can also turn off the "smart flow" function of the electronic device by clicking the switch control 9711.
[0402] In addition, during the daily use of electronic devices, users can also turn on or off the "Smart Flow" function through the relevant interface in the electronic device system settings. Fig.33 As shown in (B) in the figure, the user can open the "Smart Flow" setting interface in the system settings, that is, the user interface 98, and turn on or off the "Smart Flow" function by manipulating the switch control 9811 in the "Smart Flow" tab 981. If the switch control 9711 is displayed as off at this time, the user can turn on the "Smart Flow" function by clicking the switch control 9811, and the electronic device will also respond to the user operation and display the following Fig.33 User interface 99 shown in (C).
[0403] like Fig.33 As shown in (C), the user interface 99 may include a prompt box 991, which may be used to ask the user whether to agree to open the electronic device screen to "Smart Flow". The prompt box 991 may include an "Allow all the time" option 9911, an "Allow only during use" option 9912, and a "Prohibit" option 9913. When the user clicks the "Allow all the time" option 9911 or the "Allow only during use" option 9912, the electronic device can successfully enable the "Smart Flow" function; when the user clicks the "Prohibit" option 9913, the electronic device will not be able to enable the "Smart Flow" function.
[0404] Fig.34 Some system setting interfaces are shown for understanding the "Smart Flow" function and editing the application service icons in the Smart Flow page.
[0405] like Fig.34 As shown in (A) in FIG. 1 , the user interface 00 is an interface related to the “Smart Assistant” function in the “System Settings” of the electronic device. In the user interface 00, the user can click the “Smart Flow” tab to make the electronic device display the following Fig.34 The user interface 38 shown in (B) in FIG.
[0406] like Fig.34 As shown in (B) in FIG. 3 , the user interface 38 and the user interface 98 in the above description may be the same user interface. In the user interface 38, a “Learn Details” control 381 and a “Customize Service” tab 382 may be displayed, wherein:
[0407] The “Learn Details” control 381 can respond to a click operation by the user to cause the electronic device to display the following information: Fig.34 The user interface 39 shown in (C) in FIG. 3 is a user interface provided by the system setting, which can be used to show the user the specific role and specific operation steps of the "smart flow" function.
[0408] The "Customized Services" tab 382 can respond to a click operation by the user to cause the electronic device to display a Fig.34 The user interface 40 shown in (D) in FIG. In combination with the above description, it can be seen that among the icons displayed in the cross-application transmission interface, some icons are user-defined and fixedly displayed in the icon area, while the other icons are icons recommended to the user by the electronic device based on the elements dragged by the user. Therefore, in the user interface 40, the icons displayed in the icon display card 401 are the icons that the user has determined to be fixedly displayed in the icon area, while the icons displayed in the icon display card 402 are the icons that the user has not set to be fixedly displayed in the icon area. The user can click the removal symbol "-" in the upper right corner of any icon in the icon display card 401 to make the icon no longer fixedly displayed in the icon area of the cross-application transmission interface; similarly, the user can click the addition symbol "+" in the upper right corner of any icon in the icon display card 402 to make the icon fixedly displayed in the icon area of the cross-application transmission interface (after being added, the icon will also be displayed in the blank icon area of the icon display card 401, such as 4011).
[0409] Need to understand, Figure 33-Figure 34 The user interface related to "system settings" provided in the embodiment of the present application is only exemplified, and it should not constitute a limitation on the embodiment of the present application. For example, for the icon display card 402, it can contain more or fewer application service icons, and the present application does not limit this.
[0410] Next, the electronic device provided by this application is introduced.
[0411] The electronic device may be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA) or a dedicated camera (such as a SLR camera, a card camera), etc. The present application does not impose any restrictions on the specific type of the electronic device.
[0412] Fig.35 The structure of the electronic device is exemplarily shown.
[0413] like Fig.35As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 151, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0414] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0415] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0416] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0417] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0418] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0419] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the electronic device 100.
[0420] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.
[0421] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0422] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.
[0423] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.
[0424] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0425] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.
[0426] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0427] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.
[0428] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 151, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0429] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0430] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0431] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0432] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0433] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0434] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0435] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
[0436] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
[0437] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.
[0438] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.
[0439] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0440] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0441] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0442] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
[0443] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.
[0444] The internal memory 151 can be used to store computer executable program codes, which include instructions. The internal memory 151 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 151 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 151 and / or instructions stored in a memory provided in the processor.
[0445] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0446] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.
[0447] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.
[0448] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.
[0449] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.
[0450] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0451] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.
[0452] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.
[0453] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
[0454] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover can be automatically unlocked.
[0455] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.
[0456] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.
[0457] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.
[0458] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.
[0459] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0460] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
[0461] The touch sensor 180K is also called a "touch control device". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch control screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.
[0462] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.
[0463] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.
[0464] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0465] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.
[0466] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0467] In the present application, after the user drags up an information element in the interface, the GPU in the electronic device can perform a three-dimensional transformation on the content according to the content displayed on the display screen 194, thereby creating a visual effect of the original interface being pushed inward on the screen, and displaying recommended application and / or service icons on the side of the screen of the electronic device.
[0468] In addition, in an embodiment of the present application, after the user drags up an information element in the interface, the processor 110 can identify the information element, including identifying the type of the information element and the specific content in the information element, and determine the corresponding application icon and / or application service icon based on the identification result, and generate corresponding program instructions, which can be used to change the display information of the display screen 194, such as updating the interface in the display screen to a cross-application transmission interface, and the icon displayed in the cross-application transmission interface is the application icon and / or application service icon determined by the aforementioned processor 110 based on the identification result.
[0469] In some embodiments, after the user completes the transmission of information using the "cross-application transmission interface", the processor 110 can also obtain the application service to which the user transmits the information, and generate corresponding program instructions based on the obtained results, and combine with the GPU to display the corresponding interface on the screen (for example, the interface can display a snack bar, capsules, small windows, etc.) to feedback the results of the information element transmission to the user.
[0470] Next, we will introduce a method for transmitting information provided by the present application. By implementing this method, an electronic device can display the corresponding application service icon for the user in the interface when the user long presses and then drags the information element. The user can place the dragged element on the corresponding icon to transmit the element to the application service corresponding to the icon. This method enables electronic devices to efficiently and quickly complete information transmission between applications, effectively reducing the number of operation steps required for users to complete cross-application information transmission, improving the interaction efficiency between users and electronic devices, and thus improving user experience. Fig.36 As shown, the method may include but is not limited to the following steps:
[0471] S101. The electronic device displays a first interface.
[0472] The electronic device may be the electronic device 100 in the foregoing description. The first interface includes a first sub-interface and a second sub-interface, the first sub-interface is used to display an application interface of a first application, the second sub-interface is used to display an application interface of a second application, the first sub-interface includes first information, and the second sub-interface is used to transmit the first information to the second application under a first operation on the first information.
[0473] The above-mentioned first information is any one of an image, text, an audio file, a video file, and a document file, and can also be other forms of information, which is not limited in this application.
[0474] S102: The electronic device displays a second interface in response to a second operation on the first information.
[0475] The second operation can be used to select the first information. Specifically, the second operation can be an operation of long pressing the first information and then dragging it to the side of the first interface (i.e., the side of the display screen). If the user does not let go, the dragged first information moves in the first interface along with the user's fingertips. When the user drags the above-mentioned first information to a distance less than a certain threshold from the right side or left side of the screen, the electronic device can display the above-mentioned second interface. In the above-mentioned second interface, the application services corresponding to the above-mentioned at least one application service icon are all application services that can receive the above-mentioned first information. For example, when the above-mentioned first information is an image, The image can be sent to the friend chat service. The Moments service can be used to share the image. The portrait beautification service can beautify the image, and the search service provided by the electronic device can perform intelligent search on the image, etc. Therefore, the at least one application service icon may include application service icons corresponding to these services.
[0476] In a possible implementation, the at least one application service icon may include at least one first icon, and the at least one first icon is an application service icon recommended based on the first information. Optionally, the second interface further includes an icon area, and the at least one application service icon is displayed in the icon area. The at least one application service icon further includes at least one second icon, and the at least one second icon is a custom-displayed application service icon. The at least one first icon is displayed above the at least one second icon.
[0477] That is to say, at least one application service icon in the second interface can be divided into two parts, one of which is a fixedly displayed icon on the right (that is, the at least one second icon), and the other part of the icons can be application service icons recommended to users based on the first information. Optionally, a dividing line can be displayed between the two parts of icons for distinction. Among them, the at least one second icon is an icon customized by the user according to his own usage habits and frequency of use. No matter what information the user shares based on the electronic device, the electronic device can include this part of icons in the icons displayed based on the information, so as to meet the needs of the user as much as possible; and the at least one first icon is recommended by the electronic device based on the elements contained in the first information. When the user shares other information through this method, the recommended application service icon may be different from the icon in the at least one first icon. For details, please refer to the aforementioned Figure 23-Figure 26 The relevant instructions will not be repeated here.
[0478] It should be understood that in the daily use of electronic devices, users often drag some elements. These drag operations may not be for the purpose of transferring the dragged elements across applications (for example, dragging text to change the position or paragraph of text in document editing). Therefore, how to combine user operations and user operating habits to guide users to use the transmission method provided by this application, and set the trigger rules of this method for users, is the key to further improving the efficiency of user interaction with electronic devices. Therefore, in a possible embodiment, the first interface also includes a first trigger area and a second trigger area, the first trigger area is larger than the second trigger area, the second operation includes a first sub-operation and a second sub-operation, the first sub-operation is an operation of moving the first information to the first trigger area, and the second sub-operation is an operation of moving the first information to the second trigger area, and the second operation in response to the second operation on the first information in the first interface displays the second interface, including: in response to the first sub-operation, when the first information stays in the first trigger area for a first time period, displaying a light band guide effect in the first interface, the light band guide effect is used to indicate that the first information is moved to the second trigger area; in response to the second sub-operation, displaying the second interface.
[0479] In this embodiment, the first interface may include the first trigger area and the second trigger area. Optionally, the specific size and position of the first trigger area and the second trigger area may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of the two areas in the first interface. The size and position of the two areas may be stored in the electronic device only in a form that is perceptible to the electronic device (such as program code). When the user drags the first information to the first trigger area, the electronic device may display special effects in the first interface (such as the edge of the first interface) to prompt the user to further drag the image closer to the second trigger area; the special effects may be user-visible special effects such as luminous special effects and shadow special effects, or other user-perceptible special effects, which are not limited in this application; optionally, the electronic device may also display special effects in the first interface after the user drags the first information to the first trigger area and keeps the first information in the first trigger area for a period of time T. Specifically, the T may be set to 600 milliseconds. When the user continues to drag the first information to the second trigger area, the electronic device can immediately respond to the operation and display the second interface.
[0480] In an optional embodiment, the second interface also includes a door closing trigger area. When the user drags the first information to the third trigger area, the electronic device can no longer display the second interface, but redisplay the first interface, and if the user does not let go, when the first interface is redisplayed, the first information in the first interface is still in the state of being dragged by the user, so that the user can reselect the method of transmitting information across applications. For details, please refer to the aforementioned Figure 9-Figure 15 The relevant instructions will not be repeated here.
[0481] S103: In response to a third operation on the first information, the electronic device transmits the first information to an application service corresponding to the target icon.
[0482] Optionally, the third operation is an operation of associating the first information with the target icon. For example, the third operation is an operation of moving the first information to the target icon.
[0483] In the second interface, the user associates the first information with the target icon through the third operation, and the electronic device can transmit the first information to the application service corresponding to the target icon in response to the third operation. Specifically, the third operation can be an operation of dragging the first information close to the target icon, or an operation of dragging the first information onto the target icon and releasing it, or other operations of associating the first information with the target icon, as long as the third operation can select the target icon required by the user from the at least one application service icon and associate the first information with the target icon.
[0484] It can be understood that the information transmission process provided by the present application is continuous from the time the user drags up the above-mentioned first information to the time the above-mentioned first information is placed into the application service corresponding to the above-mentioned target icon. The "continuous" mentioned here means that the user does not need to perform operations such as copying and pasting, nor does he need to switch applications. The user's fingers do not need to leave the screen of the electronic device during the entire operation process. The operation is simple and fast, which can effectively improve the user's efficiency in transmitting information across applications and improve the user experience.
[0485] Optionally, the second interface may also display a sub-interface. The element content displayed in the sub-interface is the same as the element content displayed in the first interface (except the status bar). In fact, the sub-interface displayed in the second interface may be considered as the interface obtained by the electronic device after three-dimensional transformation of all the element content of the first interface (except the status bar). In the second interface, the sub-interface may create a visual effect of the original interface (i.e., the first interface) being pushed inward on the screen. Understandably, this "opening door" visual effect metaphorically transmits the behavior of the transmission element (i.e., the first information), which is more intuitive than copying and pasting, and this information transmission method ensures the effective browsing area of the user interface, and can transmit the first information to other application services while viewing the historical application interface (i.e., the first interface) through the sub-interface, which can further enhance the user experience. Optionally, in the second interface, the background behind the sub-interface may be set to the desktop background (i.e., desktop wallpaper) of the electronic device, and the resulting picture after the blur effect is superimposed, so as to provide users with better visual effects.
[0486] It can be understood that the electronic device can recommend multiple application services that can receive the above-mentioned first information to the user based on the above-mentioned first information, and display the icons of these application services on the right side of the above-mentioned second interface. Specifically, the upper limit of the number of these application service icons can be 20. In a possible implementation, the above-mentioned at least one application icon includes at least one icon displayed in the above-mentioned icon area and at least one icon not displayed in the above-mentioned icon area, the above-mentioned target icon is not displayed in the above-mentioned icon area, and the above-mentioned second interface also includes a third trigger area. The electronic device can respond to the seventh operation on the above-mentioned first information and update the above-mentioned at least one icon displayed in the above-mentioned icon area until the above-mentioned target icon is displayed in the above-mentioned icon area. The above-mentioned seventh operation is an operation of moving the above-mentioned first information to the above-mentioned third trigger area. That is to say, when the number of these application service icons exceeds a certain threshold (for example, 7), in order to ensure the neatness and visibility of the interface, the electronic device can only display a part of these application service icons (for example, 7) in the above-mentioned second interface at the same time when displaying; when the icons currently displayed in the above-mentioned second interface are not the application services expected by the user, the user can also place the above-mentioned first information in the above-mentioned third trigger area so that the electronic device updates the icons in the above-mentioned icon area. Specifically, the third trigger area can be set just above and / or just below the icon area. For details, please refer to the above description. Fig. 22 Related instructions.
[0487] In order to guide the user to accurately put the above-mentioned first information into the application service he needs, in the process of dragging the above-mentioned first information to the above-mentioned target icon, when the above-mentioned first information is close to the above-mentioned target icon (here it is assumed that the above-mentioned target icon has always been the icon closest to the above-mentioned first information in the at least one application icon during the entire dragging process), the above-mentioned target icon can be enlarged, and the above-mentioned target icon can be moved in the above-mentioned second interface to make the above-mentioned target icon closer to the above-mentioned first information, and create a visual effect in the above-mentioned second interface that the above-mentioned target icon is adsorbed by the above-mentioned first information (that is, the moving direction of the above-mentioned first information is opposite to the moving direction of the above-mentioned target icon, and both are approaching each other), so as to prompt the user that the above-mentioned first information has been associated with the above-mentioned target icon. If the user lets go here, the above-mentioned first information will be transmitted to the application service corresponding to the above-mentioned target icon. Optionally, when the distance between the above-mentioned first information and the above-mentioned target icon is less than the first threshold, the electronic device will enlarge the above-mentioned target icon in the above-mentioned second interface and / or move the position of the above-mentioned target icon in the above-mentioned first interface.
[0488] After transmitting the first information to the application service corresponding to the target icon, the electronic device may also display a third interface. The third interface may be set to different interface effects according to the type of application service entered by the first information and the result of the information transmission. For example, the third interface may display one or more of a floating window, a capsule (minimized floating window), a snack bar, toast feedback, and the application service interface corresponding to the target icon (full screen display) to inform the user of the transmission result of the first information and facilitate the user to proceed to the next step. For details, please refer to the aforementioned Figure 16-Figure 21 The relevant instructions will not be repeated here.
[0489] An embodiment of the present application also provides an electronic device, which includes: one or more processors and a memory; wherein the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method shown in the aforementioned embodiment.
[0490] As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.
[0491] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.
[0492] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.
Claims
1. An information transmission method, characterized in that: The method comprises: Displaying a first interface, the first interface including a first sub-interface and a second sub-interface, the first sub-interface being used to display an application interface of a first application, the second sub-interface being used to display an application interface of a second application, the first sub-interface including first information, and the second sub-interface being used to transmit the first information to the second application under a first operation on the first information; In response to a second operation on the first information, displaying a second interface; the second interface includes the first information and at least one application service icon; In response to a third operation on the first information, the first information is transmitted to an application service corresponding to a target icon, where the target icon is any one of the at least one application service icon.
2. The method according to claim 1, characterized in that In the first interface, The first sub-interface and the second sub-interface are displayed in a top-bottom split screen or a left-right split screen; Alternatively, the first sub-interface and the second sub-interface are displayed in a picture-in-picture format.
3. The method according to claim 1 or 2, characterized in that: The third operation is an operation of associating the first information with the target icon.
4. The method according to any one of claims 1 to 3, characterized in that: The third operation is an operation of moving the first information to the target icon.
5. The method according to claim 3 or 4, characterized in that: In the process of moving the first information to the target icon, the target icon is enlarged and / or the position of the target icon in the first interface is moved, and the direction of moving the target icon is opposite to the direction of moving the first information.
6. The method according to any one of claims 1 to 5, characterized in that: The at least one application service icon includes at least one first icon, and the at least one first icon is an application service icon recommended based on the first information.
7. The method according to any one of claims 1 to 6, characterized in that: The target icon includes a corresponding text description, and the text description is used to prompt the application or application service function corresponding to the target icon.
8. The method according to any one of claims 1 to 7, characterized in that: After transmitting the first information to the application service corresponding to the target icon, the method further includes: A third interface is displayed, wherein the third interface includes all the contents of the first interface, and the third interface also includes any one of a floating window and an information feedback bar, wherein the floating window is used to display the target icon or an application service interface corresponding to the target icon, and the information feedback bar is used to prompt the electronic device for the transmission result of the first information.
9. The method according to claim 8, characterized in that The third interface includes a floating window, the floating window is used to display the target icon, the third interface also includes second information, and after displaying the third interface, the method further includes: In response to a fourth operation on the second information, the second information is transmitted to the application service corresponding to the target icon, and the fourth operation is an operation of associating the second information with the floating window.
10. The method according to claim 8, characterized in that The third interface includes a floating window, the floating window is used to display the application service interface corresponding to the target icon, the floating window includes an expansion control, and after displaying the third interface, the method further includes: In response to a fifth operation on the expansion control, the application service interface displayed in the floating window is displayed in full screen.
11. The method according to claim 8, characterized in that The third interface includes an information feedback bar, the information feedback bar includes a jump control, and after displaying the third interface, the method further includes: In response to a sixth operation on the jump control, a fourth interface is displayed, where the fourth interface is an application service interface corresponding to the target icon.
12. The method according to any one of claims 1 to 11, characterized in that: The first interface further includes a first trigger area and a second trigger area, the first trigger area is larger than the second trigger area, the second operation includes a first sub-operation and a second sub-operation, the first sub-operation is an operation of moving the first information to the first trigger area, and the second sub-operation is an operation of moving the first information to the second trigger area, and the displaying of the second interface in response to the second operation on the first information in the first interface includes: In response to the first sub-operation, when the first information stays in the first trigger area for a first time period, a light guide effect is displayed in the first interface, where the light guide effect is used to indicate that the first information is moved to the second trigger area; In response to the second sub-operation, the second interface is displayed.
13. The method according to claim 12, characterized in that When the first sub-interface and the second sub-interface are displayed in a split-screen manner, the first trigger area exists in both the first interface and the second sub-interface, and the second trigger area exists in both the first interface and the second sub-interface.
14. The method according to any one of claims 6 to 13, characterized in that: The second interface also includes an icon area, and the at least one application service icon is displayed in the icon area. The at least one application service icon also includes at least one second icon, and the at least one second icon is a custom displayed application service icon. The at least one first icon is displayed above the at least one second icon.
15. The method according to claim 14, characterized in that The at least one application service icon includes at least one icon displayed in the icon area and at least one icon not displayed in the icon area, the target icon is not displayed in the icon area, the second interface further includes a third trigger area, and before responding to the second operation on the first information, the method further includes: In response to a seventh operation on the first information, the at least one icon displayed in the icon area is updated until the target icon is displayed in the icon area, and the seventh operation is an operation of moving the first information to the third trigger area.
16. The method according to any one of claims 1 to 15, characterized in that: An area of the first information in the second interface is smaller than an area of the first information in the first interface.
17. A method for information transmission, characterized in that: include: In response to any one of a global screenshot operation, a partial screenshot operation, and a long screenshot operation on the fifth interface, displaying a sixth interface, wherein the sixth interface includes a first image obtained by taking a screenshot of the fifth interface; In response to an eighth operation on the first image in the six interfaces, displaying a seventh interface; the seventh interface includes the first image and at least one application service icon; In response to a ninth operation on the first image in the seventh interface, the first image is transmitted to an application service corresponding to a target icon, where the target icon is any one of the at least one application service icon.
18. The method according to claim 17, characterized in that The first image is an image obtained by performing a global screenshot operation on the fifth interface, and in response to an eighth operation on the first image in the six interfaces, displaying the seventh interface includes: In response to a click operation on the first image in the sixth interface, an editing interface is displayed, the editing interface including the first image and editing options, the editing options being used to edit the first image; In response to the editing operation of the first image through the editing option, after the image content of the first image in the editing interface is updated, in response to the moving operation of the first image in the editing interface, the seventh interface is displayed, and the eighth operation includes the click operation, the editing operation and the moving operation.
19. A method for information transmission, characterized in that: include: In response to a partial screenshot operation on the eighth interface, a ninth interface is displayed, wherein the ninth interface includes a second image obtained by performing a partial screenshot operation on the eighth interface and a text recognition control, wherein the text recognition control is used to recognize text contained in the second image; In response to a click operation on the text recognition control, a tenth interface is displayed, wherein the tenth interface includes first text information obtained by recognizing the second image; In response to the tenth operation on the first text information in the tenth interface, displaying an eleventh interface; the eleventh interface includes the first text information and at least one application service icon; In response to an eleventh operation on the first text information in the eleventh interface, the first text information is transmitted to an application service corresponding to a target icon, where the target icon is any one of the at least one application service icon.
20. An electronic device, characterized in that: The electronic device comprises: one or more processors, a memory and a display screen; The memory is coupled to the one or more processors, and the memory is used to store computer program codes, wherein the computer program codes include computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method according to any one of claims 1 to 19.
21. A chip system, characterized in that: The chip system is applied to an electronic device, and the chip system includes one or more processors, and the processor is used to call computer instructions so that the electronic device executes the method as described in any one of claims 1-19.
22. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device is caused to execute the method as claimed in any one of claims 1 to 19.
Citation Information
Cited By
Interface display method, electronic equipment, storage medium and chip system
CN121143919A
Information transmission method and electronic device
EP4660768A1
Animation generation method, electronic device, and computer program product
WO2026152714A1
