Information transmission method and electronic equipment
By displaying a smart multi-window interface on electronic devices and dragging and dropping information to the side recommendation icon, cross-application transmission is achieved, solving the problem of complex operations in existing technologies and improving the efficiency of information transmission and user experience.
Patent Information
- Application Number
- CN202510893495.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-16
- Publication Date
- 2025-11-18
AI Technical Summary
In existing technologies, users need to perform complex and cumbersome operations when transferring information across applications, resulting in low interaction efficiency and poor user experience.
By displaying a smart multi-window interface on electronic devices, users can drag and drop information elements to the side of the interface, automatically display recommended application service icons, and complete the cross-application transfer of information when they release their fingers, simplifying the operation process.
It enables direct cross-application data transfer without the need for copying, pasting, or switching applications, improving user interaction efficiency and experience, and making the operation simple and fast.
Smart Images

Figure CN120973264A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of terminal, and in particular, to an information transmission method and an electronic device. BACKGROUND
[0002] With the continuous development of electronic information technology, smart devices such as mobile phones and tablets have become indispensable products in our daily life, work and entertainment. In the process of using smart devices, users often open multiple applications in the smart device to work together, and also often use smart devices to transmit information across applications, that is, share, upload, etc. information in one application through another application.
[0003] However, when the user needs to transmit information across applications, the user usually needs to perform complex and tedious operations to complete the transmission. For example, when the user needs to forward the text or image on the webpage in the browser to a WeChat friend, the user generally needs to copy or save the text, image, etc. information in the browser first, and then switch to WeChat, and then share, upload, etc. the information through WeChat. Such information transmission method makes the interaction between the user and the smart device inefficient, and seriously affects the user experience.
[0004] Therefore, it is necessary to study a more efficient and convenient information transmission method. SUMMARY
[0005] The purpose of the present application is to provide an information transmission method and an electronic device. By implementing the method, the electronic device can display multiple application service icons in the interface in response to the user's operation on the information, so as to facilitate the user to put the information into the target application service, so that the electronic device can efficiently and quickly complete the information transmission between applications, effectively reduce the operation steps required by the user to complete the information transmission across applications, improve the interaction efficiency between the user and the electronic device, and further improve the user experience.
[0006] The above and other objects will be achieved by the features of the independent claims. Further implementation ways are embodied in the dependent claims, the description and the drawings.
[0007] In a first aspect, a method for information transmission is provided. The method comprises: displaying a first interface, the first interface comprising a first sub-interface and a second sub-interface, the first sub-interface being configured to display an application interface of a first application, the second sub-interface being configured to display an application interface of a second application, the first sub-interface comprising first information, the second sub-interface being configured to transmit the first information to the second application in response to a first operation on the first information; in response to a second operation on the first information, displaying a second interface; the second interface comprising the first information and at least one application service icon; in response to a third operation on the first information, transmitting the first information to an application service corresponding to a target icon, the target icon being any one of the at least one application service icon.
[0008] In the method, the first interface can be a smart multi-window interface displayed by the electronic device, i.e., the first interface comprises a plurality of windows, each window corresponding to a sub-interface, and each sub-interface displaying an application interface of a corresponding application, which can be different from each other. The first sub-interface and the second sub-interface are two sub-interfaces of the plurality of sub-interfaces corresponding to the plurality of windows. Optionally, the number of the plurality of windows can be two, and the two windows correspond to the first sub-interface and the second sub-interface.
[0009] In the first interface, an information element displayed in any one of the sub-interfaces corresponding to the plurality of windows can be moved to another sub-interface in response to a user's drag operation, so as to complete cross-application transmission of the information. For example, after the user drags the first information in the first sub-interface to the second sub-interface, the information element can be transmitted from the application corresponding to the first sub-interface to the application corresponding to the second sub-interface.
[0010] However, due to the limitation of the display screen area of the electronic device, the number of windows (sub-interfaces) in the first interface is limited, and the number of application interfaces that can be displayed is limited. The user needs to open these applications in advance through corresponding user operations, and needs to split the application interfaces of these applications to display. When the user wants to share the element dragged in the first interface to an application that is not opened (i.e., the application interface cannot be displayed in the first interface), the sub-interfaces displayed by the first interface cannot meet the user's needs.
[0011] Therefore, in the method, the electronic device displays the cross-application transmission interface provided by the present application, i.e., the second interface, to the first information element in the first interface by the second operation, so as to share the first information element to the application which is not opened (i.e., the application interface fails to display in the first interface). In the cross-application transmission interface, the side of the interface can display the service icons of the applications recommended by the electronic device for the information element; then, the user releases the information element dragged, i.e., the information element is transmitted to the application service corresponding to the icon and the corresponding application service function is started.
[0012] The second operation can be used to select the first information, and specifically, the second operation can be an operation of long pressing the first information and dragging to the side (i.e., the side of the display screen) of the first interface. In the case that the user does not release the hand, the first information dragged is moved in the first interface along with the fingertip of the user. In the case that the user drags the first information to the distance from the right side or the left side of the screen less than a certain threshold, the electronic device displays the second interface. In the second interface, the application services corresponding to the at least one application service icon are all the application services which can receive the first information, for example, in the case that the first information is an image, the friend chat service can send the image, the friend circle service can be used to share the image, the beautification service can beautify the image, the search service provided by the electronic device can intelligently search the image, and therefore, the at least one application service icon can include the application service icons corresponding to these services.
[0013] Optionally, the at least one application service icon can simultaneously include the multiple application service icons corresponding to one application. It needs to be particularly noted that the at least one application service icon is all the application service icons and not the application icons, and the at least one application service icon can not be displayed in the first interface. When the user drags the information (e.g., the first information) dragged to a certain icon in the at least one application service icon, the information can be directly received by the application service corresponding to the icon.
[0014] In the second interface, the user associates the first information with the target icon through the third operation. The electronic device then responds to the third operation by transmitting the first information to the application service corresponding to the target icon. Specifically, the third operation can be dragging the first information close to the target icon, dragging the first information onto the target icon and releasing it, or any other operation that associates the first information with the target icon, as long as the third operation can select the target icon needed by the user from at least one application service icon and associate the first information with the target icon.
[0015] Understandably, the information transmission process provided in this application is continuous from the moment the user drags the first information to the moment the first information is placed into the application service corresponding to the target icon. Here, "continuous" means that the user does not need to perform operations such as copying and pasting, nor does the user need to switch applications. The user's fingers do not need to leave the screen of the electronic device during the entire operation process. The operation is simple and fast, which can effectively improve the efficiency of users transmitting information across applications and enhance the user experience.
[0016] Optionally, the second interface may also display a third sub-interface. The elements displayed in the third sub-interface are the same as those displayed in the first interface (except for the status bar). In fact, the third sub-interface displayed in the second interface can be considered as an interface obtained by the electronic device after performing a three-dimensional transformation of all elements of the first interface (except for the status bar). In the second interface, the sub-interface can create a visual effect on the screen that pushes the original interface (i.e., the first interface) inward. Understandably, this "opening the door" visual effect metaphorically represents the act of transmitting elements (i.e., the first information), which is more intuitive than copy and paste. Moreover, this information transmission method ensures the effective browsing area of the user interface, allowing the first information to be transmitted to other application services while viewing the historical application interface (i.e., the first interface) through the sub-interface, further enhancing the user experience. Optionally, in the second interface, the background behind the sub-interface can be set to the desktop background (i.e., desktop wallpaper) of the electronic device with a blurred effect to provide users with a better visual experience.
[0017] In conjunction with the first aspect, in one possible implementation, the first sub-interface and the second sub-interface are displayed in a top-bottom split-screen or left-right split-screen manner; or, the first sub-interface and the second sub-interface are displayed in a picture-in-picture manner.
[0018] In this embodiment, when the first sub-interface and the second sub-interface are displayed in a top-bottom split-screen or left-right split-screen manner, this application does not limit the relative position of the first sub-interface and the second sub-interface within the first sub-interface. For example, the first sub-interface may be displayed above the second sub-interface, or it may be displayed below the second sub-interface.
[0019] When the first sub-interface and the second sub-interface are displayed in a picture-in-picture format, if the first sub-interface is a full-screen display, then the second sub-interface can be a floating window (small window); conversely, if the first sub-interface is also a floating window (small window), then the second sub-interface can be a full-screen display. This application does not limit this. Correspondingly, when transmitting information between the two corresponding applications of the first and second sub-interfaces, the user can drag information elements from the floating window (small window) to the full-screen display, or vice versa. When sharing information elements from the first interface to other applications that do not display an application interface in the first interface using the "cross-application transmission interface" provided by this application, the user can also drag information elements from the floating window (small window) or the full-screen display to the side of the screen to make the electronic device display the "cross-application transmission interface," i.e., the second interface.
[0020] In conjunction with the first aspect, in one possible implementation, the second operation is the operation of associating the first information with the target icon.
[0021] In conjunction with the first aspect, in one possible implementation, the second operation is the operation of moving the first information to the target icon.
[0022] Specifically, in this embodiment, moving the first information to the target icon may mean moving the first information to the vicinity of the target icon, such that the target icon is the icon closest to the first information among the at least one application service icon; or, moving the first information to the target icon may mean moving the first information above the target icon. It should be understood that "above" here means that the first information overlaps with the target icon and is displayed on top of the target icon.
[0023] Optionally, the second operation may also include holding the first information on (or around) the target icon for a period of time (e.g., 120ms), or dragging the first information onto (or around) the target icon and then releasing it, thereby triggering the transmission of the first information to the application service corresponding to the target icon.
[0024] In conjunction with the first aspect, in one possible implementation, during the process of moving the first information onto the target icon, the target icon is enlarged and / or its position in the first interface is moved, with the direction of moving the target icon being opposite to the direction of moving the first information.
[0025] In this embodiment, in order to guide the user to accurately place the first information into the application service they need, during the process of dragging the first information onto the target icon, when the first information is close to the target icon (assuming that the target icon is always the icon closest to the first information among the at least one application service icon throughout the dragging process), the target icon can be enlarged, and the target icon can be moved in the second interface to bring the target icon closer to the first information. This creates a visual effect in the second interface where the target icon is attracted to the first information (i.e., the movement direction of the first information is opposite to the movement direction of the target icon, and both are moving towards each other), prompting the user that the first information has been associated with the target icon. If the user releases the device at this point, the first information will be transferred to the application service corresponding to the target icon.
[0026] Optionally, the electronic device will only enlarge the target icon and / or move the target icon's position in the first interface if the distance between the first information and the target icon is less than a first threshold.
[0027] In conjunction with the first aspect, in one possible implementation, the at least one application service icon includes at least one first icon, which is an application service icon recommended based on the first information.
[0028] In this embodiment, the electronic device can personalize icons for the user based on the content contained in the first information. Specifically, for these personalized icons, the electronic device can first identify the dragged-out first information (at this time, the electronic device has not yet displayed the second user interface), and based on the identification result, obtain application service icons that meet the user's needs in the second interface. The identification result can include the type of the first information and the element content contained in the first information. For example, assuming the first information is an image containing a QR code, the electronic device can identify the QR code image in the first information and display application service icons that can scan the QR code in the second interface, such as WeChat - Scan, Alipay - Scan, etc.; assuming the first information is an image containing a face image, the user can identify the face image in the first information and display application service icons that can beautify the image or can be used to share the image in the second interface, such as Meitu - Portrait Beautification, WeChat - Moments, etc. For example, if the first information is text containing location information, the electronic device can recognize the location information in the text and display application service icons that can navigate or hail a ride for the user on the second interface, such as Gaode Map - Navigation, Gaode Map - One-click Ride-hailing, etc.; if the first information is text containing time and location information, the electronic device recommends application service icons related to the schedule to the user, such as Schedule - Add Schedule, etc.
[0029] In other words, when a user drags two information elements in succession, even if these two information elements are of the same type (e.g., both are text or both are images), if the content contained in the two information elements is different (e.g., different image content or different text in the text), then the at least one application service icon displayed on the electronic device based on these two elements can also be different. It should be understood that "different" here can include different icon types and different icon orders. Optionally, the icon of the application service recommended to the user (i.e., the at least one first icon) is displayed in the icon area; among the at least one first icon, the icon corresponding to the application service that best matches the current user's intent will be located at the top of the icon area. The current user's intent can be determined based on the content of the elements contained in the dragged information. For example, when the information is an image and contains a QR code image, the icons corresponding to application services such as WeChat - Scan, Alipay - Scan, etc., can be displayed at the top of the at least one application service icon list; when the information is text and contains location information, the icons corresponding to application services such as Gaode Map - Navigation, Gaode Map - One-Click Taxi, etc., can be displayed at the top of the at least one application service icon list.
[0030] In conjunction with the first aspect, in one possible implementation, after transmitting the first information to the application service corresponding to the target icon, the method further includes: displaying a third interface, the third interface including all the content of the first interface, and the third interface further including any one of a floating window and an information feedback bar, the floating window being used to display the target icon or the application service interface corresponding to the target icon, and the information feedback bar being used to prompt the electronic device for the transmission result of the first information.
[0031] In this embodiment, after the information is transmitted across applications through the second interface, the electronic device can also provide different prompts and display different interface effects to the user based on the type of application service the information enters and the result of the information transmission, so as to inform the user of the transmission result of the first information and proceed to the next step.
[0032] In conjunction with the first aspect, in one possible implementation, the third interface includes a floating window for displaying the target icon, the third interface also includes second information, and after displaying the third interface, the method further includes: in response to a fourth operation on the second information, transmitting the second information to an application service corresponding to the target icon, the fourth operation being an operation of associating the second information with the floating window.
[0033] In this embodiment, it is understood that, except for the floating window, the content of the third interface is the same as the content of the first interface. The floating window is a minimized floating window, in which the application interface may not be displayed, only the target icon is displayed, and the floating window can be displayed close to the right or left side of the third interface to reduce obstruction of the third interface, so that the user can continue to transmit the information in the third interface (such as the second information) to the application service corresponding to the target icon.
[0034] Optionally, in this embodiment, the floating window can be expanded in response to the user's click operation. After being expanded, the floating window can be displayed in the third interface (at this time, the floating window may no longer be displayed on the edge, but it is still not displayed in full screen). It can also display an expansion control, which can respond to the user's operation and display the application interface in the floating window in full screen on the screen.
[0035] In conjunction with the first aspect, in one possible implementation, the third interface includes a floating window for displaying the application service interface corresponding to the target icon. The floating window includes an expand control. After displaying the third interface, the method further includes: in response to a fifth operation on the expand control, displaying the application service interface displayed in the floating window in full screen.
[0036] When the application service corresponding to the target icon is a navigation or search application service that requires a new application service interface to be displayed immediately, the electronic device needs to immediately display the application service interface corresponding to the target icon to the user. Therefore, in this embodiment, the floating window is a floating window that is displayed on top of the third interface. The third interface can still display the content of the first interface, while the floating window can display the application service interface corresponding to the target icon.
[0037] In conjunction with the first aspect, in one possible implementation, the third interface includes an information feedback bar, the information feedback bar includes a jump control, and after displaying the third interface, the method further includes: in response to a sixth operation on the jump control, displaying a fourth interface, the fourth interface being the application service interface corresponding to the target icon.
[0038] When the application service corresponding to the target icon is an application service like a global bookmark, after receiving the first information, the user may not need to understand the interface of the application service. They only need to know whether the electronic device has successfully received the first information. Therefore, in this embodiment, after the first information is transmitted to the application service corresponding to the target icon, the electronic device does not need to directly jump to its corresponding application interface. It only needs to inform the user of the result of the information transmission. Therefore, the third interface can display the information feedback bar to prompt the user about the result of the first information transmission. The information feedback bar is a screenshot bar, which may contain the jump control so that the user can quickly enter the application service interface corresponding to the target icon by clicking the jump control to view the processing result of the first information by the application service corresponding to the target icon.
[0039] In conjunction with the first aspect, in one possible implementation, the first interface further includes a first trigger area and a second trigger area, the first trigger area being larger than the second trigger area. The second operation includes a first sub-operation and a second sub-operation. The first sub-operation is an operation to move the first information to the first trigger area, and the second sub-operation is an operation to move the first information to the second trigger area. The step of displaying the second interface in response to the second operation on the first information in the first interface includes: in response to the first sub-operation, if the first information stays in the first trigger area for a first duration, displaying a light strip guiding effect in the first interface, the light strip guiding effect being used to indicate moving the first information to the second trigger area; and displaying the second interface in response to the second sub-operation.
[0040] Since dragging and dropping information across different sub-interfaces in the first interface can also complete the cross-application information transfer, and users often drag and drop elements during daily use of electronic devices, these drag and drop operations may not be for the purpose of transferring the dragged elements across applications (for example, dragging text to change the position of text or paragraphs in document editing), therefore, how to combine user operations and user operating habits to guide users to use the transfer method provided in this application, and set the trigger rules for the "cross-application transfer interface" in this method for users, is the key to further improving the efficiency of user interaction with electronic devices.
[0041] Therefore, in this embodiment, the first interface may include the first trigger area and the second trigger area. Optionally, the specific size and position of the first trigger area and the second trigger area may not be displayed in the user interface, that is, the user cannot directly observe the specific outline of these two areas in the first interface. The size and position of these two areas may be stored in the electronic device only in a form that the electronic device can perceive (e.g., program code). When the user drags the first information to the first trigger area, the electronic device may display a special effect in the first interface (e.g., at the edge of the first interface) to prompt the user to drag the image further towards the second trigger area. The special effect may be a user-visible effect such as a glowing effect or a shadow effect, or other user-perceptible effects. This application does not limit this. Optionally, the electronic device may also display the special effect in the first interface only after the user drags the first information to the first trigger area and keeps the first information in the first trigger area for a duration T. Specifically, T may be set to 600 milliseconds.
[0042] When the user continues to drag the first information to the second trigger area, the electronic device can immediately respond to the operation and display the second interface.
[0043] In an optional implementation, the second interface further includes a door-closing trigger area. When the user drags the first information to the door-closing trigger area, the electronic device may stop displaying the second interface and redisplay the first interface. If the user does not release the drag, the first information will still be dragged by the user when the first interface is redisplayed, so that the user can reselect the method of transmitting the information across applications.
[0044] In conjunction with the first aspect, in one possible implementation, when the first sub-interface and the second sub-interface are displayed in a split-screen manner (either vertical or horizontal), the first triggering area exists simultaneously in both the first interface and the second sub-interface, and the second triggering area also exists simultaneously in both the first interface and the second sub-interface.
[0045] In this embodiment, regardless of which sub-interface the element dragged by the user belongs to, if the first trigger area exists in both the first interface and the second sub-interface, and the second trigger area exists in both the first interface and the second sub-interface, the electronic device can promptly respond to the user's operation to guide the opening of the "cross-application transmission interface".
[0046] In conjunction with the first aspect, in one possible implementation, the second interface further includes an icon area, in which at least one application service icon is displayed, and the at least one application service icon further includes at least one second icon, which is a custom-displayed application service icon, and the at least one first icon is displayed above the at least one second icon.
[0047] In this embodiment, the at least one application service icon is displayed in the icon area, and the at least one application service icon in the second interface can be divided into two parts. One part is a fixed icon displayed on the right (i.e., the at least one second icon), and the other part of the icons can be application service icons recommended by the user based on the first information. Optionally, a dividing line can be displayed between the two parts of the icons for differentiation. The at least one second icon is an icon customized by the user according to their usage habits and frequency. Regardless of the information shared by the user on the electronic device, the icons displayed by the electronic device based on that information can all include this part of the icons to best meet the user's needs. The at least one first icon is recommended by the electronic device based on the elements contained in the first information. When the user shares other information through this method, the recommended application service icon can be different from the icons in the at least one first icon.
[0048] In conjunction with the first aspect, in one possible implementation, the at least one application service icon includes at least one icon displayed in the icon area and at least one icon not displayed in the icon area, the target icon is not displayed in the icon area, the second interface further includes a third trigger area, and before responding to a second operation on the first information, the method further includes: in response to a seventh operation on the first information, updating the at least one icon displayed in the icon area until the target icon is displayed in the icon area, the seventh operation being an operation to move the first information to the third trigger area.
[0049] The electronic device can recommend multiple application services that can receive the first information to the user, and display icons of these application services on the right side of the second interface. Specifically, the maximum number of these application service icons can be 20. In this embodiment, when the number of these application service icons exceeds a certain threshold (e.g., 7), in order to ensure the cleanliness and visual appeal of the interface, the electronic device can display only a portion (e.g., 7) of these application service icons simultaneously on the second interface. When none of the icons currently displayed on the second interface are the application services the user expects, the user can also place the first information in the third trigger area to cause the electronic device to update the icons in the icon area. Specifically, the third trigger area can be set directly above and / or directly below the icon area.
[0050] In conjunction with the first aspect, in one possible implementation, the area of the first information in the second interface is smaller than the area of the first information in the first interface.
[0051] Understandably, in the method provided in this application, the content of the first information in the second interface is the same as that in the first interface. However, in order to reduce the large-area obstruction of the at least one application service icon by the first information in the second interface, in this embodiment, the area of the first information can be reduced after entering the second interface to facilitate the user's selection of the application service icon.
[0052] In conjunction with the first aspect, in one possible implementation, the first information is any one of an image, text, audio file, video file, or document file.
[0053] Secondly, this application provides a method for information transmission, comprising: displaying a sixth interface in response to any one of a global screenshot operation, a partial screenshot operation, or a long screenshot operation on a fifth interface, wherein the sixth interface includes a first image obtained by taking a screenshot of the fifth interface; displaying a seventh interface in response to an eighth operation on the first image in the sixth interface; wherein the seventh interface includes the first image and at least one application service icon; and transmitting the first image to an application service corresponding to a target icon in response to a ninth operation on the first image in the seventh interface, wherein the target icon is any one of the at least one application service icon.
[0054] Most smart devices currently offer users a quick screenshot function. For example, in some scenarios, users can double-tap the screen or swipe down with three fingers to take a full-screen screenshot of the current interface of the electronic device. In some embodiments, the electronic device can also briefly display the image captured by the user through the full-screen screenshot operation as a thumbnail on the interface. Therefore, in this embodiment, after the user captures an image through the full-screen screenshot operation, the image is displayed in the form of a thumbnail on the first interface. The user can use the quick screenshot function and the transmission method provided in this application to more quickly transmit the captured image to the application service corresponding to the target icon.
[0055] In conjunction with the second aspect, in one possible implementation, the first image is an image obtained by performing a global screenshot operation on the fifth interface. The step of displaying the seventh interface in response to the eighth operation on the first image in the sixth interface includes: displaying an editing interface in response to a click operation on the first image in the sixth interface, the editing interface including the first image and editing options, the editing options being used to edit the first image; updating the image content of the first image in the editing interface in response to the editing operation on the first image through the editing options; and then displaying the seventh interface in response to a movement operation on the first image in the editing interface. The eighth operation includes the click operation, the editing operation, and the movement operation.
[0056] Understandably, after capturing an image using the quick screenshot function, users may need to edit the image, such as further cropping the image to change its area, or using a drawing tool to highlight important content in the image before sharing or uploading the edited image to other applications. Therefore, in this embodiment, after the electronic device briefly displays the image captured by the user through a full-screen screenshot as a thumbnail (i.e., the first image) on the sixth interface, the user can enter the image editing interface through the click operation. In the editing interface, the user can edit the first image accordingly. After the editing operation is completed, the electronic device still displays the editing interface. The user can directly use the movement operation in the editing interface to make the electronic device display the second interface, and use the ninth operation to transmit the edited image (i.e., the first information) to the application service corresponding to the target icon.
[0057] Thirdly, this application provides a method for information transmission, comprising: displaying a ninth interface in response to a partial screenshot operation on an eighth interface, the ninth interface including a second image obtained by performing a partial screenshot operation on the eighth interface and a text recognition control, the text recognition control being used to recognize text contained in the second image; displaying a tenth interface in response to a click operation on the text recognition control, the tenth interface including first text information obtained by recognizing the second image; displaying an eleventh interface in response to a tenth operation on the first text information in the tenth interface; the eleventh interface including the first text information and at least one application service icon; and transmitting the first text information to an application service corresponding to a target icon in response to an eleventh operation on the first text information in the eleventh interface, the target icon being any one of the at least one application service icon.
[0058] After a user takes a screenshot, some smart devices also provide recognition functions for the user in this scenario, used to identify the captured image (e.g., extracting text from the image or translating text). Therefore, regarding the screenshot function provided by electronic devices, in this method, the electronic device can quickly obtain the image selected by the user using a knuckle gesture through the partial screenshot operation and display the ninth interface. In the ninth interface, the user can identify the text information contained in the image selected by the partial screenshot frame by clicking the text recognition control. Then, the user can perform the tenth operation on the first text information obtained by recognition to make the electronic device display the "cross-application transmission interface" provided in this application, i.e., the tenth interface, and transmit the text information (i.e., the first information) to the application service corresponding to the target icon through the eleventh operation.
[0059] Optionally, after the text recognition control recognizes the text information, the text information contained in the image selected by the partial screenshot frame can be selected by the first and last cursors. The user can also adjust the position of the first and last cursors to further filter the text information and obtain the first text information that needs to be transmitted.
[0060] Fourthly, this application provides an electronic device comprising: one or more processors and a memory; the memory being coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, wherein the one or more processors invoke the computer instructions to cause the electronic device to perform a method as described in the first aspect or any possible implementation thereof, the second aspect or any possible implementation thereof, and the third aspect.
[0061] Fifthly, this application provides a chip system applied to an electronic device, the chip system including one or more processors, the processors being configured to invoke computer instructions to cause the electronic device to perform methods as described in the first aspect or any possible implementation of the first aspect, the second aspect or any possible implementation of the second aspect, and the third aspect.
[0062] In a sixth aspect, this application provides a computer-readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to perform a method as described in the first aspect or any possible implementation of the first aspect, a method as described in the second aspect or any possible implementation of the second aspect, and a method as described in the third aspect.
[0063] In a seventh aspect, this application provides a computer program product containing instructions that, when the computer program product is run on an electronic device, cause the electronic device to perform the method as described in the first aspect or any possible implementation of the first aspect, the method as described in the second aspect or any possible implementation of the second aspect, and the method as described in the third aspect. Attached Figure Description
[0064] Figure 1 This application provides a schematic diagram illustrating a process for cross-application information transmission in an embodiment of the present application.
[0065] Figure 2 This application provides a schematic diagram illustrating a process for cross-application information transmission in an embodiment of the present application.
[0066] Figure 3 This application provides a schematic diagram illustrating a process for cross-application image transmission.
[0067] Figure 4 This application provides a schematic diagram illustrating a process for cross-application text transmission in an embodiment of the present application.
[0068] Figure 5 This application provides a schematic diagram illustrating the process of cross-application information transmission in landscape mode.
[0069] Figure 6 This application provides a schematic diagram illustrating the process of cross-application transmission of a global screenshot image, as provided in an embodiment of the present application.
[0070] Figure 7 This application provides a schematic diagram illustrating the process of cross-application transmission of a partial screenshot image, as provided in an embodiment of the present application.
[0071] Figure 8 This application provides a schematic diagram illustrating the process of cross-application transmission of text in a partial screenshot image, as provided in an embodiment of the present application.
[0072] Figure 9 A schematic diagram illustrating a process for triggering a "cross-application transmission interface" operation, provided as an embodiment of this application;
[0073] Figure 10 A schematic diagram illustrating the process of closing the "cross-application transmission interface" as provided in an embodiment of this application;
[0074] Figure 11 A schematic diagram illustrating the process of closing the "cross-application transmission interface" as provided in an embodiment of this application;
[0075] Figure 12 Some interface diagrams for cross-application transmission via split-screen functionality provided in the embodiments of this application;
[0076] Figure 13 Interface diagrams showing cross-application transmission via a "cross-application transmission interface" in split-screen mode, provided for embodiments of this application;
[0077] Figure 14 Interface diagrams for cross-application transmission of some picture-in-picture functions provided in the embodiments of this application;
[0078] Figure 15 Some interface diagrams showing cross-application transmission in picture-in-picture mode via the "cross-application transmission interface" provided for embodiments of this application;
[0079] Figure 16 The interface diagram provided in this application embodiment shows that some information is transmitted across applications and then feedback is provided by the snack bar.
[0080] Figure 17A schematic diagram of an interface for providing feedback via capsule after information is transmitted across applications, as provided in the embodiments of this application;
[0081] Figure 18 This application provides a schematic diagram of a process involving secondary transmission via a capsule and subsequent capsule unfolding;
[0082] Figure 19 A schematic diagram of an interface that provides feedback via a floating window after information is transmitted across applications, as provided in the embodiments of this application;
[0083] Figure 20 A schematic diagram of an interface provided in this application embodiment for feedback via a snackbar after information is transmitted across devices;
[0084] Figure 21 A schematic diagram of an interface that provides feedback via toast when cross-device transmission of some information fails, as provided in the embodiments of this application;
[0085] Figure 22 This application provides a schematic diagram illustrating the process of updating icons in an icon area.
[0086] Figure 23 Some interface diagrams showing application service icons to users based on location information are provided for embodiments of this application;
[0087] Figure 24 Some interface diagrams provided for embodiments of this application show application service icons displayed to users based on location and time information;
[0088] Figure 25 Some interface diagrams provided for this application embodiment show how application service icons are displayed to users based on QR code images;
[0089] Figure 26 Some interface diagrams for displaying application service icons to users based on facial images, provided for embodiments of this application;
[0090] Figure 27 Some interface diagrams provided for embodiments of this application show how information is transmitted via chat interface thumbnails in a "cross-application transmission interface";
[0091] Figure 28 Some interface diagrams for cross-application information transmission via sidebar icons provided for embodiments of this application;
[0092] Figure 29 Interface diagrams of some custom sidebar icons provided for embodiments of this application;
[0093] Figure 30 This application provides a schematic diagram illustrating the process of transferring screen recording files across applications.
[0094] Figure 31 This application provides a schematic diagram illustrating the process of cross-application transmission of an edited screenshot image, as provided in an embodiment of the present application.
[0095] Figure 32 This application provides a schematic diagram illustrating the process of transmitting long screenshot images across applications.
[0096] Figure 33 System settings interface diagrams related to some "intelligent circulation" functions provided in the embodiments of this application;
[0097] Figure 34 System settings interface diagrams related to some "intelligent circulation" functions provided in the embodiments of this application;
[0098] Figure 35 An architectural diagram of an electronic device provided in an embodiment of this application;
[0099] Figure 36 This is a flowchart of an information transmission method provided in an embodiment of this application. Detailed Implementation
[0100] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to include the plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used in this application refers to and includes any or all possible combinations of one or more of the listed items.
[0101] To facilitate understanding, the relevant terms involved in the embodiments of this application will be introduced below.
[0102] (1) Cross-application and cross-device transmission of information
[0103] Cross-application information transfer refers to the transmission of information between two applications on the same device. This involves using one application to obtain target information and then using another application to share, save, or edit that information. Examples include forwarding text or images from a webpage in a browser to a WeChat friend, or sending an image sent by a WeChat friend to a QQ friend.
[0104] Cross-device information transfer refers to the transmission of information between two devices after establishing a communication connection via technologies such as Wi-Fi, Bluetooth, or cellular networks. Examples include users transferring images between two devices using Bluetooth, or sharing images from a mobile phone to a personal computer on the same network.
[0105] Specifically, the above information can be images, text, videos, audio, links, documents, etc.
[0106] (2) Cross-application transmission interface
[0107] In this application, the "cross-application transfer interface" (or cross-application transfer interface) is an interactive method provided by an electronic device based on the user's needs for cross-application and cross-device information transfer. In some embodiments of this application, this function can also be called "intelligent transfer". As its name suggests, under any interface displayed by the electronic device, when the user needs to transfer information in the interface across applications or devices, the user only needs to long press the information element in the interface and drag it to the edge of the screen. The electronic device will then perform a three-dimensional transformation of the original interface displayed on the screen, creating a visual effect of the original interface pushing inwards, and display the recommended icon for the element on the side of the screen (for details, please refer to the relevant descriptions in the subsequent embodiments, which will not be repeated here). The recommended icon can be the service icon of the application. Afterwards, the user places the dragged information element on the icon and releases it to transfer the information element to the application service corresponding to the icon and start the corresponding application service function. Specifically, in this application, an application (APP) installed on an electronic device may have multiple application services. In the cross-application transmission interface provided in this application, the service icons of the applications displayed may include some or all of the application service icons provided by the same application (APP). This application does not limit this.
[0108] (3) Small window, capsule, snack bar, toast feedback and sidebar
[0109] "Mini windows" are system tools on smart devices that allow application windows to float above the interface or desktop, enabling users to easily switch between recently used applications. As a shrunk application interface, a floating window can be displayed on top of other application interfaces (such as full-screen applications), while still displaying its inherent interface style and function list. Users can directly operate the controls in the floating window without closing or exiting other applications. For example, if you receive a message from WeChat or QQ while playing a game or watching a video in full-screen mode, the corresponding chat interface can appear as a floating window directly above the game interface. Users can view and reply to messages in the chat interface displayed in the mini window without switching or exiting the currently open application.
[0110] A "capsule" is a minimized form of a small window, named for its capsule-like shape. Unlike a regular small window, it typically doesn't display the application's interface or function list; instead, it appears as a small icon on the side of the electronic device screen. Users can tap the capsule to expand it, and once expanded, it will appear on top of the screen as the application interface (e.g., a small window).
[0111] Toast feedback is a lightweight feedback method, a type of non-modal pop-up. Common toast feedback formats include text or a combination of text and an icon. Its placement varies depending on the context, appearing at the top, middle, or bottom of the page. It disappears automatically after a certain time interval (3-5 seconds) or when the user clicks on another location. Toast feedback minimizes disruption to the user's workflow. Its drawbacks include the ease with which users may ignore it and its unsuitability for displaying excessive information, as it may disappear before the user has finished reading the message.
[0112] A "snack bar" is a lighter feedback method than a toast notification. It contains a line of text related to the ongoing action and may include corresponding navigation controls, allowing users to easily navigate to the application interface related to the action. The snack bar is also a non-modal pop-up, generally used to notify the user of a process that is currently happening or about to happen. Its content is always related to the user's current action. It typically appears briefly at the bottom of the screen, without interrupting the user experience, requiring no user interaction, and disappears automatically after a period of time. Furthermore, in some implementations, if the snack bar appears on the interface, the user can click on an area outside the snack bar to make it disappear.
[0113] A "sidebar" is a shortcut area displayed on the side of an electronic device's screen that can hold multiple application icons. Users can customize the types of applications and the order of the icons in the sidebar. From any screen, users can swipe inwards from the edge of the screen and pause to bring up the sidebar, click on an application icon to open the corresponding application, and the application will typically appear as a small window on top of the screen.
[0114] (4) Global Favorites
[0115] Global Collection is an application service provided in this application embodiment, which can be used to collect elements such as images, text, voice, and web pages that users have browsed on electronic devices. After collecting elements into the Global Collection application service, users can also edit the collected elements, such as adding tags to collect videos to mark important points, so that users can efficiently review the key information carried by the elements when reviewing them.
[0116] Users can add elements to the global collection application service by swiping down with three fingers, or they can add elements to the global collection application service through the cross-application transfer interface provided in this application. After successfully adding an element to the global collection application service, the electronic device can display the corresponding capsule on the interface, making it convenient for users to add other elements on the interface to the global collection application service. Please refer to the relevant descriptions in the following embodiments for details, which will not be repeated here.
[0117] With the continuous development of electronic information technology, smartphones, tablets, and other smart devices have become indispensable products in our daily lives, work, and entertainment. When using smart devices, users often open multiple applications simultaneously to work together, and frequently use them to transfer information across applications—processing, sharing, and uploading information from one application to another. However, when users need to transfer information across applications, they often need to perform complex and cumbersome operations to complete the task.
[0118] Figure 1 This demonstrates the specific process by which a user adds text from the "Novel Reading" app to the "Notes" app.
[0119] Figure 1 User interface 01, shown in (A), is the interface displayed on the electronic device after a user opens a novel in the "Novel Reading" application. User interface 01 includes a status bar 011, text information 012, a text option list 013, and a navigation bar 014, wherein:
[0120] The status bar 011 can include the operator's name (such as China Mobile), time, Wi-Fi icon, signal strength, and current remaining battery power.
[0121] Text message 012 can be divided into two parts. The text message "ABCDEFGHIJKLMN" represents the text the user intends to transfer to other applications (e.g., copied into a note-taking application), therefore this part is currently selected by the user and is in the dark area; while the text message "OPQRSTUVWXYZ" is not selected by the user and is therefore not in the dark area. It should be understood that, although... Figure 1As not shown in the image, when selecting text, the user can long-press on the text information 012 to adjust the positions of the first cursor 0121 and the last cursor 0122 after they appear to complete the text selection.
[0122] The text option list 013 includes copy, select all, search, translate, and share options. The copy option copies the selected text, which the user can then paste into other text boxes on the electronic device. The select all option selects all text in interface 01 with a single click. The search option uses the electronic device's search function to search for the selected text. The translate option translates the selected text, such as from Chinese to English or English to Chinese. The share option allows the user to share the selected text. Any option can be used in response to a user action, such as a click, causing the electronic device to perform the corresponding action.
[0123] The navigation bar 014 may include system navigation keys such as a back button 0141, a home screen button 0142, and a task history button 0143. When the user clicks the back button 0141, the electronic device can display the previous user interface. When the user clicks the home screen button 0142, the electronic device can display the home screen interface set by the user. When the user clicks the task history button 0143, the electronic device can display the tasks recently opened by the user. The navigation keys can also be named differently; for example, the back button could be called Back Button, the home screen button could be called Home button, and the task history button could be called MenuButton. This application does not impose any limitations on this. Furthermore, the navigation keys in the navigation bar are not limited to virtual buttons and can also be implemented as physical buttons.
[0124] After the user selects the text, the user can first... Figure 1 The click operation of the copy option shown in (A) copies the selected text information. Then, in order to add the copied text information to the note-taking application's excerpt page, the user then... Figure 1 The action of clicking button 0142 on the main interface, as shown in (A), causes the electronic device to exit the current user interface 01 and display the main interface. For the specific style of the main interface, please refer to [reference needed]. Figure 1 User interface 02 is shown in (B) above. User interface 02 may include a status bar 021, a calendar / weather widget 022, an application area 023, a dock area 024, and a navigation bar 025, wherein:
[0125] The specific functions of status bar 021 and navigation bar 025 can be found in the aforementioned description of user interface 01, and will not be repeated here.
[0126] The Calendar Weather Widget 022 can be used to indicate the current time, such as date, day of the week, and hour and minute information, as well as the weather type, such as cloudy turning sunny, light rain, temperature, and location.
[0127] Application area 023 may contain application icons such as "Novel Reading" or "Notes" (0231), and may also contain icons of other applications; this embodiment does not limit this. Any application icon can be used to respond to user actions, such as touch operations, causing the electronic device to launch the application corresponding to the icon.
[0128] Dock area 024 may contain icons such as "Phone," "SMS," "Browser," and "Camera," and may also contain icons of other applications; this embodiment does not limit this. Any application icon can be used to respond to user actions, such as touch operations, causing the electronic device to launch the application corresponding to the icon. Regardless of how the user switches screen interfaces, the size of dock area 024 and the applications it contains remain unchanged on the screen interface and are always displayed on the current interface.
[0129] To insert the previously selected and copied text information into the note-taking page of the application notes, such as... Figure 1 As shown in (B), the user needs to open the application "Notes" by clicking on the application icon 0231; the electronic device can respond to the user's click on the application icon 0231 by displaying the following... Figure 1 User interface 03 is shown in (C). In user interface 03, the user can first long press on the blank area in input area 031 to bring up input option box 032, and then click the paste option in input option box 032 to paste the previously selected text information into input area 031.
[0130] After pasting the text information, you can refer to the interface displayed on the electronic device. Figure 1 User interface 04 is shown in (D). As shown in user interface 04, the text information selected by the user in the "Novel Reading" application has been successfully entered into the "Notes" application. Afterwards, the electronic device can respond to the user's click on the confirmation control 042 and save the user's newly created note.
[0131] from Figure 1As can be seen from the specific process of text transmission across applications, this method of information transmission across applications requires multiple operation steps and involves switching between multiple applications and pages. The interaction efficiency between the user and the electronic device is very low, which seriously affects the user experience.
[0132] Figure 2 This demonstrates the specific process by which a user adds photos from the "Photos" app to the "Notes" app using the split-screen function provided by the electronic device.
[0133] like Figure 2 As shown in (A), the user interface 05 includes a first display area 051 and a second display area 052. The first display area 051 displays the application interface for the "Notes" application, and the second display area 052 displays the application interface for the "Photo Album" application. Specifically:
[0134] The first display area 051 includes an input area 0511 and a function list 052, wherein:
[0135] Input area 0511 is used to receive and display notes such as text and images entered by the user.
[0136] Function list 052 may include sharing options, favorite options, deletion options, and more. Any option can respond to a user's click, causing the electronic device to perform the function corresponding to the selected option for the current note.
[0137] The second display area 052 includes an image display area and an image thumbnail atlas 0522, wherein:
[0138] Image display area 0521 is used to display images saved by the user in the gallery;
[0139] Image thumbnail set 0522 is a thumbnail set formed after the user selects multiple images from the image display area 0521 and drags them up (i.e., the images the user currently wants to put into the notes). The number "3" displayed in the upper left corner indicates that the user has selected a total of three images.
[0140] like Figure 2 As shown in (A), users can press and hold image thumbnail set 0522 and drag it to the first display area 051, then release the button to add multiple images corresponding to image thumbnail set 0522 to the application "Notes". For details, please refer to [link / reference]. Figure 2User interface 06 is shown in (B) above. It should be noted that, in user interface 06, due to the limited area of the first display area 061, although the three images selected by the user (i.e. the three images corresponding to the image thumbnail set 0522) have all been added to the application "Notes", they are not fully displayed in the first display area 061.
[0141] Although Figure 2 The process of transmitting information across applications simplifies the user's operation steps to some extent, but the electronic device needs to keep two application interfaces displayed at the same time, which makes the user's reading experience poor. In addition, the user also needs to operate the electronic screen to split the two application interfaces, which is also cumbersome. The interaction efficiency between the user and the electronic device has not been improved, and the user experience is still poor.
[0142] against Figure 1 and Figure 2 To address the shortcomings of existing cross-application information transmission methods, this application provides an information transmission method and an electronic device. This electronic device can be used to implement the method. When implementing the method, the electronic device can display a cross-application transmission interface, enabling the electronic device to efficiently and quickly complete information transmission between applications. This effectively reduces the number of operation steps required for users to complete cross-application information transmission, improves the interaction efficiency between users and electronic devices, and thus enhances the user experience.
[0143] Specifically, on any interface displayed on an electronic device, when a user needs to transfer information across applications or devices, the user can long-press an information element on the interface and drag it to the edge of the screen. The electronic device will then perform a three-dimensional transformation of the original screen display, creating a visual effect of the original interface pushing inwards, and display recommended application service icons on the side of the screen. The user interface displayed on the electronic device at this time is the cross-application transfer interface. Afterwards, the user can place the dragged information element on the application service icon and release it to transfer the information to the application service corresponding to the icon and activate the corresponding application service function. It should be noted that the aforementioned information elements can be images, text, videos, voice, links, documents, etc., and other elements are not limited in this application. Furthermore, "cross-application transfer interface" is merely a name used in the embodiments of this application; its meaning has been recorded in the embodiments of this application, and its name does not constitute any limitation on this embodiment.
[0144] The user interface provided in the embodiments of this application is described below.
[0145] First, we will introduce the user interface involved in the triggering process of the cross-application transmission interface.
[0146] Figure 3This diagram illustrates the changes in the electronic device's interface when a user transfers images across applications using a cross-application transfer interface.
[0147] like Figure 3 As shown in (A), the user interface 07 can be the application interface of a "browser" application in an electronic device, or it can be an application... The application interface can be any of the applications mentioned above, and this application does not limit it to any other application interface. The user interface 07 may include an image 071, text 072, text 073, and a status bar 074. The electronic device can respond to user operations on the image 071, such as... Figure 3 The long press operation shown in (A) displays as follows: Figure 3 User interface 08 is shown in (B) of the diagram.
[0148] like Figure 3 As shown in (B), in user interface 08, the original image 071 is transformed into image 081 by the user's long press operation. While the user does not release the press, image 081 can move within user interface 08 with the user's fingertip, and image 081 can be displayed on top of user interface 08 (i.e., image 081 can cover any element in user interface 08). It should be understood that the image content displayed by image 081 is the same as that displayed by image 071. Optionally, image 081 can be a thumbnail obtained by shrinking image 071; that is, image 081 and image 071 are identical except for their size. Optionally, after image 071 is dragged to form image 081, the electronic device can still display image 071 in user interface 08 and blur or blur it, meaning the clarity of image 071 in user interface 08 can be lower than the clarity of image 071 in user interface 07, to indicate to the user that image 071 is selected and dragged.
[0149] Electronic devices can respond to user operations on image 081, such as Figure 3 The drag operation shown in (B) displays as follows: Figure 3 The user interface shown in (C) is 09.
[0150] Optionally, if the user drags image 081 to a distance less than a certain threshold from the right or left edge of the screen, the electronic device displays user interface 09. This will be explained in detail later and will not be elaborated on here. Figure 3 As shown in (C), the user interface 09 is the cross-application transmission interface mentioned in the foregoing description, which may include a sub-interface 091, an icon area 092, and an image 093. Wherein:
[0151] The elements displayed in sub-interface 091 (such as text, images, etc.) are the same as those displayed in user interface 07 (except for the status bar). In fact, sub-interface 091 can be considered as the interface obtained by the electronic device after a three-dimensional transformation of all elements (except the status bar) of the original user interface 07. In user interface 09, sub-interface 091 can create a visual effect on the screen that makes the original interface (i.e., user interface 07) appear to push inward. Understandably, this "opening" visual effect metaphorically represents the act of transmitting elements (information), which is more intuitive than copying and pasting. Optionally, in user interface 09, the background behind sub-interface 091 can be set to the electronic device's desktop background (i.e., desktop wallpaper) with a blurred effect.
[0152] The icon area 092 can be used to display application service icons recommended by one or more electronic devices based on the information element selected by the user (i.e., image 071 in this embodiment).
[0153] Optionally, each icon in icon area 092 has a corresponding text description below it. This text description can be used to explain the specific application name or application service name corresponding to the icon. Taking icon 0921 and text 0922 as an example, when icon 0921 represents an application... When the icon is 0922, the text 0922 can be "WeChat"; when the icon is 0921, it represents an application. When the icon for the "Moments" app service is displayed, the text 0922 can be either "Moments" or "WeChat Moments". When the icon 0921 is for the app... When using the "Scan" function to scan an application service icon, the text "0922" can be either "Scan" or "WeChat Scan". It should be understood that the text below each application service icon is only to help users understand the specific application or function corresponding to the icon; however, this application does not impose any restrictions on the specific icon style or text content.
[0154] The image content displayed in image 093 is the same as that displayed in images 071 and 081. Optionally, image 093 can be a thumbnail of image 081 obtained by reducing its size on an electronic device. Similarly, image 093 is identical to images 081 and 071 except for its size. Thus, when a user selects their desired application service in icon area 092, image 093 will not significantly obscure the icons and text in icon area 092, making it easier for the user to select icons.
[0155] It should be noted that, unlike the reduction process of image 071, after image 081 is reduced to image 093, image 081 may no longer be displayed in user interface 09. That is, image 081 can be regarded as an image obtained by copying image 071 and then reducing it, while image 093 can be regarded as an image obtained by directly reducing image 081.
[0156] In user interface 09, the user drags the information element (i.e., image 093) and places it on the corresponding icon in icon area 092 and releases it. The electronic device can then respond to the user's operation by transmitting the information element to the application service corresponding to the icon and displaying the application interface or feedback information corresponding to the application service icon. This will be explained in more detail later, but will not be elaborated on here.
[0157] Furthermore, to guide users to accurately place the dragged element into the desired application service, when image 093 approaches an icon in icon area 092, or when the distance between image 093 and an icon in icon area 092 is less than a certain threshold, the icon approached by image 093 can display certain special effects. For example, the icon and its corresponding text can be snapped closer to image 093, and the icon and its corresponding text can be enlarged. Taking icon 0923 and its corresponding text 0924 in user interface 09 as an example, when image 093 approaches icon 0923, icon 0923 and text 0924 are positioned slightly to the left compared to other icons and text, meaning they are closer to image 093 than other icons and text. In addition, icon 0923 is also enlarged to indicate to the user that if they release their finger here, image 093 (or image 071) will be transferred to the application service corresponding to icon 094.
[0158] Understandable Figure 3 The cross-application information sharing process shown is continuous, from the user dragging an element to placing it into the target application service. "Continuous" here means that the user does not need to perform operations such as copying and pasting, nor does the user need to switch applications. The user's fingers do not need to leave the screen of the electronic device throughout the entire operation, making the operation simple and fast. Moreover, this information transmission method ensures the effective browsing area of the user interface, which can effectively improve the efficiency of users' cross-application information transmission and enhance the user experience.
[0159] Figure 4 This diagram illustrates the interface changes of an electronic device when a user transmits text across applications using a "cross-application transmission interface".
[0160] like Figure 4 As shown in (A), the user interface 11 can be the application interface of a "browser" in an electronic device, or it can be an application... The application interface can be any of the applications mentioned above, and this application does not limit it to any other application interface. The user interface 11 may include text 111, text 112, images 113, and a text option list 114, wherein:
[0161] Text 111 represents the text the user intends to share to other applications; therefore, this text is currently selected and highlighted in a darker area. Correspondingly, text 112 represents the unselected text. It's important to understand that unlike the independence of images, text inherently possesses continuity. For a given paragraph of text, a user may only need a portion of it to share. Therefore, although... Figure 4 As not shown, when selecting text in the user interface 11, the user can long-press any text information in the user interface 11. After the first cursor 111A and the last cursor 111B appear, the user can adjust the positions of the first cursor 111A and the last cursor 111B to complete the text selection. Figure 4 As shown in (A), the user has selected the text 111 by adjusting the positions of the first cursor 111A and the last cursor 111B.
[0162] The text options list 114 includes options to copy, select all, search, translate, and share. Any option can be used in response to a user action, such as a click, causing the electronic device to perform the action corresponding to that option.
[0163] Similar to dragging an image, electronic devices can also respond to user actions on the text "111", for example... Figure 4 The operation shown in (A) is a long press and drag, which displays as follows: Figure 4 User interface 12 is shown in (B) of the diagram.
[0164] like Figure 4As shown in (B), in user interface 12, the original text 111 is lifted to form text 121 by a long press operation. Without releasing the user's finger, text 121 can move within user interface 12 and can be displayed on top (i.e., text 121 can cover any element in user interface 08). It should be understood that the text content contained in text 111 is the same as the text content contained in text 121. Optionally, text 121 can also be text obtained by shrinking text 111. After text 111 is lifted to form text 121, the electronic device can still display text 111 in user interface 12 and blur or blur it, meaning the clarity of text 111 in user interface 12 can be lower than the clarity of image text 111 in user interface 11, to indicate to the user that text 111 is selected and lifted.
[0165] Electronic devices can respond to user actions on text 121, for example Figure 4 The drag operation shown in (B) displays as follows: Figure 4 User interface 13 is shown in (C) in the image. (See image 13.) Figure 4 As shown in (C), user interface 13 is the cross-application transmission interface mentioned in the foregoing description, which may include sub-interface 131, icon area 132, and text 133. Wherein:
[0166] For details on the style and function of sub-interface 131 and icon area 132, please refer to the aforementioned description. Figure 3 The relevant descriptions of the Chinese user interface 09 will not be repeated here.
[0167] It should be noted that the text content contained in text 133 is the same as that contained in text 111 and text 121. However, as can be seen from user interface 12 and user interface 13, text 133 is the text obtained by shrinking text 121 on the electronic device; that is, after the "Cross-application transfer interface" is opened, the electronic device also shrinks the text dragged by the user to a certain extent, so that text 133 will not obscure the icons and text in the icon area 132, making it easier for the user to select.
[0168] Similarly, in user interface 13, when a user places the dragged information element (i.e., text 133) on the corresponding icon in icon area 132 and releases it, the electronic device can respond to the user's operation by transmitting the information element to the application service corresponding to the icon and displaying the application interface or feedback information corresponding to the application service icon.
[0169] Of course, even when the electronic device is in landscape mode, users can still transfer elements on the current screen across applications using the "Cross-Application Transfer Interface." The specific process and interface style can be found in the aforementioned section. Figure 2 , Figure 3 Related instructions and Figure 5 The user interfaces 14 and 15 shown here will not be described in detail here.
[0170] It's important to understand that most smart devices currently offer users a quick screenshot function. For example, in some scenarios, users can double-tap the screen or swipe down with three fingers to take a full-screen screenshot of the current interface. Furthermore, after a screenshot is taken, some smart devices also provide recognition functions to analyze the captured image (e.g., extracting text or translating text). Therefore, regarding the screenshot function provided by electronic devices, the following section will combine... Figure 6 as well as Figure 7 This document explains the process of transferring captured images or text within captured images across applications using a cross-application transfer interface in a screenshot scenario.
[0171] Figure 6 This diagram illustrates the interface changes of an electronic device when a user transfers a captured image across applications via a cross-application transfer interface.
[0172] like Figure 6 As shown in (A), the user interface 16 can be the application interface of a "browser" in an electronic device, or it can be an application... The application interface can be any of the applications mentioned, and this application does not limit this to any other application interface. Responding to a user's quick screenshot operation on the user interface 16, for example... Figure 6 As shown in (A), a double-tap operation with the knuckle allows the electronic device to quickly capture a full-screen image of the user interface 16 and display it as shown in Figure 16. Figure 6 User interface 17 is shown in (B) of the diagram.
[0173] like Figure 6 As shown in (B), the user interface 17 may include a screenshot image 171. The screenshot image 171 is the image obtained by the electronic device in response to a user's knuckle screenshot of the user interface 16. After a screenshot is taken, the screenshot image 171 can be displayed in the user interface 17 and generally lasts for two to three seconds, allowing the user to directly click on the screenshot image 171 to edit, save, or perform other operations. If the user does not interact with the screenshot image 171, the electronic device can automatically save it to the photo album.
[0174] In this embodiment, during the period when the electronic device displays the screenshot image 171 in the user interface 17, the user can long-press and drag the screenshot image 171 or drag it directly to the side of the electronic device screen, and then transfer it across applications through the "cross-application transfer interface". Figure 6 As shown in (B), the electronic device can respond to the user's operation of dragging the screenshot image 171 to the side, displaying as shown in Figure 171. Figure 6 User interface 18 is shown in (C).
[0175] like Figure 7 As shown in (C), user interface 18 is the cross-application transfer interface. User interface 18 may include sub-interface 181, icon area 182, and image 183, wherein:
[0176] The specific content and functions of sub-interface 181 and icon area 182 can be found in the foregoing description, and will not be repeated here.
[0177] Similarly, in order not to obscure the icon area 182 too much, when the screenshot image 171 is close to the icon area, the electronic device shrinks the original screenshot image 171 to obtain image 183.
[0178] Similarly, in user interface 18, when a user places image 183 on the corresponding icon in icon area 182 and releases it, the electronic device can respond to the user's operation by transmitting the information element to the application service corresponding to the icon and displaying the application interface or feedback information corresponding to the application service icon.
[0179] If the user releases their hand before placing image 183 on the corresponding icon in icon area 182, the electronic device can respond to the operation by redisplaying user interface 17.
[0180] In this embodiment of the application, user interface 16 can be referred to as the "fifth interface", user interface 17 can be referred to as the "sixth interface", screenshot image 171 or image 183 can be referred to as the "first image", user interface 18 can be referred to as the "seventh interface", and the operation of the user placing image 183 on the corresponding icon in icon area 182 and releasing the finger can be referred to as the "ninth operation".
[0181] Figure 7 This diagram illustrates the interface changes of an electronic device when a user transmits text from a captured image across applications via a cross-application transfer interface.
[0182] like Figure 7 As shown in (A), the user interface 19 can be the application interface of a "browser" in an electronic device, or it can be an application... The application interface can be the interface of other applications, and this application does not limit this. Responding to a user's quick screenshot operation on user interface 19, for example... Figure 7 As shown in (A), the knuckle selection operation (i.e., drawing a region on the screen using the knuckle) allows the electronic device to quickly capture the image selected by the user using the knuckle and display it as shown in the image. Figure 7 User interface 20 is shown in (B) of the diagram.
[0183] like Figure 7 As shown in (B), the user interface 20 may include a thumbnail 201, a partial screenshot frame 202, an identification control 203, a sharing control 205, and a shape option box 204. Wherein:
[0184] Thumbnail 201 can be a thumbnail of the aforementioned user interface 19.
[0185] The partial screenshot frame 202 is the screenshot area determined by the electronic device in response to the user's knuckle selection screenshot operation on the user interface 19. The user can adjust the edge of the partial screenshot frame 202 by dragging its edge, and can also adjust its specific position in the thumbnail 201 by pressing and holding the center area of the partial screenshot frame 202. It should be understood that for the electronic device, the partial screenshot frame 202 is only used to select the image in the thumbnail 211 at this time, and the electronic device cannot obtain the information contained in the image in the partial screenshot frame 202 (such as text information).
[0186] The recognition control 203 is used to recognize the text information contained in the image in the partial screenshot frame 202.
[0187] The sharing control 205 is used to share the image in the partial screenshot frame 202.
[0188] The shape option box 204 includes freeform options, rectangle options, ellipse options, and heart-shaped options. The electronic device can respond to the user's touch operation on any option, such as a click operation, and adjust the specific shape of the partial screenshot box 202 to the shape corresponding to the option.
[0189] like Figure 7 As shown in (B), the electronic device can recognize the text information contained in the image within the partial screenshot frame 202 in response to a user's click operation on the recognition control 203. After the text information is recognized, the text information contained in the image within the partial screenshot frame 202 can be selected by the first and last cursor boxes. See reference [link / reference] for details. Figure 7The content displayed in text box 212 of user interface 21 (C). Afterwards, the user can long-press the recognized text information and drag it to the side of the electronic device screen to transfer the recognized text across applications through the "Cross-application transfer interface".
[0190] like Figure 7 As shown in (C), the user interface 21 may include a thumbnail 211, a partial screenshot frame 202, text 2121, and text information 213, wherein:
[0191] Thumbnail 211 can be a thumbnail of the aforementioned user interface 19.
[0192] The partial screenshot frame 202 is the same as the partial screenshot frame 202 mentioned above. The text information in the image selected by the partial screenshot frame 202 has been recognized and extracted by the electronic device; this text is... Figure 7 The text 2121 is shown in (C) in the middle.
[0193] Text 213 is a long press operation performed by the user on text information 211. Figure 7 (Not shown in the image) The text that is dragged after the text. For example... Figure 7 As shown in (C), after the user drags the text 213, the user can drag the text information 213 to the side of the electronic device screen, and the electronic device can respond to the user's operation and display as shown in (C). Figure 8 User interface 22 is shown in (D) in the diagram.
[0194] like Figure 8 As shown in (D), user interface 22 is the cross-application transfer interface. User interface 22 may include sub-interfaces 221, icon areas 222, and text 223, wherein:
[0195] The specific content and functions of sub-interface 221 and icon area 222 can be found in the foregoing description, and will not be repeated here.
[0196] Similarly, in order not to cause too much obstruction in the icon area 222, the electronic device shrinks the text 213 when the text 223 is close to the icon, resulting in text 223.
[0197] Similarly, in user interface 22, when a user places text 223 on the corresponding icon in icon area 222 and releases it, the electronic device can respond to the user's operation by transmitting text 223 to the application service corresponding to the icon and displaying the application interface or feedback information corresponding to the application service icon.
[0198] In this embodiment of the application, user interface 19 can be referred to as the "eighth interface", user interface 20 can be referred to as the "ninth interface", text 2121, text 223, and text 213 can all be referred to as "first text information", recognition control 203 can be referred to as "text recognition control", user interface 21 can be referred to as the "tenth interface", the operation of the user dragging text information 213 to the side of the electronic device screen can be referred to as the "tenth operation", user interface 22 can be referred to as the "eleventh interface", the operation of the user placing text 223 on the corresponding icon in the icon area 222 and releasing the finger can be referred to as the "eleventh operation".
[0199] Of course, images captured by users through the partial screenshot function can also be transferred through the cross-application transfer interface. Figure 7 This demonstrates the process of a user sharing an image captured by the partial screenshot function through a cross-application transfer interface.
[0200] like Figure 8 The user interface 20 shown in (A) is the front. Figure 8 The user interface 20 is shown in (B) of the diagram. Combined with... Figure 8 As described above, the user interface 20 may include a thumbnail 201, a partial screenshot frame 202, a recognition control 203, a sharing control 205, and a shape selection box 204. The partial screenshot frame 202 is the screenshot area determined by the electronic device in response to the user's knuckle gesture to select a screenshot area on the user interface 19. It should be understood that although the partial screenshot frame 202 contains text, since the user has not clicked the recognition control 203, the partial screenshot frame 202 captures an image containing the text. Similarly, as... Figure 9- Figure 11 As shown in (A), the user can long press and drag the image captured by the partial screenshot frame 202 to the side of the electronic device screen, and then transfer the image captured by the partial screenshot frame 202 across applications through the "Cross-application transfer interface".
[0201] like Figure 9 As shown in (B), user interface 23 is the cross-application transfer interface. User interface 23 may include sub-interface 231, icon area 232, and image 233, wherein:
[0202] The specific content and functions of sub-interface 231 and icon area 232 can be found in the foregoing description, and will not be repeated here.
[0203] Similarly, to avoid excessive obstruction of the icon area 232, when the image in the partial screenshot frame 202 is dragged and brought close to the icon, the electronic device can shrink the image in the partial screenshot frame 202, resulting in image 233. It should be noted that when sharing the image in the partial screenshot frame 202 using the "cross-application transfer interface," the shape of the partial screenshot frame 202 is preserved; that is, the shape of image 233 is the same as the shape displayed by the partial screenshot frame 202.
[0204] Similarly, in user interface 23, when a user places image 233 on the corresponding icon in icon area 232 and releases their hand, the electronic device can respond to the user's operation by transmitting image 233 to the application service corresponding to the icon and displaying the application interface or feedback information corresponding to the application service icon.
[0205] In this embodiment of the application, the user interface 20 can be referred to as the "sixth interface", the user interface 23 can be referred to as the "seventh interface", and the operation of the user placing the image 233 on the corresponding icon in the icon area 232 and releasing the hand can be referred to as the "ninth operation".
[0206] It's important to understand that users frequently drag and drop elements when using electronic devices. Therefore, determining appropriate trigger rules for cross-application interface transfer based on user actions, and guiding users to display the "cross-application transfer interface" based on their operating habits, is crucial for further improving the efficiency of user interaction with electronic devices. Therefore, the following will combine... Figure 9 This section explains the triggering rules for cross-application transmission interfaces.
[0207] Figure 9 This is a schematic diagram illustrating cross-application transmission interface triggering rules, provided as an embodiment of this application.
[0208] like Figure 9 As shown in (A), the user interface 24 can be the application interface of a "browser" in an electronic device, or it can be an application... The application interface can be the interface of other applications, and this application does not limit it.
[0209] The following explanation uses image 241 of user interface 24 as an example. Figure 9 As shown in (A) above, and in conjunction with the foregoing description, the user can drag image 241 by long-pressing it. In response to the user's dragging operation of image 241, the electronic device can display as shown below. Figure 9 User interface 25 is shown in (B) of the diagram.
[0210] like Figure 9As shown in (B), the user interface 25 may include image 241, image 251, left trigger area 252L, and right trigger area 252R. In this embodiment, the left trigger area 252L and the right trigger area 252R may be collectively referred to as the "first trigger area," wherein:
[0211] Image 251 is a thumbnail formed after the user drags image 241. If the user does not release the finger, image 251 can move in the user interface 08 with the user's fingertip. For details, please refer to the aforementioned relevant descriptions, which will not be repeated here.
[0212] The left trigger area 252L is a rectangular area bounded by the left edge of the electronic screen, and the right trigger area 252R is a rectangular area bounded by the right edge of the electronic screen. Specifically, the length of the left trigger area 252L can be d1, and the width can be W; the length of the right trigger area 252R can be d1, and the width can be W. Here, d1 can be set to 25% of the width of the electronic device screen, such as... Figure 9 As shown in (A), the width of the screen is L, and W can be the height of the electronic device screen, such as... Figure 9 As shown in (A), the screen height is h. It should be noted that in the user interface 25, the left trigger area 252L and the right trigger area 252R are displayed as dark transparent areas only to facilitate the user's understanding of the specific location and area of these two areas. In actual application scenarios, the specific size and position of these two areas may not be displayed in the user interface. That is, the user cannot directly observe the specific outline of these two areas in the user interface 25. The size and position of these two areas may be stored in the electronic device only in a form that the electronic device can perceive (e.g., program code).
[0213] When the user drags image 251 into the left trigger area 252L or the right trigger area 252R, the electronic device can display a special effect at the edge of the screen. Optionally, the electronic device can also display a special effect at the edge of the screen after the user has dragged image 251 into the left trigger area 252L or the right trigger area 252R and held the image in the left trigger area 252L or the right trigger area 252R for a duration T, to prompt the user to drag the image further towards the side of the screen. Specifically, the aforementioned T can be set to 600 milliseconds.
[0214] It should be understood that "dragging image 251 into the left trigger area 252L or the right trigger area 252R" means that after the user drags image 251, the touch point (i.e., the anchor point) between the user's finger and the screen enters the left trigger area 252L or the right trigger area 252R. It does not mean that image 251 completely enters the left trigger area 252L or the right trigger area 252R.
[0215] likeFigure 9 As shown in (B), when the user drags image 241 into the right trigger area 252R, the electronic device can respond to the operation and display as shown in Figure (B). Figure 9 The user interface 26 is shown in (C) above. The user interface 26 may include image 241, image 251, and effects area 261. The effects area 261 may display user-visible effects such as glow effects and shadow effects, or other user-perceptible effects; this application does not limit this.
[0216] As described above, the special effects area 261 prompts the user to drag the image further towards the side of the screen, triggering the "Cross-Application Transfer Interface" to transfer the element to other applications. Therefore, in this embodiment, after the element is dragged, the user interface also includes an opening area. When the user drags the dragged element further into the opening area, the electronic device can respond to this operation and display the cross-application transfer interface. Figure 9 As shown in (C), when the user drags image 251 to the right until it enters the door opening area, the electronic device responds to the operation and displays as shown in (C). Figure 9 User interface 27 is shown in (D).
[0217] like Figure 9 As shown in (D) of the diagram, the user interface 27 may include image 241, image 251, a left-opening door area 271L, and a right-opening door area 271R. In this embodiment, the left-opening door area 271L and the right-opening door area 271R may be collectively referred to as the "second trigger area," wherein:
[0218] The left-opening area 271L is a rectangular area bounded by the left edge of the electronic screen, and the right-opening area 271R is a rectangular area bounded by the right edge of the electronic screen. Specifically, the length of the left-opening area 271L is d2 and the width is W; and the length of the right-opening area 271R is also d2 and the width is also W. Here, d2 can be set to 36 pixel units, and W can be the height of the electronic device screen. It should be noted that in the user interface 27, the left-opening area 271L and the right-opening area 271R are displayed as dark transparent areas only to facilitate the reader's understanding of the specific location and area of these two areas. In actual application scenarios, the specific size and position of these two areas may not be displayed in the user interface. That is, the user cannot directly observe the specific outline of these two areas in the user interface 27. The size and position of these two areas can be stored in the electronic device only in a form that the electronic device can perceive (e.g., program code).
[0219] When the user drags image 251 into the left-opening area 271L or the right-opening area 271R, the electronic device can immediately respond to the operation and display the cross-application transmission interface. Figure 9 User interface 28 is shown in (E) in the image. Figure 9 As shown in (E), the user interface 28 includes a sub-interface 281, an icon area 282, and an image 283. Wherein:
[0220] The elements displayed in sub-interface 281, such as text and images, are the same as those displayed in user interface 24 (except for the status bar). For details on the specific content and functions of sub-interface 281, please refer to the aforementioned descriptions; they will not be repeated here.
[0221] The electronic device can display one or more application service icons recommended based on the element selected by the user (i.e., image 241 in this embodiment) in the icon area 282. Furthermore, the icon area 282 can be a rectangular area bounded by the right edge of the electronic screen. Specifically, the length and width of the icon area 282 can be d3 and W, respectively, where d3 is greater than the aforementioned d2. Specifically, d3 can be set to 120 pixel units, and W can be the height of the electronic device screen (i.e., h in the aforementioned description). Similarly, in the user interface 28, the icon area 282 is displayed as a dark transparent area only to facilitate the user's understanding of the specific location and area of the area. In actual application scenarios, the specific size and position of the area may not be displayed in the user interface; that is, the user cannot directly observe the specific outline of the area in the user interface 28. The size and position of the area can be stored in the electronic device only in a form perceptible to the electronic device (e.g., program code).
[0222] The image content displayed in image 283 is the same as that displayed in images 251 and 241, differing only in size. It should be noted that image 283 in user interface 28 is smaller than image 51 in user interfaces 25 to 27. This is because when the electronic device displays user interface 28, it scales down image 251 from user interface 27 to prevent the image from being too large and obscuring the icons and text in icon area 282, thus interfering with the user's selection. In other words, image 241 can be scaled down twice during the entire cross-application transmission process; the first time occurs when the user drags it. For details, please refer to [reference needed]. Figure 9 Images 251 and 241 in (B) occur a second time when the electronic device begins displaying the "Cross-Application Transfer Interface," as detailed in the reference [link to documentation]. Figure 9 Image 251 shown in (D) and Figure 9 Image 283 is shown in (E).
[0223] In user interface 28, the user drags the information element (i.e., image 283) and places it on the corresponding icon in icon area 282 and releases it. The electronic device can then respond to the user's operation by transmitting the information element to the application service corresponding to the icon and displaying the application interface or feedback information corresponding to the application service icon. This will be explained in more detail later, but will not be elaborated on here.
[0224] In addition, in order to guide users to accurately place the dragged elements into the application services they need, in the user interface 28, when the user drags the image 283 close to an icon in the icon area 282, or when the distance between the image 283 and an icon in the icon area 282 is less than a certain threshold, the icon that is close to the image 283 can display certain special effects. For example, the icon and the text corresponding to the icon can be snapped close to the image 283 and can be enlarged.
[0225] like Figure 10 As shown in (E), in user interface 28, when the user drags image 283 to the "Friends WeChat" icon, the electronic device can display as shown in [image]. Figure 11 User interface 29 is shown in (F). As can be seen from the icon area 282 in user interface 29, when image 283 moves closer to the "Friends WeChat" icon 284, the "Friends WeChat" icon 284 and its corresponding text 285 are positioned slightly to the left compared to other icons and text, that is, closer to image 283 than other icons and text; in addition, the "Friends WeChat" icon 284 is also enlarged to indicate to the user that if they release their finger here, image 283 (or image 241) will be transferred to the application (i.e., WeChat) or application service (WeChat - Friends Chat) corresponding to the "Friends WeChat" icon.
[0226] In addition, while the cross-application transfer interface is open, users can also exit the cross-application transfer interface through corresponding operations. Please refer to [link / reference needed] for details. Figure 10 and Figure 10 .
[0227] Figure 9 This demonstrates the process by which a user exits the cross-application transfer interface by closing the door area.
[0228] like Figure 10 As shown in (A), the user interface 31 can be a cross-application transfer interface displayed on the electronic device after the user drags and drops an image from the history interface to the side. The user interface 31 includes a sub-interface 311, an icon area 312, a closing area 313, and an image 314, wherein:
[0229] Sub-interface 311 is the interface obtained by transforming the original interface where image 314 is located;
[0230] Icon area 312 is an area used to display application service icons recommended by one or more electronic devices based on the element selected by the user (i.e., image 314 in this embodiment). Its specific style and function can be referred to the foregoing description. Figure 10 The relevant explanations will not be repeated here.
[0231] The closing area 313 can be a rectangular area bounded by the left edge of the electronic screen. Specifically, the length and width of the closing area 313 can be d4 and W, respectively. Specifically, d4 can be set to half the width of the electronic device screen (i.e., L in the previous description), and W can be the height of the electronic device screen (i.e., h in the previous description). Similarly, in the user interface 31, the icon area 312 and the closing area 313 are displayed as dark transparent areas only to facilitate the user's understanding of the specific location and area of the area. In actual application scenarios, the specific size and position of these two areas may not be displayed in the user interface. That is, the user cannot directly observe the specific outline of these two areas in the user interface 31. The size and position of these two areas can be stored in the electronic device only in a form that the electronic device can perceive (e.g., program code).
[0232] like Figure 10 As shown in (A), when the user drags image 314 into the closing area 313, if the user continues to press and hold image 314, the electronic device can close the "Cross-Application Transfer Interface" and display as shown in Figure (A). Figure 11 User interface 32 is shown in (B) of the diagram.
[0233] like Figure 11 As shown in (B), the user interface 32 may include image 321 and image 322, wherein:
[0234] Image 321 is the thumbnail obtained when the user first drags image 322. Unlike image 314, image 321 is a thumbnail obtained by the electronic device after shrinking image 322 once, while image 314 is a thumbnail obtained by the electronic device after shrinking image 321 a second time after the cross-application transfer interface is opened.
[0235] If the user does not release image 321, the user can drag image 321 to the side of the screen to trigger the display of the cross-application transfer interface again.
[0236] Figure 11 This demonstrates the process by which a user exits the cross-application transfer interface by simply releasing their finger.
[0237] like Figure 11As shown in (A), the user interface 33 can be a cross-application transfer interface displayed on the electronic device after the user drags and drops an image from the history interface to the side. The user interface 33 includes a sub-interface 331, an icon area 332, a closing area 333, and an image 334, wherein:
[0238] The specific functions of sub-interface 331 and door closing area 333 can be found in the aforementioned descriptions, and will not be repeated here.
[0239] It's easy to understand that when the total length of d4 and d3 is less than the width L of the electronic screen, there is still a portion of the user interface 33 that does not belong to either the icon area 332 or the closing area 333. In the user interface 33, this portion can be a rectangular area 335 with a length of d5 and a width of h.
[0240] like Figure 11 As shown in (A), when the user drags image 334 into rectangular area 335, if the user releases their grip immediately, the electronic device can close the "Cross-Application Transfer Interface" and display as shown in Figure (A). Figure 12- Figure 15 User interface 34 is shown in (B) of the diagram.
[0241] like Figure 12 As shown in (B), user interface 34 is the original interface where image 314 is located. It may include image 341. Unlike user interface 32 described above, since the user has released their grip, user interface 34 no longer displays the thumbnail obtained by the user dragging image 341. If the user later wants to transfer image 341 to other applications through the "Cross-Application Transfer Interface", the user needs to long-press image 341 again to drag it to obtain the corresponding thumbnail, and then drag the thumbnail to the side of the screen to trigger the cross-application transfer interface again.
[0242] In subsequent embodiments, the specific operations of the user in triggering the "Cross-application transfer interface", the closing of the "Cross-application transfer interface", and the corresponding interface changes of the electronic device can be referred to the relevant descriptions in the foregoing embodiments, and will not be repeated hereafter.
[0243] It should be understood that users frequently drag and drop elements during daily use of electronic devices. For example, when a user opens two application interfaces using the "smart split-screen" function, or opens two application interfaces in a small window or "picture-in-picture" format, the user often transfers information across applications in this mode. Furthermore, in this embodiment, in split-screen and small window states, users can directly transfer information across applications using the split-screen function, or they can use the "cross-application transfer interface" provided in this application. Based on the aforementioned explanation of the triggering rules for the "cross-application transfer interface," the following will describe the different methods of transferring information across applications in split-screen and small window states on electronic devices. Please refer to [link / reference] for details. Figure 12 .
[0244] Figure 12 This demonstrates the process by which a user transfers information across applications using the split-screen function of an electronic device in split-screen mode.
[0245] like Figure 12 As shown in (A), the user interface 35 includes a first display area 351 and a second display area 352. The first display area 351 displays the application interface of the "Notes" application, and the second display area 352 displays the application interface of the "Photo Album" application. In this embodiment, the user interface 35 can be referred to as the "first interface," the first display area 351 as the "second sub-interface," and the second display area 352 as the "first sub-interface."
[0246] At this time, the user long-presses and drags the image 3521 in the second display area 352, obtaining a thumbnail 3522 of the image 3521. In this embodiment, the image 3521 or thumbnail 3522 can be referred to as "first information". Furthermore, as described above, after the image 3521 is dragged, the user interface 35 can have two pairs of determination areas: area 353L and area 353R in the user interface 35, and area 354L and area 354R selected within the dashed frame in the user interface 35. Area 353L and area 353R are the left trigger area and the right trigger area, respectively; area 354L and area 354R are the left door opening area and the right door opening area, respectively. In this embodiment, regions 353L and 353R can be collectively referred to as the "first trigger region," and regions 354L and 354R can be collectively referred to as the "second trigger region." As described above, when a user drags image 3522 into the left trigger region 354L or the right trigger region 354R and holds it there for a duration T, the electronic device can display special effects at the edge of the screen. When the user continues to drag image 3522 into the left-opening region 354L or the right-opening region 354R, the electronic device will respond to the operation and display the corresponding cross-application transfer interface. However, if the user drags image 3522 from the second display region 352 into the first display region 351 without allowing image 3522 to touch the left-opening region 354L or the right-opening region 354R, the electronic device can still transfer image 3522 (or image 3521) to the "Notes" application and display it in the first display region 351.
[0247] like Figure 12 As shown in (A), users can follow Figure 13 The dashed arrow shown in (A) indicates the direction in which image 3522 is dragged to the first display area 351. In this embodiment, the operation of dragging image 3522 to the first display area 351 can be referred to as the "first operation"; in this process, as long as image 3522 does not touch the left opening area 354L and the right opening area 354R, image 3522 (or image 3521) can be directly transferred to the "Notes" application without opening the "cross-application transfer interface" and displayed in the first display area 351. For details, please refer to... Figure 13 User interface 36 is shown in (B) in the diagram. It should be noted that even if image 3522 briefly touches the left door area 354L or the right door area 354R during this process, the electronic device will only display the corresponding effect on the side and will not directly trigger the "cross-application transmission interface".
[0248] Again, taking the user interface 35 from the aforementioned description as an example... Figure 12 This demonstrates the process by which a user transfers information across applications via the "cross-application transfer interface" of an electronic device in split-screen mode.
[0249] like Figure 12 As shown in (A), the elements contained in the user interface 35 and the functions of each element can be referred to in the aforementioned section. Figure 13 The relevant explanations will not be repeated here. However, unlike... Figure 13 The drag-and-drop method shown for the selected element (i.e., image 3522) is used because the user wants to transfer image 3522 to another application via the "Cross-Application Transfer Interface." This application doesn't have to be the "Notes" application. Therefore, as shown... Figure 13 As shown in (A) and (B), users can follow Figure 13 The dashed arrow shown in (A) indicates the direction in which image 3522 is dragged to the right-opening door area 354R; when image 3522 enters the right-opening door area 354R, the electronic device can immediately display as shown in the image. Figure 13 User interface 37 is shown in (C).
[0250] like Figure 14 As shown in (C), the user interface 37 may include a sub-interface 371, an icon area 372, and an image 373. Wherein:
[0251] The specific content and functions of sub-interface 371 can be found in the aforementioned descriptions, and will not be repeated here. However, it should be noted that in split-screen mode, after the user triggers the "cross-application transfer interface" through operation, the display screen in sub-interface 371 will still be in split-screen mode, and it will still contain two display areas, namely... Figure 15 The first display area 3711 and the second display area 3712 are shown in (C).
[0252] The specific content and functions of icon area 372 can be found in the aforementioned descriptions, and will not be repeated here.
[0253] The image content displayed in image 373 is the same as that displayed in images 3521 and 3522, except for the size of the area.
[0254] In user interface 37, when a user drags an information element, i.e., image 373, and places it on the corresponding icon in icon area 372 and releases their finger, the electronic device can respond to the user's operation by transmitting the information element to the application service corresponding to the icon and displaying the corresponding application interface. In this embodiment, user interface 35 can be referred to as the "first interface," image 3521 thumbnail 3522 or image 373 can be referred to as "first information," the operation of dragging image 3522 to the right-opening area 354R can be referred to as the "second operation," the operation of placing image 373 on the corresponding icon in icon area 372 and releasing the finger can be referred to as the "third operation," user interface 37 can be referred to as the "second interface," and the icon displayed in icon area 372 of user interface 37 can be referred to as "at least one application service icon."
[0255] Similarly, when an electronic device is in a multi-window state with small windows, users can also complete the process of transferring information across applications through the multi-window function or the "cross-application transfer interface". Figure 12 and Figure 13 This section illustrates the process of transferring information across applications using the split-screen function of an electronic device and the "cross-application transfer interface" in small window mode. In small window mode, the user interface displayed on the electronic device can include the application interfaces of two different applications. One application's interface is displayed in full screen, while the other application's interface is displayed in a small, floating window on top. When transferring information across applications in small window mode, users can directly drag and drop elements from one application interface to another using the multi-window function. The specific operation process is similar to... Figure 14 The process for cross-application data transfer in split-screen mode is similar. As you can understand, in small window mode, information can be transferred by dragging and dropping from the top-mounted small window (floating window) to the full-screen interface, or vice versa. Additionally, in small window mode, users can also transfer data through the "Cross-application Transfer Interface," the specific operation of which... Figure 15 The operation process shown is similar, so it will not be described in detail here. Please refer to [link / reference needed]. Figure 12 and Figure 13 In conjunction with the aforementioned Figure 16- Figure 21 , Figure 16 Please refer to the relevant instructions.
[0256] After using the "cross-application transfer interface" to transfer information across applications, electronic devices can also provide users with different prompts and display different interface effects based on the type of application service the information enters and the result of the information transfer. Next, we will combine... Figure 16This section describes the interface styles that electronic devices may display after a user uses the "Cross-Application Transfer Interface" to transfer information across applications.
[0257] ①After the transfer is complete, a snack bar will be displayed to the user. Please refer to [link / reference]. Figure 16 .
[0258] like Figure 16 As shown in (A), user interface 41 is a cross-application transfer interface for the user to transfer image 411 across applications. The user is currently placing the dragged information element, i.e., image 411, on the "Notes" icon on the right.
[0259] As the user releases their hand, the electronic device can respond to this user action by transmitting image 411 to the "Notes" application service; if the transmission is successful, the electronic device can display as shown below. Figure 16 User interface 42 is shown in (B) of the diagram.
[0260] like Figure 16 As shown in (B), a snack bar 421 can be displayed below the user interface 42. Specifically, the snack bar 421 may include a prompt message 4211 and a jump control 4212, wherein:
[0261] The notification message 4211 may contain the words "Transmission successful" to notify the user that the electronic device has successfully transmitted image 411 to the "Notes" application service.
[0262] The jump control 4212 can respond to the user's touch operation to jump the electronic device from the current interface to the interface of the application service "Notes".
[0263] Furthermore, if the user does not perform any operation on the snack bar 421, the snack bar 421 can also disappear automatically after being displayed for a period of time (e.g., 2-3 seconds); or, while the snack bar 421 is still displayed in the user interface 42, the user can make the snack bar 421 disappear from other locations in the electronic user interface 42 besides where the snack bar 421 is located.
[0264] like Figure 16 As shown in (B), after the user clicks the jump control 4212, the electronic device can respond to the operation and display as shown in Figure 4212. Figure 17- Figure 18 User interface 43 is shown in (C). User interface 43 is the interface of the application service "Notes". As can be seen from user interface 43, image 411 has been transferred to "Notes" by the electronic device.
[0265] It needs to be understood that Figure 17The user interface provided in this application embodiment is only illustrated by way of example and should not be construed as limiting the scope of this application embodiment. For example, when a user transfers a dragged element to an application service in another immersive scenario, the electronic device can still use a snack bar in the interface to prompt the user.
[0266] ② After the transfer is complete, a capsule will be generated to prompt the user. Please refer to [link / reference]. Figure 16 .
[0267] like Figure 17 As shown in (A), user interface 44 is a cross-application transfer interface for users to transfer image 441 across applications. At this time, the user can place the dragged information element, i.e., image 441, on the "Global Favorites" icon on the right.
[0268] As the user releases their hand, the electronic device can respond to the user's action by transferring image 441 to the global favorites (that is, adding image 441 to the global favorites folder); if the addition is successful, the electronic device can display as follows. Figure 17 User interface 45 is shown in (B) of the diagram.
[0269] like Figure 16 As shown in (B), if the electronic device successfully saves image 411 to the global favorites, a capsule 451 can be displayed on the right side of the user interface 45. Specifically, the capsule 451 can display the "Global Favorites" icon 4511. Furthermore, the user can change the capsule 451's position on the right side by pressing and dragging it. Additionally, the user can also... Figure 18 The click operation on capsule 451 shown in (B) causes the electronic device to jump from the current interface to the "Global Favorites" interface of the application service. For details of the "Global Favorites" interface after the jump, please refer to [link / reference]. Figure 18 The user interface 43 shown in (B) and the aforementioned related descriptions will not be repeated here.
[0270] Optionally, Capsule 451 can automatically disappear after being displayed on the side of the screen for a period of time. Alternatively, Capsule 451 can remain displayed on the side of the screen unless the user actively closes it, allowing the user to drag and drop other information elements currently displayed on the electronic device's screen into the "Global Favorites" list. Please refer to [link / reference] for details. Figure 17 .
[0271] like Figure 18 As shown in (A), the user interface 45 is the aforementioned Figure 18User interface 45 is shown in (B) above. Understandably, the user has already added image 441 to the "Global Favorites," and capsule 451 is still displayed in user interface 45. If the user wants to add other elements from the interface to the "Global Favorites," they can drag the elements to capsule 451 and release. For example... Figure 18 As shown in (A), after the user selects text 452, the user can long-press text 452 and drag it directly onto capsule 451. The electronic device will then respond to the user's operation and display as shown in (A). Figure 18 User interface 46 is shown in (B) of the diagram.
[0272] like Figure 18 As shown in (B), in user interface 46, when text 452 is dragged onto capsule 451, the electronic device can enlarge capsule 451 for easier user operation; that is, capsule 451 in user interface 46 can be larger than capsule 451 in user interface 45, and the electronic device can shrink the original text 452 to text 461 in user interface 46. At this time, if the user releases text 461, the electronic device can respond to the user's operation by transferring text 461 (or text 452) to the global favorites (i.e., adding text 461 to the global favorites folder). If the addition is successful, the electronic device can display as shown in [image / description]. Figure 18 User interface 47 is shown in (C).
[0273] like Figure 18 As shown in (C), capsule 451 is still displayed in user interface 47. Users can access it through... Figure 18 As shown in (C), clicking on capsule 451 opens the interface of the application service "Global Favorites". As one possible implementation, after the user clicks on capsule 451, the electronic device can display the interface of the application service "Global Favorites" in a small window. Please refer to [reference needed] for details. Figure 18 User interface 48 is shown in (D).
[0274] like Figure 18 As shown in (D), the user interface 48 may include a main interface 481 and a sub-interface 482. The main interface 481 may be the application interface of a "browser" in the electronic device, and the sub-interface 482 is the small window interface of the application service "Global Favorites". As can be seen from the user interface 48, the sub-interface 482 may include an image 4821, text 4822, and a function expansion control 4823, wherein:
[0275] Image 4821 corresponds to image 441 in the aforementioned description;
[0276] Text 4822 corresponds to text 452 or text 461 in the aforementioned description;
[0277] The function expansion control 4823 can respond to user touch operations, such as Figure 18 The click operation shown in (D) causes the electronic device to display, as shown in Figure 1. Figure 19 The user interface shown in (E) is 49.
[0278] like Figure 19 As shown in (E), in user interface 49, sub-interface 482 displays an expand control 4824, a minimize control 4825, and a close control 4826, wherein:
[0279] The minimize control 4825 can respond to user actions to cause the electronic device to collapse the sub-interface 482 and display it in the form of a capsule on the side of the screen.
[0280] The close control 4826 can respond to user actions to cause the electronic device to close the sub-interface 482.
[0281] The expand control 4824 can respond to user actions to enable the electronic device to display the "Global Favorites" application service interface in full screen. For example... Figure 19 As shown in (E), the electronic device can respond to a user's click on the expand control 4824 and display as shown in Figure 4824. Figure 19 User interface 50 is shown in (F) in the diagram. As can be seen from user interface 50, the electronic device is now displaying the "Global Favorites" application service interface in full screen, and the text images 441 and text 452 that the user previously saved are also displayed in user interface 50 accordingly.
[0282] ③ After the transfer is complete, either display a small application window in the original interface or directly display the new application interface in full screen. Please refer to [link / reference]. Figure 19 .
[0283] like Figure 19 As shown in (A), the user interface 51 is The app's chat interface. Users can long-press on text 511, drag the text 511 containing location information, and then drag it to the side of the screen; the electronic device can respond to this action by displaying... Figure 19 User interface 52 is shown in (B) of the diagram.
[0284] like Figure 19 As shown in (B) above, user interface 52 is the cross-application transfer interface. As explained above, a user can drag and drop text 521 (which is a scaled-down version of text 511) onto any icon in the icon bar on the right side of user interface 52 and release it to transfer text 521 (or text 511) to the application service corresponding to that icon. For example...Figure 19 As shown in (B), when the user drags the text 521 onto the "Map Navigation" icon 522 and releases it, the electronic device can respond to the user's operation and display the following: Figure 19 User interface 53 is shown in (C).
[0285] like Figure 20 As shown in (C), the user interface 53 may include a main interface 531 and a sub-interface 532. The main interface 531 may be an application in the electronic device. The application interface, sub-interface 532 is the application. The sub-interface 532 is a small window interface that users can drag and drop to adjust its position within the user interface 53. As can be seen from the user interface 53, the sub-interface 532 may include an expand control 5321, a minimize control 5322, and a close control 5323, wherein:
[0286] The minimize control 5322 can respond to user actions to cause the electronic device to collapse the sub-interface 532 and display it in the form of a capsule on the side of the screen.
[0287] The close control 5323 can respond to user actions to cause the electronic device to close the sub-interface 532.
[0288] Expand control 5321 can respond to user actions to enable electronic devices to display applications in full screen. The interface will display the sub-interface 532 in full screen. For example... Figure 20 As shown in (C), the electronic device can respond to the user's click operation on the expanded control 4824, as indicated by the user interface 54. From the user interface 54, it can be seen that the electronic device is now displaying the application in full screen. The interface.
[0289] Optionally, after the user places the text 521 on the "map navigation" icon 522 and releases it, the electronic device may not display the following in response to the user's action: Figure 20 Instead of the user interface 53 shown in (C), it directly displays as shown in the image. Figure 20 The user interface 54 shown in (D) is a new application interface that is displayed in full screen.
[0290] ④ After the cross-device transfer is complete, display the snack bar in the original interface to prompt the user, and control other devices to either use a small window to apply the new application interface or directly display it in full screen. Please refer to [link to relevant documentation]. Figure 20 .
[0291] It should be noted in advance that, in the embodiments of this application, after the electronic device establishes a communication connection with other smart devices, the electronic device can also perform cross-device information transmission based on the "cross-application transmission interface" provided in this application.
[0292] Figure 20 This example illustrates the specific process by which an electronic device, when establishing a communication connection with an in-vehicle terminal, sends text information containing location information from WeChat to the in-vehicle terminal using a "cross-application transmission interface," and then uses the in-vehicle terminal to navigate to that location information.
[0293] like Figure 19 As shown, the electronic device 1900 and the vehicle terminal have established a communication connection via Bluetooth, Wi-Fi, or other means. The electronic device 1900 can be an electronic device that supports the "cross-application transmission interface" interaction method provided in this embodiment.
[0294] like Figure 20 As shown in (A), the user interface 55 is The application's chat interface. Users can long-press text 551 to drag it (containing location information) to the side of the electronic device screen; the electronic device 1900 can respond to this action by displaying... Figure 20 User interface 56 is shown in (B) of the diagram.
[0295] like Figure 20 As shown in (B) above, the specific functions of the elements included in the user interface 56 can be found in the aforementioned section. Figure 20 The relevant descriptions for the user interface 52 are as follows: text 561 corresponds to the aforementioned text 521, and the "Driving Navigation" icon 562 corresponds to the aforementioned "Map Navigation" icon 522. "Driving Navigation" is a vehicle navigation service provided by the electronic device 1900. After the electronic device 1900 establishes a communication connection with other vehicle terminals, such as vehicle terminal 1901, the user can control the vehicle terminal for navigation through the "Driving Navigation" service provided by the electronic device 1900. Figure 20 As shown in (B), when the user places text 561 on the "driving navigation" icon 562 and releases it, the electronic device 1900 can respond to the user's operation and display as shown in Figure 1900. Figure 21 The user interface 57 shown in (C) transmits text 561 to the vehicle terminal 1901 so that the vehicle terminal 1901 displays the following: Figure 21 User interface 58 is shown in (D).
[0296] like Figure 21As shown in (C), a snack bar 571 can be displayed below the user interface 57. Specifically, the snack bar 571 can be used to display the prompt message "Successfully opened, please go to the associated device to view," to inform the user that the electronic device 1900 has successfully sent the text 561 containing location information to the vehicle terminal 1901, and that the vehicle terminal 1901 has opened the navigation application based on the received text 561 and is navigating to the aforementioned location information.
[0297] like Figure 21 As shown in (D), user interface 58 is the user interface displayed by the vehicle terminal 1901 after receiving text transmitted from the electronic device 1900 based on the "cross-application transmission interface". Specifically, user interface 58 can be a navigation application installed in the vehicle terminal 1901 (e.g., The user interface 58 may also display an information bar 582, which can be used to prompt the user about the source device of the location information and prompt the user to confirm whether to navigate to the location corresponding to the above location information.
[0298] ⑤ If cross-device data transmission fails, a toast notification will be displayed on the original interface to inform the user. Please refer to [link / reference]. Figure 21 .
[0299] It should be understood that for the electronic device provided in this application, cross-application information transmission using the "cross-application transmission interface" is not always successful. For example, when the size of the information element exceeds the upper limit specified by the target application service, or when the format of the information element does not conform to the requirements of the target application service, the information element cannot be transmitted to the target application service through the "cross-application transmission interface". In this case, the electronic device can display a toast notification on the interface to inform the user that the information transmission failed.
[0300] like Figure 21 As shown in (A), user interface 60 is the application interface for the "Photo Album" application, which displays 11 images, from image 601 to image 611. Among them, images 601 to 610 are images that have already been selected by the user. The user can select any one of these 10 images (e.g., ...). Figure 21 The image 610 shown in (A) is long-pressed and dragged to the side to make the electronic device display as shown. Figure 22 User interface 61 is shown in (B) of the diagram.
[0301] like Figure 22As shown in (B), user interface 61 is the cross-application transfer interface. In user interface 61, the image thumbnail set 612 is the set of thumbnails created by the user dragging and dropping images 601 to 610 from user interface 60. The number "10" displayed in the upper left corner indicates that the user has selected a total of 10 images. If the transfer is successful, the electronic device can display... The application's contact interface allows users to share all images contained in image thumbnail set 612 with WeChat friends. However, WeChat limits the number of images a user can send at a time (assuming a maximum of 9 images). Image thumbnail set 612 contains 10 images, exceeding WeChat's limit. Therefore, the transfer of images 601-610 via the "Cross-Application Transfer Interface" will fail. Consequently, after the user presses and holds image thumbnail set 612 and drags it to the "Friends WeChat" application service icon before releasing, the electronic device can display the following in response to this operation: Figure 22 User interface 62 is shown in (C).
[0302] like Figure 22 As shown in (C), a toast feedback 621 can be displayed below the user interface 62. Specifically, the toast feedback 621 can display the message "File transfer limit exceeded," indicating to the user that the number of files being transferred has exceeded the limit of the target application service, and therefore the transfer process has failed. Unlike the snack bar 421 mentioned above, the toast feedback 621 generally does not display controls for interface navigation.
[0303] In addition, if the user does not perform any operation on the toast feedback 621, the toast feedback 621 can also disappear automatically after being displayed for a period of time (e.g., 2-3 seconds); or, while the toast feedback 621 is still displayed in the user interface 62, the user can make the toast feedback 621 disappear from other locations in the electronic user interface 62 besides the location where the toast feedback 621 is located.
[0304] Furthermore, when a user transmits information through the "Cross-Application Transfer Interface," the electronic device can recommend multiple application services that can receive the information, and display icons of these application services on the right side of the Cross-Application Transfer Interface. Specifically, the maximum number of these application service icons can be 20. Optionally, when the number of these application service icons exceeds a certain threshold (e.g., 7), to ensure the cleanliness and visual appeal of the interface, the electronic device can display only a portion (e.g., 7) of these application service icons simultaneously in the Cross-Application Transfer Interface. When the icons currently displayed in the Cross-Application Transfer Interface are not the application services the user expects, the user can also place the dragged element in the blank space above or below the icon area of the "Cross-Application Transfer Interface" to update the icons in the icon area of the electronic device. Please refer to [link / reference needed] for details. Figure 22 .
[0305] like Figure 22 As shown in (A), user interface 63 is a cross-application transfer interface for users to transfer image 631 across applications. In the icon area 632 of user interface 63, seven icons are displayed: "Global Favorites" 6321, "Search" 6322, "Edit" 6323, "Print" 6324, "WeChat Friends" 6325, "Scan" 6326, and "Email" 6327.
[0306] Assuming that the application services corresponding to the icons displayed in user interface 63 at this time are not the user's target application service, then as follows: Figure 22 As shown in (B) of the user interface 64, the user can drag the image 631 to the bottom of the icon area 6321. The electronic device can then respond to this user operation by updating the icons in the icon area 632 (updating by scrolling upwards) and displaying, as shown in the image. Figure 22 The user interface 65 is shown in (C).
[0307] like Figure 22 As shown in (C), in the user interface 65, the icon area 632 also displays seven icons: the "Search" icon 6322, the "Edit" icon 6323, the "Print" icon 6324, the "WeChat" icon 6325, the "Scan" icon 6326, the "Email" icon 6327, and the "Taobao" icon 6328. Combined with... Figure 22As shown in the user interface 63 in (A), the "Global Favorites" icon 6321, which was originally displayed at the top of the icon area 632, is no longer displayed in the user interface 65 due to the update. Compared to the user interface 63, in the user interface 65, the original "Search" icon 6322, "Edit" icon 6323, "Print" icon 6324, "WeChat Friends" icon 6325, "Scan" icon 6326, and "Email" icon 6327 have all moved up one position. The bottom position is the newly displayed icon, namely the "Taobao" icon 6328.
[0308] Similarly, such as Figure 23- Figure 26 As shown in the user interface 66 (D), the user can also drag the image 631 to the top of the icon area 6321, and the electronic device can respond to the user's operation by updating the icons in the icon area 632 (updating by scrolling down) and displaying as shown. Figure 23 The user interface 67 is shown in (E) in the diagram.
[0309] like Figure 23 As shown in (E), in the user interface 67, the icon area 632 also displays seven icons: the "Print" icon, the "Global Favorites" icon 6321, the "Search" icon 6322, the "Edit" icon 6323, the "Print" icon 6324, the "Friends WeChat" icon 6325, and the "Scan" icon 6326. Combined with... Figure 23 As shown in the user interface 63 in (A), the "email" icon 6327, which was originally displayed at the bottom of the icon area 632, is no longer displayed in the user interface 65 due to the update. Compared to the user interface 63, in the user interface 65, the original icons 6321 ("Global Favorites"), 6322 ("Search"), 6323 ("Edit"), 6324 ("Print"), 6325 ("WeChat Friends"), and 6326 ("Scan") have all moved down one position. The top position is the newly displayed icon, namely the "Notes" icon 6329.
[0310] Furthermore, in some embodiments, the electronic device can divide the icon area into two parts, one part for displaying fixed icons and the other part for displaying icons personally recommended by the electronic device for the user. Specifically, for the icons personally recommended by the electronic device, the electronic device can first identify the dragged information element and, based on the identification result, obtain application service icons that meet the user's needs in the cross-application transmission interface. That is, when the user drags two elements one after the other, even if the two elements are of the same type (e.g., both are text or both are images), if the content contained in the two elements is different (e.g., different image content or different text), then the icons in the icon area of each user interface in the "cross-application transmission interface" displayed by the electronic device based on these two elements can be different; it should be understood that "different" here can include different icon types and different icon orders. In the embodiments of this application, the electronic device can display the icon that best matches the user's current needs at the top of the icon area. Please refer to [link to specific details]. Figure 23 .
[0311] Figure 23 This is a schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on location information contained in text, as provided in an embodiment of this application.
[0312] like Figure 20 As shown in (A), the user interface 68 is The app's chat interface. Users can long-press text 681 to drag it up, revealing the location information within. After dragging text 681, the electronic device responds by recognizing the location information. Based on this location information, the device determines the user's intention to travel to that location. Then, it recommends relevant app services based on this intention. In the subsequent "Cross-App Transfer Interface," the icons of these recommended services are displayed in an icon area, sorted by app service order, with the icon of the app service most closely matching the user's intention appearing at the top.
[0313] like Figure 24 As shown in (A), when the user drags the text 681 to the side of the electronic screen, the electronic device can respond to the operation by displaying the following: Figure 24 User interface 69 is shown in (B) of the diagram.
[0314] like Figure 24As shown in (B), user interface 69 is a cross-application transmission interface. In user interface 69, text 691 is the text obtained by reducing text 681. The icon area on the right can be divided into a fixed icon area 692 and a recommended icon area 693, which can be distinguished by a dividing line 694; wherein:
[0315] The fixed icon area 692 may contain the "Global Favorites" icon 6921 and the "Search" icon 6922. Understandably, regardless of what element a user shares on the electronic device, the fixed icon area 692 will be displayed on the cross-application transfer interface based on that element, and the icons contained therein will be the "Global Favorites" icon 6921 and the "Search" icon 6922.
[0316] The recommended icon area 693 may include the icons for "Map Navigation" (6931), "One-Click Ride-Hailing" (6932), "Driving Navigation" (6933), "WeChat" (6934), and "Memos" (6935). Specifically, the "Map Navigation" icon (6931) can be used to open map software on an electronic device to navigate to a location and access the navigation application interface; the "One-Click Ride-Hailing" icon (6932) can be used to access the ride-hailing service application interface based on the ride-hailing service provided by the map software; and the "Driving Navigation" icon (6933) is mainly used to transmit the aforementioned location information across devices to the in-vehicle terminal connected to the electronic device. For details, please refer to the aforementioned icon sets. Figure 24 The relevant explanation is as follows: It is understandable that, because the text information 681 contains location information, the electronic device can determine that the user intends to travel to that location. Therefore, in the recommended icon area 693, the icons 6931 ("Map Navigation"), 6932 ("One-Click Taxi"), and 6933 ("Driving Navigation") are displayed at the top of the recommended icon area 693 because they best match the user's current intention, making it easier for the user to select.
[0317] Figure 24 This is a schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on information such as time and location contained in text, as provided in an embodiment of this application.
[0318] like Figure 25As shown in (A), the user interface 70 is the application interface of the "browser". The user can long-press the text 701 to drag the text 701 containing location information. After the user drags the text 701, the electronic device can respond to the operation and recognize the text information; after the electronic device recognizes that the text 701 contains time and location information, the electronic device determines that the text information may contain specific schedule information based on the time and location information. At this time, the electronic device will recommend the corresponding application service to the user based on the user's intent, and in the subsequent "cross-application transfer interface" interface, the icons of the application services recommended to the user will be displayed in the icon area, and the icons of the application services that are more in line with the current user intent will be located at the top of the icon area.
[0319] like Figure 25 As shown in (A), when the user drags text 701 to the side of the electronic screen, the electronic device can respond to the operation by displaying as shown in Figure (A). Figure 25 User interface 71 is shown in (B) of the diagram.
[0320] like Figure 25 As shown in (B), user interface 71 is a cross-application transmission interface. In user interface 71, text 711 is the text obtained by shrinking text 711, and the icon area on the right can be divided into a fixed icon area 712 and a recommended icon area 713, which can be distinguished by a separating line 714; wherein:
[0321] The fixed icon area 712 may contain the "Global Favorites" icon 7121 and the "Search" icon 7122. Understandably, regardless of what element a user shares on the electronic device, the fixed icon area 712 will be displayed on the cross-application transfer interface based on that element, and the icons contained therein will be the "Global Favorites" icon 7121 and the "Search" icon 7122.
[0322] The recommended icon area 713 may include an icon for "Share" 7131, an icon for "Calendar" 7132, an icon for "WeChat with Friends" 7133, an icon for "Print" 7134, and an icon for "Translate" 7135. Specifically, the "Share" icon 7131 can be used to share text 701 with other devices via Bluetooth, email, etc., using the sharing services provided by the electronic device; the "Calendar" icon 7132 is mainly used to add the time and location information from text 701 to the calendar; and the "WeChat with Friends" icon 7133 can be used to send text 701 to WeChat friends through the WeChat chat interface. Understandably, since text 701 contains time and location information, the electronic device can determine that the text information may contain specific schedule information based on this time and location information. Therefore, the user currently intends to share or add the schedule. Thus, in the recommended icon area 713, the "Share" icon 7131, the "Schedule" icon 7132, and the "Friends on WeChat" icon 7133 are displayed at the top of the recommended icon area 713 because they best match the current user's intention, so that the user can make a selection.
[0323] Figure 25 This is a schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on a QR code image contained in an image, as provided in an embodiment of this application.
[0324] like Figure 26 As shown in (A), the user interface 72 is the interface of the "Browser" application. The user can long-press on image 721 to drag up image 721 containing the QR code image 7211. After the user drags up image 721, the electronic device can respond to the operation and recognize image 721. After the electronic device recognizes that image 721 contains the QR code image, the electronic device determines that the user is likely to need to scan the QR code in image 721. At this time, the electronic device will recommend corresponding application services to the user based on the user's intent, and in the subsequent "Cross-application transfer interface" interface, the icons of the application services recommended to the user will be displayed in the icon area, and the icons of the application services that are more in line with the current user intent will be located at the top of the icon area.
[0325] like Figure 26 As shown in (A), when the user drags image 721 to the side of the electronic screen, the electronic device can respond to the operation by displaying as shown in Figure (A). Figure 26 User interface 73 is shown in (B) of the diagram.
[0326] like Figure 26As shown in (B), user interface 73 is a cross-application transfer interface. In user interface 73, image 731 is an image obtained by scaling down image 721. The icon area on the right can be divided into a fixed icon area 732 and a recommended icon area 733, which can be distinguished by a dividing line 734; wherein:
[0327] The specific functions of the fixed icon area 732 can be found in the aforementioned description of the fixed icon area 712, and will not be repeated here.
[0328] The recommended icon area 733 may include the "Scan Camera" icon 7331, the "Print" icon 7332, the "Share" icon 7333, the "WeChat Friends" icon 7334, and the "Album" icon 7335. Specifically, the "Scan Camera" icon 7331 can be used to scan image 731 using the "Scan" service provided by the "Camera" app; the "Print" icon 7332 is mainly used to send image 731 to a printing device for printing; and the "Share" icon 7333 can be used to share image 731 with other devices via Bluetooth, email, etc., using the sharing services provided by the electronic device. Understandably, since image 721 contains a QR code, the electronic device can determine from the QR code image whether the user may need to scan the image, or whether the user wants to print or share the image. Therefore, in the recommended icon area 733, the "Scan Camera" icon 7331, the "Print" icon 7332, and the "Share" icon 7333 are displayed at the top of the recommended icon area 733 because they best match the current user's intention, so that the user can make a selection.
[0329] Figure 26 This is a schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on a face image contained in an image, as provided in an embodiment of this application.
[0330] like Figure 27 As shown in (A), the user interface 74 is the interface of the "Camera" application. The user can long-press on image 741 to drag up image 741 containing a face image. After the user drags up image 741, the electronic device can respond to the operation and recognize image 741; after the electronic device recognizes that image 741 contains a face image, the electronic device can determine based on the face image that the user is likely to need to beautify image 741 or share it to social media. At this time, the electronic device will recommend corresponding application services to the user based on the user's intention, and in the subsequent "Cross-application transfer interface", the icons of the application services recommended to the user will be displayed in the icon area, and the icons of the application services that are more in line with the current user's intention will be located at the top of the icon area.
[0331] likeFigure 27 As shown in (A), when the user drags image 741 to the side of the electronic screen, the electronic device can respond to the operation by displaying as shown in Figure (A). Figure 27 User interface 75 is shown in (B) of the diagram.
[0332] like Figure 27 As shown in (B), user interface 75 is a cross-application transfer interface. In user interface 75, image 751 is an image obtained by scaling down image 751. The icon area on the right can be divided into a fixed icon area 752 and a recommended icon area 753, which can be distinguished by a dividing line 754; wherein:
[0333] The specific functions of the fixed icon area 752 can be found in the previous description of the fixed icon area 712, and will not be repeated here.
[0334] The recommended icon area 753 may include icons for "Meitu" (7531), "Moments" (7532), "QQ Space" (7533), "WeChat Friends" (7534), and "Share" (7535). Specifically, the "Meitu" icon 7531 can be used to enhance image 751; the "Moments" icon 7532 is primarily used to share image 751 to WeChat Moments; and the "QQ" icon 7533 can be used to share image 751 to QQ Space. Understandably, because image 751 contains a QR code, the electronic device can determine from the facial image that the user may need to enhance image 741 or share it to social media. Therefore, in the recommended icon area 753, the "Meitu" icon 7531, "Moments" icon 7532, and "QQ Space" icon 7533, because they best match the current user's intent, are displayed at the top of the recommended icon area 753 for easy selection.
[0335] In some embodiments, the icon area in the cross-application transfer interface can be used to display not only icons of application services but also thumbnails of the application interfaces of applications running in the background of the electronic device. When a user drags an information element onto the thumbnail and releases it, the information element is transferred to the application interface corresponding to that thumbnail. See details. Figure 27 .
[0336] like Figure 27 As shown in (A), the user interface 76 is The app's chat interface with a friend (Xiaoming). The user swipes up from the bottom edge of the electronic device's screen; the device responds to this action and displays something like... Figure 27 User interface 77 is shown in (B) of the diagram.
[0337] likeFigure 27 As shown in (B), the user interface 77 is an application navigation interface, which displays thumbnails of all applications currently open on the electronic device. The application interface thumbnails 771 are... The application interface thumbnail 772 shows the chat interface of a friend (Xiaoming) within the application. The application interface thumbnail 772 is a thumbnail of the web browsing interface within the application's "browser." Here, the application whose interface is displayed on the electronic device is called the foreground application, and applications that are open but not displayed on the screen are called background applications. Therefore, in user interface 77, the user can click on any application interface thumbnail displayed in user interface 77 to switch the application corresponding to that thumbnail to the foreground application and display that application interface thumbnail full-screen. For example... Figure 27 As shown in (B), users can click on the application interface thumbnail 772 to switch the electronic device to the application "browser" as the foreground application. It should be understood that at this time, the application... It is not closed; it will run in the background when the user navigates to the application via the application navigation interface. When switched to the foreground application, the electronic device will still display the user interface 76 on the screen. In response to the user's action of switching the application "Browser" to the foreground application, the electronic device can display as follows: Figure 27 The user interface 78 is shown in (C).
[0338] like Figure 27 As shown in (C), the user interface 78 can be the application interface of a "browser" in an electronic device. Users can long-press and drag the image 781 in the user interface 78 to make the electronic device display images such as... Figure 27 User interface 79 is shown in (D).
[0339] like Figure 28- Figure 29 As shown in (D), the user interface 79 may include a sub-interface 791, an image 792, an application interface thumbnail 793, and a text description 794. The image 792 is a thumbnail obtained by scaling down the image 781. The text description 794 can be used to explain to the user the application and contact corresponding to the application interface thumbnail 793. The application interface thumbnail 793 is the thumbnail of the aforementioned user interface 76. When the user drags the image 792 onto the application interface thumbnail 793 and releases it, the electronic device can respond to the user's operation and display as shown in (D). Figure 28 The user interface 80 is shown in (E).
[0340] like Figure 28As shown in (E), the user interface 80 can be the chat interface of a friend (Xiaoming) in the "WeChat" application. From the user interface 80, it can be seen that the user has already sent image 781 obtained from the application's "browser" to their WeChat friend "Xiaoming". That is, after the user drags image 792 from the user interface 79 onto the application interface thumbnail 793 and releases it, the electronic device automatically sends image 792 (or image 781) to the WeChat friend Xiaoming without requiring any further action from the user.
[0341] It needs to be understood that Figure 28 The user interface provided in the embodiments of this application is only shown as an example and should not be construed as limiting the embodiments of this application. For example, for applications... Background applications can also be displayed in the cross-application transfer interface, and this application does not limit this.
[0342] Furthermore, in some embodiments, after a user drags up an information element, the electronic device can directly bring up the side application bar and display the corresponding application service icon in the side application bar. Next, we will combine... Figure 28 Please provide an explanation.
[0343] Figure 28 This shows two different ways to bring up the sidebar of an electronic device.
[0344] First, users can bring up the side application bar of the electronic device by swiping inward from the side of the screen as usual.
[0345] like Figure 2 As shown in (A), the user interface 81 can be the application interface of a "browser" in an electronic device, or it can be an application... The application interface can be any other application interface, and this application does not limit this to any particular application. Users can bring up the application bar icon 811 on the side of the electronic device by swiping left from the right side of the screen (while holding down the swipe); subsequently, if the user releases the swipe, the electronic device can respond to this operation and display as shown below. Figure 28 User interface 82 shown in (B)
[0346] like Figure 28 As shown in (B), a side application bar 821 can be displayed in the user interface 82. The side application bar 821 can display one or more application icons that the user has added to the side application bar 821, such as... Figure 28 (B) shown in Icon 8211 The icon 8212. Not limited to this, users can also add other application icons to the side application bar 821 via the application list control 8213. Any icon can respond to user actions, causing the electronic device to open the corresponding application. When a user opens another application through the side application bar 821 in the current application interface, the electronic device can display both application interfaces in a split-screen format. Users can then transfer information elements provided by one application to the other based on these two interfaces (see the aforementioned...). Figure 28 (See the relevant explanations), which is the "smart multi-window function" provided by electronic devices.
[0347] Secondly, users can bring up the side application bar of the electronic device by long-pressing and dragging information elements within the interface.
[0348] like Figure 28 As shown in (C), the user interface 83 can be the application interface of a "browser" in an electronic device, or it can be an application... The application interface can be any other application interface, and this application does not limit this; specifically, user interface 83 and user interface 81 described above can be the same interface. The user can drag the selected text 831 in user interface 83 by long-pressing it; after the user drags the text 831 (it does not need to be dragged to the side), the electronic device will respond to the operation and display as shown below. Figure 29 The user interface shown in (D) is 84.
[0349] like Figure 29 As shown in (D), the user interface 84 can display text 842 and a side application bar 821. Text 842 is the text obtained by dragging and shrinking text 831. The side application bar 841 can contain an application list control 8414 and two areas: a smart flow icon area 8411 and a smart multi-window icon area 8412. These two areas can be separated by a separator line 8413.
[0350] The smart flow icon area 8411 can display multiple application service icons. It should be understood that all icons displayed in the smart flow icon area 8411 can be used for cross-application transfer of elements dragged by the user (i.e., text 842) without relying on the split-screen function provided by the electronic device. This transfer method, compared to the method of transfer via the "cross-application transfer interface" in the aforementioned embodiments, can be referred to as the "smart flow" function of the electronic device in this application. Optionally, the icons displayed in the smart flow icon area 8411 may also include user-defined fixed icons and icons recommended and displayed by the electronic device based on the content of text 842. For example, in... Figure 29In the "Global Favorites" icon 84111, "Search" icon 84112, "Schedule" icon 84113, and "Notes" icon 84114 shown in (D), the "Global Favorites" icon 84111 and "Search" icon 84112 can be fixed icons, while the "Schedule" icon 84113 and "Notes" icon 84114 can be icons that the electronic device recommends to the user based on the content in the text 842.
[0351] The smart multi-window icon area 8412 can display one or more application icons, and these icons can be... Figure 29 The icons in the side application bar 821 of the user interface 82 shown in (B) are all or part of the icons. Unlike the Smart Flow icon area 8411, the icons in this area cannot be used for cross-application transmission of text 842; they are only displayed in the user interface 84. Furthermore, if the number of application service icons recommended by the electronic device for text 842 exceeds a certain limit, the side application bar may prioritize displaying the application service icons recommended by the electronic device for text 842, and will no longer display the Smart Multi-Window icon area 8412 and the application icons contained therein.
[0352] The application list control 8414 can be used to display icons that can be added to the side application bar 841, including application service icons that can be added to the Smart Flow icon area 8411 and displayed permanently, as well as application icons that can be added to the Smart Multi-Window icon area 8412. See the attached document for details. Figure 29 .
[0353] Figure 30 This demonstrates the specific process by which a user adds an icon to the sidebar app bar.
[0354] In response to a user's click on an application list control in the sidebar (such as application list control 8213 or application list control 8414 as described above), the electronic device can display... Figure 30 The user interface 8A shown in (A) is described above. User interface 8A may include a side application bar 8A1 and an icon display interface 8A2, wherein:
[0355] The side application bar 8A1 may include a smart flow icon area 8A11, a smart multi-window icon area 8A12, and an add control 8A13 for adding icons to the icons in the side application bar 8A1.
[0356] The icon display interface 8A2 can display the Smart Multi-Window icon display area 8A21 and the Smart Flow icon display area 8A22. Understandably, the icons in the Smart Multi-Window icon display area 8A21 can be added to the Smart Multi-Window icon area 8A12 in the side application bar 8A1; the icons in the Smart Flow icon display area 8A22 can be added to the Smart Flow icon area in the side application bar 8A1.
[0357] like Figure 30 As shown in (A), in response to a click operation by the electronic device on the added control 8A11, the electronic device can display as follows: Figure 30 The user interface 8B shown in (B) is as follows. As shown in the user interface 8B, each icon displayed in the icon display interface 8B2 has a symbol to be added in the upper right corner, and the Smart Flow icon area 8B11 and the Smart Multi-Window icon area 8B12 in the side application bar 8B1 both have blank spaces for storing newly added icons by the user.
[0358] Specifically, users can add an icon to a blank icon position in either the Smart Multi-Window icon display area 8B21 or the Smart Flow icon display area 8B22 by clicking any icon in either area. For example, a user can click the "Memo" icon in the Smart Multi-Window icon display area 8B21 to add it to a blank position 8B121 in the Smart Multi-Window icon area 8B12, or a user can click the "Scan Camera" icon in the Smart Flow icon display area 8B22 to add it to a blank position 8B111 in the Smart Flow icon area 8B11. Afterwards, the user can click the confirmation control 8B14 in the side application bar 8B1, and the electronic device will save the added icon option. The newly added icon will be displayed in the side application bar the next time it is shown.
[0359] Most smart devices currently offer users a convenient screen recording function. For example, in some scenarios, users can double-tap the screen with two knuckles to record the current interface of the electronic device. Therefore, regarding the convenient screen recording function provided by electronic devices, the following section will combine... Figure 30 This document explains the process of transferring recorded videos across applications using a cross-application transfer interface in screen recording scenarios.
[0360] Figure 30 This diagram illustrates the interface changes of an electronic device when a user transfers recorded video across applications via a cross-application transfer interface.
[0361] like Figure 30As shown in (A), the user interface 85 can be the application interface of a "browser" in an electronic device, or it can be an application... The application interface can be the interface of other applications, and this application does not limit this. At this time, the user has already enabled the screen recording function of the electronic device through relevant operations. In the user interface 85, the screen recording function box may include a microphone control 8511, a time control 8512, and an option control 8513, wherein;
[0362] The microphone control 8511 can respond to user operation to enable the electronic device to start / stop recording external sounds;
[0363] The time control 8512 can be used to display the recording duration in real time, and it can also respond to user operations to stop the electronic device from recording.
[0364] The option control 8513 can respond to user operations to allow the electronic device to display more screen recording settings options, such as whether to record the user's screen operation trajectory.
[0365] For example Figure 30 As shown in (A), in response to a user's click on the time control 8512, the electronic device can stop the screen recording process and display as shown in Figure (A). Figure 30 User interface 86 is shown in (B) of the diagram.
[0366] like Figure 30 As shown in (B), the user interface 86 may include a video file 861. The video file 861 is the video recorded by the electronic device in response to the user's screen recording operation. After screen recording, the video file 861 can be displayed in the user interface 86, and generally for two to three seconds, so that the user can directly click on the video file 861 to edit, save, or perform other operations on it; if the user does not operate on the video file 861, the electronic device can automatically save it to the photo album.
[0367] In this embodiment, during the period when the electronic device displays the video file 861 in the user interface 86, the user can long-press the video file 861, drag it to the side of the electronic device screen, and then transfer it across applications through the "cross-application transfer interface". For example... Figure 31 As shown in (B), the electronic device can respond to a user's long press and drag operation on the side of video file 861, displaying as shown in Figure 1. Figure 31 The user interface shown in (C) is 87.
[0368] like Figure 31 As shown in (C), the user interface 87 is the cross-application transfer interface. The user interface 87 may include a sub-interface 871, an icon area 872, and a video file 873, wherein:
[0369] The specific content and functions of sub-interface 871 and icon area 872 can be found in the foregoing description, and will not be repeated here.
[0370] Similarly, in order not to obscure the icon area 872 too much, when the video file 861 is close to the icon area, the electronic device shrinks the original video file 861 to obtain the video file 873.
[0371] Similarly, in user interface 87, when a user places a video file 873 on the corresponding icon in icon area 872 and releases it, the electronic device can respond to the user's operation by transmitting the information element to the application service corresponding to the icon and displaying the corresponding application interface.
[0372] In addition, after capturing an image on their electronic device using the quick screenshot function, users can edit the captured image and then transfer it via the "Cross-Application Transfer Interface" on the editing page. For details, please refer to [link to relevant documentation]. Figure 31 .
[0373] like Figure 31 As shown in (A), the user interface 88 can be the application interface of a "browser" in an electronic device, or it can be an application... The application interface can be the interface of other applications, and this application does not limit this. Responding to the user's quick screenshot operation on the user interface 88, for example... Figure 31 As shown in (A), a double-tap operation with the knuckle allows the electronic device to quickly capture a full-screen image of the user interface 88 and display it as shown in (A). Figure 31 The user interface shown in (B) is 89.
[0374] like Figure 31 As shown in (B), the user interface 89 may include a screenshot image 891. The screenshot image 891 is the image obtained by the electronic device in response to a user's knuckle screenshot of the user interface 88. After a screenshot is taken, the screenshot image 891 can be displayed in the user interface 89 and generally lasts for two to three seconds, allowing the user to directly click on the screenshot image 891 to edit, save, or perform other operations. If the user does not interact with the screenshot image 891, the electronic device can automatically save it to the photo album.
[0375] In this embodiment of the application, during the period during which the electronic device displays the screenshot image 891 in the user interface 89, the electronic device can respond to, as follows: Figure 31 The user's click on screenshot image 891, as shown in (B) in the image, displays as follows: Figure 31User interface 90 is shown in (C). User interface 90 is the editing interface for screenshot image 891, which may include thumbnail 901 and drawing options 902, wherein:
[0376] Thumbnail 901 can be a thumbnail of the aforementioned user interface 88.
[0377] The drawing option 902 can respond to user actions, enabling the electronic device to respond to the user's touch operation on the screen by drawing the user's touch trajectory on the screen onto the thumbnail 901.
[0378] like Figure 7 As shown in (C), users can follow Figure 8 The trajectory indicated by the directional dashed line shown in (D) is drawn on thumbnail 901. The electronic device can respond to this user operation (in this embodiment, this operation can be referred to as the "eighth operation"), drawing the trajectory indicated by the directional dashed line onto thumbnail 901 and displaying it as shown. Figure 31 User interface 91 is shown in (D) of the diagram. Optionally, in user interface 90, the image contained in thumbnail 901 can also be long-pressed and dragged by the user to display the cross-application transmission interface provided in this application on the electronic device, and transmission can be performed based on the cross-application transmission interface; when the user clicks the text recognition control in user interface 90, the electronic device can also recognize the text contained in image 901, which can also be long-pressed and dragged by the user to display the cross-application transmission interface provided in this application on the electronic device, and transmission can be performed based on the cross-application transmission interface. For details, please refer to the aforementioned... Figure 31 and Figure 31 The relevant explanations will not be repeated here.
[0379] like Figure 31 As shown in (D), the user-drawn triangle pattern 911 is already displayed on the thumbnail 901 in the user interface 91.
[0380] Understandably, user interface 91 remains an image editing interface. Within user interface 91, users can also long-press on thumbnails 901, drag them to the side of the electronic device screen, and then transfer them across applications via the "Cross-Application Transfer Interface." For example... Figure 31 As shown in (D), the electronic device can respond to the user's operation of long-pressing and dragging the thumbnail 901 (which now contains the user-drawn pattern, i.e., the triangle pattern 911) to the side, displaying as shown in Figure (D). Figure 32 User interface 92 is shown in (E) in the image.
[0381] like Figure 32As shown in (E), user interface 92 is the cross-application transmission interface. User interface 92 may include sub-interfaces 921, icon areas 922, and images 923, wherein:
[0382] The specific content and functions of sub-interface 921 and icon area 922 can be found in the previous description, and will not be repeated here.
[0383] Similarly, in order not to obscure the icon area 922 too much, when the thumbnail 901 is close to the icon area, the electronic device shrinks the original thumbnail 901 again to obtain image 923 (image 923 also contains the pattern drawn by the user, namely the triangle pattern 911).
[0384] Similarly, in user interface 92, when a user places image 923 on the corresponding icon in icon area 922 and releases their hand, the electronic device can respond to the user's operation by transmitting the information element to the application service corresponding to the icon and displaying the corresponding application interface.
[0385] In this embodiment, user interface 88 can be referred to as the "fifth interface," user interface 89 can be referred to as the "sixth interface," user interface 91 can be referred to as the "seventh interface," user interface 90 can be referred to as the "editing interface," images 891 and 901 can be referred to as the "first image," user interface 95 can be referred to as the "seventh interface," and the user's click operation on screenshot image 891, and the user's actions according to... Figure 32 The directional dashed line shown in (D) represents the drawing operation on thumbnail 901, and the operation of the user long-pressing thumbnail 901 and dragging it to the side of the electronic device screen can be collectively referred to as the "eighth operation".
[0386] Furthermore, in some embodiments, the electronic device also provides users with a long screenshot function. A long screenshot, also known as a scrolling screenshot, is an effective method for capturing the current content of an interface, obtaining the entire content rather than just the visible portion. It has wide applications in web browsing scenarios and is very useful for investigating web information or collecting materials. Generally, the scrolling screenshot process involves first using a scrolling function to scroll the webpage, continuously capturing webpage content. After the webpage content is captured, the program automatically combines all the content together to form a complete long image. The "cross-application transmission interface" provided in this application is also applicable to images captured by users through the long screenshot function; please refer to [link / reference] for details. Figure 32 .
[0387] like Figure 32 As shown in (A) in the figure, in the case of Figure 32As shown in (A), the user interface 93 can be the application interface of a "browser" in an electronic device, or it can be an application... The application interface can be any of the applications mentioned, and this application does not limit this to any other application interface. Responding to a user's long screenshot operation on user interface 93, for example... Figure 32 The action shown in (A) – tapping with the knuckles to draw an "S" trajectory – allows electronic devices to quickly scroll through web pages and continuously capture content. When the user taps the screen again… Figure 32 (A) in the image does not show this operation), indicating that the webpage content the user needs has been captured. The electronic device will then combine all the captured content into a single long image and display it as shown. Figure 32 User interface 94 is shown in (B) of the diagram.
[0388] like Figure 32 As shown in (B), the user interface 94 may include a long screenshot image 941. The long screenshot image 941 is the image obtained by the electronic device in response to the user's long screenshot operation on the user interface 93. After taking a long screenshot, the user can edit, save, and perform other operations on the long screenshot image 941 through relevant editing options in the user interface 94.
[0389] In this embodiment of the application, the electronic device may also respond to, for example Figure 32 The user's action of long-pressing and dragging the long screenshot image 941 to the side, as shown in (B), displays as follows: Figure 33 The user interface 95 is shown in (C).
[0390] like Figure 33 As shown in (C), the user interface 95 is the cross-application transfer interface. The user interface 95 may include a sub-interface 951, an icon area 952, and an image 953, wherein:
[0391] The specific content and functions of sub-interface 951 and icon area 952 can be found in the foregoing description, and will not be repeated here.
[0392] Similarly, in order not to obscure the icon area 952 too much, the electronic device shrinks the long screenshot image 941 when it is close to the icon area, resulting in image 953.
[0393] Similarly, in user interface 95, when a user places image 953 on the corresponding icon in icon area 952 and releases it, the electronic device can respond to the user's operation by transmitting the information element to the application service corresponding to the icon and displaying the corresponding application interface.
[0394] Optionally, if the size of the long screenshot image 941 exceeds the upper limit specified by the application service, or if the format of the long screenshot image 941 does not conform to the requirements of the target application service, the long screenshot image 941 cannot be transmitted to the target application service through the "Cross-Application Transfer Interface". In this case, the electronic device can also display a toast notification on the interface to inform the user that the information failed to be transmitted.
[0395] For example, when the transmission of a long screenshot image 941 fails, the electronic device can, as follows: Figure 33 User interface 96 is shown in (D). A toast feedback 961 can be displayed below user interface 96. Specifically, toast feedback 961 can display the message "Image exceeds the Smart Stream transmission limit, please crop it before transmitting." to inform the user that the image being transmitted exceeds the limit of the target application service, therefore the transmission process failed.
[0396] Similarly, if the user does not perform any operation on the toast feedback 961, the toast feedback 961 may disappear automatically after being displayed for a period of time (e.g., 2-3 seconds); or, while the toast feedback is still displayed in the user interface 96, the user may make the toast feedback 961 disappear from other locations in the electronic user interface 96 besides where the toast feedback 961 is located.
[0397] In this embodiment of the application, user interface 93 can be referred to as the "fifth interface", user interface 94 can be referred to as the "sixth interface", long screenshot image 941 or image 953 can be referred to as the "first image", user interface 95 can be referred to as the "seventh interface", and the operation of the user placing image 953 on the corresponding icon in icon area 952 and releasing the finger can be referred to as the "ninth operation".
[0398] The following describes the system settings interface involved in the "Smart Circulation" function.
[0399] First, combine Figure 33 This section introduces the user interface involved in enabling the "Smart Flow" function on electronic devices.
[0400] like Figure 33 As shown in (A), the user interface 97 can be the navigation interface displayed to the user when the electronic device is first turned on after leaving the factory. In the user interface 97, the Smart Flow Service tab 971 may contain a switch control 9711, which can be set to the on state by default, meaning the "Smart Flow" function is already enabled by default on the electronic device. Of course, the user can also turn off the "Smart Flow" function by clicking the switch control 9711.
[0401] In addition, users can enable or disable the "Smart Flow" function through the relevant interface in the electronic device's system settings during their daily use of the device. For example... Figure 34 As shown in (B), users can open the "Smart Flow" settings interface in the system settings, i.e., user interface 98, and turn the "Smart Flow" function on or off by manipulating the switch control 9811 in the "Smart Flow" tab 981. If the switch control 9711 is currently in the off state, the user can turn on the "Smart Flow" function by clicking the switch control 9811, and the electronic device will respond to the user's operation, displaying as shown in (B). Figure 34 The user interface shown in (C) is 99.
[0402] like Figure 34 As shown in (C), the user interface 99 may include a prompt box 991, which can be used to ask the user whether they agree to allow the electronic device screen to be displayed to "Smart Flow". The prompt box 991 may include a "Always Allow" option 9911, a "Allow During Use Only" option 9912, and a "Deny" option 9913. When the user clicks the "Always Allow" option 9911 or the "Allow During Use Only" option 9912, the electronic device can successfully enable the "Smart Flow" function; when the user clicks the "Deny" option 9913, the electronic device will not be able to enable the "Smart Flow" function.
[0403] Figure 34 The system settings interface is shown for understanding the "Smart Flow" function and editing the application service icons on the Smart Flow page.
[0404] like Figure 34 As shown in (A), user interface 00 is the interface related to the "Smart Assistant" function in the "System Settings" of the electronic device. In user interface 00, the user can click the "Smart Flow" tab to make the electronic device display the following... Figure 34 User interface 38 is shown in (B) of the diagram.
[0405] like Figure 33- Figure 34 As shown in (B), user interface 38 can be the same user interface as user interface 98 described above. User interface 38 may display a "Learn More" control 381 and a "Customize Services" tab 382, wherein:
[0406] The "Learn More" control 381 can respond to a user's click action to cause the electronic device to display, such as... Figure 35 User interface 39 is shown in (C) in the diagram. User interface 39 is a user interface provided by the system settings, which can be used to show users the specific functions and operation steps of the "Smart Flow" feature.
[0407] The "Customize Services" tab 382 can respond to user clicks to make the electronic device display, such as... Figure 35 User interface 40 is shown in (D) above. As explained above, among the icons displayed in the cross-application transfer interface, some are user-defined and permanently displayed in the icon area, while others are icons recommended to the user by the electronic device based on the element dragged by the user. Therefore, in user interface 40, the icons displayed in icon display card 401 are those the user has already designated for permanent display in the icon area, while the icons displayed in icon display card 402 are those the user has not yet set for permanent display in the icon area. Users can remove an icon from the icon area of the cross-application transfer interface by clicking the remove symbol "-" in the upper right corner of any icon in icon display card 401; similarly, users can make an icon permanently displayed in the icon area of the cross-application transfer interface by clicking the add symbol "+" in the upper right corner of any icon in icon display card 402 (after being added, the icon will also simultaneously appear in the blank icon area of icon display card 401, such as 4011).
[0408] It needs to be understood that Figure 36 The user interface related to "system settings" provided in the embodiments of this application is only shown as an example and should not be construed as limiting the embodiments of this application. For example, the icon display card 402 may contain more or fewer application service icons, and this application does not limit this.
[0409] The electronic device provided in this application will now be described.
[0410] The electronic device may be a mobile phone, tablet computer, wearable device, in-vehicle device, augmented reality (AR) / virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), or dedicated camera (such as SLR camera, point-and-shoot camera), etc. This application does not limit the specific type of the electronic device.
[0411] Figure 23- Figure 26 The structure of the electronic device is shown as an example.
[0412] like Figure 9- Figure 15As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 151, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0413] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0414] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.
[0415] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.
[0416] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0417] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0418] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.
[0419] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.
[0420] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0421] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.
[0422] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.
[0423] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0424] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.
[0425] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0426] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.
[0427] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 151, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.
[0428] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0429] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0430] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0431] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.
[0432] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0433] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0434] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0435] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.
[0436] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0437] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.
[0438] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0439] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.
[0440] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0441] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0442] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.
[0443] Internal memory 151 can be used to store computer executable program code, which includes instructions. Internal memory 151 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 151 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 110 executes various functional applications and data processing of electronic device 100 by running instructions stored in internal memory 151 and / or instructions stored in memory located in the processor.
[0444] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0445] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.
[0446] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.
[0447] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.
[0448] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.
[0449] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.
[0450] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.
[0451] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.
[0452] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.
[0453] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.
[0454] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.
[0455] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.
[0456] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device 100 emits infrared light outward through the LED. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 may use the proximity sensor 180G to detect when a user holds the electronic device 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.
[0457] The ambient light sensor 180L is used to sense the brightness of ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.
[0458] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.
[0459] Temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 uses the temperature detected by temperature sensor 180J to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs thermal protection by reducing the performance of a processor located near temperature sensor 180J to reduce power consumption. In other embodiments, when the temperature is below another threshold, electronic device 100 heats battery 142 to prevent abnormal shutdown of electronic device 100 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, electronic device 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.
[0460] Touch sensor 180K, also known as a "touch device," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.
[0461] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 180M can also be incorporated into headphones to form bone conduction headphones. The audio module 170 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 180M to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 180M to realize heart rate detection functionality.
[0462] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.
[0463] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.
[0464] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.
[0465] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0466] In this application, the GPU in the electronic device can perform three-dimensional transformation on the content displayed on the display screen 194 after the user drags the information element in the interface, creating a visual effect of the original interface pushing inward on the screen, and displaying recommended application and / or service icons on the side of the screen of the electronic device.
[0467] Furthermore, in this embodiment, when a user drags up an information element in the interface, the processor 110 can identify the information element, including identifying the type of the information element and the specific content in the information element, and determine the corresponding application icon and / or application service icon based on the identification result, and generate corresponding program instructions. The program instructions can be used to change the display information of the display screen 194, for example, updating the interface in the display screen to a cross-application transmission interface. The icons displayed in the cross-application transmission interface are the application icons and / or application service icons determined by the processor 110 based on the identification result.
[0468] In some embodiments, after a user completes the information transfer using the "cross-application transfer interface", the processor 110 can also obtain which application service the user transferred the information to, and generate corresponding program instructions based on the obtained results. In conjunction with the GPU, the processor can display the corresponding interface on the screen (e.g., the interface may display a snack bar, capsule, small window, etc.) to provide feedback on the results of the information element transfer to the user.
[0469] The following describes an information transmission method provided in this application. Implementing this method, an electronic device can display corresponding application service icons on the interface when a user long-presses and drags an information element. The user can then place the dragged element onto the corresponding icon to transmit the element to the application service associated with that icon. This method enables electronic devices to efficiently and quickly complete information transmission between applications, effectively reducing the number of steps required for users to complete cross-application information transmission, improving the interaction efficiency between users and electronic devices, and thus enhancing the user experience. Figure 22 As shown, the method may include, but is not limited to, the following steps:
[0470] S101, The electronic device displays the first interface.
[0471] The aforementioned electronic device may be the electronic device 100 described above. The first interface includes a first sub-interface and a second sub-interface. The first sub-interface is used to display the application interface of a first application, and the second sub-interface is used to display the application interface of a second application. The first sub-interface includes first information, and the second sub-interface is used to transmit the first information to the second application under a first operation on the first information.
[0472] The aforementioned first information can be any one of image, text, audio file, video file, or document file, or other forms of information, which this application does not limit.
[0473] S102, the electronic device responds to a second operation on the first information and displays a second interface.
[0474] The second operation can be used to select the first information. Specifically, the second operation can be a long press and drag operation of the first information to the side of the first interface (i.e., the side of the display screen). While the user does not release the finger, the dragged first information moves within the first interface along with the user's fingertip. When the user drags the first information to a distance less than a certain threshold from the right or left edge of the screen, the electronic device can display the second interface. In the second interface, the application services corresponding to at least one of the application service icons are all application services capable of receiving the first information. For example, if the first information is an image... The friend chat service can send this image. The WeChat Moments service can be used to share this image. The portrait enhancement service can enhance the image, and the search service provided by the electronic device can perform intelligent searches on the image. Therefore, at least one of the above application service icons can include the application service icons corresponding to these services.
[0475] In one possible implementation, the at least one application service icon may include at least one first icon, which is an application service icon recommended based on the first information. Optionally, the second interface may further include an icon area, in which the at least one application service icon is displayed. The at least one application service icon may also include at least one second icon, which is a custom-displayed application service icon, and the at least one first icon is displayed above the at least one second icon.
[0476] In other words, at least one application service icon in the aforementioned second interface can be divided into two parts. One part is a fixed icon displayed on the right (i.e., the aforementioned at least one second icon), and the other part can be application service icons recommended by the user based on the aforementioned first information. Optionally, a separating line can be displayed between these two parts of the icons for differentiation. The aforementioned at least one second icon is an icon customized by the user according to their usage habits and frequency. Regardless of the information the user shares on the electronic device, the icons displayed by the electronic device based on that information can all include this part of the icon to best meet the user's needs. The aforementioned at least one first icon is recommended by the electronic device based on the elements contained in the aforementioned first information. When the user shares other information through this method, the recommended application service icon can be different from the icons in the aforementioned at least one first icon. For details, please refer to the aforementioned... Figure 16- Figure 21 The relevant explanations will not be repeated here.
[0477] It should be understood that in the process of using electronic devices in daily life, users often drag and drop elements. These drag and drop operations may not be for the purpose of transferring the dragged elements across applications (such as dragging text to change the position of text or paragraphs in document editing). Therefore, how to combine user operations and user operating habits to guide users to use the transfer method provided in this application, and set the trigger rules of this method for users, is the key to further improving the efficiency of user interaction with electronic devices. Therefore, in one possible implementation, the first interface further includes a first trigger area and a second trigger area, the first trigger area being larger than the second trigger area, the second operation including a first sub-operation and a second sub-operation, the first sub-operation being an operation to move the first information to the first trigger area, the second sub-operation being an operation to move the first information to the second trigger area, and the display of the second interface in response to the second operation on the first information in the first interface including: in response to the first sub-operation, if the first information stays in the first trigger area for a first duration, displaying a light strip guiding effect in the first interface, the light strip guiding effect being used to indicate moving the first information to the second trigger area; and displaying the second interface in response to the second sub-operation.
[0478] In this embodiment, the first interface may include the first trigger area and the second trigger area. Optionally, the specific size and position of the first and second trigger areas may not be displayed in the user interface, meaning the user cannot directly observe the specific outlines of these two areas in the first interface. The size and position of these two areas may be stored in the electronic device only in a form perceptible to the electronic device (e.g., program code). When the user drags the first information to the first trigger area, the electronic device may display a special effect in the first interface (e.g., at the edge of the first interface) to prompt the user to drag the image further towards the second trigger area. The special effect may be a user-visible effect such as a glowing effect or a shadow effect, or other user-perceptible effects; this application does not limit this. Optionally, the electronic device may also display the special effect in the first interface only after the user drags the first information to the first trigger area and holds the first information in the first trigger area for a duration T. Specifically, T may be set to 600 milliseconds. When the user continues to drag the first piece of information to the second trigger area, the electronic device can immediately respond to the operation and display the second interface.
[0479] In an optional implementation, the second interface further includes a door-closing trigger area. When the user drags the first information to the third trigger area, the electronic device can deselect the second interface and redisplay the first interface. Furthermore, if the user does not release the drag, the first information remains dragged by the user on the first interface, allowing the user to reselect the method for cross-application information transmission. For details, please refer to the aforementioned... The relevant explanations will not be repeated here.
[0480] S103. In response to the third operation on the first information, the electronic device transmits the first information to the application service corresponding to the target icon.
[0481] Optionally, the third operation described above is an operation that associates the first information with the target icon. For example, the third operation described above is an operation that moves the first information to the target icon.
[0482] In the second interface described above, the user associates the first information with the target icon through the third operation. The electronic device then responds to the third operation by transmitting the first information to the application service corresponding to the target icon. Specifically, the third operation can be dragging the first information closer to the target icon, dragging the first information onto the target icon and releasing it, or any other operation that associates the first information with the target icon, as long as the third operation can select the target icon needed by the user from at least one application service icon and associate the first information with the target icon.
[0483] Understandably, the information transmission process provided by this application is continuous from the moment the user drags the first information to the moment the first information is placed into the application service corresponding to the target icon. The term "continuous" here means that the user does not need to perform operations such as copying and pasting, nor does the user need to switch applications. The user's fingers do not need to leave the screen of the electronic device during the entire operation process. The operation is simple and fast, which can effectively improve the efficiency of users transmitting information across applications and enhance the user experience.
[0484] Optionally, the second interface may also display sub-interfaces. The elements displayed in the sub-interfaces are the same as those displayed in the first interface (except for the status bar). In fact, the sub-interfaces displayed in the second interface can be considered as the interface obtained by the electronic device after performing a three-dimensional transformation of all elements (except the status bar) of the first interface. In the second interface, the sub-interfaces can create a visual effect on the screen that pushes the original interface (i.e., the first interface) inward. Understandably, this "opening the door" visual effect metaphorically represents the act of transmitting elements (i.e., the first information), which is more intuitive than copy and paste. This information transmission method ensures an effective browsing area for the user interface, allowing the first information to be transmitted to other application services while viewing the historical application interface (i.e., the first interface) through the sub-interfaces, further enhancing the user experience. Optionally, in the second interface, the background behind the sub-interfaces can be set to the desktop background (i.e., desktop wallpaper) of the electronic device with a blurred effect to provide users with a better visual experience.
[0485] Understandably, the electronic device can recommend multiple application services that can receive the first information to the user based on the first information, and display icons of these application services on the right side of the second interface. Specifically, the maximum number of these application service icons can be 20. In one possible implementation, the at least one application icon includes at least one icon displayed in the icon area and at least one icon not displayed in the icon area. The target icon is not displayed in the icon area. The second interface also includes a third trigger area. The electronic device can update the at least one icon displayed in the icon area in response to a seventh operation on the first information until the target icon is displayed in the icon area. The seventh operation is the operation of moving the first information to the third trigger area. That is, when the number of these application service icons exceeds a certain threshold (e.g., 7), in order to ensure the cleanliness and visibility of the interface, the electronic device can only display a portion of these application service icons (e.g., 7) simultaneously in the second interface. When the icons currently displayed in the second interface are not the application services expected by the user, the user can also place the first information in the third trigger area to make the electronic device update the icons in the icon area. Specifically, the third trigger area can be set directly above and / or directly below the icon area, as detailed above. Related explanations.
[0486] To guide users in accurately placing the aforementioned first information into the desired application service, during the dragging and dropping of the first information onto the target icon, when the first information approaches the target icon (assuming the target icon remains the closest to the first information among at least one application icon throughout the dragging process), the target icon can be enlarged and moved within the second interface to bring it closer to the first information. This creates a visual effect in the second interface where the target icon appears to be attracted to the first information (i.e., the movement direction of the first information and the target icon are opposite, both moving towards each other), indicating to the user that the first information is associated with the target icon. If the user releases the device at this point, the first information will be transferred to the application service corresponding to the target icon. Optionally, the electronic device will only enlarge the target icon and / or move its position in the first interface within the second interface if the distance between the first information and the target icon is less than a first threshold.
[0487] After transmitting the first information to the application service corresponding to the target icon, the electronic device can also display a third interface. This third interface can be configured with different effects depending on the type of application service accessed by the first information and the result of the information transmission. For example, the third interface can display one or more of the following: a floating window, a capsule (minimized floating window), a snack bar, toast feedback, or the application service interface corresponding to the target icon (full-screen display), to inform the user of the transmission result of the first information and facilitate further user operations. For details, please refer to the aforementioned... The relevant explanations will not be repeated here.
[0488] This application also provides an electronic device, which includes one or more processors and a memory; wherein the memory is coupled to the one or more processors, and the memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the electronic device to perform the methods shown in the foregoing embodiments.
[0489] As used in the above embodiments, depending on the context, the term "when..." can be interpreted as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is interpreted as meaning "if determining...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)".
[0490] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.
[0491] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
Claims
1. An information transmission method applied to electronic devices, characterized in that, The method includes: Display a first interface, which includes first information; In response to a first operation on the first information, second information corresponding to the first information is displayed on the first interface, and a light strip is displayed at the edge of the screen of the electronic device; In response to a second operation on the second information, the second information is moved; In response to a third operation on the second information, a first visual effect is displayed where the second interface is pushed inward, and multiple first icons recommended based on the first information are displayed at the edge, wherein the second interface is the content of the first interface excluding the status bar; In response to the user's fourth operation, the first information is transmitted to the application corresponding to the target icon and the application interface or feedback information corresponding to the target icon is displayed, wherein the target icon is one of the multiple first icons; The first operation, the second operation, and the third operation are consecutive operations.
2. The method according to claim 1, characterized in that, The first visual effect is the visual effect of "opening the door".
3. The method according to claim 1, characterized in that, The light strip is used to prompt the user to drag towards the edge of the interface.
4. The method according to any one of claims 1-3, characterized in that, The light strip includes either a glowing effect or a shadow effect.
5. The method according to any one of claims 1-3, characterized in that, The first visual effect of being pushed inward is on the same side of the screen as the light strip.
6. The method according to any one of claims 1-3, characterized in that, When the first operation satisfies the first condition, the electronic device displays the light strip at the first edge.
7. The method according to claim 6, characterized in that, The third operation is a drag operation. When the user drags the second information to meet the second condition, the electronic device displays the first visual effect on the side corresponding to the first edge and displays the first icon on the first edge.
8. The method according to claim 1, characterized in that, After displaying the visual effect and before receiving the fourth operation, the method further includes: Upon receiving a fifth operation from the user, in response to the fifth operation, the electronic device redisplays the first interface and displays the second information on the first interface, wherein the fifth operation and the third operation are consecutive operations.
9. The method according to claim 8, characterized in that, The fifth operation is a drag operation, and the method further includes: After the first interface is redisplayed and the second information is displayed on the first interface, if the user does not release the finger, a drag operation on the second information is received, and the first visual effect of pushing the second interface inward is displayed again, and the first icon recommended based on the first information is displayed on the first edge.
10. The method according to claim 8, characterized in that, The fifth operation is a drag operation, and the method further includes: After the first interface is redisplayed and the second information is displayed on the first interface, the user receives a sixth operation on the second information without releasing the device. In response to the sixth operation, the second information is moved and a light strip is displayed at the second edge of the screen of the electronic device; In response to the user's seventh operation on the second information, a second visual effect of the second interface being pushed inward is displayed, and the first icon recommended by the first information is displayed on the second edge; The fifth, sixth, and seventh operations are drag operations that are consecutive to the third operation.
11. The method according to claim 7, characterized in that, When the first operation satisfies the third condition, the electronic device displays the light strip at the second edge of the screen.
12. The method according to claim 11, characterized in that, The third operation is a drag operation. When the user drags the second information to meet the fourth condition, the electronic device displays the visual effect on one side corresponding to the second edge and displays the first icon on the second edge.
13. The method according to claim 11 or 12, characterized in that, The first edge and the second edge are different edges of the electronic device.
14. The method according to claim 7, characterized in that, The first condition includes: the user's finger touches the screen in a first trigger area, which is located on the left or right side of the electronic device.
15. The method according to claim 14, characterized in that, The second condition includes: the user drags the second information into the first door opening area, and the first door opening area and the first trigger area are located on the same side of the screen.
16. The method according to claim 12, characterized in that, The third condition includes: the user's finger touches the screen in the second trigger area, which is located on the left or right side of the electronic device.
17. The method according to claim 16, characterized in that, The fourth condition includes: the user drags the second information into the second door opening area, and the second door opening area and the second trigger area are located on the same side of the screen.
18. The method according to claim 8, characterized in that, The fifth operation includes: the user dragging the second information to the door closing area.
19. The method according to claim 18, characterized in that, The closing area is half the width of the screen of the electronic device in the width direction.
20. The method according to claim 1, characterized in that, The method further includes: After displaying the visual effect and before receiving the fourth operation, when the user's sixth operation is received, in response to the sixth operation, the electronic device redisplays the first interface and cancels the display of the second information.
21. The method according to claim 20, characterized in that, The sixth operation includes: releasing the hand.
22. The method according to claim 1, characterized in that, The method further includes: In response to the third operation, a second icon is displayed at the edge, the second icon being an icon fixed in the target area.
23. The method according to claim 22, characterized in that, The first interface also includes third information, and the method further includes: In response to the first operation on the third information, fourth information corresponding to the third information is displayed on the first interface, and a light strip is displayed at the edge of the screen of the electronic device; In response to the seventh operation on the fourth information, the fourth information is moved; In response to the eighth operation on the fourth information, the first visual effect of the second interface being pushed inward is displayed, and the second icon and the third icon recommended based on the third information are displayed at the edge.
24. The method according to claim 23, characterized in that, The first information includes: images, text, QR codes, screenshots, or videos; the third information includes: images, text, QR codes, screenshots, or videos; the third information is different from the first information. The third icon is different in type or order from the first icon.
25. The method according to claim 22, characterized in that, The method further includes: In response to a user action, a settings interface is opened, which includes a switch control and a tab, wherein the switch control is in the on state; In response to a user's click on a tab, a user interface is displayed. The icons displayed in the first area of the user interface are icons that the user has not yet set to be permanently displayed in the icon area, and the icons displayed in the second area of the user interface are icons that the user has already set to be permanently displayed in the icon area. In response to the user's operation of adding a symbol to the fourth icon in the first area, the fourth icon is displayed in the blank icon area of the second area; In response to the user's operation of removing the fifth icon from the second area, the fifth icon is removed from the second area.
26. The method according to claim 25, characterized in that, The second icon includes the fourth icon but does not include the fifth icon.
27. The method according to claim 1, characterized in that, The method further includes: In response to the fourth operation, one of the following is displayed on the first interface: a first prompt message, a first capsule, and a first floating window, wherein the first prompt message is used to prompt the user that the first information has been transmitted to the application corresponding to the target icon, and the first floating window is the interface of the application corresponding to the target icon; In response to the first prompt message or the fourth operation of the first capsule, the interface of the application corresponding to the target icon is displayed.
28. The method according to claim 1, characterized in that, The first piece of information is an image. When the number of images in the first information exceeds the limit on the number of images that the application corresponding to the target icon can send at one time, in response to the fourth operation, the electronic device also displays a second prompt message, which is used to indicate that the transmission limit has been exceeded.
29. The method according to claim 28, characterized in that, The second information displays the number of images.
30. The method according to claim 1, characterized in that, The first information is text, the first information includes location information, the first icon includes an icon for a map application, and the method further includes: In response to a user placing the second information on the icon of the map application and releasing it, the electronic device displays a floating window of the map application, which includes the location information and the location of the location information on the map.
31. The method according to claim 1, characterized in that, The first information is text, the first information includes location information, the first icon includes an icon of a map application, the target icon is the icon of the map application, and the method further includes: In response to the fourth operation, the electronic device displays a floating window of the map application, the floating window including the location information, the location information's position on the map, and navigation routes.
32. The method according to claim 1, characterized in that, The fourth operation includes dragging and releasing, and the method further includes: In response to the user dragging the second information close to the target icon, the target icon is displayed with special effects.
33. The method according to claim 32, characterized in that, The target icon is enlarged and brought closer to the second information.
34. The method according to claim 1, characterized in that, The first icon is a subset of icons recommended based on the first information.
35. The method according to claim 34, characterized in that, The step of transmitting the first information to the application corresponding to the target icon in response to the user's fourth operation includes: In response to the user dragging the second information to the first area of the icon area, the icons in the icon area are updated by scrolling in the first direction; In response to the user dragging the second information to the second area of the icon area, the icons in the icon area are updated by scrolling in the second direction. In response to the user placing the second information on the target icon and releasing it, the first information is transmitted to the application corresponding to the target icon.
36. The method according to claim 35, characterized in that, In response to the user placing the second information on the target icon, the target icon is displayed with special effects.
37. The method according to claim 1, characterized in that, The first interface includes a first sub-interface and a second sub-interface. The first sub-interface and the second sub-interface are displayed in a split-screen format, or one of the first and second sub-interfaces is displayed in full-screen mode while the other is displayed in a small window. The first sub-interface is the interface of the first application, and the second sub-interface is the interface of the second application.
38. The method according to claim 37, characterized in that, The first information is information from the first sub-interface or the second sub-interface.
39. The method according to claim 38, characterized in that, The first information is the information in the first sub-interface, and the method further includes: In response to a seventh operation on the second information, the first information is transmitted to the second application.
40. The method according to claim 1, characterized in that, The second interface is the interface obtained by transforming the content of the first interface, excluding the status bar, into a three-dimensional form.
41. An electronic device, characterized in that, The electronic device includes: One or more processors; One or more memories coupled to the one or more processors; The memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the electronic device to perform the method as described in any one of claims 1-40.
42. A computer-readable storage medium comprising instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the method as described in any one of claims 1-40.
Citation Information
Patent Citations
File sharing method and terminal
CN110622487A
Interaction method among multiple application programs
CN114201097A
Cross-device object dragging method and device
CN114764298A
Application interaction method and electronic equipment
CN115033142A
File sharing method and terminal
WO2019071872A1