Cross-application data transmission method and related device
By triggering smart flow services on electronic devices, directly sending data from one application to another, solving the problem of cumbersome operations in the existing technology, achieving fast and convenient cross-application data transmission, and improving user experience.
Patent Information
- Application Number
- PCT/CN2024/078657
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-29
- Filing Date
- 2024-02-27
- Publication Date
- 2025-01-02
AI Technical Summary
In the prior art, the user needs to select data in one application and exit the application, open another application, and then paste the data, resulting in cumbersome operations and poor user experience.
By generating operation controls on electronic devices, detecting that the user drags the control into the preset hot zone and triggers the smart flow service, determines the application that can receive data, and sends the data to the target application after being dragged to the target application icon area and releases it. , realize cross-application data transmission.
It provides fast and convenient cross-application data transmission services, reduces operational steps and improves user experience.
Smart Images

Figure CN2024078657_02012025_PF_FP_ABST
Abstract
Description
Cross-application data transmission method and related equipment
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on June 29, 2023, with application number 202310788797.5 and application name “Cross-application data transmission method and related equipment”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of terminals, and in particular to a cross-application data transmission method and related equipment. Background Art
[0003] Currently, if a user wants to send some data from one app to another, they need to select the data, exit the app, open the other app, and then paste the data to be transferred into the other app. This cumbersome operation brings a poor user experience.
[0004] Summary of the Invention
[0005] The present application provides a cross-application data transmission method and related equipment. In this method, electronic devices implementing this method, such as mobile phones, tablet computers, etc., can use corresponding operation controls after obtaining screenshots, screen recordings, texts, documents, and waiting for data to be transmitted. After detecting that the user drags the above-mentioned operation control into a preset hot zone, the electronic device can trigger a smart flow service, determine one or more applications that can receive the corresponding data to be transmitted, and display the icons of the above-mentioned applications. Furthermore, after detecting that the user continues to drag the above-mentioned operation control to the area where any application icon is located and releases the operation, the electronic device can send the data to be transmitted corresponding to the above-mentioned operation control to the application corresponding to the above-mentioned application icon, providing users with fast, convenient and smooth cross-application data transmission services.
[0006] In a first aspect, the present application provides a data sharing method, applied to an electronic device, comprising:
[0007] A first operation of dragging a first control into a first area on the screen is detected; in response to the first operation, an icon of the first application and an icon of the second application are displayed; a second operation of continuing to drag the first control into a second area where the icon of the first application is located and releasing it is detected; in response to the second operation, first data corresponding to the first control is shared with the first application.
[0008] By implementing the method provided in the first aspect, after detecting that the user drags a preset control into a preset hot zone, the electronic device can trigger a smart flow service and display multiple application icons. After detecting that the user continues to drag the above-mentioned preset control to the area where any application icon among the above-mentioned multiple application icons is located and releases it, the data to be transmitted corresponding to the above-mentioned preset control is sent to the application corresponding to any of the above-mentioned application icons, thereby providing users with fast, convenient and smooth cross-application data transmission services.
[0009] In combination with the method provided in the first aspect, in some embodiments, the method also includes: displaying a first interface; detecting a screenshot operation when displaying the first interface; displaying a first control on the first interface in response to the screenshot operation, and the first data includes a screenshot image of the first interface.
[0010] By implementing the method provided in the above embodiment, the electronic device can generate a screenshot image after detecting a screenshot operation and display a control corresponding to the screenshot image. The control is the first control, that is, the preset control. At this time, after detecting that the user drags the first control into the preset hot zone, the electronic device can trigger the smart flow service, display multiple application icons, and after detecting that the user continues to drag the first control to the area where any application icon among the multiple application icons is located and releases the control, the screenshot image corresponding to the first control is sent to the application corresponding to the any application icon.
[0011] In some embodiments, a preview of a screenshot of the first interface is displayed on the first control, so that the user can intuitively determine the specific content of the data to be transmitted.
[0012] In combination with the method provided in the above embodiments, in some embodiments, before detecting the first operation of dragging the first control into the first area of the screen, the method also includes: detecting a third operation acting on the first control; starting vibration feedback, and setting the first control to a draggable floating state.
[0013] When implementing the method provided in the above embodiment, the first control generated by the electronic device based on the screenshot operation is initially non-draggable. After detecting a third operation (such as a long press operation) acting on the first control, the electronic device can set the first control to a draggable suspended state to prevent accidental touches and dragging. At the same time, the electronic device can also activate a motor to initiate vibration feedback to remind the user that dragging has been initiated.
[0014] In combination with the method provided in the first aspect, in some embodiments, the method also includes: displaying a first interface; detecting a screenshot operation when displaying the first interface; displaying a first screenshot image in response to the screenshot operation; detecting an editing operation on the first screenshot image to obtain a second screenshot image; detecting a fourth operation on the second screenshot image; and displaying a first control on the image editing interface in response to the fourth operation, wherein the first data includes the second screenshot image.
[0015] By implementing the method provided in the above embodiment, the electronic device may generate and display a screenshot image, i.e., a first screenshot image, after detecting a screenshot operation. Then, the electronic device may detect an operation to edit the screenshot image, such as adding handwriting, highlight marks, stickers, text, and other editing operations, and obtain an edited screenshot image based on the above editing operation, i.e., a second screenshot image. After detecting a fourth operation (such as a long press operation) on the second screenshot image, the electronic device may display a first control corresponding to the above second screenshot image. At this time, after triggering the smart flow service and displaying multiple application icons, after detecting that the user continues to drag the first control to the area where any application icon is located and releases it, the electronic device may send the edited screenshot image corresponding to the above first control to the application corresponding to any of the above application icons.
[0016] In some embodiments, a preview of the second screenshot image is displayed on the first control, so that the user can intuitively determine that the specific content of the data to be transmitted is the edited screenshot image.
[0017] In combination with the method provided in the above embodiment, in some embodiments, displaying the first screenshot image in response to a screenshot operation specifically includes: displaying a second control in response to the screenshot operation, where a preview of the first screenshot image is displayed on the second control; detecting a fifth operation applied to the second control; and displaying an image editing interface in response to the fifth operation, where the image editing interface includes the first screenshot image;
[0018] The image editing interface also includes multiple editing controls, wherein an editing operation on a first screenshot image is detected to obtain a second screenshot image, specifically including: detecting an operation acting on one or more editing controls; performing image editing processing corresponding to one or more editing controls on the first screenshot image to obtain a second screenshot image.
[0019] In the above embodiment, the screenshot operation is any one of the following: a global screenshot operation, a local screenshot operation, and a scrolling screenshot operation; when the screenshot operation is a global screenshot operation, the size of the first screenshot image is the same as the size of the screen; when the screenshot operation is a local screenshot operation, the first screenshot image is irregular in shape, and the size of the first screenshot image is smaller than the size of the screen; when the screenshot operation is a scrolling screenshot operation, the size of the first screenshot image is larger than the size of the screen.
[0020] This means that for any screenshot operation, the electronic device can generate corresponding operation controls and associate the above operation controls with the screenshot images captured by the screenshot operation. After triggering the smart flow and determining the target application, the above screenshot images are shared to the target application, providing users with a convenient cross-application screenshot image sharing service.
[0021] In combination with the method provided in the first aspect, in some embodiments, the method further includes: displaying a first interface, the first interface including target text; detecting an operation on the target text; and displaying a first control on the first interface in response to the operation, the first data including the target text.
[0022] By implementing the method provided in the above embodiment, upon detecting an operation (e.g., a long press) on target text within the displayed text, the electronic device may generate a first control corresponding to the target text. At this point, after triggering the smart flow and determining the target application, the electronic device may send the target text corresponding to the first control to the target application.
[0023] In some embodiments, all or part of the target text is displayed on the first control, so that the user can intuitively determine the specific content of the text to be transmitted at any time.
[0024] In combination with the method provided in the first aspect, in some embodiments, the method also includes: displaying a first interface, the first interface including the target text; when displaying the first interface, detecting a screenshot operation and displaying a first screenshot image; obtaining the text in the first screenshot image; selecting the target text from the text in the first screenshot image; detecting a sixth operation on the target text, and in response to the sixth operation, displaying a first control, wherein the first data includes the target text.
[0025] By implementing the method provided in the above embodiment, the electronic device can obtain a screenshot image including the current display interface through a screenshot operation, then recognize the text in the image, obtain the text in the current display interface, and then provide the user with the function of selecting the target text. In this way, when some applications restrict users from directly copying text in the interface, the electronic device can support users in the screenshot scenario, edit the screenshot, extract the target text, and then perform intelligent circulation, realizing the cross-application transmission of text content.
[0026] In conjunction with the method provided in the above embodiment, in some embodiments, displaying the first screenshot image specifically includes: in response to a screenshot operation, displaying a second control, wherein a preview image of the first screenshot image is displayed on the second control; upon detecting a user operation on the second control, displaying an image editing interface, wherein the image editing interface includes the first screenshot image;
[0027] The image editing interface also includes a third control, and obtaining the text in the first screenshot image specifically includes: detecting a user operation acting on the third control, and obtaining the text in the first screenshot image.
[0028] In combination with the method provided in the first aspect, in some embodiments, the method further includes: detecting a screen recording operation, recording the interface currently displayed on the electronic device to obtain a first video; after the screen recording is completed, displaying a first control, and the first data includes the first video.
[0029] By implementing the method provided in the above embodiment, upon detecting a screen recording operation and obtaining a recorded video, the electronic device may generate a first control corresponding to the recorded video. At this point, after triggering smart transfer and determining a target application, the electronic device may send the recorded video corresponding to the first control to the target application.
[0030] In some embodiments, a frame of the first video is displayed on the first control.
[0031] In combination with the method provided in the above embodiments, in some embodiments, the first application and the second application are application programs that can receive the first data and are determined based on the type and / or semantic information of the first data.
[0032] For example, when the first data is a screenshot or other image, the first application and the second application can be applications that can receive such images, such as note-taking applications, instant messaging applications, photo editing applications, shopping applications, etc., as determined based on the image and image content; when the first data is text, the first application and the second application can be applications that can receive text, such as note-taking applications, instant messaging applications, calendar applications, etc. In this way, for any data to be transmitted selected by the user, the electronic device can automatically determine the application that matches it and can be used as the target application, and then display the corresponding icon for the user to select.
[0033] In combination with the method provided in the above embodiments, in some embodiments, the first application is an instant messaging application. After sharing the first data corresponding to the first control to the first application, the method also includes: displaying a first window, the first window displaying multiple contacts; detecting a seventh operation of determining a target contact from multiple contacts; and sending the first data to the target contact in response to the seventh operation.
[0034] When implementing the method provided in the above embodiment, when the target application (i.e., the first application) is an instant messaging application, after sending the data to be transmitted to the first application, the electronic device can also immediately display multiple contacts for the user to select the target contact, and then directly send the data received by the target application to the above target contact without the user having to enter the target application to perform settings and other operations.
[0035] In combination with the method provided in the above embodiments, in some embodiments, displaying the icon of the first application and the icon of the second application specifically includes: displaying the icon of the first application and the icon of the second application in the right side area or the left side area of the screen, and the icon of the first application and the icon of the second application are arranged vertically.
[0036] In combination with the method provided in the above embodiment, in some embodiments, after sharing the first data corresponding to the first control to the first application, the method further includes: stopping displaying the icon of the first application and the icon of the second application.
[0037] In this way, after the smart flow is completed, that is, after the data to be transmitted is successfully transmitted to the selected target application, the electronic device can close the multiple application icons displayed after the smart flow is triggered at any time, and then switch the interface currently displayed by the electronic device back to before the smart flow is triggered, so that the user can continue browsing, editing and other operations before the smart flow.
[0038] In a second aspect, the present application provides an electronic device comprising one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, and the computer program code comprises computer instructions. When the one or more processors execute the computer instructions, the electronic device executes the method described in the first aspect and any possible implementation of the first aspect.
[0039] In a third aspect, an embodiment of the present application provides a chip system, which is applied to an electronic device, and the chip system includes one or more processors, which are used to call computer instructions to enable the electronic device to execute the method described in the first aspect and any possible implementation method of the first aspect.
[0040] In a fourth aspect, the present application provides a computer-readable storage medium comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect and any possible implementation of the first aspect.
[0041] In a fifth aspect, the present application provides a computer program product comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect and any possible implementation of the first aspect.
[0042] It is understandable that the electronic device provided in the second aspect, the chip system provided in the third aspect, the computer storage medium provided in the fourth aspect, and the computer program product provided in the fifth aspect are all used to perform the methods provided in this application. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] Figures 1A-1M are a set of user interfaces for implementing cross-application data transmission provided by an embodiment of the present application;
[0044] 2A-2F are another set of user interfaces for implementing cross-application data transmission provided by an embodiment of the present application;
[0045] 3A-3G are a set of user interfaces for implementing cross-application data transmission based on image editing, provided in an embodiment of the present application;
[0046] 4A-4F are another set of user interfaces for implementing cross-application data transmission based on image editing provided by an embodiment of the present application;
[0047] 5A-5I are a set of user interfaces for transmitting partial screenshot images across applications provided by an embodiment of the present application;
[0048] 6A-6D are another set of user interfaces for transmitting partial screenshot images across applications provided by an embodiment of the present application;
[0049] 7A-7C are another set of user interfaces for implementing cross-application data transmission provided by an embodiment of the present application;
[0050] 8A-8F are another set of user interfaces for implementing cross-application data transmission provided by an embodiment of the present application;
[0051] FIG9A is a schematic diagram of hot zones for triggering smart flow in an electronic device 100 according to an embodiment of the present application;
[0052] FIG9B is a schematic diagram of hot zones for shutting down smart flow of the electronic device 100 provided in an embodiment of the present application;
[0053] 10A-10C are a set of user interfaces showing usage instructions provided in an embodiment of the present application;
[0054] 11A-11D are another set of user interfaces for implementing cross-application data transmission provided by an embodiment of the present application;
[0055] FIG12 is a flowchart of cross-application data transmission provided by an embodiment of the present application;
[0056] FIG13 is a schematic structural diagram of an electronic device 100 provided in an embodiment of the present application. DETAILED DESCRIPTION
[0057] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application.
[0058] In current cross-application data transfer scenarios, after a user selects data to be transferred in one application, they must exit that application, open another application, and then paste the data into the other application. This cumbersome operation provides a poor user experience.
[0059] In view of this, an embodiment of the present application provides a method for transmitting data across applications, which can be applied to electronic devices 100 such as mobile phones and tablet computers.
[0060] In this method, the electronic device 100 can generate corresponding operation controls after obtaining screenshots, screen recordings, texts, documents and data to be transmitted. After detecting that the user drags the above-mentioned operation controls into a preset hot zone, the electronic device 100 can trigger the smart flow service, determine one or more applications that can receive the corresponding data to be transmitted, and display the icons of the above-mentioned applications. Furthermore, after detecting that the user continues to drag the above-mentioned operation controls to the area where any application icon is located and releases the operation, the electronic device 100 can send the data to be transmitted corresponding to the above-mentioned operation controls to the application corresponding to the above-mentioned application icon, providing users with fast, convenient and smooth cross-application data transmission services.
[0061] The electronic device 100 is not limited to mobile phones and tablet computers. It can also be a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device and / or a smart city device. The embodiments of the present application do not impose any special restrictions on the specific type of the electronic device.
[0062] Figures 1A-1M are a set of user interfaces for implementing cross-application data transmission provided by an embodiment of the present application.
[0063] FIG1A is a user interface provided in an embodiment of the present application.
[0064] The application that provides the user interface can be a system application or a third-party application. In the embodiment of the present application, a system application refers to an application directly provided by the operating system of the electronic device 100 for implementing a specific function. A third-party application refers to an application provided by other developers and obtained by the electronic device 100 through the Internet for implementing a specific function.
[0065] In some embodiments, the user interface may also be the home page, the negative first screen, the lock screen, etc. of the electronic device 100, which is not limited in this embodiment of the present application. The negative first screen refers to the first screen on the left side of the home page opened by swiping right on the home page.
[0066] During the display of the user interface shown in FIG1A , the electronic device 100 may detect a screenshot operation. The screenshot operation may be performed by a physical button on the electronic device 100, such as a power button or a volume button, or by a touch operation on the screen of the electronic device 100, such as a three-finger swipe operation shown in FIG1A , and the present application does not limit this.
[0067] In response to the above screenshot operation, the electronic device 100 can save a frame of the user interface on the current screen, i.e., a screenshot image (screenshot). The electronic device 100 can write the screenshot to the memory of the electronic device 100 for storage, so that the user can browse the screenshot at any time through the access operation.
[0068] In an embodiment of the present application, the electronic device 100 may also display a preview of the screenshot on the screen to prompt the user to obtain a frame of the screenshot. FIG1B is a user interface for displaying a screenshot preview on the screen provided by an embodiment of the present application.
[0069] As shown in FIG1B , the electronic device 100 may display a control 111 in the lower left corner of the screen. The lower left corner of the screen may be referred to as the default screenshot display area. The default screenshot display area is not limited to the lower left corner; it may also be the upper right corner, lower right corner, upper left corner, etc. of the screen, and this embodiment of the application does not limit this.
[0070] Control 111 displays a preview of the screenshot of the user interface shown in FIG1A . The user can use control 111 to preview the screenshot obtained by the aforementioned screenshot operation. Electronic device 100 may display control 111 for a period of time based on a preset timer, such as three seconds, for the user to view. After the timer expires, electronic device 100 may no longer display control 111.
[0071] In an embodiment of the present application, while displaying control 111, electronic device 100 may detect whether a user operation is performed on control 111. Referring to FIG1C , electronic device 100 may detect a long press operation on control 111. In response to the user operation, electronic device 100 may switch control 111 to a suspended state, i.e., float control 111. In the suspended state, control 111 may adjust its display position in real time following the motion trajectory of the user's touch operation, i.e., adjust the display position of the screenshot preview image.
[0072] Referring to Figures 1C-1E , in the suspended state, electronic device 100 can detect a user sliding control 111 toward the right edge of the screen. Upon detecting that control 111 is approaching the right edge of the screen, electronic device 100 can display a light bar 112. Light bar 112 can be used to alert the user that control 111 has approached the right edge of the screen. At this point, the user can decide to continue swiping right to trigger the service corresponding to the right edge of the screen, or stop swiping right to avoid triggering the service corresponding to the right edge of the screen.
[0073] Specifically, the electronic device 100 can set a right-side hot zone. A hot zone refers to a touch area of a fixed shape and size on the screen. The right-side hot zone is a rectangular touch area extending from the right edge of the screen to the other side. The electronic device 100 can determine whether the control 111 is close to the right side of the screen by the distance between the position of the current finger touch point on the screen and the right-side hot zone. Furthermore, when it is recognized that the current touch point is within the right-side hot zone, the electronic device 100 can determine to trigger the service corresponding to the right side of the screen.
[0074] Referring to the control 111 shown in FIG. 1C to FIG. 1E , while dragging the control 111 to slide, the electronic device 100 may reduce the size of the control 111 to reduce obstruction of other content on the screen.
[0075] In an embodiment of the present application, the service corresponding to the hot zone on the right side may be a smart flow service. Smart flow service refers to matching applications that can receive data to be transmitted, and providing users with a service to quickly send data to be transmitted to other target applications. The data to be transmitted includes but is not limited to text, pictures, videos, documents, hyperlinks, etc. The electronic device 100 may determine the data to be transmitted based on the operating control when the smart flow is triggered. For example, in the above scenario, the control 111 may be referred to as the operating control, and the screenshot corresponding to the control 111 may be referred to as the data to be transmitted.
[0076] After triggering the smart transfer, the electronic device 100 may display a menu bar on the right side of the screen containing one or more candidate application icons. These candidate applications are selected by the electronic device 100 from all installed applications and are capable of receiving the data to be transmitted. The electronic device 100 may determine the candidate applications based on the information type and semantic information of the data to be transmitted. The matching strategy for determining candidate applications based on information type and semantic information will be described in detail later and will not be elaborated on here.
[0077] The electronic device 100 may detect the user operation of continuing to swipe right. In response to the above operation, the electronic device 100 may trigger the smart flow service corresponding to the right side hot zone and display a menu bar including one or more candidate application icons.
[0078] 1F , the electronic device 100 may display a menu bar 113 on the right side of the screen. The menu bar 113 includes a plurality of application icons. When the menu bar 113 is triggered to be displayed, the control 111 may block the application icons displayed in the menu bar 113. At this time, referring to FIG1G , the user may drag the control 111 to the left for a distance to remove the blockage. As shown in FIG1G , the menu bar 113 may display: a favorite icon, a search icon, a sharing icon, a note icon, a text message icon, a shopping icon, a print icon, etc. One icon corresponds to one application. The applications corresponding to the above icons are all applications (candidate applications) that can receive screenshots corresponding to the control 111.
[0079] After menu bar 113 is displayed, the user can use the icons displayed in menu bar 113 to identify all candidate applications that can receive the data to be transmitted, and then determine the target application to receive the data to be transmitted from the candidate applications. It is understood that when the data to be transmitted is other types of data such as text, video, hyperlinks, or data of the same type but with different semantic information, the candidate applications displayed in menu bar 113 may change accordingly.
[0080] At the same time, the original user interface can be adjusted to a right perspective image, which forms an "opening the door" animation effect with the above-mentioned menu bar 113 to enhance the user experience. In one implementation, after "opening the door", the image displayed on the left is the user interface at the triggering moment captured by the electronic device 100. That is to say, after "opening the door", the image on the left is fixed during the process of the user selecting the target application and will not change over time. In other embodiments, the electronic device 100 may also display the user interface of the original application in real time after "opening the door". At this time, after "opening the door", the image on the left will change over time during the process of the user selecting the target application.
[0081] After obtaining the menu bar 113, the user can determine the target application to receive the screenshot corresponding to the control 111 from the candidate applications displayed in the menu bar 113. The user can select the target application by dragging the control 111 to the area where the target application icon is located. For example, the user can select the note application as the target application for receiving the screenshot corresponding to the control 111. At this time, referring to Figure 1H, the user can continue to drag the control 111 to the note icon and release it. After detecting the user operation of dragging the control 111 to the note icon and releasing it, the electronic device 100 can confirm that the note application is the target application and write the screenshot corresponding to the control 111 into the note application.
[0082] In some embodiments, dragging a control (such as the control 111) to an icon (such as the note icon) requires that the touch point of the drag operation be within the icon. In other embodiments, the electronic device 100 may set a receiving area that completely contains the icon, and the area of the receiving area is larger than the area of the icon. In this case, dragging a control to an icon may only require that the touch point of the drag operation be within the receiving area.
[0083] It is understandable that when there are too many candidate applications to be displayed in the menu bar 113 at the same time, the electronic device 100 may also update the candidate application icons currently displayed in the menu bar 113 according to the user's dragging operation. For example, the electronic device 100 may detect that the user drags the control 111 to a position below the last candidate application icon currently displayed (such as the mail icon). In response to the above operation, the electronic device 100 may scroll the application icons in the menu bar 113 upwards: hide the application icons above the menu bar (such as the favorites icon, the search icon, etc.), and display the icons of more candidate applications that are not currently displayed after the last candidate application icon. Similarly, the electronic device 100 may detect that the user drags the control 111 to a position above the first candidate application icon currently displayed. In response to the above operation, the electronic device 100 may scroll the application icons in the menu bar 113 downwards: hide the application icons below the menu bar, and display the icons of more candidate applications before the first candidate application icon currently displayed.
[0084] After detecting that the control 111 is dragged to the note icon, the electronic device 100 can highlight the note icon, for example, by increasing its size, changing its color, etc., to prompt the user that the note application is currently selected as the target application to avoid erroneous transmission.
[0085] The process of sending the data to be transferred from one application to another different application can be called smart transfer. After the transfer is completed, for example, after writing to the note application, the electronic device 100 can close the menu bar 113 of the smart transfer service, see Figure 1I.
[0086] Optionally, the electronic device 100 may further display a prompt window 114. The prompt window 114 may prompt the user that the transfer is successful, that is, the data to be transferred selected by the user has been successfully written to the target application. As shown in FIG1I , the prompt window 114 may further include a control 116: “Go to Notes to View”. When a user operation acting on the control 116 is detected, such as a click operation, the electronic device 100 may open the note application and display the user interface of the note application. At this time, the note application may include a screenshot corresponding to the control 111 written through the above-mentioned smart transfer.
[0087] In the method shown in Figures 1A to 1I, a reading interface shown in Figure 1A can be referred to as a first interface, control 111 can be referred to as a first control, and the screenshot image corresponding to control 111 can be referred to as a screenshot image of the first interface, that is, the first data. Among them, the right side hot zone and the left side hot zone to be introduced later (collectively referred to as the smart flow hot zone) can be referred to as the first area. The note application selected by the user shown in Figure 1H can be referred to as the first application, that is, the target application. The display area corresponding to the icon of the first application or the preset receiving area larger than the display area can be referred to as the second area. Any of the other multiple applications remaining in the menu bar can be the second application.
[0088] In some embodiments, after writing the data to be transmitted to the target application, the electronic device 100 may also immediately display a floating window of the target application so that the user can use the received data in the target application.
[0089] Referring to Figures 1J-1K , after detecting a user action of dragging control 111 to the messaging icon and releasing it, electronic device 100 may confirm that the messaging app is the target app and then display a floating window 115. Floating window 115 may display one or more contact options. The user may select any one of these one or more contact options as the target contact. After confirming the target contact, for example, after confirming the target contact "Henry," electronic device 100 may send the screenshot corresponding to control 111 to the selected target contact via the messaging app.
[0090] For example, when the target application is a shopping application, one or more product options may be displayed in the floating window 115. When the target application is a printing application, one or more print options may be displayed in the floating window 115 to set print parameters.
[0091] In the methods shown in Figures 1A-1G and 1J-1K, the information application selected by the user shown in Figure 1J may be referred to as the first application, ie, the target application. The floating window 115 shown in Figure 1K may be referred to as the first window.
[0092] After triggering Smart Flow and displaying a menu bar including one or more candidate application icons, the electronic device 100 may also detect a user operation to cancel Smart Flow. In one embodiment, the operation to cancel Smart Flow can be set to an operation of dragging the operation control to the other side opposite the menu bar. For example, referring to Figures 1G and 1L, after triggering Smart Flow and displaying menu bar 113, the electronic device 100 may detect a user operation of dragging control 111 to the left side of the screen. Then, referring to Figure 1M, the electronic device 100 may close Smart Flow.
[0093] At any time before determining the target application, after detecting that the user stops dragging and releases the control 111, the electronic device 100 can redisplay the control 111 in the default screenshot display area. For example, after detecting that the user drags the control 111 to the position shown in FIG1D (the smart flow has not yet been triggered) and stops dragging and releases the control 111, the electronic device 100 can redisplay the control 111 in the lower left corner of the screen, with reference to FIG1B . For another example, after detecting that the user drags the control 111 to the position shown in FIG1G (triggering the smart flow) and stops dragging and releases the control 111, the electronic device 100 can turn off the smart flow and redisplay the control 111 in the lower left corner of the screen, with reference to FIG1B .
[0094] After returning to the default screenshot display area, the electronic device 100 can restart the timer of the default screenshot display area. Before the timer expires, the electronic device 100 can display the control 111 in the default screenshot display area. After the timer expires, the electronic device 100 can stop displaying the control 111.
[0095] 2A-2F are another set of user interfaces for implementing cross-application data transmission provided by an embodiment of the present application.
[0096] 2A , the electronic device 100 may detect a long press operation. In response to the above operation, the electronic device 100 may extract all the texts in the interface shown in FIG2A . The user may select the target text for cross-application data transmission from all the above texts as needed. Referring to FIG2B , for example, the user may select the text "Modernist design is..., or "machine art"". The above text selected by the user may be referred to as target text 211. Referring to FIG2C , the electronic device 100 may detect a long press operation on the target text 211. Referring to FIG2D , in response to the above operation, the electronic device 100 may display a suspended control 212. The above target text 211 is displayed in the control 212. In some embodiments, the point of contact between the user's finger and the screen corresponds to the midpoint of the upper edge of the control 212. In other embodiments, the point of contact between the user's finger and the screen corresponds to the midpoint of the control 212, the midpoint of the lower edge, the lower right corner, and so on. The embodiments of the present application are not limited to this.
[0097] After generating control 212, the user can drag control 212 to any position on the screen. Referring to Figures 2E-2F, electronic device 100 can detect the user's operation of dragging control 212 into the right edge hot zone. In response to the above drag operation, electronic device 100 can trigger smart flow and display menu bar 113 including one or more application icons. Electronic device 100 can detect the user's operation of continuing to drag control 212 to the information icon and releasing it. In response to the above operation, electronic device 100 can send the target text 211 corresponding to control 212 to the information application.
[0098] Further, referring to FIG. 1K , the electronic device 100 may detect a target contact selected by the user, and then send the target text 211 corresponding to the control 212 to the target contact.
[0099] In this way, based on the smart flow service, users can more conveniently extract text from one application and send it to another application, and further perform operations such as forwarding, sharing, and editing.
[0100] 2A-2F, the interface shown in FIG2A may be referred to as the first interface, the control 212 may be referred to as the first control, the target text 211 may be referred to as the first data, and the information application selected by the user shown in FIG2F may be referred to as the first application.
[0101] When displaying user interfaces provided by some applications, the electronic device 100 does not support the intelligent transfer of text directly extracted from the interface as shown in Figures 2A-2D due to application limitations. In this case, the electronic device 100 can support users in screenshot scenarios, edit the screenshot, extract the target text, and then perform intelligent transfer to achieve cross-application transmission of text content.
[0102] 3A-3G are a set of user interfaces for implementing cross-application data transmission based on image editing, provided in an embodiment of the present application.
[0103] When electronic device 100 does not support direct extraction of text from the interface, the user can perform a screenshot operation. In response to the screenshot operation, electronic device 100 obtains a screenshot. At the same time, referring to FIG3A , electronic device 100 may display control 111. Control 111 corresponds to the screenshot. Subsequently, electronic device 100 may detect a user operation on control 111, such as a click operation. In response to the operation, electronic device 100 may display the editing interface shown in FIG3B .
[0104] The editing interface displays the image to be edited 310 in the center, which is the screenshot obtained by the screenshot operation described above. The editing interface also includes multiple editing controls, such as a shape capture control in toolbar 312 and a pen shape control, color control, and thickness control in toolbar 313. The editing interface also includes control 311, which can be used to recognize and extract text from the image to be edited.
[0105] Electronic device 100 can detect a user operation on control 311, such as a click. In response to this operation, electronic device 100 can recognize text in image 310 to be edited and then provide the user with a function to select target text. Referring to the user interface shown in FIG3C , the user can select target text 314 from the text recognized by electronic device 100.
[0106] 3D-3E , electronic device 100 may detect a long press operation on target text 314. In response to this operation, electronic device 100 may display a floating control 315. Control 315 corresponds to target text 314 selected by the user. The user can drag control 315 to any position on the screen.
[0107] 3F-3G , the electronic device 100 can detect the user operation of dragging the control 315 into the right side hot zone. In response to the above operation, the electronic device 100 can trigger the smart flow and display a menu bar 113 including one or more application icons. Taking the information application as an example, the electronic device 100 can detect the user's operation of continuing to drag the control 315 into the information icon and releasing it. In response to the above operation, the electronic device 100 can send the target text 314 corresponding to the control 315 to the message application selected by the user. Further, referring to Figure 1K , the electronic device 100 can display a floating window of the target application, and provide the user with a more convenient method of editing and using the target text 314 in the target application through the floating window, which will not be repeated here.
[0108] In this way, in the scenario where direct extraction of text in the interface is restricted for intelligent flow, the electronic device 100 can provide users with fast text recognition and extraction functions through the above method, and then provide users with convenient services for transmitting target text across applications through intelligent flow.
[0109] In the methods described in Figures 1A-1B and Figures 3A-3G, the screenshot image obtained by taking a screenshot of the interface shown in Figure 1A based on the screenshot operation can be called the first screenshot image, the control 111 corresponding to the first screenshot image can be called the second control, the interface shown in Figure 3B can be called the image editing interface, the control 311 can be called the third control, the control 315 can be called the first control, and the target text 314 corresponding to the control 315 can be called the first data.
[0110] In some embodiments, after obtaining a screenshot, electronic device 100 may also edit the screenshot and determine the edited image as data to be transmitted. Such editing operations include, but are not limited to, handwriting marking, mosaicing, adding text / stickers, cropping, and so on. Then, through Smart Flow, electronic device 100 can send the edited image to other applications.
[0111] 4A-4F are another set of user interfaces for implementing cross-application data transmission based on image editing, provided by an embodiment of the present application.
[0112] Based on the user interface shown in Figure 1B, after detecting a user operation acting on the control 111, the electronic device 100 may display the editing interface shown in Figure 4A for editing the screenshot corresponding to the control 111. The electronic device 100 may detect a user operation acting on one or more editing controls in the toolbar 312 and / or toolbar 313. In response to the above operation, the electronic device 100 may modify the image to be edited 410 (i.e., the screenshot) according to the image processing method corresponding to the editing control, and then obtain the edited image. For example, with reference to Figure 4B, the electronic device 100 may detect a user operation of marking the text "machine art" with handwriting. Then, after performing the above editing operation, the electronic device 100 may display the edited image 411. The electronic device 100 may also detect multiple editing operations, and the edited image will change according to the one or more editing operations performed, which will not be repeated here.
[0113] After one or more editing operations are completed, referring to FIG4C , the electronic device 100 may detect a long press operation on the edited image 411. In response to the above operation, the electronic device 100 may display a suspended control 412. The control 412 corresponds to the above edited image 411. After recognizing that the user's contact time on the screen reaches a preset duration, the electronic device 100 may determine that a long press operation has been detected. At the same time, the electronic device 100 will limit the recognition of the above long press operation as a picture editing operation. Optionally, in order to highlight the suspended control 412, the electronic device 100 may perform grayscale blurring on the original editing interface.
[0114] Referring to Figures 4D-4F , electronic device 100 may detect a user action of dragging control 412 into the right edge hot zone. In response to this action, electronic device 100 may trigger Smart Flow, displaying menu bar 113 including one or more application icons. Taking the note-taking app as an example, electronic device 100 may detect a user action of continuing to drag control 412 onto the note icon and then releasing it. In response to this action, electronic device 100 may send the edited image 411 corresponding to control 412 to the user-selected note-taking app.
[0115] In the method shown in Figures 1A-1B and Figures 4A-4F, the screenshot image obtained by taking a screenshot of the interface shown in Figure 1A based on the screenshot operation can be called a first screenshot image, the control 111 corresponding to the first screenshot image can be called a second control, the interface shown in Figure 4A can be called an image editing interface, the edited image 411 can be called a second screenshot image, and the control 412 can be called a first control.
[0116] In the editing interface, the electronic device 100 can also detect a partial screenshot operation. After detecting the partial screenshot operation, the electronic device 100 can use the partial screenshot obtained by the partial screenshot operation, or the text extracted based on the partial screenshot, or the image edited based on the partial screenshot as the data to be transmitted for intelligent circulation.
[0117] Figures 5A-5I are a set of user interfaces for transmitting partial screenshot images across applications provided by an embodiment of the present application.
[0118] The electronic device 100 can detect a partial screenshot operation, such as a screenshot operation in which a finger is used to circle a local area. The electronic device 100 can determine a target screenshot area based on the partial screenshot operation. Referring to FIG5A , area 511 can be the target screenshot area determined by the electronic device 100 based on the partial screenshot operation. The content displayed in the target screenshot area is the partial screenshot.
[0119] 5B-5C , after determining the partial screenshot, the electronic device 100 may detect a long press operation on the target screenshot area. In response to the above operation, the electronic device 100 may display the control 512. The control 512 corresponds to the above partial screenshot. The user can drag the control 512 to any position on the screen. Referring to FIG5C-5D , the electronic device 100 may detect the operation of the user dragging the control 512 into the right side hot zone. In response to the above operation, the electronic device 100 may trigger the smart flow service and display the menu bar 113 of the smart flow. Then, taking the note application as an example, the electronic device 100 may detect the user operation of continuing to drag the control 512 to the note icon and releasing it. In response to the above operation, the electronic device 100 may send the partial screenshot corresponding to the control 512 to the note application selected by the user.
[0120] It can be understood that, in addition to the editing interface, in the user interface shown in FIG1A or other user interfaces, the electronic device 100 can also detect a partial screenshot operation and determine a partial screenshot based on the partial screenshot operation.
[0121] Referring to Figure 5E, the electronic device 100 may detect a screenshot operation in which a local area is circled with a knuckle during the process of displaying the user interface shown in Figure 1A. Among them, track 514 is the sliding track of the knuckle screenshot. Subsequently, the electronic device 100 may display the editing interface shown in Figure 5F. Area 515 may indicate that the electronic device 100 can determine the target screenshot area based on the local screenshot operation. Similarly, referring to Figures 5G to 5H, after determining area 515, the electronic device 100 may detect a long press operation acting on area 515, and in response to the above operation the electronic device may display control 516. Then, referring to Figure 5I, the electronic device 100 may detect an operation in which the user drags the control 516 into the right side hot zone and drags it to the note icon and releases it. In response to the above operation, the electronic device 100 may send the local screenshot corresponding to the control 516 to the note application selected by the user.
[0122] In the partial screenshot method shown in Figures 5A-5I , control 512 may be referred to as the first control, and the irregular screenshot generated by the partial screenshot operation corresponding to control 512 may be referred to as the first data. In the partial screenshot method shown in Figures 5E-5I , control 516 may be referred to as the first control, and the irregular screenshot generated by the partial screenshot operation corresponding to control 516 may be referred to as the first data.
[0123] In some embodiments, the user may also obtain a partial screenshot through a partial screenshot operation, and then perform text extraction on the partial screenshot to obtain the target text, and then perform intelligent flow on the target text.
[0124] 6A-6B , after determining the target screenshot area 511 and obtaining the partial screenshot corresponding to the area 511, the electronic device 100 may detect a user operation acting on the control 311. In response to the above operation, the electronic device 100 may recognize and extract the text in the area 511. At this time, the text obtained by recognizing the image content in the area 511 may be referred to as the target text. Then, the electronic device 100 may detect a long press operation acting on the area 511. Referring to FIG6C , in response to the above operation, the electronic device 100 may display a suspended control 513. The target text obtained based on the partial screenshot may be displayed in the control 513.
[0125] 6D , the electronic device 100 may detect that the user has dragged the control 513 into the right hot zone. In response to this operation, the electronic device 100 may trigger a smart flow and send the target text corresponding to the control 513 to the target application selected by the user. Detailed description is omitted here.
[0126] 7A-7C are another set of user interfaces for implementing cross-application data transmission provided by an embodiment of the present application.
[0127] As shown in Figure 7A , after obtaining a global screenshot and displaying control 111, electronic device 100 may detect a swipe-up operation on control 111. In response to the swipe-up operation, electronic device 100 displays the user interface shown in Figure 7B . As shown in Figure 7B , electronic device 100 may display control 711 above control 111 to instruct the user to trigger sharing. The screen area corresponding to control 711 may be referred to as a swipe-up sharing hotspot.
[0128] Electronic device 100 may detect that the user has swiped up, stopped the swipe-up sharing hotspot, and then released the swipe. In response, electronic device 100 may display the user interface shown in FIG7C . As shown in FIG7C , electronic device 100 may display window 712 at the bottom of the screen. Window 712 may include one or more application icons. After detecting that the user has selected a target application, electronic device 100 may send the global screenshot corresponding to control 111 to the target application selected by the user.
[0129] In some embodiments, the electronic device 100 also supports scrolling screenshots to obtain long screenshots. In this case, the electronic device 100 can also support the use of smart flow to provide users with the function of transmitting long screenshots across applications.
[0130] Referring to Figure 8A , after obtaining a global screenshot and displaying control 111, electronic device 100 may detect a swipe down action on control 111. In response to this swipe down action, electronic device 100 displays the user interface shown in Figure 8B . As shown in Figure 8B , electronic device 100 may display control 811 above control 111 to instruct the user to trigger a scrolling screenshot. The screen area corresponding to control 811 may be referred to as a scrolling screenshot hotspot.
[0131] The electronic device 100 can detect the operation of the user sliding down to stop in the scrolling screenshot hot zone and raising the hand to release. In response to the above operation, the electronic device 100 generates a long screenshot of the current interface. Referring to Figure 8C, the electronic device 100 can display control 812. Control 812 is used to indicate that a long screenshot has been generated and provide a long screenshot preview function. Referring to the method shown in Figures 1C to 1K, the electronic device 100 can detect the operation of the user dragging the control 812 into the right side hot zone, and then, in response to the above operation, trigger the smart flow function to display the icon of the candidate application that can receive the long screenshot corresponding to the control 812. After detecting that the user continues to drag the control 812 to the area where any candidate application icon is located and releases it, the electronic device 100 can send the long screenshot corresponding to the control 812 to the application corresponding to the candidate application icon to realize cross-application data transmission.
[0132] In some embodiments, the electronic device 100 may set a maximum size. When the size of a long screenshot does not exceed the maximum size, the electronic device 100 may perform intelligent streaming of the long screenshot. Conversely, when the size of a long screenshot exceeds the maximum size, the electronic device 100 may prompt the user to crop it, and then perform intelligent streaming of the cropped long screenshot that meets the size limit.
[0133] 8C , electronic device 100 may detect a click operation on control 812. In response to the click operation, electronic device 100 may display the user interface shown in FIG8D . At this point, image to be edited 818 is a long screenshot corresponding to control 812, i.e., a long screenshot obtained by scrolling the screenshot.
[0134] In a scenario where the size of the long screenshot corresponding to control 812 does not exceed the maximum size, referring to the methods shown in Figures 3A-3G, 4A-4F, 5A-5I, and 6A-6D, the electronic device 100 can also extract target text from the long screenshot, or obtain a partial screenshot, or perform editing operations such as note marking on the long screenshot to obtain an edited image, and then use it as data to be transmitted, and after triggering the smart flow, send the above data to be transmitted to the target application selected by the user.
[0135] In a specific implementation, the size of the screen is a*b, and the maximum size is a*3b. Wherein, a is the width of the screen, and b is the length of the screen. When the size of the long screenshot exceeds the maximum size, the electronic device 100 may display window 813. Window 813 may prompt the user that the size of the long screenshot exceeds the maximum size and cannot be intelligently transferred. At this time, the electronic device 100 may support the extraction of target text from the long screenshot for intelligent transfer according to the method shown in Figures 3A-3G or Figures 6A-6D, or obtain a partial screenshot that does not exceed the maximum size for intelligent transfer according to the method shown in Figures 5A-5I, but does not support intelligent transfer of long screenshots that exceed the maximum size.
[0136] In another specific implementation, referring to FIG8E , the electronic device 100 may display a window 814. Window 814 may not only prompt the user that the size of the long screenshot exceeds the maximum size and cannot be transferred intelligently, but may also prompt the user to crop the long screenshot so that the cropped long screenshot meets the conditions for intelligent transfer.
[0137] Electronic device 100 marks image 818 to be edited based on its maximum size. As shown in FIG8E , the size corresponding to area 815 corresponds to the maximum size supported by Smart Flow, while gray area 816 represents the area of image 818 to be edited that exceeds the maximum size. It is understood that electronic device 100 can allow the user to adjust the position of area 815 within image 818 to obtain a longer screenshot that better meets the user's needs.
[0138] Electronic device 100 may detect a user double-clicking the screen. In response to this operation, electronic device 100 may crop image 818 to be edited according to region 815 and then display the cropped image. For example, electronic device 100 may display the user interface shown in FIG8F . In this case, the cropped image 817 meeting the maximum size restriction may be displayed in the interface.
[0139] Then, the electronic device 100 can support the extraction of target text from the cropped image 817 for intelligent circulation according to the method shown in Figures 3A-3G or Figures 6A-6D, or obtain a partial screenshot for intelligent circulation according to the method shown in Figures 5A-5I, and also support the intelligent circulation of the cropped image 817 that meets the maximum size restriction conditions according to the method shown in Figures 4A-4F.
[0140] In the long screenshot method shown in FIG. 8A to FIG. 8F , the control 812 may be referred to as a second control, and the image 817 may be referred to as a second screenshot image.
[0141] In some embodiments, the electronic device 100 may also set a left-side hot zone. After detecting that the operating controls such as controls 111 and controls 212 enter the left-side hot zone, the electronic device 100 may also trigger smart flow, display one or more candidate application icons that can receive the corresponding data to be transmitted, and send the above-mentioned data to be transmitted to the target application selected by the user. At this time, the menu bar 113 shown in Figure 1G can be displayed on the left side of the screen accordingly, and the electronic device 100 can adjust the original user interface to a left perspective style. Not limited to the right-side hot zone and the left-side hot zone, the electronic device 100 may also set other hot zones for detecting and determining whether to trigger smart flow, and this embodiment of the present application is not limited to this. Hot zones such as the right-side hot zone and the left-side hot zone are set to trigger smart flow, also known as smart flow hot zones.
[0142] FIG9A is a schematic diagram of hot zones for triggering intelligent flow of the electronic device 100 provided in an embodiment of the present application.
[0143] A specific touch area preset in the screen is called a hot zone. Referring to the above introduction, the electronic device 100 can set one or more hot zones for triggering the intelligent flow, such as the right side hot zone and the left side hot zone. As shown in Figure 9A, the right side hot zone is a rectangular touch area extending from the right side of the screen to the left. Correspondingly, the left side hot zone is a rectangular touch area extending from the left side of the screen to the right. Exemplarily, the width of the screen is x, and the extended length can be 1 / 6 of the width of the screen, that is, 1 / 6x.
[0144] During the drag operation, when the user's finger and the touch point of the screen enter the right side hot zone or the left side hot zone (smart flow hot zone), the electronic device 100 can trigger the smart flow.
[0145] FIG9B is a schematic diagram of hot zones for shutting down smart flow of the electronic device 100 provided in an embodiment of the present application.
[0146] The left-side closing hot zone shown in FIG9B (a) may represent the hot zone for closing the smart flow of the electronic device 100 in the scenario where the smart flow is triggered by the right-side hot zone. For example, the width of the left-side closing hot zone may be 1 / 2 of the screen width. In conjunction with the user interface shown in FIG1L-FIG1M, after triggering the smart flow, when it is detected that the user drags the operation control into the other side closing hot zone, the electronic device 100 may close the menu bar corresponding to the smart flow, close the smart flow, and restore the display of the original application interface.
[0147] The right-side hot zone shown in FIG9B (b) may indicate that the electronic device 100 turns off the hot zone for smart flow when the smart flow is triggered by the left-side hot zone. Similarly, the width of the right-side hot zone may be 1 / 2 of the screen width, which will not be further described here.
[0148] It is understandable that when using smart flow for the first time, the electronic device 100 may display usage instructions to instruct the user how to control the electronic device 100 to perform smart flow.
[0149] 10A-10C are a set of user interfaces showing usage instructions provided in an embodiment of the present application.
[0150] As shown in Figure 10A, after obtaining the screenshot for the first time and displaying the corresponding operation control, the electronic device 100 may display an upward sliding arrow and a prompt "Swipe up to share", indicating that the user controls the operation control to perform an upward sliding operation to trigger sharing. Then, the electronic device 100 may display the user interface shown in Figure 10B. The electronic device 100 may display a downward sliding arrow and a prompt "Swipe down to scroll the screenshot", indicating that the user controls the operation control to perform a downward sliding operation to trigger a scrolling screenshot, thereby obtaining a long screenshot. Then, the electronic device 100 may display the user interface shown in Figure 10C. The electronic device 100 may display left and / or right sliding arrows, as well as a prompt "Press and hold the thumbnail and drag to the left / right edge of the screen to turn on smart flow", indicating that the user controls the operation control to perform a left or right sliding operation to trigger smart flow.
[0151] 11A-11D are another set of user interfaces for implementing cross-application data transmission provided by an embodiment of the present application.
[0152] FIG11A is another user interface provided by an embodiment of the present application, such as an interface for playing a video. The user can enable the screen recording function during the video playback process. Based on the screen recording operation, the electronic device 100 can generate a corresponding video file.
[0153] 11B , the electronic device 100 may display a control 911 in the lower left corner of the screen. The control 911 corresponds to the video file obtained by the screen recording operation, and may be used to prompt the user that a screen recording video has been generated.
[0154] After detecting a long press operation on the control 911, the electronic device 100 can float the control 911, that is, set the control 911 to a draggable suspended state. The electronic device 100 can change the display position of the control 911 on the screen according to the user's drag operation. Referring to Figures 11B to 11D, after detecting that the user drags the control 911 into the right side hot zone, the electronic device 100 can trigger the smart flow and display the icons of candidate applications that can receive the video files corresponding to the control 911. Then, as shown in Figure 11D, after detecting that the user continues to drag the control 911 to the favorite icon and releases it, the electronic device 100 can send the video file corresponding to the control 911 to the favorite application selected by the user, thereby realizing cross-application video data transmission.
[0155] In this way, after recording the screen, the user can use the above method to quickly and conveniently send the recorded video to other applications for subsequent sharing, editing, and other operations, thereby improving the user experience. Similarly, in the screen recording scenario, the electronic device 100 can trigger the sharing shown in Figures 7A-7C after detecting an upward sliding operation on the control 911, which will not be repeated here.
[0156] In the method shown in Figures 11A to 11D, the control 911 can be called the first control, and the screen recording video corresponding to the control 911 can be called the first video, also known as the first data.
[0157] FIG12 is a flowchart of cross-application data transmission provided by an embodiment of the present application.
[0158] S101. The electronic device 100 displays a first interface.
[0159] S102: The electronic device 100 determines data to be transmitted according to a detected preset user operation.
[0160] S103: The electronic device 100 displays an operation control corresponding to the data to be transmitted.
[0161] S104: The electronic device 100 detects a user operation of dragging an operation control into a preset hot zone.
[0162] S105. Trigger the smart flow, and the electronic device 100 displays one or more application icons.
[0163] S106: The electronic device 100 detects a user operation of continuing to drag the operation control into any application icon area and releasing it.
[0164] S107. The electronic device 100 sends the data to be transmitted corresponding to the operation control to the application corresponding to the application icon.
[0165] The first interface is any user interface provided by the electronic device 100. For example, a reading interface shown in FIG1A may be referred to as a first interface. A video playback interface shown in FIG11A may be referred to as a first interface. In some embodiments, the first interface may also be a user interface such as the homepage, negative one screen, or lock screen of the electronic device 100.
[0166] While displaying the first interface, the electronic device 100 may detect a predetermined specific user operation. Based on the user operation, the electronic device 100 may determine data to be transferred that may be used for smart transfer. Simultaneously, the electronic device 100 may display operation controls corresponding to the data to be transferred on the screen, allowing the electronic device 100 to detect whether the user intends to perform smart transfer through the operation controls.
[0167] The electronic device 100 can set a specific touch area on the screen as a hotspot for triggering Smart Flow, such as the right and left hotspots described above. The electronic device 100 can detect the current location of the drag operation in real time and, based on the preset hotspots, determine whether the user's dragged control enters the hotspot, thereby determining whether the user intends to initiate Smart Flow.
[0168] When the electronic device 100 detects that the user has dragged the above-mentioned operation control into a preset hot zone, it can determine whether the user intends to perform smart transfer, and then the electronic device 100 can trigger the smart transfer. The electronic device 100 can determine that the text, image, video, document, hyperlink, and other data corresponding to the operation control is the data to be transferred. Furthermore, the electronic device 100 can determine the application that can receive the above-mentioned data to be transferred, that is, the candidate application. The electronic device 100 can then display the application icons of the above-mentioned candidate applications for the user to select the target application to receive the above-mentioned data to be transferred.
[0169] After displaying the candidate application icons, the user can continue to drag the operation control to an application icon and release it to determine the target application to receive the data to be transferred. After detecting the above operation, the electronic device 100 can send the above transmission data to the above target application, thereby realizing cross-application data transmission.
[0170] In the embodiment shown in Figures 1A-1K , after displaying the user interface shown in Figure 1A , electronic device 100 may detect a screenshot operation. This screenshot operation may be referred to as a preset specific user operation. In response to this screenshot operation, electronic device 100 may obtain a screenshot based on the first interface shown in Figure 1A . This screenshot may be referred to as data to be transmitted. After determining the data to be transmitted, electronic device 100 may generate and display an operation control corresponding to the data to be transmitted, such as control 111. The user may drag control 111 to any location on the screen. Referring to Figures 1B-1G , electronic device 100 may detect that the user has dragged control 111 into the right-hand hot zone, whereupon electronic device 100 may display menu bar 113 containing multiple candidate application icons. The user may continue to drag control 111 to any application icon in menu bar 113 and release it. Referring to Figure 1H , electronic device 100 may detect that the user has continued to drag control 111 into the note application icon and released it. In response, electronic device 100 may send the screenshot corresponding to control 111 to the note application.
[0171] In the above embodiment, the screenshot operation detected by the electronic device 100 may be referred to as a global screenshot operation. The size of the screenshot generated by the global screenshot operation is the same as the size of the screen of the electronic device 100. In some embodiments, the preset specific user operation may also be a partial screenshot operation or a scrolling screenshot operation. Accordingly, the data to be transmitted may be a screenshot obtained by the partial screenshot operation or the scrolling screenshot operation.
[0172] For example, in the embodiment shown in Figures 5A-5I , the electronic device 100 may detect a partial screenshot operation, such as a screenshot operation in which a finger is used to circle a local area. The electronic device 100 may generate a partial screenshot based on the partial screenshot operation. In this case, the partial screenshot represents the data to be transmitted. After determining the data to be transmitted, the electronic device 100 may generate and display an operation control corresponding to the data to be transmitted, such as control 512. The user may drag control 512 to any location on the screen. In Figures 5B-5D , the electronic device 100 may detect the user dragging control 512 into the right-hand hot zone. Subsequently, the electronic device 100 may trigger the smart transfer service and display a menu bar 113 containing multiple candidate application icons. The user may continue to drag control 512 to any application icon in the menu bar 113 and release it. Referring to Figure 5D , the electronic device 100 may detect the user continuing to drag control 512 to the note application icon and releasing it. In response, the electronic device 100 may send the partial screenshot corresponding to control 512 to the note application selected by the user.
[0173] In the embodiment shown in Figures 8A to 8F, the electronic device 100 can detect a scrolling screenshot operation. The electronic device 100 can obtain a long screenshot based on the above-mentioned scrolling screenshot operation. At this time, the above-mentioned long screenshot is the data to be transmitted. After determining the data to be transmitted, the electronic device 100 can generate and display an operation control corresponding to the above-mentioned data to be transmitted, such as control 812. After detecting that the user drags the control 812 into the right side hot zone, the electronic device 100 can trigger the smart flow service and display multiple candidate application icons. Further, after detecting that the user continues to drag the control 812 to any application icon and releases the user operation, the electronic device 100 can send the long screenshot corresponding to the control 812 to the target application selected by the user.
[0174] In some embodiments, after obtaining a screenshot (including a full-screen screenshot, a partial screenshot, and a long screenshot), the electronic device 100 may also detect operations for editing the screenshot, such as highlighting, cropping, etc., as well as an operation for lifting the screenshot after editing is completed (i.e., an operation for displaying draggable operation controls). At this time, the preset specific user operation also includes the above-mentioned editing operation and lifting operation, and the data to be transmitted is the edited screenshot. Then, the electronic device 100 can trigger and execute smart transfer according to the aforementioned method of dragging to the preset hot zone, and send the edited screenshot to the target application.
[0175] For example, in the embodiment shown in FIG. 4A to FIG. 4F , the operation of long pressing the image 411 shown in FIG. 4C may be referred to as an operation of taking a screenshot after editing, and the edited screenshot shown in the image 411 is the data to be transmitted.
[0176] The preset specific user operation is not limited to screenshot operations. It can also be other operations, such as extracting text or hyperlinks, selecting documents, recording screens, etc. Correspondingly, the data to be transmitted is not limited to images. It can also be text, video, documents, hyperlinks, and other types of data.
[0177] For example, in the embodiment shown in Figures 2A to 2F, the electronic device 100 can detect a long press operation and obtain the text in the interface based on the long press operation. Then, the electronic device 100 can determine the target text, such as target text 211, based on the user's selection operation. The above operation of obtaining text in the interface and determining the target text can be referred to as a preset specific user operation (an operation to extract text). The selected target text can be referred to as data to be transmitted. After determining the above data to be transmitted, the electronic device 100 can generate and display an operation control corresponding to the above data to be transmitted, such as control 212. After detecting the operation of the user dragging the control 212 into the right side hot zone, the electronic device 100 can trigger the smart flow service and display multiple candidate application icons. Further, after detecting the user operation of continuing to drag the control 212 to any application icon and releasing it, the electronic device 100 can send the target text 211 corresponding to the control 212 to the target application selected by the user.
[0178] In the embodiment shown in Figures 3A to 3G, when the electronic device 100 cannot directly extract text from the currently displayed interface, the electronic device 100 may first obtain a screenshot including the currently displayed interface through a screenshot operation, and then extract the text in the screenshot through text recognition. Then, the electronic device 100 may determine the target text, such as target text 314, from the extracted text according to the user's selection operation. The target text determined by the above method may also be referred to as data to be transmitted. Then, the electronic device 100 may also display the corresponding operation control and detect the user's drag action. When the smart flow is triggered, the electronic device 100 sends the corresponding target text to the target application selected by the user.
[0179] Similarly, in the above method for obtaining text data to be transmitted based on screenshots, the screenshot for text recognition may also be a partial screenshot obtained by a partial screenshot operation, or a long screenshot obtained by a scrolling screenshot operation.
[0180] When the target text is a hyperlink information such as a Uniform Resource Locator (URL), the operation of copying the above hyperlink from the interface can be called an operation of extracting a hyperlink. Correspondingly, the electronic device 100 can display an operation control corresponding to the above hyperlink information for the user to perform a drag-and-drop operation, thereby transmitting data across applications. The specific flow process of the data to be transmitted of the hyperlink type can refer to the flow process of the data to be transmitted of the text type shown in Figures 2A-2F and Figures 3A-3G, which will not be repeated here.
[0181] In the embodiment shown in Figures 11A to 11D, the electronic device 100 can also detect a screen recording operation. At this time, the screen recording operation is a preset specific user operation, and the video file obtained based on the screen recording operation can be called data to be transmitted. The electronic device 100 can generate and display operation controls corresponding to the above-mentioned video file, such as control 911. Similarly, after detecting the operation of the user dragging the control 911 into the right side hot zone, the electronic device 100 can trigger the smart flow service and display multiple candidate application icons. Further, after detecting the user operation of continuing to drag the control 911 to any application icon and releasing it, the electronic device 100 can send the target text 211 corresponding to the control 911 to the target application selected by the user.
[0182] In summary, through the cross-application data transmission method provided by this application, users can mark the corresponding pictures, text, videos, documents, and other data as data to be transmitted after performing a preset specific user operation such as taking a screenshot, extracting text or hyperlinks, selecting a document, or recording a screen. After detecting a preset drag operation, the electronic device 100 can send the above-mentioned data to be transmitted to the target application corresponding to the drag operation, providing users with a smoother and more convenient cross-application data transmission experience.
[0183] As previously described, after triggering smart transfer and before displaying one or more candidate application icons, electronic device 100 may determine candidate applications that can receive the data to be transmitted based on the data type and semantic information of the data to be transmitted. The following describes in detail the strategy by which electronic device 100 may determine candidate applications based on the data type and semantic information of the data to be transmitted.
[0184] Table 1 is a table of matching relationships between data types to be transmitted and candidate applications provided by an embodiment of the present application. After triggering smart transfer, the electronic device 100 can first determine the candidate applications that can receive the current data to be transmitted based on the matching relationships described in Table 1.
[0185] Table 1
[0186] First, candidate applications include both global applications and personalized applications. Global applications can receive any type of data to be transmitted, while personalized applications are only used to receive data of a specific type and with specific semantic information. In other words, when any type of data to be transmitted triggers intelligent flow, the corresponding candidate applications include all global applications and personalized applications that match the type and semantic information of the data to be transmitted.
[0187] As shown in Table 1, when the data to be transmitted, that is, the data corresponding to the operation control (such as the control 111 shown in Figures 1A-1K and the control 212 shown in Figures 2A-2F) is text, and the text includes address information, the candidate applications displayed in the menu bar 113 of the smart flow include all global applications: favorite applications, search applications, sharing applications, note applications, instant messaging applications, email applications, and matching personalized applications: navigation applications, taxi applications.
[0188] When the data to be transmitted is text, and the text includes film / performance information (such as "***concert", "***concert", "movie***"), the candidate applications displayed in the menu bar 113 of the smart flow include all global applications and matching personalized applications: ticket purchase applications. When the text includes product name / shopping password information (such as "**speaker", "**skirt"), the matching personalized applications include shopping applications. When the text includes food names (such as "barbecue", "hot pot"), the matching personalized applications include: catering applications, takeaway applications. When the text includes schedule information (such as "2023.01.01 9:30 morning meeting"), the matching personalized applications include: calendar applications.
[0189] When the data to be transmitted is an image, the personalized applications default to image editing applications. Furthermore, through image recognition, if the image to be transmitted contains address information, the personalized applications may also include navigation applications and taxi-hailing applications. If the image to be transmitted contains movie / performance information, the personalized applications may also include ticket purchasing applications. If the image to be transmitted contains product names / purchase passwords, the personalized applications may also include shopping applications. If the image to be transmitted contains food names, the personalized applications may also include restaurant applications and food delivery applications.
[0190] In particular, the screenshot image may also carry an application identity identifier, namely an application ID. When matching personalized applications, the electronic device 100 may also determine the corresponding application based on the above application ID, and determine the above application as a candidate application, so that the user can quickly enter the application corresponding to the screenshot image. For example, after receiving a screenshot image carrying an application ID from a contact, the electronic device 100 may determine that the candidate applications include the application corresponding to the above application ID, such as a short video application. In this way, the user can quickly enter the above application and quickly browse the video corresponding to the above screenshot image.
[0191] When the data to be transmitted is a video, personalized applications may include video editing applications and short video social networking applications. When the data to be transmitted is a document, personalized applications may include note-taking applications, printer applications, and calendar applications. When the data to be transmitted is a hyperlink, personalized applications may include browser applications.
[0192] Not limited to the matching strategies listed in Table 1, the electronic device 100 can also obtain more information from the content to be transmitted to determine candidate applications that can receive the content to be transmitted and have implementation scenarios, which will not be repeated here.
[0193] FIG13 is a schematic structural diagram of an electronic device 100 provided in an embodiment of the present application.
[0194] As shown in Figure 13, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0195] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0196] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0197] The controller can generate an operation control signal based on the instruction operation code and the timing signal to complete the control of instruction fetching and execution. The processor 110 can also be provided with a memory for storing instructions and data.
[0198] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0199] The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor. In an embodiment of the present application, the electronic device 100 can implement the methods shown in Figures 1A-1M, Figures 2A-2F, Figures 3A-3G, Figures 4A-4F, Figures 5A-5I, Figures 6A-6D, Figures 7A-7C, Figures 8A-8F, Figures 10A-10C, and Figures 11A-11D through a GPU, a display screen 194, and an application processor.
[0200] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
[0201] The NPU is a neural network (NN) computing processor. In the embodiment of the present application, the electronic device 100 can use the NPU to recognize and extract text from the screenshot, thereby providing the user with a convenient function to obtain text when the third-party application does not support copying text.
[0202] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM). The program code corresponding to the cross-application data transmission method provided in the embodiment of the present application may be stored in the NVM. When executing the above method, the electronic device 100 may load the program code stored in the non-volatile storage into the random access memory, and then read and execute it through the processor.
[0203] The external memory interface 120 can be used to connect to an external NVM to expand the storage capacity of the electronic device 100 .
[0204] The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0205] The pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor 180A can be set on the display screen 194. The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. The air pressure sensor 180C is used to measure air pressure. The magnetic sensor 180D can be used to detect the magnetic state, such as the opening and closing of a flip cover or a flip leather case. The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). The distance sensor 180F is used to measure the distance. The proximity light sensor 180G can detect that there are no objects near the electronic device 100. The ambient light sensor 180L is used to sense the brightness of the ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The fingerprint sensor 180H is used to collect fingerprints. The temperature sensor 180J is used to detect the temperature.
[0206] The touch sensor 180K is also called a "touch device". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In an embodiment of the present application, the electronic device 100 can detect touch operations such as user clicking the screen, long pressing, double-clicking, and dragging on the screen through the touch sensor 180K.
[0207] The bone conduction sensor 180M can obtain vibration signals. The buttons 190 include a power button, a volume button, etc. The electronic device 100 can receive key inputs and generate key signal inputs related to user settings and function controls of the electronic device 100.
[0208] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts or touch vibration feedback. For example, in an embodiment of the present application, when a floating operation control is displayed in response to a long press operation, the electronic device 100 can generate vibrations through motor 191 to provide stronger feedback to the user that the long press operation has been detected. Indicator 192 can be an indicator light. SIM card interface 195 is used to connect a SIM card.
[0209] The term "user interface (UI)" in the specification, claims and drawings of this application refers to the media interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface of an application is a source code written in a specific computer language such as Java and Extensible Markup Language (XML). The interface source code is parsed and rendered on the terminal device, and finally presented as content that the user can recognize, such as pictures, text, buttons and other controls. Controls, also known as widgets, are the basic elements of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, pictures and text. The properties and contents of controls in the interface are defined by tags or nodes, such as XML through <textview> 、 <imgview> 、 <videoview>The controls contained in the interface are specified by nodes such as <head> and <body>. A node corresponds to a control or attribute in the interface, and the node is presented as user-visible content after parsing and rendering. In addition, many applications, such as hybrid applications, usually also contain web pages in their interfaces. A web page, also known as a page, can be understood as a special control embedded in the application interface. A web page is a source code written in a specific computer language, such as hypertext markup language (HTML), cascading style sheets (CSS), JavaScript (JS), etc. The web page source code can be loaded and displayed as user-recognizable content by a browser or a web page display component with similar functions to a browser. The specific content contained in a web page is also defined by tags or nodes in the web page source code, such as HTML through <body>. 、 、 <video> 、 <canvas>To define the elements and attributes of a web page.
[0210] A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operations that uses graphics. It can be an icon, window, control, or other interface element displayed on the display of an electronic device. Controls can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements.
[0211] As used in the specification and appended claims of the present application, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to include plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more listed items. As used in the above embodiments, the term "when..." can be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...". Similarly, the phrase "when determining..." or "if (stated condition or event) is detected" can be interpreted to mean "if determining..." or "in response to determining..." or "when (stated condition or event) is detected" or "in response to detecting (stated condition or event)", depending on the context.
[0212] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk).
[0213] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.< / canvas> < / video> < / videoview> < / imgview> < / textview>
Claims
1. A data sharing method, characterized in that: Applied to electronic equipment, the method comprises: Detecting a first operation of dragging a first control into a first area on the screen; In response to the first operation, displaying an icon of the first application and an icon of the second application; detecting a second operation of continuing to drag the first control into a second area where the icon of the first application is located and releasing the control; In response to the second operation, the first data corresponding to the first control is shared to the first application.
2. The method according to claim 1, characterized in that The method further comprises: Display the first interface; When the first interface is displayed, a screenshot operation is detected; In response to the screenshot operation, the first control is displayed on the first interface, and the first data includes a screenshot image of the first interface.
3. The method according to claim 2, characterized in that A preview image of the screenshot image of the first interface is displayed on the first control.
4. The method according to claim 2 or 3, characterized in that: Before detecting a first operation of dragging the first control into the first area of the screen, the method further includes: A third operation acting on the first control is detected; vibration feedback is initiated, and the first control is set to a draggable suspended state.
5. The method according to claim 1, characterized in that The method further comprises: Display the first interface; When the first interface is displayed, a screenshot operation is detected; In response to the screenshot operation, displaying a first screenshot image; detecting an editing operation on the first screenshot image, and obtaining a second screenshot image; detecting a fourth operation on the second screenshot image; In response to the fourth operation, the first control is displayed on the image editing interface, and the first data includes the second screenshot image.
6. The method according to claim 5, characterized in that In response to the screenshot operation, displaying a first screenshot image specifically includes: In response to the screenshot operation, displaying a second control, wherein a preview image of the first screenshot image is displayed on the second control; detecting a fifth operation acting on the second control; In response to the fifth operation, an image editing interface is displayed, wherein the image editing interface includes the first screenshot image. picture; The image editing interface further includes a plurality of editing controls, and detecting an editing operation on the first screenshot image to obtain a second screenshot image specifically includes: An operation on one or more edit controls is detected; The image editing process corresponding to the one or more editing controls is performed on the first screenshot image to obtain the second screenshot image.
7. The method according to any one of claims 2 to 6, characterized in that: The screenshot operation is any one of the following: a global screenshot operation, a local screenshot operation, or a scrolling screenshot operation; When the screenshot operation is a global screenshot operation, the size of the first screenshot image is the same as the size of the screen; When the screenshot operation is a partial screenshot operation, the first screenshot image is in an irregular shape, and the size of the first screenshot image is smaller than the size of the screen; When the screenshot operation is a scrolling screenshot operation, the size of the first screenshot image is larger than the size of the screen.
8. The method according to claim 1, characterized in that The method further comprises: Displaying a first interface, wherein the first interface includes a target text; detecting an operation on the target text; In response to the operation, the first control is displayed on the first interface, and the first data includes the target text.
9. The method according to claim 8, characterized in that The first control displays all or part of the target text.
10. The method according to claim 1, characterized in that The method further comprises: Displaying a first interface, wherein the first interface includes a target text; When the first interface is displayed, a screenshot operation is detected, and a first screenshot image is displayed; Obtaining text in the first screenshot image; Selecting the target text from the text; detecting a sixth operation on the target text, In response to the sixth operation, the first control is displayed, and the first data includes the target text.
11. The method according to claim 10, characterized in that The displaying of the first screenshot image specifically includes: In response to the screenshot operation, a second control is displayed, on which a preview image of the first screenshot image is displayed; a user operation acting on the second control is detected, and an image editing interface is displayed, the image editing interface including the first screenshot image; The image editing interface further includes a third control, wherein obtaining the text in the first screenshot image specifically includes: A user operation acting on the third control is detected, and text in the first screenshot image is obtained.
12. The method according to claim 1, characterized in that The method further comprises: A screen recording operation is detected, and a screen recording is performed on the interface currently displayed by the electronic device to obtain a first video; After the screen recording is completed, the first control is displayed, and the first data includes the first video.
13. The method according to claim 12, characterized in that A frame of image of the first video is displayed on the first control.
14. The method according to any one of claims 1 to 13, characterized in that: The first application and the second application are application programs that can receive the first data and are determined according to the type and / or semantic information of the first data.
15. The method according to any one of claims 1 to 14, characterized in that: The first application is an instant messaging application, and after sharing the first data corresponding to the first control to the first application, the method further includes: Displaying a first window, wherein the first window displays a plurality of contacts; detecting a seventh operation of determining a target contact from the plurality of contacts; In response to the seventh operation, the first data is sent to the target contact.
16. The method according to any one of claims 1 to 15, characterized in that: The displaying of the icon of the first application and the icon of the second application specifically includes: The icon of the first application and the icon of the second application are displayed in the right side area or the left side area of the screen, and the icon of the first application and the icon of the second application are arranged vertically.
17. The method according to claim 16, characterized in that After sharing the first data corresponding to the first control to the first application, the method further includes: Stop displaying the icon of the first application and the icon of the second application.
18. An electronic device, characterized in that: It comprises one or more processors and one or more memories; wherein, the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program codes, and the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the method as described in any one of claims 1-17 is executed.
19. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the method according to any one of claims 1 to 17 is executed.
Citation Information
Patent Citations
Method and apparatus for content sharing
CN106489126A
Content sharing method, device and terminal
CN106527882A
Screenshot picture sharing method and mobile terminal
CN106681623A
Information sending method, information sending device and electronic equipment
CN112954046A
Screen capture method and device, electronic equipment and computer readable medium
CN114779976A
Cited By
Information transmission method and electronic device
EP4660768A4
Collaborative interaction method for electronic device, and electronic device, storage medium and chip system
WO2026170958A1