Content processing method, graphical interface, and electronic device
By displaying the application interface on the electronic device and responding to user operations, allowing users to drag and drop the panel to select and share content, the problem of inconvenience in content selection and sharing in the prior art is solved, and a convenient content processing experience is achieved.
Patent Information
- Application Number
- PCT/CN2024/108465
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-27
- Filing Date
- 2024-07-30
- Publication Date
- 2025-05-08
AI Technical Summary
The prior art is difficult to meet the user's need to conveniently select and share rich content in applications, especially the content processing methods are not uniform among different applications.
By displaying the application interface on an electronic device, a panel including text or image is displayed in response to user operations, and the user is allowed to drag the panel to the edit hot zone or target area to select and share content.
It enables users to easily select content they are interested in and share it with the target object, improving user interaction experience and providing a unified content processing method.
Smart Images

Figure CN2024108465_08052025_PF_FP_ABST
Abstract
Description
Content processing method, graphic interface and electronic device
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on November 3, 2023, with application number 202311465279.6 and application name “Content selection method, graphical interface and electronic device”, and claims priority to the Chinese patent application filed with the China Patent Office on December 27, 2023, with application number 202311832908.4 and application name “Content processing method, graphical interface and electronic device”, all contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of terminals, and in particular to a content processing method, a graphical interface, and an electronic device. Background Art
[0003] At present, the content provided by various applications is becoming more and more abundant. Users want to conveniently select the content they are interested in and process it more. How to meet the needs of users is an urgent problem to be solved.
[0004] Summary of the Invention
[0005] The present application provides a content processing method, a graphical interface and an electronic device. The electronic device displays an interface of an application, which includes content such as text or images. If an operation acting on the text is received, a first panel including the text is displayed. If an operation of dragging the first panel to an editing hot zone is also detected, a second panel including the text is displayed, allowing the user to select a target text from the second panel, and when an operation of dragging the target text to a target area and releasing it is received, the target text is shared with a target object. In this way, users can be provided with a convenient experience of freely selecting content of interest and sharing it.
[0006] In a first aspect, the present application provides a content processing method, which is applied to an electronic device, the method comprising: displaying an interface of a first application, the interface including a first text; in response to a first operation acting on the first text, displaying a first panel, wherein the first panel includes the first text; in response to a second operation acting on the first panel, displaying a second panel, wherein the second panel includes the first text and a cursor; in response to the operation acting on the cursor, a target text is selected, wherein the target text is part or all of the first text.
[0007] After implementing the method provided in the first aspect, a function of freely selecting content of interest from an application can be provided to the user, thereby supporting the user to process the content of interest further, thus meeting the user's needs. In conjunction with the method described in the first aspect, the first operation is a long press operation.
[0008] In this way, the user only needs to perform a simple and convenient long press operation to trigger the electronic device to provide a content selection function, thereby improving the user's interactive experience with the device.
[0009] In conjunction with the method described in the first aspect, the second operation is an operation of dragging to a first area of the interface. The first area includes a first icon, and the first icon is used to prompt the user to edit the text. The first area can be located below the screen of the electronic device.
[0010] In this way, by displaying an icon in a specific area, the user can be prompted to drag the panel to the specific area to select content, and setting the specific area below the electronic device screen can facilitate the user to drag the panel into it, thereby improving the user's interactive experience.
[0011] In combination with the method described in the first aspect, displaying the first panel includes: displaying the first panel on the upper layer of the interface; after displaying the first panel and before displaying the second panel, the method also includes: displaying the interface on the lower layer of the first panel.
[0012] In this way, the panel displayed by the electronic device is equivalent to floating above the original interface, which not only retains the content of the original interface to a certain extent, but also gives the user a visual effect of being able to drag the panel, thereby enhancing the user's interactive experience with the device.
[0013] In combination with the method described in the first aspect, after displaying the second panel, the method further includes: stopping displaying the first panel.
[0014] In this way, the display of unnecessary elements can be reduced, interference with elements that users are concerned about can be avoided, and the interface display effect can be improved.
[0015] In combination with the method described in the first aspect, after the target text is selected, the method further includes: in response to a third operation performed on the target text, displaying a menu bar, wherein the menu bar includes an icon of a second application; and in response to a fourth operation performed on the target text, sharing the target text with the second application. The third operation is dragging the target text to the second area of the interface, and the fourth operation is continuing to drag the target text to the icon of the second application and releasing the target text.
[0016] In this way, a more convenient and richer content sharing method can be provided to users. Specifically, users can simply drag the selected content to the target area and release it to share the selected content with the target object.
[0017] In combination with the method described in the first aspect, after the third operation, the method further includes: stopping displaying the second panel.
[0018] In this way, during the content sharing process, the panel for selecting content is no longer displayed. This reduces the display of unnecessary elements, avoids interfering with the elements that the user is concerned about, and improves the interface display effect.
[0019] In combination with the method described in the first aspect, after the third operation and before the target text is shared to the second application, the method further includes: switching the target text from the first display form to the second display form.
[0020] In this way, by switching the display form of the target text, the dragged area can be better adapted during the dragging process, thereby improving the interactive experience.
[0021] In combination with the method described in the first aspect, before displaying the menu bar, the method further includes: displaying a light band in the third area.
[0022] In this way, the light strip can guide the user to drag the panel to the corresponding area to trigger the opening of the menu bar, thereby improving the user's interactive experience with the device.
[0023] In combination with the method described in the first aspect, after the target text is selected, the method further includes: in response to a fifth operation performed on the second panel, displaying a third panel, wherein the third panel includes the first text; in response to a third operation performed on the third panel, displaying a menu bar, wherein the menu bar includes an icon of a second application; and in response to a fourth operation performed on the second panel, sharing all text in the second panel with the second application. The fifth operation is a long press on a blank area, the third operation is a drag to the second area of the interface, and the fourth operation is a continued drag to the icon of the second application and a release.
[0024] This allows users to easily share all the content in the panel while they're still selecting it. Instead of using the cursor to select all the content, users can simply long-press a blank area in the panel to quickly select the entire content for sharing.
[0025] In combination with the method described in the first aspect, after the third operation, the method further includes: stopping displaying the third panel.
[0026] In this way, during the content sharing process, the panel for selecting content is no longer displayed. This reduces the display of unnecessary elements, avoids interfering with the elements that the user is concerned about, and improves the interface display effect.
[0027] In combination with the method described in the first aspect, after the third operation and before all the text in the third panel is shared to the second application, the method further includes: the third panel is switched from the third display form to the fourth display form.
[0028] In this way, by switching the display form of all texts, the dragged area can be better adapted during the dragging process, thereby improving the interactive experience.
[0029] In combination with the method described in the first aspect, before displaying the menu bar, the method further includes: displaying a light band in the fourth area.
[0030] In this way, the light strip can guide the user to drag the panel to the corresponding area to trigger the opening of the menu bar, thereby improving the user's interactive experience with the device.
[0031] In combination with the method described in the first aspect, the first text is displayed in a non-editable control provided by the first application. The first panel and the second panel are provided by an application, service or component other than the first application.
[0032] In this way, for situations where some applications do not support users selecting their content, or provide different content selection methods for different applications, the content selection method provided by this application can provide users with a unified content processing method to meet user needs and improve user experience.
[0033] In combination with the method described in the first aspect, after the first operation and before displaying the first panel, the method further includes: taking a screenshot to obtain the first text.
[0034] In second aspect, the present application provides a content processing method, which is applied to an electronic device, the method comprising: displaying an interface of a first application, the interface including a first text; in response to a first operation acting on the first text, displaying a first panel, wherein the first panel includes the first text; in response to a third operation acting on the first panel, displaying a menu bar, wherein the menu bar includes an icon of a second application; in response to a fourth operation acting on the first panel, the first text is shared to the second application.
[0035] After implementing the method provided in the second aspect, a convenient operation entry can be provided for users to share all the contents contained in the panel before freely selecting the content. That is, the user does not need to trigger the selection of content, but can directly and quickly select the entire content for sharing by simply dragging the panel to the area to be shared.
[0036] In a third aspect, the present application provides a content processing method, which is applied to an electronic device, the method comprising: displaying an interface of a first application, the interface including a first text; displaying a first panel in response to a first operation acting on the first text, wherein the first panel includes the first text; displaying a cursor in the first panel in response to an eleventh operation acting on the first panel; and selecting the target text in response to the operation acting on the cursor, wherein the target text is part or all of the first text.
[0037] After implementing the method provided in the third aspect, users can be provided with a function of freely selecting content of interest from an application, thereby supporting users to perform further processing on the content of interest and meeting user needs.
[0038] In a fourth aspect, the present application provides a content processing method, which is applied to an electronic device, the method comprising: displaying an interface of a first application, the interface including a first text; in response to a first operation acting on the first text, displaying a first panel, wherein the first panel includes a first text and a cursor, and the first text is in a fully selected state; in response to an operation acting on the cursor, the target text is selected, wherein the target text is part or all of the first text.
[0039] After implementing the method provided in the fourth aspect, users can be provided with a function of freely selecting content of interest from the application, thereby supporting users to perform further processing on the content of interest and meeting user needs.
[0040] In a fifth aspect, the present application provides a content processing method, which is applied to an electronic device, the method comprising: displaying an interface of a first application, the interface comprising a first text; in response to a first operation acting on the first text, displaying a first panel, wherein the first panel comprises a first text and a cursor, and part of the text in the first text is selected; in response to an operation acting on the cursor, the target text is selected, wherein the target text is part or all of the first text.
[0041] After implementing the method provided in the fifth aspect, users can be provided with a function to freely select the content of interest from the application, thereby supporting users to perform further processing on the content of interest and meet user needs.
[0042] In a sixth aspect, the present application provides an electronic device comprising one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, and the computer program code comprises computer instructions, and when the one or more processors execute the computer instructions, the method described in any one of the first aspect or the second aspect is executed.
[0043] In a seventh aspect, the present application provides a computer-readable storage medium comprising instructions, which, when executed on an electronic device, enable execution of the method described in either the first aspect or the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0044] Figures 1A-1C are schematic diagrams of display interfaces for several text-processing controls provided by an application;
[0045] 2A-2B are schematic diagrams of display interfaces for several image processing controls provided by the application;
[0046] FIG3A is a schematic diagram of an operation interface for freely selecting text provided in an embodiment of the present application;
[0047] FIG3B is a schematic diagram of an operation interface for transmitting freely selectable text according to an embodiment of the present application;
[0048] FIG3C is a schematic diagram of an operation interface for selecting all texts provided in an embodiment of the present application;
[0049] FIG3D is a schematic diagram of an operation interface for transmitting fully selected text according to an embodiment of the present application;
[0050] FIG4A is a schematic diagram of another set of operation interfaces for freely selecting text provided in an embodiment of the present application;
[0051] FIG4B is a schematic diagram of another set of operation interfaces for transmitting freely selectable texts provided in an embodiment of the present application;
[0052] FIG4C is a schematic diagram of another set of operation interfaces for selecting all texts provided in an embodiment of the present application;
[0053] FIG4D is a schematic diagram of another set of operation interfaces for transmitting fully selected text provided in an embodiment of the present application;
[0054] FIG4E is a schematic diagram of another set of operation interfaces for selecting all texts provided in an embodiment of the present application;
[0055] FIG4F is a schematic diagram of another set of operation interfaces for transmitting fully selected text provided in an embodiment of the present application;
[0056] FIG5A is a schematic diagram of another set of operation interfaces for freely selecting text provided in an embodiment of the present application;
[0057] FIG5B is a schematic diagram of another set of operation interfaces for transmitting freely selectable text provided in an embodiment of the present application;
[0058] FIG5C is a schematic diagram of another set of operation interfaces for selecting all texts provided in an embodiment of the present application;
[0059] FIG5D is a schematic diagram of another set of operation interfaces for transmitting fully selected text provided in an embodiment of the present application;
[0060] FIG6A is a schematic diagram of another set of operation interfaces for freely selecting text provided in an embodiment of the present application;
[0061] FIG6B is a schematic diagram of another set of operation interfaces for transmitting freely selectable texts provided in an embodiment of the present application;
[0062] FIG6C is a schematic diagram of another set of operation interfaces for selecting all texts provided in an embodiment of the present application;
[0063] FIG6D is a schematic diagram of another set of operation interfaces for transmitting fully selected text provided in an embodiment of the present application;
[0064] FIG7A is a schematic diagram of an operation interface for freely editing images provided in an embodiment of the present application;
[0065] FIG7B is a schematic diagram of an operation interface for transmitting a freely editable image according to an embodiment of the present application;
[0066] FIG7C is a schematic diagram of an operation interface for selecting a group of images provided in an embodiment of the present application;
[0067] FIG7D is a schematic diagram of an operation interface for directly transmitting a selected image according to an embodiment of the present application;
[0068] FIG8 is a schematic diagram of the hardware architecture of an electronic device provided in an embodiment of the present application;
[0069] FIG9 is a schematic diagram of electronic device software provided in an embodiment of the present application. DETAILED DESCRIPTION
[0070] The following is a clear and detailed description of the technical solutions in the embodiments of the present application, with reference to the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " represents the meaning of "or." For example, A / B can represent A or B. "and / or" in the text is merely a description of the association relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone.
[0071] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.
[0072] References to "embodiments" in this application mean that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described in this application may be combined with other embodiments.
[0073] The term "user interface (UI)" in the following embodiments of this application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form that the user can receive. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface code is parsed and rendered on the electronic device and finally presented as content that the user can recognize. The commonly used form of user interface is graphical user interface (GUI), which refers to a user interface related to computer operation that is displayed in a graphical manner. It can be a visual interface element such as a control, text, icon, button, menu, tab, text box, dialog box, status bar, navigation bar, widget, etc. displayed on the display screen of an electronic device.
[0074] Currently, application programs (also referred to as applications or APPs) are all provided with controls, and content such as text and images are displayed through these controls.
[0075] Controls can be divided into two types: those that support selecting their displayed content and those that don't. For example, WebView, TextView, EditText, and ImageView control types typically support user selection of displayed content, enabling operations like copying and searching. However, controls like TextView and ImageView typically don't support user selection of displayed content, preventing further operations.
[0076] Optionally, the control type and whether it supports selection do not have the aforementioned strong binding correspondence. In the process of developing applications, developers can also customize some properties of various controls in the application to set whether the control type can support editing. For example, by defining the textIsSelectable property in TextView to true, the content displayed in the TextView class control can be selected to implement functions such as copying. For another example, by defining the editable property in EditText to false, the content displayed in the EditText class control can be prohibited from being selected. Similarly, the corresponding properties in ImageView can also be defined to set the editability of the content displayed in ImageView.
[0077] 1A-1C , which exemplarily illustrate several display interface diagrams for processing text-type controls.
[0078] FIG1A shows a schematic diagram of a display interface of a text control that does not support selection.
[0079] As shown in Figure 1A, the control 111 included in the application is a text control that does not support selection. Specifically, although text content is displayed in the control 111, after the user inputs an operation such as a long press on the control 111, the application will not respond, that is, the content in the control 111 will not be triggered.
[0080] FIG1B shows a schematic diagram of a display interface of a text control that only supports full selection.
[0081] As shown in Figure 1B , the control 112 included in the application is a text control that only supports full selection. Specifically, although text content is displayed in control 112, after the user inputs an action, such as a long press, on control 112, the application selects all the content in control 112 by default and pops up a toolbar 113 for processing the content in control 112. Toolbar 113 may include various tool options, such as copy, forward, favorite, and search.
[0082] FIG1C shows a schematic diagram of a display interface supporting freely selectable text controls.
[0083] As shown in FIG1C , the control 114 included in the application is a text control that supports free selection. Specifically, text content is displayed in the control 114. After the user inputs an operation such as a long press on the control 114, the application displays cursors 115A and 115B for sliding and selecting text content, and pops up a toolbar 116 for processing the selected content. The toolbar 116 may include various tool options, such as copy, select all, and search.
[0084] 2A-2B , which exemplarily illustrate several display interface diagrams for image processing controls.
[0085] FIG2A shows a schematic diagram of a display interface of an image-type control that does not support selection.
[0086] As shown in Figure 2A, the control 211 included in the application is an image control that does not support selection. Specifically, although the control 211 displays image content, after the user inputs an operation such as a long press on the control 211, the application does not respond, that is, the image in the control 211 is not triggered to be selected.
[0087] FIG2B shows a schematic diagram of a display interface of an image-type control that supports selection.
[0088] As shown in FIG2B , the control 212 included in the application is an image control that supports selection. Specifically, the control 212 displays image content. When the user inputs an operation, such as a long press, on the control 212, the application selects the image in the control 212 by default and pops up a window 213 for processing the content in the control 212. The window 213 may include various processing options, such as sharing to different applications, saving, and viewing the original image.
[0089] By analyzing the layout of controls in various applications, we found that most applications do not support user selection of content and, consequently, do not support further processing of that content. While a few applications do support user selection of content for further processing, the methods used vary from application to application. Users often need to select content of interest and perform unified processing on content selected from across different applications.
[0090] In order to solve the above problems, the present application provides a content processing method, a graphical interface and an electronic device, which can support users to freely select content provided by applications and can provide a unified and rich processing method for content in different applications. The method includes: displaying an interface of an application, which includes content such as text or images. If an operation acting on the text is received, a first panel including the text is displayed. If an operation of dragging the first panel to an editing hot zone is also detected, a second panel including the text is displayed, allowing the user to select a target text from the second panel, and when an operation of dragging the target text to a target area and releasing it is received, the target text is shared with a target object. In addition, if it is detected that the first panel is dragged to a target area and released, or if it is detected that a blank area is pressed in the editing panel and then a third panel containing the text is dragged to a target area and released, the text is shared with the target object. In addition, if an operation acting on the image is received, a fourth panel including the image is displayed, and if it is also detected that the fourth panel is dragged to a target area and released, the image is shared with the target object.
[0091] Optionally, the present application also provides another content processing method, a graphical interface and an electronic device. The method includes: displaying an interface of an application, which includes content such as text or images. If an operation acting on the text is received, the first panel including the text is displayed, and the text in the first panel is unselected by default. If an operation of selecting a target text from the first panel is also received (as opposed to a landing solution), and an operation of dragging the target text to the target area for release is also received, the target text is shared with the target object. In addition, if it is detected that the first panel is dragged to the target area for release, or it is detected that a blank space is pressed in the first panel and then the third panel containing the text is dragged to the target area for release, the text is shared with the target object. In addition, if an operation acting on the image is received, the fourth panel including the image is displayed, and if it is also detected that the fourth panel is dragged to the target area for release, the image is shared with the target object.
[0092] Optionally, the present application also provides another content processing method, a graphical interface and an electronic device. The method includes: displaying an interface of an application, which includes content such as text or images. If an operation acting on the text is received, the first panel including the text is displayed, and all the texts in the first panel are selected by default. If an operation of selecting a target text from the first panel is also received (as opposed to a landing solution), and an operation of dragging the target text to the target area for release is also received, the target text is shared with the target object. In addition, if it is detected that the first panel is dragged to the target area for release, or it is detected that a blank space is pressed in the first panel and then the third panel containing the text is dragged to the target area for release, the text is shared with the target object. In addition, if an operation acting on the image is received, the fourth panel including the image is displayed, and if it is also detected that the fourth panel is dragged to the target area for release, the image is shared with the target object.
[0093] Optionally, the present application also provides another content processing method, a graphical interface and an electronic device. The method includes: displaying an interface of an application, which includes content such as text or images. If an operation acting on the text is received, a first panel including the text is displayed, and the text in the first panel is partially selected by default. If an operation of selecting a target text from the first panel is also received (as opposed to a landing solution), and an operation of dragging the target text to the target area for release is also received, the target text is shared with the target object. In addition, if it is detected that the first panel is dragged to the target area for release, or it is detected that a blank space is pressed in the first panel and then the third panel containing the text is dragged to the target area for release, the text is shared with the target object. In addition, if an operation acting on the image is received, a fourth panel including the image is displayed, and if it is also detected that the fourth panel is dragged to the target area for release, the image is shared with the target object.
[0094] After implementing the method provided in this application, the following effects can be achieved:
[0095] (1) Provide users with a more convenient and free content selection method. Specifically, users can directly and quickly select the entire content by simply long pressing the content, or they can select the content of interest from the entire content by long pressing the content.
[0096] (2) Provide users with a more convenient and rich content sharing method. Specifically, users can share the selected content to the target object by simply dragging the selected content to the target area.
[0097] (3) Provide a unified and rich content processing method for the content of different applications. Specifically, users can share the content of different applications to target objects, which can be applications, devices, split screens, etc. mentioned later.
[0098] Edit Hotspot
[0099] The editing hot zone involved in this application refers to an area in the interface that can be used for interaction and will trigger the electronic device to execute the corresponding event after the interaction. The interaction method corresponding to the editing hot zone includes, for example, the operation of dragging a draggable element to the editing hot zone and then releasing it. The event triggered by the interaction method includes, for example, triggering the electronic device to display an editing panel, which can support the user to edit the text therein. The editing hot zone referred to in this application is only an exemplary name. This application does not limit the specific name of this area. The specific functions provided by it have been recorded in detail in the embodiments of this application.
[0100] Content Selection
[0101] The display panel, drag panel, and target text in the selection panel mentioned in the context of this application can be specifically provided by the "content selection" function, which can be provided by any of the system-level / third-party applications, services, or components. The name of the "content selection" function is only an example and is not limited to this embodiment of the application. The specific functions it provides are all described in detail in this application.
[0102] Content Sharing
[0103] The content sharing involved in the context of this application can be specifically provided by "smart flow service", "cross-device transmission service" or "split-screen transmission service".
[0104] "Smart Flow Service" can also be called "Cross-Application Transmission Service", which specifically provides the function of sharing content in this application to other applications in Anygate.
[0105] "Cross-device transmission service" can also be called "multi-device collaborative service", which specifically provides the function of sharing content in this device to other devices for collaborative processing.
[0106] "Split-screen transmission service" can also be called "multi-screen collaborative service", which can specifically provide the function of sharing the content in this sub-screen to other sub-screens for collaborative processing.
[0107] In the embodiments of this application, when "content sharing" is applied in different scenarios, "content sharing" can be specifically provided by the aforementioned different functional modules, and this embodiment of the application does not limit this. The names of the aforementioned various functions are only examples, and this embodiment of the application does not limit their names. The specific functions they provide are all described in detail in this application.
[0108] In an embodiment of the present application, "content selection" and "content sharing" can be provided by two independent functional modules, or can be provided by a functional module formed by coupling two sub-functional modules to each other. The implementation of this application does not impose any restrictions on this.
[0109] In the embodiments of this application, to protect the user's intellectual property rights and provide an immersive gaming experience, applications that can perform the aforementioned "content selection" and "content sharing" include system applications or third-party applications in addition to the following applications: document provision applications, gaming applications. This embodiment of the application does not impose specific restrictions on applications that cannot perform the aforementioned "content selection" and "content sharing", and these can be adjusted according to actual needs.
[0110] Next, the content processing method provided by this application will be described in detail by taking text content and image content as examples and combining with several sets of user interfaces provided in the accompanying drawings.
[0111] For text content, this application provides four processing methods, please refer to the detailed description below for details.
[0112] 1. FIG. 3A to FIG. 3D are operation interfaces involved in the first text content processing method.
[0113] In text content processing method 1, the user can drag the floating panel to the editing hotspot to further freely select text through the editing panel, and then drag the selected text to the target area to share it with the target object. Alternatively, the user can directly drag the floating panel to the target area to share it with the target object.
[0114] (1) In the text content processing method 1, for a floating panel, in which all texts contained in the panel are unselected, the user can drag the panel to the editing hot zone to further freely select text through the editing panel, and then drag the freely selected text to the target area to share it with the target object. For details, see the description of Figures 3A-3B below.
[0115] (2) In the text content processing method 1, for the floating panel, and the text contained in the panel is in a completely unselected state, the user can also directly drag the panel to the target area to share it with the target object. For details, please refer to the description of Figures 3C-3D below.
[0116] Refer to Figure 3A, which is a schematic diagram of an operation interface for freely selecting text provided in an embodiment of the present application.
[0117] 3A a shows an interface 30 of an electronic device displaying an application. Specifically, the interface 30 includes text 311, which can be displayed through a text-type control provided by the application. The application interface 30 can specifically be an interface provided by a system-level application or a third-party application, and this embodiment of the application does not limit this. If the electronic device detects a long press operation on the text 311, in response to the long press operation, the electronic device displays a panel, as shown in b in FIG3A.
[0118] b in Figure 3A shows a panel 312 displayed by an electronic device. Specifically, in response to a long press operation on the text 311, the electronic device displays a panel 312 and an icon 313 on the upper layer of the interface 30. The panel 312 contains the text 311, and the process of displaying the panel 312 gives the user a floating visual experience, that is, the panel 312 is equivalent to a suspended interface element. In some embodiments, the panel 312 can also be implemented as a text-type control containing the text 311, or an image-type control such as a preview or thumbnail containing the text 311. In some embodiments, in response to a long press operation on the text 311, the electronic device can obtain the text 311 by taking a screenshot, and then display the panel 312 including the text 311. In some embodiments, after displaying the panel 312, if it is detected that the user ends the long press operation (i.e., the user releases the hand), the panel 312 may continue to be displayed for a preset period of time (e.g., 3 seconds) and then disappear; if it is detected that the user does not release the hand and drags the panel 312, or if it is detected that the panel 312 is dragged within a preset period of time (e.g., 3 seconds) after the hand is released, the panel 312 will move the display area along the user's dragging trajectory.
[0119] 3A c shows the operation interface of the electronic device when the drag panel 312 is displayed. Specifically, when the operation of dragging the panel 312 is detected, the electronic device also displays an icon 313, which is used to instruct the user to continue dragging the panel 312 into the hot zone of the icon 313 to edit the text 311.
[0120] d in Figure 3A shows an editing panel 314 displayed by an electronic device. Specifically, when the operation of dragging the panel 312 to the hot zone of the icon 313 is detected, the electronic device displays the editing panel 314 and stops displaying the panel 312. The editing panel 314 includes text 311 and cursors 315A and 315B. The text between the cursors 315A and 315B is the selected text. In the initial editing panel 314 displayed by default, the text between the cursors 315A and 315B can be selected as all or other by default. The user can adjust the selected target text by sliding the cursor 315A and the cursor 315B. In some embodiments, the electronic device can also detect other editing operations entered by the user in the editing panel 314, such as deletion, writing, etc., which are not limited in this embodiment of the present application.
[0121] Refer to FIG3B , which is a schematic diagram of an operation interface for transmitting freely selectable text provided in an embodiment of the present application.
[0122] Figure 3B (e) shows an operation interface displayed by the electronic device when freely selecting text through the editing panel 314. Specifically, the electronic device can adjust the selection state of the text 311 in the editing panel 314 based on detecting the operation of sliding the cursor 315A and / or 315B in the editing panel 314. The text in the selected state is the target text mentioned in this application.
[0123] Figure f in Figure 3B shows the operation interface of the electronic device displayed to trigger dragging the target text. Specifically, upon detecting a long press operation on the target text in the editing panel 314, the electronic device may display a panel 316 in a suspended state corresponding to the target text. The panel 316 may be displayed on the upper layer of the target text in the editing panel 314. The panel 316 includes the target text. Optionally, when the target text has a lot of content, part of the target text may be displayed in the panel 316, such as the first sentence of the target text, or a summary of the target text. In some embodiments, the panel 316 may also be implemented as a text-type control of the target text, or an image-type control such as a preview or thumbnail of the target text.
[0124] 3B shows a light strip 317 displayed by an electronic device. Specifically, after the electronic device displays a suspended panel 316, as the user drags the panel 316, the electronic device can display a light strip 317, which is used to guide the user to drag the panel 316 to any door hot zone to trigger the opening of any door (i.e., to open the smart flow service). The light strip 317 can be an interface element with attributes such as color, shadow, gradient, graphic fill (such as grid fill, diagonal fill), etc. In some embodiments, the light strip 317 can also present dynamic effects, such as changing the display area, color, etc. For example, the light strip can change the display area as the panel 316 is dragged, giving the user an operating experience of adsorbing the suspended panel 316. In other embodiments, the light strip 317 can also be an area with transparency, so that the interface elements displayed on the lower layer of the light strip 317 are not blocked.
[0125] Figure 3B h shows the operation interface of opening any door for transmission displayed by the electronic device. Specifically, when the electronic device detects that the panel 316 is dragged to the light strip 317, it triggers the electronic device to open any door, and the opened door displays a menu bar 318 including icons of one or more candidate applications. The menu bar 318 may include a favorites icon, a search icon, a share icon, a note icon, an information icon, a shopping icon, a print icon, and an email icon, etc. In addition, when the electronic device detects that the user continues to drag the panel 316 to the icon of any candidate application in the menu bar 318 (for example, the note application icon, i.e., the target area) and releases it, the electronic device can confirm that the note application is the target object. Subsequently, the electronic device can transfer the text corresponding to the panel 316 (i.e., the target text) to the note application, and can also output corresponding prompt information 319. Not limited to outputting prompt information 319, in some other embodiments, the electronic device can also display the window provided by the target object, or directly jump to the interface provided by the target object.
[0126] Among them, the collection application corresponding to the collection icon in the menu bar 318 can be a system application, which provides a global system collection function. The note application corresponding to the note icon can be a system application or a third-party application, which can provide in-application recording, collection and other functions. Candidate applications are applications that support receiving data to be transmitted, which are screened by the electronic device from all installed applications. The electronic device can determine the candidate application based on the information type, semantic information, etc. of the data to be transmitted. The candidate applications may include global applications that support receiving any type of data (such as collection applications, search applications, sharing applications, email applications, etc.), and may also include applications that only support receiving some types of data (such as picture editing applications that only support receiving pictures, navigation applications that only support receiving text, etc.). Different data to be transmitted can correspond to different menu bars.
[0127] Continuing to refer to f, g, and h in FIG3B , during the process of dragging panel 316, the display form of panel 316 will switch, including switching the display size and / or display content. For example, when panel 316 is dragged from the initial position toward the direction of light band 317, the size of panel 316 will be reduced from f in FIG3B to the size shown in g in FIG3B ; for another example, when panel 316 is dragged to the light band area, the size of panel 316 will be further reduced from g in FIG3B to the size shown in h in FIG3B , and the text contained therein will also be reduced from the content shown in g in FIG3B to the content shown in h in FIG3B . The embodiment of the present application does not specifically limit the change in the display form of panel 316 during the dragging process.
[0128] Continuing with reference to h in FIG3B , while displaying menu bar 318 containing icons of candidate applications, the electronic device may adjust the original foreground user interface to a right perspective style, thereby visually creating an "opening door" animation effect with the menu bar 318. The foreground user interface may refer to an interface consisting of other content displayed on the display screen excluding the status bar, or may refer to all content displayed on the display screen including the status bar, and this embodiment of the application is not limited thereto.
[0129] Refer to Figure 3C, which is a schematic diagram of the operation interface for selecting all texts provided in an embodiment of the present application.
[0130] Figures a and b in Figure 3C show that a long press operation on text 311 triggers the electronic device to display panel 312, which includes all the contents of text 311. Figures a and b in Figure 3C are the same as those in Figure 3A above. For details, please refer to the previous description of Figure 3A a and b, which will not be repeated here.
[0131] Refer to Figure 3D, which is a schematic diagram of an operation interface for transmitting fully selected text provided in an embodiment of the present application.
[0132] Figures c and d in Figure 3D show dragging panel 312 to the target area in the Any Door and releasing it to transfer the entire text. Figures c and d in Figure 3D are similar to g and h in Figure 3B above, except that the content being dragged and shared is different. Here, the entire text in panel 312 is dragged and shared, while the previously mentioned drag and share content is only a portion of the content in panel 312. For other similarities, please refer to the previous description of g and h in Figure 3B, which will not be repeated here.
[0133] In one practicable manner, after the electronic device displays the panel 312 shown in b in FIG. 3C , and before detecting the operation of dragging the panel 312 shown in c in FIG. 3D , the user can long press the text 311 to trigger the display panel 312 and start dragging the panel 312 without releasing the hand, or the user can long press the text 311 to trigger the display panel 312 and release the hand, and start dragging the panel 312 within 3 seconds after releasing the hand, and the embodiment of the present application does not limit this. Optionally, the length of time that the panel 312 remains displayed can be other than 3 seconds, and the embodiment of the present application does not limit this.
[0134] Other ways to share content
[0135] The aforementioned Figures 3B and 3D only use the "smart flow service" as an example to introduce the operation method of transmitting the selected text. In addition, the electronic device can also transmit the selected text through methods such as "cross-device transmission service" or "split-screen transmission service". The operation methods corresponding to the latter two methods are similar to the operation method shown in Figure 3B described above. The difference is that the panel 316 corresponding to the selected content needs to be dragged to a target area different from the aforementioned light band 317 for release, and the target object of sharing is also different. Specifically, taking the "cross-device transmission service" as an example, the target area can also be the edge area of the local electronic device (the edge area includes, for example, the left edge, right edge, upper edge or lower edge of the local device display screen, and the specific edge area depends on the side of the neighboring device close to the local device), and the target object is the neighboring device for collaborative processing. Taking the "split-screen transmission service" as an example, the target area can be another split-screen area of the electronic device, and the target object is the object in the other split-screen area.
[0136] In the embodiment of the present application, the custom name involved in the aforementioned text content processing method 1 can also be called other names, as follows:
[0137] The application providing the interface 30 may also be referred to as a first application.
[0138] The text 311 may also be referred to as the first text, the text control for displaying the text 311 may also be referred to as the first control, and the long-press operation performed on the text 311 may also be referred to as the first operation. In the embodiment of the present application, the first operation may be other types of operations in addition to the long-press operation, and the embodiment of the present application does not limit this.
[0139] Panel 312 is also called the first panel, icon 313 is also called the first icon, the display area of icon 313 is also called the first area, the operation of dragging panel 312 to icon 313 can also be called the second operation, the operation of dragging panel 312 directly to light strip 317 can also be called the third operation, and the operation of dragging panel 312 to the note application in menu bar 318 and releasing it can also be called the fourth operation.
[0140] The editing panel 314 is also called the second panel, the area where the light band 317 is located can also be called the second area, and the operation of dragging the target text in the second panel to the light band 317 can also be called the third operation.
[0141] The note application in the menu bar 318 may also be referred to as a second application, and the operation of dragging the target text to the icon of the handwriting application and releasing it may also be referred to as a fourth operation.
[0142] The long press operation on the blank space in the editing panel can also be called the fifth operation. In addition to the long press operation, the fifth operation can also be other types of operations, such as a click operation, etc. This application does not impose any restrictions on this.
[0143] Panel 316 is also called the third panel. The operation of dragging panel 316 to the menu bar 318 can also be called the third operation. The operation of dragging panel 316 to the note application in the menu bar 318 and then releasing it can also be called the fourth operation.
[0144] 2. FIG. 4A to FIG. 4F are operation interfaces involved in the second text content processing method.
[0145] (1) In the text content processing method 2, for the floating panel, the text contained in the panel is in a completely unselected state. The user can edit the panel to further freely select text through the panel, and then drag the freely selected text to the target area to share it with the target object. For details, see the description of Figures 4A-4B below.
[0146] (2) In text content processing method 2, for a floating panel where all text contained in the panel is unselected, the user can also directly drag the panel to the target area to share it with the target object. For details, see the description of Figures 4C-4D below.
[0147] (3) In text content processing method 2, for a panel that supports free selection of text, the user can also press a blank area of the panel to trigger the display of a new panel, in which the text contained in the new panel is in a completely unselected state, and then drag the new panel to the target area to share it with the target object. For details, see the description of Figures 4E-4F below.
[0148] Refer to FIG4A , which is a schematic diagram of another set of operation interfaces for freely selecting text provided in an embodiment of the present application.
[0149] 4A a shows an interface 40 of an electronic device displaying an application. Specifically, the interface 40 includes text 411, which can be displayed through a text-type control provided by the application. The application interface 40 can specifically be an interface provided by a system-level application or a third-party application, and this embodiment of the application does not limit this. If the electronic device detects a long press operation on the text 411, in response to the long press operation, the electronic device displays a panel, as shown in b in FIG4A.
[0150] 4A b shows a panel 412 displayed by an electronic device. Specifically, in response to a long press operation on text 411, the electronic device displays panel 412 on the upper layer of interface 40. The panel 412 contains text 411, and the process of displaying panel 412 gives the user a floating visual experience, that is, the panel 412 is equivalent to a suspended interface element. In some embodiments, panel 412 can also be implemented as a text-type control containing text 411, or as an image-type control such as a preview or thumbnail of text 411. In some embodiments, after displaying panel 412, if it is detected that the user ends the long press operation (i.e., the user leaves the hand), the panel 412 can continue to display for a preset time (e.g., 3 seconds) and then disappear; if it is detected that the user does not leave the hand and drags the panel 412, or if it is detected that the panel 412 is dragged within a preset time (e.g., 3 seconds) after leaving the hand, the panel 412 will move the display area along the user's dragging trajectory.
[0151] c in Figure 4A shows an operation interface for triggering the free selection of target text. Specifically, when a long press operation acting on the drag panel 412 is detected, the electronic device displays a cursor 413A and a cursor 413B, and the text between the cursor 413A and the cursor 413B is the selected text. The text between the cursor 413A and the cursor 413B can default to the text corresponding to the long press operation input by the user. The user can adjust the selected target text by sliding the cursor 413A and the cursor 413B. In some embodiments, the electronic device can also detect other editing operations entered by the user in the panel 412, such as deletion, writing, etc., which are not limited in this embodiment of the present application.
[0152] 4A d shows an operation interface displayed by the electronic device when freely selecting text through panel 412. Specifically, the electronic device can adjust the selected state of text 411 in panel 412 based on the operation of cursor 413A and / or 413B detected in sliding panel 412. The text in the selected state is the target text described in this application.
[0153] Refer to FIG4B , which is a schematic diagram of another set of operation interfaces for transmitting freely selectable text provided in an embodiment of the present application.
[0154] Figure 4B (e) shows the operation interface of the electronic device that triggers the dragging of the target text. Specifically, when a long press operation is detected on the target text, the electronic device can display a suspended panel 414 corresponding to the target text. During the display of panel 414, panel 412 stops displaying, but the original text 411 in interface 40 does not stop displaying, thereby giving the user a visual effect that the text other than the target text in panel 412 sinks from panel 412. The panel 414 can be located at the position of the touch point acting on the display screen when the user inputs a long press operation. The panel 414 includes the target text. Optionally, when the content of the target text is relatively large, part of the target text can be displayed in panel 414, such as the first sentence of the target text, or a summary of the target text. In some embodiments, panel 414 can also be implemented as a text control of the target text, or an image control such as a preview or thumbnail of the target text.
[0155] Figures f and g in Figure 4B show the operation interface displayed by the electronic device for dragging the target text to the arbitrary door hot zone. Specifically, after the electronic device displays the suspended panel 414, as the user drags the panel 414, the electronic device can display a light strip 415, which is used to guide the user to drag the panel 414 to the arbitrary door hot zone to trigger the opening of the arbitrary door (i.e., to start the smart flow service). The light strip 415 can be an interface element with attributes such as color, shadow, gradient, graphic fill (such as grid fill, diagonal fill), etc. In some embodiments, the light strip 415 can also present dynamic effects, such as changing the display area, color, etc. For example, the light strip can change the display area as the panel 414 is dragged, giving the user an operational experience of adsorbing the suspended panel 414. In some embodiments, during the process of dragging the panel 414, the display form of the panel 414 will switch, including switching the display size and / or display content. For example, when the panel 414 is dragged from its initial position toward the light strip 415, the size of the panel 414 will be reduced from the size shown in f in FIG. 4B to the size shown in g in FIG. 4B, and the text contained therein will also be reduced from the content shown in f in FIG. 4B to the content shown in g in FIG. 4B. The embodiment of the present application does not specifically limit the change in the display form of the panel 414 during the dragging process. In other embodiments, the light strip 415 may also be a transparent area so as not to block the interface elements displayed in the lower layer of the light strip 415.
[0156] Figure 4B h shows the operation interface of opening any door for transmission displayed by the electronic device. Specifically, when the electronic device detects that the panel 414 is dragged to the light strip 415, it triggers the electronic device to open any door, and the opened door displays a menu bar 416 including icons of one or more candidate applications. The menu bar 416 may include a favorites icon, a search icon, a share icon, a note icon, an information icon, a shopping icon, a print icon, and an email icon, etc. In addition, when the electronic device detects that the user continues to drag the panel 414 to the icon of any candidate application in the menu bar 416 (for example, the note application icon, i.e., the target area) and releases it, the electronic device can confirm that the note application is the target object. Subsequently, the electronic device can transfer the text corresponding to the panel 414 (i.e., the target text) to the note application, and can also output corresponding prompt information 417. Not limited to outputting prompt information 417, in some other embodiments, the electronic device can also display a window provided by the target object, or directly jump to the interface provided by the target object.
[0157] Continuing to refer to h in Figure 4B, the favorite application corresponding to the favorite icon in the menu bar 416 can be a system application, which provides a global system favorite function. The note application corresponding to the note icon can be a system application or a third-party application, which can provide in-application recording, collection and other functions. Candidate applications are applications that support receiving data to be transmitted, which are screened out by the electronic device from all installed applications. The electronic device can determine the candidate application based on the information type, semantic information, etc. of the data to be transmitted. The candidate applications may include global applications that support receiving any type of data (such as favorite applications, search applications, sharing applications, email applications, etc.), and may also include applications that only support receiving some types of data (such as picture editing applications that only support receiving pictures, navigation applications that only support receiving text, etc.). Different data to be transmitted can correspond to different menu bars.
[0158] Continuing with reference to h in FIG4B , while displaying menu bar 416 containing icons of candidate applications, the electronic device may adjust the original foreground user interface to a right perspective style, thereby visually creating an "opening door" animation effect with the menu bar 416. The foreground user interface may refer to an interface consisting of other content displayed on the display screen excluding the status bar, or may refer to all content displayed on the display screen including the status bar, and this embodiment of the application is not limited thereto.
[0159] Refer to Figure 4C, which is a schematic diagram of another set of operation interfaces for selecting all texts provided in an embodiment of the present application.
[0160] Figures a and b in Figure 4C show that a long press operation on text 411 triggers the electronic device to display panel 412, which includes all the contents of text 411. Figures a and b in Figure 4C are the same as those in Figure 4A above. For details, please refer to the previous description of Figure 4A a and b, which will not be repeated here.
[0161] Refer to Figure 4D, which is a schematic diagram of another set of operation interfaces for transmitting fully selected text provided in an embodiment of the present application.
[0162] Figures c and d in Figure 4D show dragging panel 412 to the target area in the Any Door and releasing it to transfer the entire text. Figures c and d in Figure 4D are similar to g and h in Figure 4B above, except that the content being dragged and shared is different. Here, the entire text in panel 412 is dragged and shared, while the previously mentioned drag and share content is only a portion of the content in panel 412. For other similarities, please refer to the previous description of g and h in Figure 4B, which will not be repeated here.
[0163] In one practicable manner, after the electronic device displays the panel 412 shown in b in FIG. 4C , and before detecting the operation of dragging the panel 412 shown in c in FIG. 4D , the user can long press the text 411 to trigger the display panel 412 and start dragging the panel 412 without releasing the hand, or the user can long press the text 411 to trigger the display panel 412 and release the hand, and start dragging the panel 412 within 3 seconds after releasing the hand, and the embodiment of the present application does not limit this. Optionally, the length of time that the panel 412 remains displayed can be other than 3 seconds, and the embodiment of the present application does not limit this.
[0164] Refer to Figure 4E, which is a schematic diagram of another set of operation interfaces for selecting all texts provided in an embodiment of the present application.
[0165] 4E a and b show that when freely selecting text, by acting on the blank space of panel 412, the electronic device is triggered to display panel 418, which includes all the contents of text 411 in panel 418, that is, panel 418 is equivalent to switching panel 412, which can be in a state where text can be freely selected, to a state where text cannot be freely selected. In some embodiments, panel 418 shown in b of FIG4E and panel 412 shown in a of FIG4E can be the same panel, the difference being that the text in panel 418 does not exist in a selected state, while the text in panel 412 exists in a selected state. In other embodiments, panel 418 shown in b of FIG4E and panel 412 shown in a of FIG4E are not the same panel, and when panel 418 is displayed, panel 412 disappears. a and b in FIG4C are similar to a and b in FIG4A above. For details on their similarities, please refer to the introduction to a and b in FIG4A above, which will not be repeated here.
[0166] Refer to Figure 4F, which is a schematic diagram of another set of operation interfaces for transmitting fully selected text provided in an embodiment of the present application.
[0167] Figures c and d in Figure 4F show dragging panel 418 to the target area in any door and releasing it to transfer the entire text. Figures c and d in Figure 4F are similar to g and h in Figure 4B above, except that the content being dragged and shared is different. Here, the entire text in panel 418 is dragged and shared, while the content previously shared by dragging and sharing was only a portion of the content in panel 418. For other similarities, please refer to the previous description of g and h in Figure 4B, which will not be repeated here.
[0168] In one practicable manner, after the electronic device displays the panel 418 shown in b in FIG. 4E , and before detecting the operation of dragging the panel 418 shown in c in FIG. 4F , the user can long press a blank area of the panel 412 to trigger the display of the panel 418 and then directly start dragging the panel 418 without releasing the hand, or the user can long press a blank area of the panel 412 to trigger the display of the panel 418 and then release the hand, and start dragging the panel 418 within 3 seconds after releasing the hand, and the embodiment of the present application does not limit this. Optionally, the duration for which the panel 418 remains displayed may be other than 3 seconds, and the embodiment of the present application does not limit this.
[0169] Other ways to share content
[0170] The aforementioned Figures 4B, 4D and 4F only use the “smart flow service” as an example to introduce the operation method of transmitting the selected text. In addition, the electronic device can also transmit the selected text through methods such as “cross-device transmission service” or “split-screen transmission service”. The operation methods corresponding to the latter two methods are similar to the operation method shown in Figure 4B described above. The difference is that the panel 414 corresponding to the selected content needs to be dragged to a target area different from the aforementioned light band 415 for release, and the target object of sharing is also different. Taking the “cross-device transmission service” as an example, the target area can also be the edge area of the local electronic device (the edge area is specifically the area where the neighboring device is close to the local device), and the target object is the neighboring device for collaborative processing. Taking the “split-screen transmission service” as an example, the target area can be another split-screen area of the electronic device, and the target object is the object in the other split-screen area.
[0171] In the embodiment of the present application, the custom name involved in the aforementioned text content processing method 2 may also be called other names, as follows:
[0172] The application providing the interface 40 may also be referred to as a first application.
[0173] The text 411 may also be referred to as the first text, and the long press operation on the text 411 may also be referred to as the first operation. In the embodiment of the present application, the first operation may be other types of operations besides the long press operation, which is not limited in the embodiment of the present application.
[0174] Panel 412 is also called the first panel. The long press operation on panel 412 can also be called the eleventh operation. In the embodiment of the present application, in addition to the long press operation, the eleventh operation can also be other types such as a click operation, and the embodiment of the present application does not limit this.
[0175] 3. FIG. 5A to FIG. 5D are operation interfaces involved in the third content processing method.
[0176] (1) In text content processing method 3, for the floating panel containing all selected text, the user can edit the panel to further freely select text through the panel, and then drag the freely selected text to the target area to share it with the target object. For details, see the description of Figures 5A-5B below.
[0177] (2) In text content processing method 3, for the floating panel containing the fully selected text, the user can also long press a blank area of the panel to drag the panel to the target area to share it with the target object. For details, see the description of Figures 5C and 5D below.
[0178] Refer to Figure 5A, which is a schematic diagram of another set of operation interfaces for freely selecting text provided in an embodiment of the present application.
[0179] 5A a shows an interface 50 of an electronic device displaying an application. Specifically, the interface 50 includes text 511, which can be displayed through a text-type control provided by the application. The application interface 50 can specifically be an interface provided by a system-level application or a third-party application, and this embodiment of the application does not limit this. If the electronic device detects a long press operation on the text 511, in response to the long press operation, the electronic device displays a panel, as shown in b in FIG5A.
[0180] 5A b shows a panel 512 displayed by the electronic device. Specifically, in response to a long press operation on the text 511, the electronic device displays the panel 512 on the upper layer of the interface 50. The panel 512 includes the text 511, a cursor 513A, and a cursor 513B. The text between the cursor 513A and the cursor 513B is the selected text. The selected text between the cursor 513A and the cursor 513B can be defaulted to the entire text 511, and the process of displaying the panel 512 gives the user a floating visual experience, that is, the panel 512 is equivalent to a suspended interface element. In some embodiments, the panel 512 can also be implemented as a text-type control containing the text 511, or an image-type control such as a preview or thumbnail containing the text 511. In some embodiments, after displaying the panel 512, if it is detected that the user ends the long press operation (i.e., the user releases the hand), the panel 512 may continue to be displayed for a preset period of time (e.g., 3 seconds) and then disappear; if it is detected that the user does not release the hand and drags the panel 512, or if it is detected that the panel 512 is dragged within a preset period of time (e.g., 3 seconds) after the hand is released, the panel 512 will move the display area along the user's dragging trajectory.
[0181] Figure 5A, c, shows an operation interface displayed by the electronic device when freely selecting text. Specifically, the electronic device can adjust the selected state of the text 511 in the panel 512 based on the operation of the cursor 513A and / or 513B in the sliding panel 512. The text in the selected state is the target text described in this application. In some embodiments, in addition to adjusting the selected target text by sliding the cursor 513A or the cursor 513B, the user can also enter other editing operations, such as deletion, writing, etc., which are not limited in this embodiment of the application.
[0182] Refer to FIG5B , which is a schematic diagram of another set of operation interfaces for transmitting freely selectable text provided in an embodiment of the present application.
[0183] Figure 5B (e) shows the operation interface of the electronic device that triggers the dragging of the target text. Specifically, when a long press operation is detected on the target text, the electronic device can display a suspended panel 514 corresponding to the target text. During the display of panel 514, panel 512 stops displaying, but the original text 511 in interface 50 does not stop displaying, thereby giving the user a visual effect that the text other than the target text in panel 512 sinks from panel 512. The panel 514 can be located at the position of the touch point acting on the display screen when the user inputs a long press operation. The panel 514 includes the target text. Optionally, when the content of the target text is relatively large, part of the target text can be displayed in panel 514, such as the first sentence of the target text, or a summary of the target text. In some embodiments, panel 514 can also be implemented as a text control of the target text, or an image control such as a preview or thumbnail of the target text.
[0184] Figures f and g in Figure 5B show the operation interface of dragging the target text to the arbitrary door hot zone displayed by the electronic device. Specifically, after the electronic device displays the suspended panel 514, as the user drags the panel 514, the electronic device can display a light strip 515, which is used to guide the user to drag the panel 514 to the arbitrary door hot zone to trigger the opening of the arbitrary door (i.e., to start the smart flow service). The light strip 515 can be an interface element with attributes such as color, shadow, gradient, graphic fill (such as grid fill, diagonal fill), etc. In some embodiments, the light strip 515 can also present dynamic effects, such as changing the display area, color, etc. For example, the light strip can change the display area as the panel 514 is dragged, giving the user an operational experience of adsorbing the suspended panel 514. In some embodiments, during the process of dragging the panel 514, the display form of the panel 514 will switch, including switching the display size and / or display content. For example, when the panel 514 is dragged from its initial position toward the light band 515, the size of the panel 514 will be reduced from the size shown in f in FIG. 5B to the size shown in g in FIG. 5B, and the text contained therein will also be reduced from the content shown in f in FIG. 5B to the content shown in g in FIG. 5B. The embodiment of the present application does not specifically limit the change in the display form of the panel 514 during the dragging process. In other embodiments, the light band 515 may also be a transparent area so as not to block the interface elements displayed in the lower layer of the light band 515.
[0185] Figure 5B h shows the operation interface of opening any door for transmission displayed by the electronic device. Specifically, when the electronic device detects that the panel 514 is dragged to the light strip 515, it triggers the electronic device to open any door, and the opened door displays a menu bar 516 including icons of one or more candidate applications. The menu bar 516 may include a favorites icon, a search icon, a share icon, a note icon, an information icon, a shopping icon, a print icon, and an email icon, etc. In addition, when the electronic device detects that the user continues to drag the panel 514 to the icon of any candidate application in the menu bar 516 (for example, the note application icon, i.e., the target area) and releases it, the electronic device can confirm that the note application is the target object. Subsequently, the electronic device can transfer the text corresponding to the panel 514 (i.e., the target text) to the note application, and can also output corresponding prompt information 517. Not limited to outputting prompt information 517, in some other embodiments, the electronic device can also display a window provided by the target object, or directly jump to the interface provided by the target object.
[0186] Continuing to refer to h in Figure 5B, the favorite application corresponding to the favorite icon in the menu bar 516 can be a system application, which provides a global system favorite function. The note application corresponding to the note icon can be a system application or a third-party application, which can provide in-application recording, collection and other functions. Candidate applications are applications that support receiving data to be transmitted, which are screened by the electronic device from all installed applications. The electronic device can determine the candidate application based on the information type, semantic information, etc. of the data to be transmitted. The candidate applications may include global applications that support receiving any type of data (such as favorite applications, search applications, sharing applications, email applications, etc.), and may also include applications that only support receiving some types of data (such as picture editing applications that only support receiving pictures, navigation applications that only support receiving text, etc.). Different data to be transmitted can correspond to different menu bars.
[0187] Continuing with reference to h in FIG. 5B , while displaying menu bar 516 containing icons of candidate applications, the electronic device may adjust the original foreground user interface to a right perspective style, thereby visually creating an "opening door" animation effect with the menu bar 516. The foreground user interface may refer to an interface consisting of other content displayed on the display screen excluding the status bar, or may refer to all content displayed on the display screen including the status bar, and this embodiment of the present application is not limited thereto.
[0188] Continuing with reference to h in FIG. 5B , while displaying menu bar 516 containing icons of candidate applications, the electronic device may adjust the original foreground user interface to a right perspective style, thereby visually creating an "opening door" animation effect with the menu bar 516. The foreground user interface may refer to an interface consisting of other content displayed on the display screen excluding the status bar, or may refer to all content displayed on the display screen including the status bar, and this embodiment of the present application is not limited thereto.
[0189] Refer to Figure 5C, which is a schematic diagram of another set of operation interfaces for selecting all texts provided in an embodiment of the present application.
[0190] Figures a and b in Figure 5C illustrate that by long pressing on a blank area in panel 512, the electronic device is triggered to display panel 518, which includes all the contents of text 511. In some embodiments, panel 518 shown in b in Figure 5C and panel 512 shown in a in Figure 5C can be the same panel, the difference being that none of the text in panel 518 is in a selected state, while the text in panel 512 is in a selected state. In other embodiments, panel 518 shown in b in Figure 5C and panel 512 shown in a in Figure 5C are not the same panel. When panel 518 is displayed, panel 512 disappears. In addition, a in Figure 5C is the same as b in Figure 5A above. For details, please refer to the previous introduction to a in Figure 5A, which will not be repeated here.
[0191] Refer to Figure 5D, which is a schematic diagram of another set of operation interfaces for transmitting fully selected text provided in an embodiment of the present application.
[0192] Figures c and d in Figure 5D show dragging panel 518 to the target area in the Any Door and releasing it to transfer the entire text. Figures c and d in Figure 5D are similar to g and h in Figure 5B above, except that the content being dragged and shared is different. Here, the entire text in panel 518 is dragged and shared, while the previously dragged and shared content is equivalent to a portion of the content in panel 518. For other similarities, please refer to the previous description of g and h in Figure 5B, which will not be repeated here.
[0193] In one practicable manner, after the electronic device displays the panel 518 shown in b in FIG. 5C , and before detecting the operation of dragging the panel 518 shown in c in FIG. 5D , the user can long press a blank area of the panel 512 to trigger the display of the panel 518 and then directly start dragging the panel 518 without releasing the hand, or the user can long press a blank area of the panel 512 to trigger the display of the panel 518 and then release the hand, and start dragging the panel 518 within 3 seconds after releasing the hand, and the embodiment of the present application does not limit this. Optionally, the duration for which the panel 518 remains displayed may be other than 3 seconds, and the embodiment of the present application does not limit this.
[0194] Other ways to share content
[0195] The aforementioned Figures 5B and 5D only use the "smart flow service" as an example to introduce the operation method of transmitting the selected text. In addition, the electronic device can also transmit the selected text through methods such as "cross-device transmission service" or "split-screen transmission service". The operation methods corresponding to the latter two methods are similar to the operation method shown in Figure 5B described above. The difference is that the panel 514 corresponding to the selected content needs to be dragged to a target area different from the aforementioned light band 515 for release, and the target object of sharing is also different. Taking the "cross-device transmission service" as an example, the target area can also be the edge area of the local electronic device (the edge area is specifically the area where the neighboring device is close to the local device), and the target object is the neighboring device for collaborative processing. Taking the "split-screen transmission service" as an example, the target area can be another split-screen area of the electronic device, and the target object is the object in the other split-screen area.
[0196] In an embodiment of the present application, the custom name involved in the aforementioned text content processing method 3 can also be called other names, as follows: the application providing the interface 50 can also be called the first application, and the text 511 can also be called the first text.
[0197] 4. FIG. 6A to FIG. 6D are operation interfaces involved in the fourth content processing method.
[0198] (1) In the text content processing method 4, for the floating panel containing the selected text, the user can edit the panel to further freely select text through the panel, and then drag the freely selected text to the target area to share it with the target object. For details, please refer to the description of Figures 6A-6B below.
[0199] (2) In text content processing method 4, for the floating panel containing all selected text, the user can also long press a blank area of the panel to drag the panel to the target area to share it with the target object. For details, see the description of Figures 6C and 6D below.
[0200] Refer to FIG6A , which is a schematic diagram of another set of operation interfaces for freely selecting text provided in an embodiment of the present application.
[0201] 6A a shows an interface 60 of an electronic device displaying an application. Specifically, the interface 60 includes text 611, which can be displayed through a text-type control provided by the application. The application interface 60 can specifically be an interface provided by a system-level application or a third-party application, and this embodiment of the application does not limit this. If the electronic device detects a long press operation on the text 611, in response to the long press operation, the electronic device displays a panel, as shown in b in FIG6A.
[0202] 6A b shows a panel 612 displayed by the electronic device. Specifically, in response to a long press operation on the text 611, the electronic device displays a panel 612 on the upper layer of the interface 50. The panel 612 includes text 611, a cursor 613A, and a cursor 613B. The text between the cursor 613A and the cursor 613B is the selected text. The selected text between the cursor 613A and the cursor 613B can be defaulted to the text corresponding to the long press operation input by the user, and the process of displaying the panel 612 gives the user a floating visual experience, that is, the panel 612 is equivalent to a suspended interface element. In some embodiments, the panel 612 can also be implemented as a text-type control containing the text 611, or an image-type control such as a preview or thumbnail containing the text 611. In some embodiments, after displaying the panel 612, if it is detected that the user ends the long press operation (i.e., the user releases the hand), the panel 612 may continue to be displayed for a preset period of time (e.g., 3 seconds) and then disappear; if it is detected that the user does not release the hand and drags the panel 612, or if it is detected that the panel 612 is dragged within a preset period of time (e.g., 3 seconds) after the hand is released, the panel 612 will move the display area along the user's dragging trajectory.
[0203] Figure 6A, c, shows an operation interface displayed by an electronic device when freely selecting text. Specifically, the electronic device can adjust the selected state of the text 611 in the panel 612 based on the operation of the cursor 613A and / or 613B in the sliding panel 612. The text in the selected state is the target text described in this application. In some embodiments, in addition to adjusting the selected target text by sliding the cursor 613A or the cursor 613B, the user can also input other editing operations, such as deletion, writing, etc., which are not limited in this embodiment of the application.
[0204] Refer to FIG6B , which is a schematic diagram of another set of operation interfaces for transmitting freely selectable text provided in an embodiment of the present application.
[0205] Figure 6B (e) shows the operation interface of the electronic device that triggers the dragging of the target text. Specifically, when a long press operation is detected on the target text, the electronic device can display a suspended panel 614 corresponding to the target text. During the display of panel 614, panel 612 stops displaying, but the original text 611 in interface 60 does not stop displaying, thereby giving the user a visual effect that the text other than the target text in panel 612 sinks from panel 612. The panel 614 can be located at the position of the touch point acting on the display screen when the user inputs a long press operation. The panel 614 includes the target text. Optionally, when the content of the target text is relatively large, part of the target text can be displayed in panel 614, such as the first sentence of the target text, or a summary of the target text. In some embodiments, panel 614 can also be implemented as a text control of the target text, or an image control such as a preview or thumbnail of the target text.
[0206] Figures f and g in Figure 6B show the operation interface of dragging the target text to the arbitrary door hot zone displayed by the electronic device. Specifically, after the electronic device displays the suspended panel 614, as the user drags the panel 614, the electronic device can display a light strip 615, which is used to guide the user to drag the panel 614 to the arbitrary door hot zone to trigger the opening of the arbitrary door (i.e., to open the smart flow service). The light strip 615 can be an interface element with attributes such as color, shadow, gradient, graphic fill (such as grid fill, diagonal fill), etc. In some embodiments, the light strip 615 can also present dynamic effects, such as changing the display area, color, etc. For example, the light strip can change the display area as the panel 614 is dragged, giving the user an operational experience of adsorbing the suspended panel 614. In some embodiments, during the process of dragging the panel 614, the display form of the panel 614 will switch, including switching the display size and / or display content. For example, when the panel 614 is dragged from its initial position toward the light band 615, the size of the panel 614 will be reduced from the size shown in f in FIG. 6B to the size shown in g in FIG. 6B, and the text contained therein will also be reduced from the content shown in f in FIG. 6B to the content shown in g in FIG. 6B. The embodiment of the present application does not specifically limit the change in the display form of the panel 614 during the dragging process. In other embodiments, the light band 615 may also be a transparent area so as not to block the interface elements displayed in the lower layer of the light band 615.
[0207] Figure 6B h shows the operation interface of opening any door for transmission displayed by the electronic device. Specifically, when the electronic device detects that the panel 614 is dragged to the light strip 615, it triggers the electronic device to open any door, and the opened door displays a menu bar 616 including icons of one or more candidate applications. The menu bar 616 may include a favorites icon, a search icon, a share icon, a note icon, an information icon, a shopping icon, a print icon, and an email icon, etc. In addition, when the electronic device detects that the user continues to drag the panel 614 to the icon of any candidate application in the menu bar 616 (for example, the note application icon, i.e., the target area) and releases it, the electronic device can confirm that the note application is the target object. Subsequently, the electronic device can transfer the text corresponding to the panel 614 (i.e., the target text) to the note application, and can also output corresponding prompt information 617. Not limited to outputting prompt information 617, in some other embodiments, the electronic device can also display a window provided by the target object, or directly jump to the interface provided by the target object.
[0208] Continuing to refer to h in Figure 6B, the favorite application corresponding to the favorite icon in the menu bar 616 can be a system application, which provides a global system favorite function. The note application corresponding to the note icon can be a system application or a third-party application, which can provide in-application recording, collection and other functions. Candidate applications are applications that support receiving data to be transmitted, which are screened out by the electronic device from all installed applications. The electronic device can determine the candidate application based on the information type, semantic information, etc. of the data to be transmitted. The candidate applications may include global applications that support receiving any type of data (such as favorite applications, search applications, sharing applications, email applications, etc.), and may also include applications that only support receiving some types of data (such as picture editing applications that only support receiving pictures, navigation applications that only support receiving text, etc.). Different data to be transmitted can correspond to different menu bars.
[0209] Continuing with reference to h in FIG6B , while the electronic device displays a menu bar 616 containing icons of candidate applications, the electronic device may adjust the original foreground user interface to a right perspective style, thereby visually forming an "opening door" animation effect with the menu bar 616. The foreground user interface may refer to an interface consisting of other content displayed on the display screen excluding the status bar, or may refer to all content displayed on the display screen including the status bar, and this embodiment of the application is not limited thereto.
[0210] Continuing with reference to h in FIG6B , while the electronic device displays menu bar 416 including icons of candidate applications, the electronic device may adjust the original foreground user interface to a right perspective style, thereby visually forming an "opening door" animation effect with the menu bar 416. The foreground user interface may refer to an interface consisting of other content displayed on the display screen excluding the status bar, or may refer to all content displayed on the display screen including the status bar, and this embodiment of the application is not limited thereto.
[0211] Refer to Figure 6C, which is a schematic diagram of another set of operation interfaces for selecting all texts provided in an embodiment of the present application.
[0212] Figures a and b in Figure 6C illustrate that a long press operation on a blank area in panel 612 triggers the electronic device to display panel 618, which includes all the contents of text 611. In some embodiments, panel 618 shown in b in Figure 6C and panel 612 shown in a in Figure 6C may be the same panel, the difference being that none of the text in panel 618 is selected, while the text in panel 612 is selected. In other embodiments, panel 618 shown in b in Figure 6C and panel 612 shown in a in Figure 6C are not the same panel. When panel 618 is displayed, panel 612 disappears. In addition, a in Figure 6C is the same as b in Figure 6A above. For details, please refer to the previous introduction to a in Figure 6A, which will not be repeated here.
[0213] Refer to Figure 6D, which is a schematic diagram of another set of operation interfaces for transmitting fully selected text provided in an embodiment of the present application.
[0214] Figures c and d in Figure 6D show dragging panel 618 to the target area in any door and releasing it to transfer the entire text. Figures c and d in Figure 6D are similar to g and h in Figure 6B above, except that the content being dragged and shared is different. Here, the entire text in panel 618 is dragged and shared, while the content previously shared by dragging and sharing is equivalent to a portion of the content in panel 618. For other similarities, please refer to the previous description of g and h in Figure 6B, which will not be repeated here.
[0215] In one practicable manner, after the electronic device displays the panel 618 shown in b in FIG. 6C , and before detecting the operation of dragging the panel 618 shown in c in FIG. 6D , the user can long press a blank area of the panel 612 to trigger the display of the panel 618 and then directly start dragging the panel 618 without releasing the hand, or the user can long press a blank area of the panel 612 to trigger the display of the panel 618 and then release the hand, and start dragging the panel 618 within 3 seconds after releasing the hand, and the embodiment of the present application does not limit this. Optionally, the duration for which the panel 612 remains displayed may be other than 3 seconds, and the embodiment of the present application does not limit this.
[0216] Other ways to share content
[0217] The aforementioned Figures 6B and 6D only use the "smart flow service" as an example to introduce the operation method of transmitting the selected text. In addition, the electronic device can also transmit the selected text through methods such as "cross-device transmission service" or "split-screen transmission service". The operation methods corresponding to the latter two methods are similar to the operation method shown in Figure 6B described above. The difference is that the panel 614 corresponding to the selected content needs to be dragged to a target area different from the aforementioned light band 615 for release, and the target object of sharing is also different. Taking the "cross-device transmission service" as an example, the target area can also be the edge area of the local electronic device (the edge area is specifically the area where the neighboring device is close to the local device), and the target object is the neighboring device for collaborative processing. Taking the "split-screen transmission service" as an example, the target area can be another split-screen area of the electronic device, and the target object is the object in the other split-screen area.
[0218] In an embodiment of the present application, the custom name involved in the aforementioned text content processing method 4 can also be called other names, as follows: the application providing the interface 60 can also be called the first application, and the text 611 can also be called the first text.
[0219] The previous article only uses text content as an example to introduce the content processing method provided by this application. The following describes in detail the processing method for image content. Similar to the method used for processing text content, for image content, the user can also long press the image to trigger the display of a floating panel containing the image, and then drag the panel to the target area to share it with the target object. For details, please refer to the detailed description of Figures 7A-7D below.
[0220] Refer to FIG7A , which is a schematic diagram of an operation interface for freely editing a set of images provided in an embodiment of the present application.
[0221] 7A a shows an interface 70 of an electronic device displaying an application. Specifically, the interface 70 includes an image 711, which can be displayed by an image-type control provided by the application. The application interface 70 can specifically be an interface provided by a system-level application or a third-party application, and this embodiment of the application does not limit this. If the electronic device detects a long press operation on the image 711, in response to the long press operation, the electronic device displays a panel, as shown in b in FIG7A.
[0222] Figure 7A b shows a panel 712 displayed by an electronic device. Specifically, in response to a long press operation on the image 711, the electronic device displays a panel 712 and an icon 713 on the upper layer of the interface 30. The panel 712 includes the image 711, and the process of displaying the panel 712 gives the user a floating visual experience, that is, the panel 712 is equivalent to a suspended interface element. In some embodiments, the panel 712 can also be implemented as an image-type control containing the image 711. In some embodiments, after displaying the panel 712, if it is detected that the user ends the long press operation (i.e., the user leaves the hand), the panel 712 can continue to display for a preset time (e.g., 3 seconds) and then disappear; if it is detected that the user does not leave the hand and drags the panel 712, or if it is detected that the panel 712 is dragged within a preset time (e.g., 3 seconds) after leaving the hand, the panel 712 will move the display area along the user's dragging trajectory.
[0223] 7A c shows an operation interface when the electronic device displays the drag panel 712. Specifically, when detecting the operation of dragging the panel 712, the electronic device further displays an icon 713, which is used to instruct the user to continue dragging the panel 712 into the hot zone of the icon 713 to edit the image 711.
[0224] d in FIG7A shows an editing interface 71 displayed by an electronic device. Specifically, when the operation of dragging the panel 712 to the hot zone of the icon 713 is detected, the electronic device displays the editing interface 71, which includes: an editing panel 714 and multiple editing controls, such as a shape capture control in the toolbar 715A, a pen-shaped control, a color control, a thickness control, and the like in the toolbar 715B. The user can freely edit the image by using various tools in the toolbar 715A and the toolbar 715B. Before editing the image in the editing panel 714, the image is the same as the aforementioned image 711. After editing the image in the editing panel 714, the image is the target image obtained after editing the image 711. d in FIG7A only shows an editing operation such as a graffiti arrow as an example. This application does not limit the editing operation of the image.
[0225] Refer to FIG. 7B , which is a schematic diagram of an operation interface for transmitting freely editable images provided in an embodiment of the present application.
[0226] 7B e shows an operation interface for triggering the dragging of a target image displayed by an electronic device. Specifically, upon detecting a long press operation on a target image (i.e., an image freely edited in panel 714), the electronic device may display a suspended panel 716 corresponding to the target image. The panel 716 may be located at the position of the touch point acting on the display screen when the user inputs a long press operation. The panel 716 includes a target image. Optionally, when the target image is much larger, a portion of the target image may be displayed in the panel 716, such as the central area of the target image. In some embodiments, the panel 716 may also be implemented as an image-type control of the target image.
[0227] Figures f and g in Figure 7B show the operation interface of the electronic device when dragging the panel 716. Specifically, after the electronic device displays the suspended panel 716, as the user drags the panel 716, the electronic device can display a light strip 717. The light strip 717 is used to guide the user to drag the panel 716 to any door hot zone to trigger the opening of any door (i.e., to start the smart flow service). The light strip 717 can be an interface element with attributes such as color, shadow, gradient, graphic fill (such as grid fill, diagonal fill), etc. In some embodiments, the light strip 717 can also present dynamic effects, such as changing the display area, color, etc. For example, the light strip can change the display area as the panel 716 is dragged, giving the user an operating experience of adsorbing the suspended panel 716. In other embodiments, the light strip 717 can also be an area with transparency, so that the interface elements displayed on the lower layer of the light strip 717 are not blocked.
[0228] Figure 7B h shows the operation interface of opening any door for transmission displayed by the electronic device. Specifically, when the electronic device detects that the panel 716 is dragged to the light strip 717, it triggers the electronic device to open any door, and the opened door displays a menu bar 718 including icons of one or more candidate applications. The menu bar 718 may include a favorites icon, a search icon, a share icon, a note icon, an information icon, a shopping icon, a print icon, and an email icon, etc. In addition, when the electronic device detects that the user continues to drag the panel 716 to the icon of any candidate application in the menu bar 718 (for example, the note application icon is the target area) and releases it, the electronic device can confirm that the note application is the target object. Subsequently, the electronic device can transfer the target image corresponding to the panel 716 to the note application and can also output corresponding prompt information 719. Not limited to outputting prompt information 719, in some other embodiments, the electronic device can also display the window provided by the target object, or directly jump to the interface provided by the target object.
[0229] Continuing to refer to e, f, g, and h in FIG7B , during the process of dragging panel 716, the display form of panel 716 will switch, including switching the display size and / or displayed content. For example, when panel 716 is dragged from the initial position toward light band 717, the size of panel 716 will be reduced from the size shown in e in FIG7B to the size shown in f in FIG7B ; for another example, when panel 716 is dragged close to the light band area, the size of panel 716 will be further reduced from f in FIG7B to the size shown in g in FIG7B . The embodiment of the present application does not specifically limit the change in the display form of panel 716 during the dragging process.
[0230] Continuing with reference to h in FIG. 7B , while displaying menu bar 718 containing icons of candidate applications, the electronic device may adjust the original foreground user interface to a right perspective style, thereby visually creating an "opening door" animation effect with the menu bar 718. The foreground user interface may refer to an interface consisting of other content displayed on the display screen excluding the status bar, or may refer to all content displayed on the display screen including the status bar, and this embodiment of the present application is not limited thereto.
[0231] Refer to Figure 7C, which is a schematic diagram of an operation interface for selecting a group of images provided in an embodiment of the present application.
[0232] Figures a and b in Figure 7C illustrate that a long press operation on image 711 triggers the electronic device to display panel 712, which includes image 711. Figures a and b in Figure 7C are the same as those in Figure 7A above. For details, please refer to the previous description of Figure 7A a and b, which will not be repeated here.
[0233] Refer to Figure 7D, which is a schematic diagram of a set of operation interfaces for directly transmitting selected images provided in an embodiment of the present application.
[0234] Figures c and d in Figure 7D show dragging panel 712 to the target area in any door and releasing it to transmit image 711. Figures c and d in Figure 7D are similar to g and h in Figure 7B above, except that the content being shared by dragging is different. Here, it is image 711 in panel 712, while the previously shared content was the target image in panel 716. For other similarities, please refer to the previous description of g and h in Figure 7B, which will not be repeated here.
[0235] In one practicable manner, after the electronic device displays the panel 712 shown in b in FIG. 7C , and before detecting the operation of dragging the panel 712 shown in c in FIG. 7D , the user can long-press the image 711 to trigger the display of the panel 712 without releasing the hand and directly start dragging the panel 712, or the user can long-press the image 711 to trigger the display of the panel 712 and release the hand, and start dragging the panel 712 within 3 seconds after releasing the hand, and the embodiment of the present application does not limit this. Optionally, the length of time that the panel 712 remains displayed can be other than 3 seconds, and the embodiment of the present application does not limit this.
[0236] From the above description, it can be seen that after implementing the method provided by this application, it can provide users with a more convenient and free content selection method, as well as a more convenient and rich content sharing method.
[0237] Based on the above introduction to the UI embodiment of the content processing method provided in this application, the form of the electronic device involved and its software and hardware architecture are introduced next.
[0238] Electronic equipment can be equipped or portable terminal devices with other operating systems, such as mobile phones, tablet computers, desktop computers, laptop computers, handheld computers, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, as well as cellular phones, personal digital assistants (PDAs), augmented reality (AR) devices, virtual reality (VR) devices, artificial intelligence (AI) devices, wearable devices, in-vehicle devices, smart home devices and / or smart city devices, etc.
[0239] FIG8 shows a schematic structural diagram of the electronic device 100 .
[0240] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a sensor module 180, a display screen 194, etc. The sensor module 180 may include a pressure sensor 180A, a touch sensor 180K, etc.
[0241] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0242] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0243] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0244] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0245] In the embodiment of the present application, the processor 110 is used to cooperate with the display screen 194, the touch sensor 180K, etc. to implement the aforementioned content processing method.
[0246] In some embodiments, the processor 110 may include one or more interfaces. The interface may include a universal serial bus (USB) interface, etc. The USB interface 130 is an interface that complies with USB standard specifications, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices.
[0247] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.
[0248] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0249] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD). The display screen panel can also be made of an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniLED, a microLED, a micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than one.
[0250] In an embodiment of the present application, the electronic device can output corresponding feedback information based on the detected operation control display screen 194, and the specific output can include but is not limited to the interfaces shown in Figures 1A-7D.
[0251] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).
[0252] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 via the external memory interface 120 to implement data storage. For example, files such as music and videos can be stored in the external non-volatile memory.
[0253] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be located on display screen 194. There are many types of pressure sensors 180A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force acts on pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the touch intensity based on pressure sensor 180A. Electronic device 100 can also calculate the touch location based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch location but with different touch intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, a command to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, a command to create a new short message is executed.
[0254] In the embodiment of the present application, the pressure sensor 180A may be used to detect various touch and press operations involved in the aforementioned FIG. 1A to FIG. 7D .
[0255] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a location different from that of the display screen 194.
[0256] In the embodiment of the present application, the touch sensor 180K is used to detect various touch and press operations involved in the aforementioned Figures 1A to 7D.
[0257] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.
[0258] FIG9 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application.
[0259] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0260] The application layer can include a series of application packages.
[0261] As shown in FIG9 , the application package may include but is not limited to applications such as the first application, settings, maps, and notes.
[0262] The first application is a third-party application or system application installed on the electronic device. In this embodiment of the application, a system application refers to an application directly provided by the operating system of the electronic device 100 for implementing a specific function. A third-party application refers to an application provided by other developers and obtained by the electronic device 100 via the internet for implementing a specific function. The first application can display a user interface as described in the UI implementation above.
[0263] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0264] As shown in Figure 9, the application framework layer may include a window manager, a view system, an intelligent flow service, a split-screen service, and a cross-device transmission service.
[0265] The view system includes visual controls, such as the controls for displaying text and images described above. The view system is used to build applications. A display interface can be composed of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying an image.
[0266] In an embodiment of the present application, the view system is used to construct a first application, which can then display the interface provided by the first application introduced above. The view system can also be used to construct and display various panels described in Figures 1A-7D, etc. These panels are provided by a second application installed in the electronic device other than the first application.
[0267] "Smart Flow Service" is a system service or system function provided by the electronic device in this application, which can support the electronic device to conveniently transfer content from one application to another. Specifically, the "Smart Flow Service" supports the electronic device to display one or more icons of applications that can be used to receive the above-mentioned content to be transferred on the display screen, and after detecting the operation of dragging the panel / element corresponding to the content to be transferred to the area where any application icon is located and releasing it, the content to be transferred will be shared with the corresponding application.
[0268] The "split-screen transmission service" can also be called the "multi-screen collaborative service", which can specifically provide the ability to share the content of this sub-screen with other sub-screens for collaborative processing.
[0269] "Cross-device transmission service" can also be called "multi-device collaborative service", which specifically provides the function of sharing the content of this device to other devices for collaborative processing.
[0270] Optionally, the content selection mentioned above can also be provided by "smart flow service", "split-screen transmission service" or "cross-device transmission service", or provided by a separate functional module. The separate functional module can work in conjunction with the aforementioned three services to provide users with a complete content processing method. For details about the content processing method, please refer to the description of the UI embodiment above, which will not be repeated here.
[0271] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (e.g., OpenGL ES), and a 2D graphics engine (e.g., SGL).
[0272] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.
[0273] It should be understood that each step in the above method embodiments provided herein can be implemented by hardware integrated logic circuits in a processor or by software instructions. The method steps disclosed in the embodiments of this application can be directly implemented as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.
[0274] The present application also provides a chip system, which includes at least one processor for implementing the functions involved in the method executed by the electronic device in any of the above embodiments.
[0275] The present application also provides a computer program product, which includes: a computer program (also referred to as code, or instruction), which, when executed, enables a computer to execute the method executed by the electronic device in any of the above embodiments.
[0276] The present application also provides a computer-readable storage medium storing a computer program (also referred to as code or instruction). When the computer program is executed, the computer executes the method executed by the electronic device in any of the above embodiments.
[0277] The various implementation modes of this application can be combined arbitrarily to achieve different technical effects.
[0278] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described herein are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive).
[0279] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0280] In short, the above description is only an embodiment of the technical solution of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of the present invention should be included in the scope of protection of the present invention.
Claims
1. A content processing method, characterized in that: Applied to electronic equipment, the method comprises: Displaying an interface of a first application, wherein the interface includes a first text; In response to a first operation acting on the first text, displaying a first panel, wherein the first panel includes the first text; In response to a second operation on the first panel, displaying a second panel, wherein the second panel includes the first text and a cursor; In response to an operation on the cursor, a target text is selected, wherein the target text is part or all of the first text.
2. The method according to claim 1, characterized in that The first operation is a long press operation.
3. The method according to claim 1 or 2, characterized in that: The second operation is an operation of dragging to the first area of the interface.
4. The method according to any one of claims 1 to 3, characterized in that Displaying the first panel includes: displaying the first panel on an upper layer of the interface; After displaying the first panel and before displaying the second panel, the method further includes: displaying the interface at a lower layer of the first panel.
5. The method according to any one of claims 1 to 4, characterized in that After displaying the second panel, the method further includes: stopping displaying the first panel.
6. The method according to any one of claims 1 to 5, characterized in that After the target text is selected, the method further includes: In response to a third operation acting on the target text, displaying a menu bar, wherein the menu bar includes an icon of a second application; In response to a fourth operation acting on the target text, the target text is shared to the second application.
7. The method according to claim 6, characterized in that The third operation is an operation of dragging to the second area of the interface.
8. The method according to claim 6 or 7, characterized in that: The fourth operation is to continue dragging to the icon of the second application and release it.
9. The method according to any one of claims 6 to 8, characterized in that: After the third operation, the method further includes: stopping displaying the second panel.
10. The method according to any one of claims 6 to 9, characterized in that: After the third operation and before the target text is shared to the second application, the method further includes: The target text is switched from a first display form to a second display form.
11. The method according to any one of claims 6 to 10, characterized in that: Before displaying the menu bar, the method further includes: displaying a light bar at the third area.
12. The method according to any one of claims 1 to 5, characterized in that After the target text is selected, the method further includes: In response to a fifth operation performed on the second panel, displaying a third panel, wherein the third panel includes the first text; In response to a third operation performed on the third panel, displaying a menu bar, wherein the menu bar includes an icon of a second application; In response to a fourth operation performed on the second panel, all text in the second panel is shared to the second application.
13. The method according to claim 12, characterized in that The fifth operation is an operation of long pressing the blank area.
14. The method according to claim 12 or 13, characterized in that The third operation is an operation of dragging to the second area of the interface.
15. The method according to any one of claims 12 to 14, characterized in that: The fourth operation is to continue dragging to the icon of the second application and release it.
16. The method according to any one of claims 12 to 15, characterized in that: After the third operation, the method further includes: stopping displaying the third panel.
17. The method according to any one of claims 12 to 16, characterized in that: After the third operation and before all text in the third panel is shared to the second application, the method further includes: The third panel switches from the third display mode to the fourth display mode.
18. The method according to any one of claims 12 to 17, characterized in that: Before displaying the menu bar, the method further includes: displaying a light bar at the fourth area.
19. The method according to claim 3, characterized in that The first area includes a first icon, and the first icon is used to prompt the user to edit text.
20. The method according to claim 3 or 19, characterized in that The first area is located below the screen of the electronic device.
21. The method according to any one of claims 1 to 20, characterized in that The first text is displayed in a non-editable control provided by the first application.
22. The method according to any one of claims 1 to 21, characterized in that The first panel and the second panel are provided by one of applications, services or components other than the first application.
23. The method according to any one of claims 1 to 22, characterized in that After the first operation and before displaying the first panel, the method further includes: taking a screenshot to obtain the first text.
24. A content processing method, characterized in that: Applied to electronic equipment, the method comprises: Displaying an interface of a first application, wherein the interface includes a first text; In response to a first operation acting on the first text, displaying a first panel, wherein the first panel includes the first text; In response to a third operation performed on the first panel, displaying a menu bar, wherein the menu bar includes an icon of a second application; In response to a fourth operation performed on the first panel, the first text is shared to the second application.
25. A content processing method, characterized in that: Applied to electronic equipment, the method comprises: Displaying an interface of a first application, wherein the interface includes a first text; In response to a first operation acting on the first text, displaying a first panel, wherein the first panel includes the first text; In response to an eleventh operation performed on the first panel, displaying a cursor in the first panel; In response to an operation on the cursor, the target text is selected, wherein the target text is part or all of the first text.
26. A content processing method, characterized in that: Applied to electronic equipment, the method comprises: Displaying an interface of a first application, wherein the interface includes a first text; In response to a first operation on the first text, displaying a first panel, wherein the first panel includes the first text and a cursor, and the first text is in a fully selected state; In response to an operation on the cursor, the target text is selected, wherein the target text is part or all of the first text.
27. A content processing method, characterized in that: Applied to electronic equipment, the method comprises: Displaying an interface of a first application, wherein the interface includes a first text; In response to a first operation on the first text, a first panel is displayed, wherein the first panel includes a first A text and a cursor, wherein a portion of the first text is in a selected state; In response to an operation on the cursor, the target text is selected, wherein the target text is part or all of the first text.
28. An electronic device, characterized in that: It comprises one or more processors and one or more memories; wherein, the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program codes, and the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the method described in any one of claims 1-27 is executed.
29. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the method according to any one of claims 1 to 27 is executed.
Citation Information
Patent Citations
Content processing method, graphical interface and electronic equipment
CN119987611A
Text information editing method and device, computer equipment and storage medium
CN110471609A
Text processing method and device and storage medium
CN110929484A
Information collection method and device and electronic equipment
CN111859202A
File dragging method and electronic equipment
CN114527901A