Interface element processing method and device, electronic equipment and storage medium
By using touch operations on electronic devices to identify objects to be processed from interface elements and display service entry points, the problem of low processing efficiency of interface elements is solved, enabling rapid processing and enhancing the perception capabilities of artificial intelligence programs.
Patent Information
- Application Number
- CN202410612869.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-16
- Publication Date
- 2025-11-18
AI Technical Summary
In existing technologies, the interface elements of electronic devices are processed inefficiently, the operation path is too long, the perception capabilities of artificial intelligence programs cannot be effectively utilized, and non-fixed document materials cannot be directly input for processing.
By performing touch operations on the user interface, the object to be processed is determined from the interface elements, and the service entry is displayed when the movement parameters meet the specified conditions. The object to be processed is then processed through the target service entry.
It improves the processing efficiency of interface elements, enables rapid processing of interface elements, and enhances the perception capabilities of artificial intelligence programs and the convenience of processing non-fixed document materials.
Smart Images

Figure CN120973284A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic device technology, and more specifically, to a method, apparatus, electronic device, and storage medium for processing interface elements. Background Technology
[0002] With the development of science and technology, electronic devices are becoming increasingly widespread and offer a wider range of services, making them an essential part of people's daily lives. In some scenarios, users may need to process interface elements through the services of electronic devices; however, the operation paths are often too long, leading to low processing efficiency for these interface elements. Summary of the Invention
[0003] In view of the above problems, this application proposes a method, apparatus, electronic device and storage medium for processing interface elements to solve the above problems.
[0004] In a first aspect, embodiments of this application provide a method for processing interface elements, the method comprising: displaying a user interface, wherein the user interface includes interface elements; responding to a touch operation applied to the interface elements, determining an object to be processed from the interface elements, and controlling the object to be processed to move based on the touch operation; displaying at least one service entry when the movement parameters of the object to be processed meet specified movement parameters; and processing the object to be processed through a target service corresponding to a target service entry, wherein the target service entry is the service entry among the at least one service entry that corresponds to the release position of the touch operation.
[0005] Secondly, embodiments of this application provide an interface element processing apparatus, the apparatus comprising: a user interface display module for displaying a user interface, wherein the user interface includes interface elements; a pending object determination module for determining a pending object from the interface elements in response to a touch operation applied to the interface elements, and controlling the pending object to move based on the touch operation; a service entry display module for displaying at least one service entry when the movement parameters of the pending object satisfy specified movement parameters; and an interface element processing module for processing the pending object through a target service corresponding to a target service entry, wherein the target service entry is the service entry among the at least one service entry that corresponds to the release position of the touch operation.
[0006] Thirdly, embodiments of this application provide an electronic device, including a memory and a processor, wherein the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the processor performs the above-described method.
[0007] Fourthly, embodiments of this application provide a computer-readable storage medium storing program code, which can be invoked by a processor to execute the above-described method.
[0008] The interface element processing method, apparatus, electronic device, and storage medium provided in this application embodiment display a user interface including interface elements, respond to touch operations applied to the interface elements, determine an object to be processed from the interface elements, control the object to be processed to move based on the touch operation, display at least one service entry when the movement parameters of the object to be processed meet specified movement parameters, and process the object to be processed through the target service corresponding to the target service entry. The target service entry is the service entry among at least one service entry that corresponds to the release position of the touch operation. Thus, by determining the object to be processed from the interface elements and selecting the target service entry from at least one service entry through touch operations applied to the user interface, the object to be processed can be processed quickly, thereby improving the processing efficiency of interface elements. Attached Figure Description
[0009] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0010] Figure 1 A flowchart illustrating a method for processing interface elements according to an embodiment of this application is shown.
[0011] Figure 2 A flowchart illustrating a method for processing interface elements according to an embodiment of this application is shown.
[0012] Figure 3 This application shows Figure 2 A flowchart illustrating steps S240 of the method for processing interface elements shown.
[0013] Figure 4 A flowchart illustrating a method for processing interface elements according to an embodiment of this application is shown.
[0014] Figure 5 A flowchart illustrating a method for processing interface elements according to an embodiment of this application is shown.
[0015] Figure 6 This application shows Figure 5 The flowchart of step S440 of the method for processing interface elements is shown.
[0016] Figure 7A flowchart illustrating a method for processing interface elements according to an embodiment of this application is shown.
[0017] Figure 8 This paper illustrates a first interface diagram of an electronic device provided in an embodiment of this application;
[0018] Figure 9 A schematic diagram of a second interface of an electronic device provided in an embodiment of this application is shown;
[0019] Figure 10 A schematic diagram of a third interface of an electronic device provided in an embodiment of this application is shown;
[0020] Figure 11 A schematic diagram of a fourth interface of the electronic device provided in an embodiment of this application is shown;
[0021] Figure 12 A schematic diagram of a fifth interface of the electronic device provided in an embodiment of this application is shown;
[0022] Figure 13 A block diagram of a device for processing interface elements according to an embodiment of this application is shown;
[0023] Figure 14 A block diagram of an electronic device for performing a method for processing interface elements according to an embodiment of this application is shown.
[0024] Figure 15 This application illustrates a storage unit for storing or carrying program code that implements a method for processing interface elements according to an embodiment of this application. Detailed Implementation
[0025] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.
[0026] Currently, electronic devices are generally equipped with artificial intelligence (AI) programs, which can provide corresponding services such as image and text recognition, image and text search, image and text editing, and image and text generation. In terms of industry application scenarios for AI programs on electronic devices, the following methods are generally used for processing (such as editing or secondary creation), as illustrated in the following examples:
[0027] First, users can manually add relevant materials to the AI program for processing. For example, they can manually add images or text to the AI process for further creation or to generate questions. Specifically, users can launch the AI program, click the corresponding add icon in the user interface, and then select to add materials such as images, text, and videos to the AI program—in other words, input the materials into the AI program.
[0028] Second, add corresponding materials to the AI program for processing by sharing / sending. For example, you can use images, text, videos and other materials as input by sending or sharing them into the AI program.
[0029] Understandably, in terms of user intent or operational efficiency, the above methods do not incorporate system-level interaction methods, and therefore have at least the following drawbacks:
[0030] First, AI's perception is weak and it cannot reflect the performance of the AI era.
[0031] Secondly, the path for identifying user intent based on content is too long, requiring input before processing, which is too detached from the system.
[0032] Third, non-fixed document / resource materials cannot be directly input into AI programs for processing, such as cut-out images. Specifically, electronic device photo albums generally support cut-out capabilities, but they lack interactive features after cut-out. Furthermore, users may have various types of intentions regarding the cut-out images, but cut-out images cannot be directly input into AI programs for subsequent services such as intent recognition.
[0033] To address the aforementioned problems, the inventors, through extensive research, discovered and proposed the interface element processing method, apparatus, electronic device, and storage medium provided in the embodiments of this application. By using touch operations applied to the user interface to determine the object to be processed from the interface elements and selecting a target service entry from at least one service entry, the processing efficiency of the interface elements can be improved through rapid processing of the object to be processed. The specific interface element processing method will be described in detail in the subsequent embodiments.
[0034] Please see Figure 1 , Figure 1 This diagram illustrates a flowchart of a method for processing interface elements according to an embodiment of this application. The method is used to determine the object to be processed from interface elements and select a target service entry from at least one service entry point through touch operations applied to the user interface, thereby enabling rapid processing of the object and improving the processing efficiency of interface elements. In a specific embodiment, this method for processing interface elements is applied to, for example... Figure 13The interface element processing device 200 shown and the electronic device 100 configured with the interface element processing device 200 ( Figure 14 The following will use an electronic device as an example to illustrate the specific process of this embodiment. Of course, it is understood that the electronic device used in this embodiment may include smartphones, tablets, wearable electronic devices, etc., and is not limited thereto. The following will focus on... Figure 1 The process shown is described in detail, and the method for processing interface elements may specifically include the following steps:
[0035] Step S110: Display the user interface, wherein the user interface includes interface elements.
[0036] In this embodiment, a user interface may be displayed. Optionally, the user interface may include the system desktop, lock screen, application pages, etc., and is not limited thereto.
[0037] The user interface may include interface elements. Optionally, the number of interface elements may be one or more, which is not limited here.
[0038] In some implementations, if the user interface is a system desktop, the interface elements included in the user interface may include: application icons, system desktop components, custom desktop components, etc., without limitation. If the user interface is a lock screen, the interface elements included in the user interface may include: time components, date components, weather components, etc., without limitation. If the user interface is an application page, the application type corresponding to the application page may include video type, instant messaging type, search type, photo album type, navigation type, shopping type, etc., and the interface elements included in the user interface may include: images, videos, text, etc., without limitation.
[0039] As one possible approach, a user interface can be displayed when a touch operation on a touchscreen is detected; a user interface can be displayed when a press operation on a physical button is detected; a user interface can be displayed when a lift operation on an electronic device is detected; a user interface can be displayed when the current time meets a preset time; a user interface can be displayed when the current location meets a preset location, etc., without limitation.
[0040] Step S120: In response to a touch operation applied to the interface element, determine the object to be processed from the interface element, and control the object to be processed to move based on the touch operation.
[0041] In this embodiment, during the display of the user interface, touch operations applied to the user interface can be detected. Specifically, if a touch operation is detected on an interface element, the system can respond to the touch operation, determine the object to be processed from the interface elements, and control the object to be processed to move based on the touch operation.
[0042] In some implementations, during the display of the user interface, touch operations applied to the user interface can be detected in real time; touch operations applied to the user interface can be detected at preset time intervals; touch operations applied to the user interface can be detected at preset time points; touch operations applied to the user interface can be detected according to other preset conditions, etc., without limitation.
[0043] Optionally, determining the object to be processed from the interface elements may include: determining the entire interface element as the object to be processed, or determining one or more sub-interface elements within the interface element as the object to be processed, without limitation.
[0044] As an feasible approach, if a touch operation is detected on an interface element, the touch position corresponding to the touch operation on the interface element can be determined, and the object to be processed can be determined from the interface element based on the touch position.
[0045] As another feasible approach, if a touch operation is detected on an interface element, the touch position corresponding to the touch operation on the interface element can be determined, as well as the touch area corresponding to the touch position on the interface element. The size of the touch area is larger than the size of the touch position. Based on the touch area, the object to be processed is determined from the interface element. Optionally, determining the touch area corresponding to the touch position on the interface can include: expanding outward by a preset size from the touch position as the center to form a touch area larger than the touch position; expanding outward by a preset size in a specified direction from the touch position as the edge to form a touch area larger than the touch position, etc., without limitation.
[0046] As one feasible approach, once the object to be processed is determined from the interface elements, the drag direction corresponding to the touch operation can be determined, and the object to be processed can be controlled to move based on that drag direction. The movement direction of the object to be processed can be the same as the drag direction.
[0047] As another feasible approach, when the object to be processed is determined from the interface elements, the drag trajectory corresponding to the touch operation can be determined, and the object to be processed can be controlled to move based on the drag trajectory. The movement trajectory of the object to be processed can be the same as the drag trajectory.
[0048] As another feasible approach, when the object to be processed is determined from the interface elements, the drag speed corresponding to the touch operation can be determined, and the object to be processed can be controlled to move based on the drag speed. The movement speed of the object to be processed can be equal to or less than the drag speed.
[0049] In some implementations, during the process of controlling the movement of the object to be processed based on touch operation, the object to be processed can remain in its original display position; that is, the position where the user interface originally displayed the object to be processed remains unchanged. Optionally, when the object to be processed is determined from the interface elements, the object to be processed can be copied from the interface elements to obtain a copied object to be processed, and the copied object to be processed can be controlled to move based on touch operation. In this case, the original object to be processed continues to be displayed in its original position on the user interface.
[0050] Step S130: Display at least one service entry if the movement parameters of the object to be processed meet the specified movement parameters.
[0051] In some implementations, the electronic device may pre-set and store specified movement parameters, which are used as the basis for determining the movement parameters of the object to be processed. Therefore, in this embodiment, during the process of controlling the movement of the object to be processed based on touch operation, the movement parameters of the object to be processed can be obtained and compared with the specified movement parameters to determine whether the movement parameters meet the specified movement parameters. If it is determined that the movement parameters meet the specified movement parameters, it can be assumed that the user expects to call the corresponding program to process the object to be processed through the AI of the electronic device, and at least one service entry can be displayed. If it is determined that the movement parameters do not meet the specified movement parameters, it can be assumed that the user does not expect to call the corresponding program to process the object to be processed through the AI of the electronic device, and no service entry can be displayed.
[0052] Within this framework, users can access corresponding services through service entry points. Conversely, each entry point can lead to different services. The services associated with each entry point may include: image recognition, wallpaper generation, text recognition, text search, image search, etc., without further limitation.
[0053] Optionally, specifying movement parameters may include specifying the movement direction. During the movement of the object to be processed, the movement direction of the object to be processed can be obtained, and at least one service entry point can be displayed if the movement direction of the object to be processed is consistent with the specified movement direction.
[0054] Optionally, specifying movement parameters may include specifying movement distance. During the movement of the object to be processed, the movement distance of the object can be obtained, and at least one service entry point can be displayed when the movement distance of the object reaches the specified movement distance.
[0055] Optionally, specifying movement parameters may include specifying movement speed. During the movement of the object to be processed, the movement speed of the object can be obtained, and at least one service entry point can be displayed if the movement speed of the object matches the specified movement speed.
[0056] Optionally, specifying movement parameters may include specifying a movement trajectory. During the movement of the object to be processed, the movement trajectory of the object can be acquired, and at least one service entry point can be displayed if the movement trajectory of the object to be processed matches the specified movement trajectory.
[0057] Of course, specifying movement parameters can also include at least two of the following combinations: specifying movement direction, specifying movement distance, specifying movement speed, and specifying movement trajectory, which will not be elaborated here.
[0058] In some implementations, if the movement parameters of the object to be processed meet the specified movement parameters, at least one service entry can be displayed in a pop-up window on the user interface; at least one service entry can be displayed floating on the user interface, etc., without limitation.
[0059] In some implementations, when the movement parameters of the object to be processed meet the specified movement parameters, at least one service entry can be displayed in a specified bottom area of the user interface; at least one service entry can be displayed in a specified top area of the user interface; at least one service entry can be displayed in a specified left area of the user interface; at least one service entry can be displayed in a specified right area of the user interface; at least one service entry can be displayed in a specified middle area of the user interface, etc., without limitation. Optionally, the display area corresponding to the service entry matches the dragging direction of the touch operation. For example, if the dragging direction corresponding to the touch operation is towards the bottom of the user interface, the display area corresponding to the service entry can be the specified bottom area of the user interface; if the dragging direction corresponding to the touch operation is towards the top of the user interface, the display area corresponding to the service entry can be the specified top area of the user interface.
[0060] Step S140: Process the object to be processed through the target service corresponding to the target service entry, wherein the target service entry is the service entry among the at least one service entry that corresponds to the release position of the touch operation.
[0061] In this embodiment, during the display of at least one service entry point, it can be determined whether a release operation corresponding to a touch operation exists. If a release operation is determined to exist, the release position of the touch operation can be determined, and the service entry point corresponding to the release position of the touch operation can be selected as the target service entry point from the at least one service entry point. If no release operation is determined to exist, the object to be processed can continue to be controlled to move based on the touch operation.
[0062] In some implementations, during the display of at least one service entry point, it can be determined whether a touch operation applied to the object to be processed has disappeared. Specifically, if it is determined that the touch operation applied to the object to be processed has disappeared, it is determined that a release operation corresponding to the touch operation exists; if it is determined that the touch operation applied to the object to be processed has not disappeared, it is determined that no release operation corresponding to the touch operation exists.
[0063] In some implementations, if a release operation corresponding to a touch operation is determined, the release position corresponding to the touch operation and the display position corresponding to at least one service entry can be determined. Based on this, the release position is matched with the display position corresponding to each of the at least one service entry. If there is a service entry whose display position matches the release position, then the service entry whose display position matches the release position can be determined as the target service entry.
[0064] As an implementable approach, at least one display position corresponding to each service entry can be determined, and based on the display positions corresponding to each service entry, a display range corresponding to each service entry can be determined, wherein the display range corresponding to each service entry is larger than the display position corresponding to the service entry. Based on this, if a release operation corresponding to a touch operation is determined, the release position corresponding to that touch operation can be determined, and the release position can be matched with the display range corresponding to each of the at least one service entry. If there is a service entry whose display range includes the release position, then the service entry whose display range includes the release position can be determined as the target service entry.
[0065] In some implementations, when a target service entry is determined from at least one service entry, the object to be processed can be processed through the target service corresponding to the target service entry. For example, if the object to be processed is an image, optionally, if the target service corresponding to the target service entry is "image recognition", then image recognition can be performed on the object to be processed; if the target service corresponding to the target service entry is "generate wallpaper", then the object to be processed can be set as the wallpaper of the electronic device.
[0066] As one feasible approach, processing the object to be processed through the target service corresponding to the target service entry point can include: launching the target service page and processing the object to be processed on the target service page, such as querying the object to be processed on the target service page, etc., without limitation.
[0067] As one feasible approach, processing the object to be processed through the target service corresponding to the target service entry point can include: calling the target program corresponding to the target service entry point, and then having the target program process the object to be processed based on the target service. Optionally, the target program can be a system program of the electronic device or a third-party program installed on the electronic device; there is no limitation on this.
[0068] In this system, multiple programs on an electronic device can each provide one or more services, and these services can be displayed as service entry points in the user interface. Therefore, when a target service entry point is determined from the one or more service entry points displayed in the user interface, the target program corresponding to that target service entry point can be invoked, and the object to be processed can be processed by that target program based on the target service.
[0069] An embodiment of this application provides a method for processing interface elements, which displays a user interface including interface elements, responds to touch operations applied to the interface elements, determines an object to be processed from the interface elements, controls the object to be processed to move based on the touch operation, displays at least one service entry when the movement parameters of the object to be processed meet specified movement parameters, and processes the object to be processed through the target service corresponding to the target service entry. The target service entry is the service entry among the at least one service entry that corresponds to the release position of the touch operation. Thus, by determining the object to be processed from the interface elements and selecting the target service entry from at least one service entry through touch operations applied to the user interface, the object to be processed can be processed quickly, thereby improving the processing efficiency of interface elements.
[0070] Please see Figure 2 , Figure 2 A flowchart illustrating a method for processing interface elements according to an embodiment of this application is shown. The following will focus on... Figure 2 The process shown is described in detail, and the method for processing interface elements may specifically include the following steps:
[0071] Step S210: Display the user interface, wherein the user interface includes interface elements, and the interface elements include multiple sub-interface elements.
[0072] For a detailed description of step S210, please refer to step S110, which will not be repeated here.
[0073] Step S220: In response to a touch operation applied to the interface element, determine the positional relationship between the touch position of the touch operation and the display position of the plurality of sub-interface elements.
[0074] Optionally, a UI element may include multiple sub-UI elements. For example, if the UI element is a photo containing a dog, a cat, and a pig, then the image of the "dog," the image of the "cat," and the image of the "pig" can all be understood as sub-UI elements within that photo. As another example, if the UI element is a photo containing a dog and some text, then the image of the "dog" and the "text" can all be understood as sub-UI elements within that photo. Furthermore, if the UI element is multiple text segments, then each segment or each character within those text segments can be understood as a sub-UI element within the photo.
[0075] In this embodiment, during the display of the user interface, touch operations applied to the user interface can be detected. If a touch operation is detected on an interface element, the system can respond to the touch operation and determine the positional relationship between the touch position and the display positions of multiple sub-interface elements. Optionally, this positional relationship may include whether there is overlap or not. The existence of overlap can be partial or complete, and is not limited here.
[0076] In some implementations, if a touch operation is detected on an interface element, the system can respond to the touch operation by determining the touch position corresponding to the touch operation and the display positions corresponding to each of the multiple sub-interface elements. Then, the touch position is compared with the display positions corresponding to each of the multiple sub-interface elements to determine the positional relationship between the touch position and the display positions of the multiple sub-interface elements. As one possible implementation, a coordinate system can be established with the center of the electronic device as the origin, the axis of the electronic device as the X-axis, and the direction perpendicular to the axis of the electronic device as the Y-axis. Based on this, a first coordinate corresponding to the touch operation in this coordinate system and a second coordinate corresponding to each of the multiple sub-interface elements in this coordinate system can be determined. Then, the first coordinate is compared with the second coordinate corresponding to each of the multiple sub-interface elements to determine the positional relationship between the touch position and the display positions of the multiple sub-interface elements.
[0077] Step S230: Determine the object to be processed from the interface elements based on the positional relationship, and control the object to be processed to move based on the touch operation.
[0078] In this embodiment, given the positional relationship between the touch position of the touch operation and the display positions of multiple sub-interface elements, the object to be processed can be determined from the interface elements based on this positional relationship.
[0079] In some implementations, if the touch position of the touch operation does not overlap with the display positions of multiple sub-interface elements based on the positional relationship, then it can be considered that the entire interface element is to be processed, and the interface element can be identified as the object to be processed. For example, if the interface element is a photo including a dog, a cat, and a pig, and the touch position of the touch operation does not overlap with the display positions of the dog, cat, and pig based on the positional relationship (e.g., the touch position is in a blank area of the interface element), then the photo including the dog, cat, and pig can be identified as the object to be processed.
[0080] In some implementations, if the touch position of the touch operation overlaps with the display position of a target sub-interface element among multiple sub-interface elements based on the positional relationship, then it can be considered that the target sub-interface element is to be processed, and the target sub-interface element can be identified as the object to be processed. For example, if the interface element is a photo including a dog, a cat, and a pig, and the touch position of the touch operation overlaps with the display position of the dog based on the positional relationship, then the image of the dog can be identified as the object to be processed.
[0081] Please see Figure 3 , Figure 3 This application shows Figure 2 The flowchart illustrates step S230 of the method for processing interface elements. The following will focus on... Figure 3 The process shown will be described in detail, and the method may specifically include the following steps:
[0082] Step S231: If the target sub-interface element is determined to be the object to be processed, then the target sub-interface element is extracted from the interface elements.
[0083] In some implementations, if a target sub-interface element is identified as the object to be processed, the target sub-interface element can be extracted from the interface elements.
[0084] As a feasible approach, electronic devices can possess image matting capabilities. When a target sub-interface element within an interface element is identified as the object to be processed, this matting capability can be used to extract the target sub-interface element from the interface element.
[0085] In some implementations, if a target sub-interface element is identified as the object to be processed, the target sub-interface element can be extracted from the interface elements and highlighted within the interface elements. Optionally, highlighting the sub-interface element may include: displaying the target sub-interface element with a box, flashing the target sub-interface element, or bolding the target sub-interface element, etc., and is not limited here.
[0086] Specifically, during the process of highlighting the target sub-interface element, if an input modification operation is detected, the system can respond to the input modification operation, modify the target sub-interface element to obtain the modified target sub-interface element, and extract the modified target sub-interface element from the interface elements. Optionally, modifying the target sub-interface element may include: increasing the size of the target sub-interface element, decreasing the size of the target sub-interface element, redetermining the target sub-interface element from the interface elements, etc., which are not limited here.
[0087] Step S232: Control the target sub-interface element to move based on the touch operation.
[0088] In some implementations, when a target sub-interface element is extracted from the interface elements, the target sub-interface element can be controlled to move based on the touch operation.
[0089] As one feasible approach, after extracting the target sub-interface element from the interface elements, the drag direction corresponding to the touch operation can be determined, and the target sub-interface element can be controlled to move based on that drag direction. The movement direction of the target sub-interface element can be the same as the drag direction.
[0090] As another feasible approach, when the target sub-interface element is extracted from the interface elements, the drag trajectory corresponding to the touch operation can be determined, and the target sub-interface element can be controlled to move based on the drag trajectory. The movement trajectory of the target sub-interface element can be the same as the drag trajectory.
[0091] As another feasible approach, when the target sub-interface element is extracted from the interface elements, the drag speed corresponding to the touch operation can be determined, and the target sub-interface element can be controlled to move based on the drag speed. The movement speed of the target sub-interface element can be equal to or less than the drag speed.
[0092] In some implementations, during the process of controlling the target sub-interface element to move based on touch operations, the target sub-interface element can remain in its original display position; that is, the position where the target sub-interface element was originally displayed on the user interface remains unchanged. Optionally, when the target sub-interface element is extracted from the interface elements, it can be copied to obtain a copied target sub-interface element, and the copied target sub-interface element can be controlled to move based on touch operations. In this case, the original target sub-interface element continues to be displayed in its original position on the user interface.
[0093] Step S240: Display at least one service entry if the movement parameters of the object to be processed meet the specified movement parameters.
[0094] Step S250: Process the object to be processed through the target service corresponding to the target service entry, wherein the target service entry is the service entry among the at least one service entry that corresponds to the release position of the touch operation.
[0095] For a detailed description of steps S240-S250, please refer to steps S130-S140, which will not be repeated here.
[0096] An embodiment of this application provides a method for processing interface elements, displaying a user interface, wherein the user interface includes interface elements, and the interface elements include multiple sub-interface elements. In response to a touch operation applied to the interface elements, the method determines the positional relationship between the touch position of the touch operation and the display positions of the multiple sub-interface elements. Based on the positional relationship, it determines an object to be processed from the interface elements and controls the object to be processed to move based on the touch operation. If the movement parameters of the object to be processed meet specified movement parameters, at least one service entry is displayed. The object to be processed is then processed through a target service corresponding to the target service entry, wherein the target service entry is the service entry among at least one service entry that corresponds to the release position of the touch operation. Compared to... Figure 1 The method for processing interface elements shown in this embodiment further includes setting the interface elements to include multiple sub-interface elements, and determining the interface element or sub-interface element as the object to be processed based on the positional relationship between the touch position of the touch operation and the display position of the multiple sub-interface elements, thereby improving the diversity and efficiency of interface element processing.
[0097] Please see Figure 4 , Figure 4 A flowchart illustrating a method for processing interface elements according to an embodiment of this application is shown. The following will focus on... Figure 4 The process shown is described in detail, and the method for processing interface elements may specifically include the following steps:
[0098] Step S310: Display the user interface, wherein the user interface includes interface elements.
[0099] Step S320: In response to a touch operation applied to the interface element, determine the object to be processed from the interface element, and control the object to be processed to move based on the touch operation.
[0100] For a detailed description of steps S310-S320, please refer to steps S110-S120, which will not be repeated here.
[0101] Step S330: If the movement parameters of the object to be processed meet the specified movement parameters, determine the attribute information corresponding to the object to be processed, and display the service entry corresponding to the service that matches the attribute information.
[0102] In this embodiment, during the process of controlling the movement of the object to be processed based on touch operation, it is possible to detect whether the movement parameters of the object to be processed meet the specified movement parameters. If it is determined that the movement parameters of the object to be processed meet the specified movement parameters, the attribute information corresponding to the object to be processed can be determined, as well as the service matching the attribute information. Optionally, the attribute information corresponding to the object to be processed may include: text attributes, image attributes, etc., which are not limited here.
[0103] In some implementations, if the movement parameters of the object to be processed meet specified movement parameters, the content contained in the object to be processed can be analyzed to obtain analysis results, and the attribute information corresponding to the object to be processed can be determined based on the analysis results. As an example, if the analysis results indicate that the object to be processed contains "text", then the attribute information corresponding to the object to be processed can be determined to be a text attribute; if the analysis results indicate that the object to be processed does not contain "text", then the attribute information corresponding to the object to be processed can be determined to be an image attribute.
[0104] In some implementations, the electronic device may pre-set and store mapping relationships. These mapping relationships may include multiple attribute information, multiple services, and correspondences between these attribute information and services. The correspondence may include one attribute information corresponding to one service, one attribute information corresponding to multiple services, or multiple attribute information corresponding to one service, etc., without limitation. In this embodiment, when the attribute information corresponding to the object to be processed is determined, services that correspond to the attribute information of the object to be processed can be determined based on this mapping relationship, and these services are identified as matching the attribute information of the object to be processed.
[0105] In some implementations, the electronic device may be equipped with a target algorithm. When the attribute information corresponding to the object to be processed is determined, the target algorithm can be used to calculate the attribute information to determine the service that matches the attribute information corresponding to the object to be processed.
[0106] In some implementations, once the attribute information corresponding to the object to be processed is determined, intent recognition can be performed on the attribute information to determine the service that matches the attribute information corresponding to the object to be processed. Optionally, intent recognition can be performed on the attribute information based on entity annotation and intent recognition; intent recognition can be performed on the attribute information based on a dictionary and template; intent recognition can be performed on the attribute information based on machine learning, etc., without limitation.
[0107] Optionally, if the attribute information of the object to be processed is determined to be a text attribute, the services that match the attribute information may include: text recognition, text query, text translation, etc.; if the attribute information of the object to be processed is determined to be an image attribute, the services that match the attribute information may include: image recognition, setting as wallpaper, etc., without limitation.
[0108] In this embodiment, if a service matching the attribute information is identified, the service entry corresponding to that service can be displayed. Optionally, if a service matching the attribute information is identified, a service entry corresponding to that service can be generated and displayed.
[0109] Step S340: Process the object to be processed through the target service corresponding to the target service entry, wherein the target service entry is the service entry among the at least one service entry that corresponds to the release position of the touch operation.
[0110] For a detailed description of step S340, please refer to step S140, which will not be repeated here.
[0111] An embodiment of this application provides a method for processing interface elements, displaying a user interface, wherein the user interface includes interface elements, responding to touch operations applied to the interface elements, determining a to-be-processed object from the interface elements, controlling the to-be-processed object to move based on the touch operation, determining the attribute information corresponding to the to-be-processed object when the movement parameters of the to-be-processed object meet specified movement parameters, and displaying a service entry corresponding to a service matching the attribute information, processing the to-be-processed object through a target service corresponding to the target service entry, wherein the target service entry is at least one service entry corresponding to the release position of the touch operation. Compared to Figure 1 The method for processing interface elements shown in this embodiment also determines and displays the corresponding service entry based on the attributes of the object to be processed, thereby improving the accuracy of the services provided.
[0112] Please see Figure 5 , Figure 5 A flowchart illustrating a method for processing interface elements according to an embodiment of this application is shown. The following will focus on... Figure 5 The process shown is described in detail, and the method for processing interface elements may specifically include the following steps:
[0113] Step S410: Display the user interface, wherein the user interface includes interface elements.
[0114] Step S420: In response to a touch operation applied to the interface element, determine the object to be processed from the interface element, and control the object to be processed to move based on the touch operation.
[0115] For a detailed description of steps S410-S420, please refer to steps S110-S120, which will not be repeated here.
[0116] Step S430: Determine the movement direction of the object to be processed.
[0117] In this embodiment, when an object to be processed is determined, the object to be processed can be controlled to move based on the touch operation, and the movement direction of the object to be processed can be determined during the movement of the object to be processed.
[0118] In some implementations, a touch sensor may be provided on the display screen of the electronic device, wherein the touch sensor is used to detect touch operations performed on the display screen. During the process of controlling the movement of the object to be processed based on the touch operation, the touch sensor can detect the movement data (such as movement trajectory) corresponding to the touch operation, and the movement direction of the object to be processed can be determined based on the movement data.
[0119] Step S440: If the movement direction satisfies the specified movement direction, display the at least one service entry.
[0120] In some implementations, the electronic device may pre-set and store a specified movement direction, which serves as the basis for determining the movement direction of the object to be processed. Therefore, in this embodiment, when the movement direction of the object to be processed is determined, this movement direction can be compared with the specified movement direction to determine whether the movement direction satisfies the specified movement direction. Optionally, if the movement direction is exactly the same as the specified movement direction or the deviation between the movement direction and the specified movement direction is within a specified range, it can be determined that the movement direction satisfies the specified movement direction; if the deviation between the movement direction and the specified movement direction is outside the specified range, it can be determined that the movement direction does not satisfy the specified movement direction.
[0121] If the movement direction is determined to meet the specified movement direction, it can be assumed that the user expects to use the AI of the electronic device to call the corresponding program to process the object to be processed, and at least one service entry point can be displayed. If the movement direction is determined not to meet the specified movement direction, it can be assumed that the user does not expect to use the AI of the electronic device to call the corresponding program to process the object to be processed, and no service entry point can be displayed.
[0122] Optionally, the specified direction of movement can be from the top of the electronic device to the bottom, or from the bottom of the electronic device to the top, etc.
[0123] In some implementations, when it is determined that the movement direction of the object to be processed meets the specified movement direction, a light effect can be displayed in the corresponding area of the display screen. The light effect indicates that the touch operation on the object to be processed meets the condition for triggering the processing of the object, so that the user can continue to control the object to be processed to move towards the displayed service entry through touch operation. For example, if the movement direction is towards the bottom of the electronic device, a light effect can be displayed in the bottom area of the display screen; if the movement direction is towards the top of the electronic device, a light effect can be displayed in the top area of the display screen, etc., without limitation.
[0124] Please see Figure 6 , Figure 6 This application shows Figure 5 The flowchart illustrates step S440 of the method for processing interface elements. The following will focus on... Figure 6 The process shown will be described in detail, and the method may specifically include the following steps:
[0125] Step S441: If the movement direction satisfies the specified movement direction, determine the movement distance of the object to be processed.
[0126] In some implementations, if the direction of movement of the object to be processed is determined to satisfy a specified direction of movement, the distance the object moves can be determined. Optionally, this distance can be the straight-line distance the object moves in that direction.
[0127] In some implementations, a touch sensor may be provided on the display screen of the electronic device, wherein the touch sensor is used to detect touch operations performed on the display screen. During the process of controlling the movement of the object to be processed based on the touch operation, the touch sensor can detect the movement data (such as movement trajectory) corresponding to the touch operation, and the movement distance of the object to be processed can be determined based on the movement data.
[0128] Step S442: If the travel distance reaches a distance threshold, display the at least one service entry point.
[0129] In some implementations, the electronic device may pre-set and store a distance threshold, which is used as a basis for determining the movement distance of the object to be processed. Therefore, in this embodiment, when the movement distance of the object to be processed is determined, the movement distance can be compared with the distance threshold to determine whether the movement distance has reached the distance threshold. Optionally, if the movement distance is equal to or greater than the distance threshold, it can be determined that the movement distance has reached the distance threshold; if the movement distance is less than the distance threshold, it can be determined that the movement distance has not reached the distance threshold.
[0130] If the movement distance is determined to reach a distance threshold, it can be assumed that the user expects to use the AI of the electronic device to call the corresponding program to process the object to be processed, and at least one service entry point can be displayed. If the movement distance is determined not to reach the distance threshold, it can be assumed that there may be a misoperation and the user does not expect to use the AI of the electronic device to call the corresponding program to process the object to be processed, and the service entry point can not be displayed.
[0131] Optionally, the distance threshold can include 7 density-independent pixels (dp), 8dp, etc. Here, dp is a unit of measurement used on platforms such as Android to describe the size of UI elements. It is designed to ensure that UI elements appear to be the same size on devices with different screen sizes and pixel densities.
[0132] Step S450: Process the object to be processed through the target service corresponding to the target service entry, wherein the target service entry is the service entry among the at least one service entry that corresponds to the release position of the touch operation.
[0133] For a detailed description of step S450, please refer to step S140, which will not be repeated here.
[0134] An embodiment of this application provides a method for processing interface elements, displaying a user interface, wherein the user interface includes interface elements, responding to touch operations applied to the interface elements, determining an object to be processed from the interface elements, controlling the object to be processed to move based on the touch operation, determining the movement direction of the object to be processed, and, if the movement direction satisfies a specified movement direction, displaying at least one service entry, and processing the object to be processed through a target service corresponding to the target service entry, wherein the target service entry is the service entry among at least one service entry that corresponds to the release position of the touch operation. Compared to Figure 1 The method for processing interface elements shown in this embodiment also displays a service entry when the movement direction of the object to be processed based on the touch operation meets the specified movement direction, so as to adapt to the user's interaction habits and improve the user experience.
[0135] Please see Figure 7 , Figure 7 A flowchart illustrating a method for processing interface elements according to an embodiment of this application is shown. In this embodiment, touch operations may include pressing and dragging operations. The following will focus on... Figure 7 The process shown is described in detail, and the method for processing interface elements may specifically include the following steps:
[0136] Step S510: Display the user interface, wherein the user interface includes interface elements.
[0137] For a detailed description of step S510, please refer to step S110, which will not be repeated here.
[0138] Step S520: In response to the press operation applied to the interface element, determine the press duration corresponding to the press operation.
[0139] In this embodiment, during the display of the user interface, touch operations applied to the user interface can be detected. Specifically, if a press operation is detected on an interface element, the press operation can be responded to, and the press duration corresponding to the press operation can be determined.
[0140] In some implementations, the electronic device may include a pressure sensor and a timer, wherein the pressure sensor is used to detect a pressing operation applied to the display screen, and the timer is used to keep track of the press duration. During the display of the user interface, the pressure sensor can detect pressing operations applied to the display screen. If a pressing operation applied to an interface element is detected by the pressure sensor, the timer can be started to keep track of the press duration to obtain the pressing operation.
[0141] Step S530: If the pressing duration reaches the duration threshold, the object to be processed is determined from the interface elements and the object to be processed is marked as selected.
[0142] In some implementations, the electronic device may pre-set and store a duration threshold, which is used as a basis for determining the press duration. Therefore, in this embodiment, when the press duration corresponding to the press operation is determined, the press duration can be compared with the duration threshold to determine whether the press duration has reached the duration threshold.
[0143] If the press duration reaches a threshold, the user can be considered to have confirmed the selection of the object to be processed. This object can then be identified from the interface elements and marked as selected. Optionally, marking the object as selected may include making it movable, enlarging its display, etc., without limitation.
[0144] If it is determined that the pressing duration has not reached the duration threshold, it can be assumed that the user has not confirmed the selection of the object to be processed. The timer for the pressing operation can be maintained until it is determined that the pressing duration has reached the duration threshold. Then, the object to be processed is determined from the interface elements and marked as selected.
[0145] Step S540: In response to the drag operation applied to the object to be processed, control the object to be processed to move based on the drag operation.
[0146] In some implementations, when an object to be processed is marked as selected, the object can be moved based on a drag operation applied to it. Optionally, when an object to be processed is marked as selected, the user can perform the drag operation while maintaining a press, or the user can release the press before performing the drag operation; this is not limited here.
[0147] Step S550: Display at least one service entry if the movement parameters of the object to be processed meet the specified movement parameters.
[0148] Step S560: Process the object to be processed through the target service corresponding to the target service entry, wherein the target service entry is the service entry among the at least one service entry that corresponds to the release position of the touch operation.
[0149] For a detailed description of steps S550-S560, please refer to steps S130-S140, which will not be repeated here.
[0150] An embodiment of this application provides a method for processing interface elements, displaying a user interface, wherein the user interface includes interface elements. In response to a press operation applied to the interface elements, the method determines the press duration corresponding to the press operation. If the press duration reaches a duration threshold, a to-be-processed object is determined from the interface elements and marked as selected. The to-be-processed object is controlled to move based on a touch operation. If the movement parameters of the to-be-processed object meet specified movement parameters, at least one service entry is displayed. A target service entry corresponding to the release position of the touch operation is determined from the at least one service entry, and the to-be-processed object is processed through the target service corresponding to the target service entry. Compared to... Figure 1In addition to the method of processing interface elements shown, this embodiment also selects the object to be processed by pressing the interface element and marks the object to be processed as selected to provide feedback to the user and improve the user's interactive experience.
[0151] The following will describe the application that can be used for processing interface elements provided in the embodiments of this application.
[0152] Taking a photo album interface as an example, this interface contains multiple photos. Each photo can be considered a UI element, and the content within each photo can be considered multiple sub-UI elements within that UI element. When the electronic device displays the photo album interface, the user can select photo A as the object to be processed by pressing on the UI elements. Figure 8 As shown. If photo A is determined to be the object to be processed, the electronic device can provide feedback (such as highlighting photo A), such as... Figure 9 As shown. Afterwards, the user can drag photo A downwards. If the movement parameters meet the specified parameters, two service entry points (image recognition entry point, wallpaper generation entry point) will be displayed at the bottom of the electronic device, as shown. Figure 10 As shown. While dragging photo A, the user can release photo A at the corresponding location of each of the two service entry points. For example, releasing photo A at the location corresponding to the image recognition entry point, such as... Figure 11 As shown. Finally, if the selected service entry point is the photo recognition entry point, then the program corresponding to the photo recognition entry point can be called to process photo A, such as image recognition, etc. Figure 12 As shown.
[0153] As an feasible approach, intent recognition can be performed on the object to be processed to determine the services that the user may need, and the corresponding service entry point can be identified and displayed.
[0154] As another feasible approach, the current processing time of the object to be processed can be obtained. Intent recognition can then be performed on the object and the current processing time to determine the services the user might need, and the corresponding service entry point can be identified and displayed. For example, for the same object to be processed, the services a user expects in the morning and in the evening may differ.
[0155] As another feasible approach, the current processing location of the object to be processed can be obtained. Intent recognition can be performed on the object and the current processing location to determine the services the user might need, and then the corresponding service entry point can be identified and displayed. For example, for the same object to be processed, the services a user expects at home may differ from those expected outdoors.
[0156] Please see Figure 13 , Figure 13 A block diagram of a processing apparatus for interface elements according to an embodiment of this application is shown. The following will focus on... Figure 13 The block diagram shown illustrates that the interface element processing device 200 includes: a user interface display module 210, a task object determination module 220, a service entry display module 230, and an interface element processing module 240, wherein:
[0157] The user interface display module 210 is used to display a user interface, wherein the user interface includes interface elements.
[0158] The object to be processed determination module 220 is used to respond to the touch operation applied to the interface element, determine the object to be processed from the interface element, and control the object to be processed to move based on the touch operation.
[0159] Furthermore, the interface elements include multiple sub-interface elements, and the object determination module 220 includes: a positional relationship determination sub-module and an object determination sub-module, wherein:
[0160] The positional relationship determination submodule is used to respond to touch operations applied to the interface elements and determine the positional relationship between the touch position of the touch operation and the display positions of the plurality of sub-interface elements.
[0161] The object to be processed determination submodule is used to determine the object to be processed from the interface elements based on the positional relationship.
[0162] Further, the object-to-be-processed determination submodule includes: a first object-to-be-processed determination unit and a second object-to-be-processed determination unit, wherein:
[0163] The first object-to-be-processed determination unit is used to determine the interface element as the object to be processed if, based on the positional relationship, it is determined that the touch position of the touch operation does not overlap with the display position of the plurality of sub-interface elements.
[0164] The second object-to-be-processed determination unit is used to determine the target sub-interface element as the object to be processed if, based on the positional relationship, the touch position of the touch operation overlaps with the display position of the target sub-interface element among the plurality of sub-interface elements.
[0165] Furthermore, the touch operation includes pressing and dragging operations, and the object determination module 220 includes: a pressing duration determination submodule, an object marking submodule, and an object dragging submodule, wherein:
[0166] The press duration determination submodule is used to respond to the press operation applied to the interface element and determine the press duration corresponding to the press operation.
[0167] The pending object marking submodule is used to determine the pending object from the interface elements and mark the pending object as selected if the pressing duration reaches the duration threshold.
[0168] The object dragging submodule is used to respond to the dragging operation applied to the object and control the object to move based on the dragging operation.
[0169] Further, the object determination module 220 includes: a sub-interface element extraction sub-module and a sub-interface element movement sub-module, wherein:
[0170] The sub-interface element extraction submodule is used to extract the target sub-interface element from the interface elements if the target sub-interface element is determined to be the object to be processed.
[0171] The sub-interface element movement sub-module is used to control the movement of the target sub-interface element based on the touch operation.
[0172] The service entry display module 230 is used to display at least one service entry when the movement parameters of the object to be processed meet the specified movement parameters.
[0173] Furthermore, the service entry display module 230 includes: a service determination submodule, wherein:
[0174] The service determination submodule is used to determine the attribute information corresponding to the object to be processed and display the service entry corresponding to the service that matches the attribute information.
[0175] Furthermore, the service entry display module 230 includes: a movement direction determination submodule and a second service entry display submodule, wherein:
[0176] The movement direction determination submodule is used to control the movement of the object to be processed based on the touch operation and to determine the movement direction of the object to be processed.
[0177] The second service entry display submodule is used to display the at least one service entry when the movement direction meets the specified movement direction.
[0178] Furthermore, the second service entry display submodule includes: a movement distance determination unit and a second service entry display unit, wherein:
[0179] The movement distance determination unit is used to determine the movement distance of the object to be processed when the movement direction satisfies the specified movement direction.
[0180] The second service entry display unit is used to display the at least one service entry when the travel distance reaches a distance threshold.
[0181] The interface element processing module 240 is used to process the object to be processed through the target service corresponding to the target service entry, wherein the target service entry is the service entry that corresponds to the release position of the touch operation among the at least one service entry.
[0182] Furthermore, the interface element processing module 240 includes: a submodule for inputting the object to be processed and a submodule for processing the object to be processed, wherein:
[0183] The target program calling submodule is used to call the target program corresponding to the target service entry point.
[0184] The object processing submodule is used to process the object to be processed by the target program based on the target service.
[0185] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described device and module can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0186] In the several embodiments provided in this application, the coupling between modules can be electrical, mechanical, or other forms of coupling.
[0187] Furthermore, the service modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated module can be implemented in hardware or as a software service module.
[0188] Please see Figure 14 This document illustrates a structural block diagram of an electronic device 100 provided in an embodiment of this application. The electronic device 100 can be a smartphone, tablet computer, e-reader, or other electronic device capable of running applications. The electronic device 100 in this application may include one or more of the following components: a processor 110, a memory 120, and one or more applications, wherein the one or more applications can be stored in the memory 120 and configured to be executed by one or more processors 110, and the one or more applications are configured to perform the methods described in the foregoing method embodiments.
[0189] The processor 110 may include one or more processing cores. The processor 110 connects to various parts within the electronic device 100 using various interfaces and lines, and performs various services and processes data of the electronic device 100 by running or executing instructions, programs, code sets, or instruction sets stored in the memory 120, and by calling data stored in the memory 120. Optionally, the processor 110 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). The processor 110 may integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content to be displayed; and the modem handles wireless communication. It is understood that the modem may also not be integrated into the processor 110 and may be implemented separately using a communication chip.
[0190] The memory 120 may include random access memory (RAM) or read-only memory (ROM). The memory 120 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 120 may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing at least one service (such as touch services, sound playback services, image playback services, etc.), instructions for implementing the various method embodiments described below, etc. The data storage area may also store data created by the electronic device 100 during use (such as phonebooks, audio and video data, chat log data, etc.).
[0191] In some embodiments, the electronic device 100 may further include a touch screen, which is used to display information input by the user, information provided to the user, and various graphical user interfaces of the electronic device 100. These graphical user interfaces may be composed of graphics, text, icons, numbers, video, and any combination thereof. In one example, the touch screen may be a liquid crystal display (LCD) or an organic light-emitting diode (OLED), without limitation.
[0192] In some embodiments, the electronic device 100 may also include a radio frequency (RF) module, which is used to receive and transmit electromagnetic waves, realize the mutual conversion between electromagnetic waves and electrical signals, and thus communicate with communication networks or other devices. The RF module may include various circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption / decryption chips, user identity module (SIM) cards, etc.
[0193] In some embodiments, the electronic device 100 may further include sensors, including a light sensor that can be used to turn off the touchscreen display when an object approaches the touchscreen, such as when the body of the electronic device is moved to the ear. The sensor may also include a pressure sensor that can detect pressure generated by pressing on the electronic device; that is, the pressure sensor can detect pressure generated by contact or pressing between the user and the electronic device, such as pressure generated by contact or pressing between the user's ear or finger and the electronic device. The sensor may also include a gravity sensor that can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. This can be used for applications that identify the posture of the electronic device (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition-related functions (such as pedometers, taps), etc. Additionally, the electronic device may also be equipped with other sensors such as gyroscopes, barometers, hygrometers, and thermometers, which are not limited here.
[0194] Of course, electronic devices may include many other components, which will not be elaborated here.
[0195] Please see Figure 15 This diagram illustrates a structural block diagram of a computer-readable storage medium provided in an embodiment of this application. The computer-readable medium 300 stores program code that can be called by a processor to execute the methods described in the above method embodiments.
[0196] The computer-readable storage medium 300 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 300 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 300 has storage space for program code 310 that performs any of the method steps described above. This program code can be read from or written to one or more computer program products. The program code 310 may be compressed, for example, in a suitable form.
[0197] In summary, the interface element processing method, apparatus, electronic device, and storage medium provided in this application display a user interface including interface elements, respond to touch operations applied to the interface elements, determine the object to be processed from the interface elements, control the object to be processed to move based on the touch operation, display at least one service entry when the movement parameters of the object to be processed meet specified movement parameters, and process the object to be processed through the target service corresponding to the target service entry. The target service entry is the service entry among at least one service entry that corresponds to the release position of the touch operation. Thus, by determining the object to be processed from the interface elements and selecting the target service entry from at least one service entry through touch operations applied to the user interface, the object to be processed can be processed quickly, thereby improving the processing efficiency of interface elements.
[0198] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.
Claims
1. A method for processing interface elements, characterized in that, The method includes: Display user interface, wherein the user interface includes interface elements; In response to a touch operation applied to the interface element, determine the object to be processed from the interface element, and control the object to be processed to move based on the touch operation; Display at least one service entry if the movement parameters of the object to be processed meet the specified movement parameters. The object to be processed is processed through the target service corresponding to the target service entry, wherein the target service entry is the service entry that corresponds to the release position of the touch operation among the at least one service entry.
2. The method according to claim 1, characterized in that, The interface elements include multiple sub-interface elements. The response to a touch operation applied to the interface elements, determining the object to be processed from the interface elements, includes: In response to a touch operation applied to the interface element, determine the positional relationship between the touch position of the touch operation and the display position of the plurality of sub-interface elements; The object to be processed is determined from the interface elements based on the positional relationship.
3. The method according to claim 2, characterized in that, The step of determining the object to be processed from the interface elements based on the positional relationship includes: If, based on the positional relationship, it is determined that the touch position of the touch operation does not overlap with the display positions of the plurality of sub-interface elements, then the interface element is identified as the object to be processed; or If, based on the positional relationship, it is determined that the touch position of the touch operation overlaps with the display position of the target sub-interface element among the plurality of sub-interface elements, then the target sub-interface element is determined as the object to be processed.
4. The method according to claim 3, characterized in that, The control of the object to be processed to move based on the touch operation includes: If the target sub-interface element is determined to be the object to be processed, then the target sub-interface element is extracted from the interface element. Control the movement of the target sub-interface element based on the touch operation.
5. The method according to claim 1, characterized in that, The display of at least one service entry point includes: Determine the attribute information corresponding to the object to be processed, and display the service entry corresponding to the service that matches the attribute information.
6. The method according to claim 1, characterized in that, The process of processing the object to be processed through the target service corresponding to the target service entry point includes: Invoke the target program corresponding to the target service entry point; The target program processes the object to be processed based on the target service.
7. The method according to any one of claims 1-6, characterized in that, The step of displaying at least one service entry when the movement parameters of the object to be processed meet the specified movement parameters includes: Determine the direction of movement of the object to be processed; If the movement direction meets the specified movement direction, the at least one service entry point is displayed.
8. The method according to claim 7, characterized in that, Displaying the at least one service entry point when the movement direction meets the specified movement direction includes: If the movement direction satisfies the specified movement direction, determine the movement distance of the object to be processed; If the travel distance reaches a distance threshold, at least one service entry point will be displayed.
9. The method according to any one of claims 1-6, characterized in that, The touch operation includes pressing and dragging operations. The response to the touch operation on the interface element, determining the object to be processed from the interface element, and controlling the object to be processed to move based on the touch operation, includes: In response to the press operation applied to the interface element, determine the press duration corresponding to the press operation; If the pressing duration reaches the duration threshold, the object to be processed is determined from the interface elements and marked as selected. In response to the drag operation applied to the object to be processed, control the object to be processed to move based on the drag operation.
10. A device for processing interface elements, characterized in that, The device includes: A user interface display module is used to display a user interface, wherein the user interface includes interface elements; The object to be processed module is used to respond to the touch operation applied to the interface element, determine the object to be processed from the interface element, and control the object to be processed to move based on the touch operation. The service entry display module is used to display at least one service entry when the movement parameters of the object to be processed meet the specified movement parameters. The interface element processing module is used to process the object to be processed through the target service corresponding to the target service entry, wherein the target service entry is the service entry that corresponds to the release position of the touch operation among the at least one service entry.
11. An electronic device, characterized in that, The method includes a memory and a processor, the memory being coupled to the processor, the memory storing instructions, and the processor performing the method as described in any one of claims 1-9 when the instructions are executed by the processor.
12. A computer-readable storage medium, characterized in that, The computer-readable storage medium contains program code that can be invoked by a processor to execute the method as described in any one of claims 1-9.