Methods, devices, storage media, and controls for performing operations on controls.
By detecting user control operations on the terminal device and automatically executing the first and second actions of the control, the problem of cumbersome information query and setting operations on the terminal device is solved, enabling users to obtain information and settings with one click, thereby improving the user experience and the intelligence of the application.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2021-02-04
- Publication Date
- 2026-04-17
AI Technical Summary
When users search for and operate information on their terminal devices, the process is cumbersome, resulting in low efficiency. This is especially true when searching for specific photos in the gallery or adjusting device settings, which requires multiple manual steps.
By detecting user actions on controls, the system automatically executes the first and second actions of the controls, such as opening the gallery or camera, and matching or setting relevant information in the interface, such as automatically displaying an ID photo or adjusting the screen mode, reducing manual user operations.
This allows users to obtain the information or settings they need with just one click, improving the user experience, simplifying the operation process, and enhancing the intelligence and convenience of the application.
Smart Images

Figure CN114860120B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic devices, and more particularly to a method, apparatus, storage medium, and control for performing control operations. Background Technology
[0002] As terminal devices become more widespread in the market, users are owning more and more terminal devices of various types and with more and more applications and richer and richer functions. As a result, users have increasingly higher demands for intelligence.
[0003] For example, in current image retrieval applications, if a user needs to upload a photo of their ID card, they usually have to manually search for the ID card photo among a large number of photos in the image library, or they have to manually enter keywords in the search box before they can find the ID card photo. In such application scenarios, the user's operation is cumbersome and the efficiency is low. Users urgently need a more intelligent and convenient end-to-end user experience. Summary of the Invention
[0004] In view of this, an execution method, apparatus, storage medium and control for control operations are proposed.
[0005] In a first aspect, embodiments of this application provide a method for executing control operations. The method is used in a terminal device and includes: detecting a user's trigger operation on a control in a first interface of the terminal device, the control being used to acquire target data; and responding to the user's trigger operation by executing a first action and a second action corresponding to the control, the first action being used to open and display a second interface, and the second action being used to match information related to the target data in the second interface.
[0006] According to the embodiments of this application, by detecting the user's trigger operation on the controls in the first interface of the terminal device, in response to the user's trigger operation, the first action and the second action corresponding to the control are executed. The first action is used to open and display the second interface, and the second action is used to match the information related to the target data in the second interface, so that the user can obtain the required information with just one click. At the same time, the application is made more intelligent, saving the user multiple steps and improving the user experience.
[0007] According to the first aspect, in a first possible implementation of the method for executing control operations, the control is used to acquire collected target data, the second interface includes a data browsing interface, and the information includes data related to the target data from the collected data displayed in the data browsing interface, wherein the data related to the target data is highlighted in the data browsing interface.
[0008] According to the embodiments of this application, by triggering the control, data related to the target data in the collected data is matched in the data browsing interface, and the data related to the target data is highlighted. This can realize the operation of automatically highlighting the data matching the target data in the data browsing interface, eliminating the need for manual searching and saving time for users, simplifying operations, and improving user experience. At the same time, the embodiments of this application do not only focus on the problem of a certain link in the user's use of the application, but also realize the end-to-end experience improvement of the user in multiple scenarios.
[0009] According to the first possible implementation of the first aspect, in the second possible implementation of the execution method for the control operation, the data browsing interface includes a gallery browsing interface, and matching information related to the target data in the second interface includes: obtaining images related to the target data from the images in the gallery browsing interface.
[0010] According to the embodiments of this application, the terminal device can automatically match the image needed by the user in the image library, making the application more intelligent. The user can find the image needed directly with one operation, avoiding tedious operations and improving the user experience.
[0011] According to the first aspect, in a third possible implementation of the method for executing control operations, the control is used to collect target data, the second interface includes a data collection interface of a data collection application, and the information includes a data collection mode related to the target data among candidate data collection modes in the data collection interface, wherein the data collection application is set to the data collection mode related to the target data.
[0012] According to the embodiments of this application, by triggering the control, the data acquisition mode related to the target data is matched in the data acquisition interface of the data acquisition application, and the data acquisition application is set to the data acquisition mode related to the target data. The user does not need to perform manual switching of modes, making the application more intelligent and the user more convenient.
[0013] According to the third possible implementation of the first aspect, in the fourth possible implementation of the execution method for the control operation, the data acquisition application includes a camera, the data acquisition interface includes the camera's photo-taking interface, and matching information related to the target data in the second interface includes: obtaining the photo-taking mode related to the target data from the candidate photo-taking modes of the camera's photo-taking interface, and setting the camera to the photo-taking mode related to the target data.
[0014] According to the embodiments of this application, the terminal device can automatically set the camera to the shooting mode required by the user, making the application more intelligent. The user can obtain the automatically set camera mode with one operation, which can more conveniently obtain target data, avoid tedious operations, and improve the user experience.
[0015] According to the first aspect or the first, second, third or fourth possible implementation of the first aspect, in the fifth possible implementation of the execution method for the control operation, the target data includes one or more of images, videos, sounds and text.
[0016] According to the embodiments of this application, the end-to-end user experience can be improved in various scenarios.
[0017] According to the first aspect, in the sixth possible implementation of the method for executing the control operation, matching information related to the target data in the second interface specifically includes: determining the action attribute of the second action corresponding to the control, the action attribute including the execution parameters of the second action, the execution parameters corresponding to the target data; and matching the information based on the execution parameters.
[0018] According to the embodiments of this application, by determining the action attribute of the second action corresponding to the control and matching the information according to the execution parameters, the user can achieve the effect of obtaining multiple operations with one operation, thereby simplifying the user's operation and making the application more intelligent.
[0019] According to the sixth possible implementation of the first aspect, in the seventh possible implementation of the execution method for the control operation, the action attribute includes execution parameters pre-set in the operating system of the terminal device and associated with the control.
[0020] According to the embodiments of this application, specific operations can be implemented more accurately, resulting in more precise operation results for users and improving their user experience. Simultaneously, developers do not need to implement related methods in the functional code and call interfaces provided by the operating system. For example, when implementing a search function, there is no need to construct complex Structured Query Language (SQL) parameters, nor to call the search function interface provided by the operating system in the functional code. This prevents the operating system from exposing its interfaces, reducing the risk of operating system attacks. Pre-setting in the operating system reduces the risk of operating system attacks due to exposed interfaces. Furthermore, it does not limit the type of operating system, allowing the method to be applied across multiple operating systems. Developers only need to preset action attributes in the operating system, without needing to worry about the differences between different operating systems or the different versions of interfaces provided by different operating systems, nor maintaining multiple sets of code, thus reducing the amount of code maintenance required by developers. Pre-setting in the operating system also reduces the amount of development work required to implement the corresponding actions.
[0021] According to the sixth possible implementation of the first aspect, in the eighth possible implementation of the execution method for the control operation, the action attribute includes execution parameters associated with the control obtained by the terminal device in the first interface.
[0022] According to the embodiments of this application, information can be transmitted between controls, so that the function of the controls can automatically adapt to the needs of the interface. Specific actions can be implemented in combination with business scenarios, making the application more intelligent. At the same time, without presetting execution parameters, the amount of code that developers need can also be reduced.
[0023] Secondly, embodiments of this application provide a method for executing control operations. The method is used in a terminal device and includes: detecting a user's trigger operation on a control in a first interface of the terminal device, the control being used to open a second interface; responding to the user's trigger operation, executing a first action and a second action corresponding to the control, the first action being used to open and display the second interface, and the second action being used to set a display state corresponding to the second interface.
[0024] According to the embodiments of this application, by detecting the user's trigger operation on the control in the first interface of the terminal device, in response to the user's trigger operation, the first action and the second action corresponding to the control are executed. The first action is used to open and display the second interface, and the second action is used to set the display state corresponding to the second interface. This allows the user to obtain the desired display state of the interface with just one click, without the need for the user to set it manually. This saves the user multiple steps and makes the application more intelligent, thus improving the user experience.
[0025] According to the second aspect, in a first possible implementation of the method for executing control operations, setting the display state corresponding to the second interface includes: when displaying the second interface, setting the screen of the terminal device to eye protection mode.
[0026] According to the embodiments of this application, the application can automatically switch to eye protection mode when the user is browsing the interface, so that the user does not need to manually adjust the interface, making the application more intelligent and improving the user experience.
[0027] According to the second aspect, in a second possible implementation of the method for executing control operations, setting the display state corresponding to the second interface includes: when displaying the second interface, setting the screen of the terminal device to always-on mode.
[0028] According to the embodiments of this application, the screen can be automatically switched to always-on mode when the user is viewing the interface, without the need for the user to manually prevent the screen from turning off, making the application more intelligent and improving the user experience.
[0029] According to the second aspect, in a third possible implementation of the method for executing control operations, setting the display state corresponding to the second interface specifically includes: determining the action attribute of the second action corresponding to the control, the action attribute including the execution parameters of the second action, the execution parameters corresponding to the display state; and setting the display state according to the execution parameters.
[0030] According to the embodiments of this application, by determining the action attribute of the second action corresponding to the control, and setting the display state according to the execution parameters, the terminal device can automatically set the display state after the user opens the interface, so that the user can achieve the effect of multi-step operation with one step, thereby simplifying the user's operation and making the application more intelligent.
[0031] According to the third possible implementation of the second aspect, in the fourth possible implementation of the method for executing control operations, the action attribute includes execution parameters pre-set in the operating system of the terminal device and associated with the control.
[0032] According to the embodiments of this application, specific operations can be implemented more accurately, providing users with more precise results and improving their user experience. Simultaneously, developers do not need to implement related methods in the functional code and call interfaces provided by the operating system. For example, when implementing a search function, there is no need to construct complex SQL parameters or call the search function interface provided by the operating system in the functional code. This prevents the operating system from exposing its interfaces, reducing the risk of the operating system being attacked. Pre-setting in the operating system reduces the risk of operating system attacks due to exposed interfaces. Furthermore, it does not limit the type of operating system, allowing the method to be applied across multiple operating systems. Developers only need to preset the action attributes in the operating system, without needing to worry about the differences between different operating systems or the different versions of interfaces provided by different operating systems, nor do they need to maintain multiple sets of code, reducing the amount of code maintenance required by developers. Furthermore, pre-setting in the operating system also reduces the amount of development work required to implement the corresponding actions.
[0033] According to the third possible implementation of the second aspect, in the fifth possible implementation of the execution method for the control operation, the action attribute includes execution parameters associated with the control obtained by the terminal device in the first interface.
[0034] According to the embodiments of this application, information can be transmitted between controls, so that the function of the controls can automatically adapt to the needs of the interface. Specific actions can be implemented in combination with business scenarios, making the application more intelligent. At the same time, without presetting execution parameters, the amount of code that developers need can also be reduced.
[0035] Thirdly, embodiments of this application provide an execution device for control operations. The device is used in a terminal device and includes: a first detection module for detecting a user's trigger operation on a control in a first interface of the terminal device, wherein the control is used to acquire target data; and a first execution module for responding to the user's trigger operation by executing a first action and a second action corresponding to the control, wherein the first action is used to open and display a second interface, and the second action is used to match information related to the target data in the second interface.
[0036] According to the third aspect, in a first possible implementation of the execution device for operating the control, the control is used to acquire collected target data, the second interface includes a data browsing interface, and the information includes data related to the target data from the collected data displayed in the data browsing interface, wherein the data related to the target data is highlighted in the data browsing interface.
[0037] According to the first possible implementation of the third aspect, in the second possible implementation of the execution device for control operation, the data browsing interface includes a gallery browsing interface, and matching information related to the target data in the second interface includes: obtaining images related to the target data from the images in the gallery browsing interface.
[0038] According to the third aspect, in a third possible implementation of the execution device for operating the control, the control is used to collect target data, the second interface includes a data collection interface of a data collection application, the information including a data collection mode related to the target data among candidate data collection modes in the data collection interface, wherein the data collection application is set to the data collection mode related to the target data.
[0039] According to the third possible implementation of the third aspect, in the fourth possible implementation of the execution device for control operation, the data acquisition application includes a camera, the data acquisition interface includes the camera's photo-taking interface, and matching information related to the target data in the second interface includes: obtaining a photo-taking mode related to the target data from the candidate photo-taking modes of the camera's photo-taking interface, and setting the camera to the photo-taking mode related to the target data.
[0040] According to the third aspect or the first, second, third or fourth possible implementation of the third aspect, in the fifth possible implementation of the execution device for control operation, the target data includes one or more of images, videos, sounds and text.
[0041] According to the third aspect, in a sixth possible implementation of the execution device for operating the control, matching information related to the target data in the second interface specifically includes: determining the action attribute of the second action corresponding to the control, the action attribute including the execution parameters of the second action, the execution parameters corresponding to the target data; and matching the information based on the execution parameters.
[0042] According to the sixth possible implementation of the third aspect, in the seventh possible implementation of the execution device for operating the control, the action attribute includes execution parameters pre-set in the operating system of the terminal device and associated with the control.
[0043] According to the sixth possible implementation of the third aspect, in the eighth possible implementation of the execution device for operating the control, the action attribute includes the execution parameters associated with the control obtained by the terminal device in the first interface.
[0044] Fourthly, embodiments of this application provide an execution device for control operations. The device is used in a terminal device and includes: a second detection module for detecting a user's trigger operation on a control in a first interface of the terminal device, the control being used to open a second interface; and a second execution module for responding to the user's trigger operation by executing a first action and a second action corresponding to the control, the first action being used to open and display the second interface, and the second action being used to set the display state corresponding to the second interface.
[0045] According to the fourth aspect, in a first possible implementation of the execution device for control operation, setting the display state corresponding to the second interface includes: when displaying the second interface, setting the screen of the terminal device to eye protection mode.
[0046] According to the fourth aspect, in a second possible implementation of the execution device for control operation, setting the display state corresponding to the second interface includes: when displaying the second interface, setting the screen of the terminal device to always-on mode.
[0047] According to the fourth aspect, in a third possible implementation of the execution device for operating the control, setting the display state corresponding to the second interface specifically includes: determining the action attribute of the second action corresponding to the control, the action attribute including the execution parameters of the second action, the execution parameters corresponding to the display state; and setting the display state according to the execution parameters.
[0048] According to the third possible implementation of the fourth aspect, in the fourth possible implementation of the execution device for operating the control, the action attribute includes execution parameters pre-set in the operating system of the terminal device and associated with the control.
[0049] According to the third possible implementation of the fourth aspect, in the fifth possible implementation of the execution device for operating the control, the action attribute includes the execution parameters associated with the control obtained by the terminal device in the first interface.
[0050] Fifthly, embodiments of this application provide an execution apparatus for control operations, the apparatus comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to, when executing the instructions, implement one or more of the execution methods for control operations in accordance with the first aspect or multiple possible implementations of the first aspect, or implement one or more of the execution methods for control operations in accordance with the second aspect or multiple possible implementations of the second aspect.
[0051] In a sixth aspect, embodiments of this application provide a control that corresponds at least to a first action attribute and a second action attribute. The first action attribute is used to determine a first action, and the second action attribute is used to determine a second action. The first action is used to enter a first interface. In response to a user's triggering operation on the control, the first action is executed according to the first action attribute, and the second action is executed according to the second action attribute.
[0052] According to the sixth aspect, in a first possible implementation of the control, the control is used to acquire target data, and the second action is used to match information related to the target data in the first interface after entering the first interface.
[0053] According to the sixth aspect, in a second possible implementation of the control, the second action is used to set the display state corresponding to the first interface after entering the first interface.
[0054] According to the first possible implementation of the sixth aspect, in the third possible implementation of the control, the second action attribute includes the execution parameters of the second action, the execution parameters corresponding to the target data; the matching of information related to the target data in the first interface specifically includes: matching the information according to the execution parameters.
[0055] According to the second possible implementation of the sixth aspect, in the fourth possible implementation of the control, the second action attribute includes the execution parameters of the second action, the execution parameters corresponding to the display state; setting the display state corresponding to the first interface specifically includes setting the display state according to the execution parameters.
[0056] According to the third or fourth possible implementation of the sixth aspect, in the fifth possible implementation of the control, the second action attribute includes execution parameters pre-set in the operating system of the terminal device and associated with the control.
[0057] According to the third or fourth possible implementation of the sixth aspect, in the sixth possible implementation of the control, the second action attribute includes the execution parameters associated with the control obtained by the terminal device in the first interface.
[0058] In a seventh aspect, embodiments of this application provide a non-volatile computer-readable storage medium storing computer program instructions thereon, which, when executed by a processor, implement one or more of the execution methods for control operations in accordance with the first aspect or various possible implementations of the first aspect, or implement one or more of the execution methods for control operations in accordance with the second aspect or various possible implementations of the second aspect.
[0059] Eighthly, embodiments of this application provide a terminal device that can execute one or more of the control operation execution methods in the first aspect or in various possible implementations of the first aspect, or implement one or more of the control operation execution methods in the second aspect or in various possible implementations of the second aspect.
[0060] Ninthly, embodiments of this application provide a computer program product including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code. When the computer-readable code is executed in an electronic device, a processor in the electronic device executes one or more of the execution methods for control operations in accordance with the first aspect or multiple possible implementations of the first aspect, or implements one or more of the execution methods for control operations in accordance with the second aspect or multiple possible implementations of the second aspect.
[0061] These and other aspects of this application will become more apparent in the description of the following embodiments(s). Attached Figure Description
[0062] The accompanying drawings, which are included in and form part of this specification, illustrate exemplary embodiments, features, and aspects of this application together with the specification and serve to explain the principles of this application.
[0063] Figure 1a A schematic diagram illustrating the application scenarios of existing technologies is shown.
[0064] Figure 1b A schematic diagram illustrating the application scenarios of existing technologies is shown.
[0065] Figure 2 A schematic diagram of an application scenario according to an embodiment of this application is shown.
[0066] Figure 3 A flowchart illustrating a method for performing control operations according to an embodiment of this application is shown.
[0067] Figure 4 A schematic diagram of an application scenario according to an embodiment of this application is shown.
[0068] Figure 5A flowchart illustrating a method for performing control operations according to an embodiment of this application is shown.
[0069] Figure 6 A flowchart illustrating a method for performing control operations according to an embodiment of this application is shown.
[0070] Figure 7 A flowchart illustrating a method for performing control operations according to an embodiment of this application is shown.
[0071] Figure 8 A flowchart illustrating a method for performing control operations according to an embodiment of this application is shown.
[0072] Figure 9 A flowchart illustrating a method for performing control operations according to an embodiment of this application is shown.
[0073] Figure 10 A structural diagram of an execution device for control operation according to an embodiment of this application is shown.
[0074] Figure 11 A structural diagram of an execution device for control operation according to an embodiment of this application is shown.
[0075] Figure 12 A schematic diagram of the structure of a terminal device according to an embodiment of this application is shown.
[0076] Figure 13 A software structure block diagram of a terminal device according to an embodiment of this application is shown. Detailed Implementation
[0077] Various exemplary embodiments, features, and aspects of this application will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.
[0078] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.
[0079] Furthermore, to better illustrate this application, numerous specific details are provided in the following detailed embodiments. Those skilled in the art should understand that this application can be implemented without certain specific details. In some instances, methods, means, components, and circuits well-known to those skilled in the art have not been described in detail in order to highlight the main points of this application.
[0080] Currently, in many scenarios, users need to perform numerous operations to obtain, query, or set information, which is not intelligent enough and results in a poor user experience. For example, when handling personal business, users need to upload a photo of their ID card. Figure 1a As shown, after entering the personal information interface, users can obtain a photo of their ID card by clicking the "Upload ID Card Photo" button. After clicking the button, the device will enter the photo library, where photos are sorted in ascending order of when they were taken. Users need to manually search for and upload their ID card photo from a vast collection. In this scenario, if a user took their ID card photo a long time ago, manually searching for it could consume a significant amount of time.
[0081] Or, such as Figure 1b As shown in the application scenario, after clicking the button to upload a photo of their ID card, the user will enter the gallery. The user can try to manually enter the keyword "ID card" in the search box at the top of the gallery display interface to search, and then select and upload the ID card photos found in the search results. Figure 1b The application scenarios shown save users the time of manually searching, but still require users to perform several steps.
[0082] This application provides a method for executing control operations. This method can be applied to terminal devices. By responding to user operations on controls, it automatically performs multiple specific operations, making the application more intelligent, saving users multiple steps, and improving the user experience.
[0083] The terminal device can refer to a device with wireless connectivity, meaning it can connect to other terminal devices via Wi-Fi, Bluetooth, or other wireless methods. The terminal device in this application can also have wired communication capabilities. The terminal device in this application can be touchscreen, non-touchscreen, or screenless. Touchscreen devices can be controlled by clicking or swiping on the display screen using fingers or styluses. Non-touchscreen devices can connect to input devices such as mice, keyboards, or touch panels to control the terminal device. Screenless devices can be, for example, screenless Bluetooth speakers. For instance, the terminal device in this application can be a smartphone, netbook, tablet, laptop, wearable electronic device (such as a smart bracelet or smartwatch), TV, virtual reality device, speaker, e-ink, etc. This application does not limit the type of terminal device or the operating system it runs. Embodiments of this application can be applied to any operating system, and can also be applied to other scenarios.
[0084] Figure 2 A schematic diagram illustrating an application scenario according to an embodiment of this application is shown. The following description uses the scenario of a user uploading a photo of their ID card in an application as an example. Those skilled in the art should understand that the embodiments of this application are not limited to this application scenario.
[0085] like Figure 2 As shown, after opening the interface, the user is prompted to upload a photo of their ID card. The user can do so by clicking as shown below. Figure 2 (a) The dashed box indicates entering the image library, where users can select and upload a corresponding photo. Using the method provided in this embodiment, after entering the image library, the system automatically matches photos of ID cards and arranges them at the top of the library. Users can directly select the desired ID card photo without manually searching through a large number of photos in the library, nor do they need to find a search entry point and input search criteria. It should be noted that the system's search results can be presented to the user in various ways, and this embodiment does not limit this. In one possible implementation, the system can also directly pop up a dialog box including the ID card photo search results for the user to select. The execution method for control operations provided in this embodiment can improve the intelligence of the application, eliminating the need for users to search for information during operation, making it more convenient and intelligent, and providing a better user experience.
[0086] In an exemplary application scenario, after opening the interface, the user is prompted to upload a photo of their ID card, and the interface includes controls for browsing photos. Clicking these controls opens the photo gallery, at which point the terminal device automatically displays the ID card photo at the top of all photos. In one possible implementation, the terminal device can also display only ID card photos in the gallery, allowing the user to directly select photos, replacing manual searching. A diagram illustrating this application scenario can be found [link to diagram]. Figure 2 .
[0087] Based on this application scenario Figure 3 A flowchart illustrating an operation execution method according to an embodiment of this application is shown. Figure 3 As shown, the operation execution method according to an embodiment of this application includes the following flow:
[0088] Step S101: In response to the user's operation of opening the interface for uploading ID card photos in the application, the interface for uploading ID card photos is displayed, and the interface contains controls for obtaining photos.
[0089] The first interface can display, for example, Figure 2 The content shown in (a) could be a button control used to open the gallery, for example, see [link to example]. Figure 2(a) The button in the dashed box allows the user-uploaded ID photo to be displayed as shown below. Figure 2 (a) is within the dashed box.
[0090] The gallery can include a gallery used locally on the terminal device to store photos, or a gallery that retrieves photos from the internet.
[0091] Step S102: A user's trigger operation on the photo browsing control is detected.
[0092] The triggering operation can be a user action on a control, such as clicking a button. Figure 2 (a) shows the operation of the button control for browsing photos in the interface for uploading ID card photos.
[0093] In step S103, in response to the user's trigger operation on the control, the gallery interface is opened and displayed, and the ID card photo is matched in the gallery interface and pushed to the user for the user to select directly.
[0094] After the user clicks the button control, the terminal device can open the photo library. Matching ID card photos can be done by the terminal device searching for ID card photos in the photo library and displaying them at the top of all photos, or by displaying only the searched ID card photos in the photo library interface. This way, users can directly select the desired ID card photo without having to go through a series of cumbersome operations such as opening the photo library, manually searching, or entering keywords.
[0095] The control in this application embodiment may include at least two action attributes. A first action, such as opening a photo library, can be executed based on an existing first action attribute in the control. A second action, such as retrieving ID card photos from the photo library, can also be executed based on a newly added second action attribute in the control. The action of retrieving ID card photos from the photo library can be triggered by the newly added second action attribute in the control. The newly added action attribute may include an execution instruction, which represents a new action to be performed on top of the existing action (e.g., opening a photo library), such as retrieving ID card photos from the photo library. The action attribute may also include execution parameters, such as the content of the retrieved image (e.g., "ID card"). These execution parameters may be pre-set or default (e.g., null). In one possible implementation, these execution parameters can be obtained by the terminal device extracting keywords contained in the first interface after the user opens it, and then using that keyword information.
[0096] The newly added action attributes can be added by the terminal device to the operating system, and the operating system will execute the corresponding actions. The action attributes can encapsulate functions that the operating system uses to execute related actions. For example, for the action attribute used to retrieve images from the gallery, the encapsulated functions can include functions for retrieving images from the gallery, or functions for reordering the retrieved images.
[0097] Figure 4 A schematic diagram illustrating an application scenario according to another embodiment of this application is shown. For example... Figure 4 As shown, after opening the interface for uploading food photos, users can click the camera control on the interface to open the camera. At this time, the terminal device can automatically switch the shooting mode to food mode (e.g., Figure 4 (b) The display below the camera allows users to directly see the camera interface with the shooting mode set to food mode, without requiring users to manually set it after opening the camera.
[0098] In this application scenario, Figure 5 A flowchart illustrating an execution method for control operations according to an embodiment of this application is shown. Figure 5 As shown, the flow of the method for performing control operations according to an embodiment of this application includes:
[0099] Step S201: Display the interface for uploading food photos, which includes controls for opening the camera.
[0100] Among them, the controls for opening the camera are shown in, for example... Figure 4 (a) The "Take Photo" button allows users to upload food photos, which can then be displayed as follows: Figure 4 (a) is within the dashed box.
[0101] Step S202: The user's trigger operation on the camera control is detected.
[0102] The triggering action can be, for example, clicking such as Figure 4 (a) shows the operation of the "Take Photo" button control in the interface for uploading food photos.
[0103] In step S203, in response to the user's trigger operation, the camera's shooting interface is opened, and the "food" mode is selected in the shooting interface.
[0104] This allows you to set the camera's shooting mode to "Food" mode and display it (for example, "Food" mode can be represented by a selected triangle icon). Figure 4 (b)).
[0105] When a user clicks this button, the terminal device can open the camera and enter the photo-taking interface.
[0106] The operating system can execute the original function of the control, namely, to open the camera. It can also set the camera mode to food mode (if the terminal device's shooting mode is not food mode, it will switch the camera's shooting mode to food mode). In this way, after the user clicks the shooting button control on the interface for uploading food photos, the camera can automatically enter food mode without the user having to manually switch the camera's shooting mode.
[0107] The control in this embodiment may include at least two action attributes. A first action, such as opening the camera, can be performed based on an existing first action attribute in the control. A second action, such as setting the camera's shooting mode, can also be performed based on a newly added second action attribute in the control. The action of setting the shooting mode can be triggered by the newly added second action attribute in the control. For example, the execution instruction included in the newly added action attribute may be setting the camera's shooting mode, and the execution parameters included in the action attribute may represent the camera's shooting mode to be set, such as food, portrait, or landscape shooting modes; in this case, it is, for example, the food mode.
[0108] The newly added action attribute can be added to the operating system by the terminal device, and the corresponding action can be executed by the operating system. The action attribute can encapsulate a function for setting the camera shooting mode, which serves as the execution instruction for the action attribute.
[0109] In another application scenario of one embodiment of this application, before opening the application, the user needs to click a control (for jumping to the user agreement) to browse the user agreement. Since the content of the user agreement is long text, the terminal device can automatically set the screen display state of the interface for browsing the user agreement to eye protection mode. After clicking the control, the user can directly browse the user agreement in eye protection mode without having to manually set the screen display state after opening the interface for browsing the user agreement.
[0110] The control in this embodiment may include at least two action attributes. A first action can be executed based on an existing first action attribute in the control, such as opening an interface for browsing user agreements. A second action can also be executed based on a newly added second action attribute in the control, such as setting the screen display state. The action of setting the screen display state can be triggered by the newly added second action attribute in the control (e.g., a link control). For example, the execution instruction included in the newly added action attribute may be setting the screen display state corresponding to the interface, and the execution parameters included in the action attribute may represent the screen display state to be set, such as eye protection mode in this case.
[0111] The newly added action attribute can be added by the terminal device to the operating system, and the corresponding action can be executed by the operating system. The action attribute can encapsulate a function that sets the screen display state, which serves as the execution instruction for the action attribute.
[0112] In another application scenario of one embodiment of this application, the interface of the application is used to display static images (pictures) or play videos for a long time. After the user clicks the control (such as a button control) used to open the interface for displaying static images, the interface can be opened. After the interface is opened, the terminal device can automatically set the screen display state of the interface to always-on mode, so that the user can watch the static image for a long time without frequent manual operation (such as clicking the screen) to prevent the screen from turning off automatically.
[0113] The control embodiments of this application may include at least two action attributes. A first action can be executed based on an existing first action attribute in the control, such as opening an interface displaying a static image. A second action can also be executed based on a newly added second action attribute in the control, such as setting the screen display state. The action of setting the screen display state can be triggered by a newly added action attribute in the control (e.g., the control used to open an interface displaying a static image). For example, the execution instruction included in the newly added action attribute may be setting the screen display state corresponding to the interface, and the execution parameter of the action included in the action attribute may be, for example, a constant-on mode.
[0114] Figure 6 A flowchart illustrating an execution method for control operations according to an embodiment of this application is shown. This method is used in a terminal device, such as... Figure 6 As shown, the method may include:
[0115] Step S601: Detect the user's trigger operation on a control in the first interface of the terminal device, wherein the control is used to acquire target data;
[0116] Step S602: In response to the user's trigger operation, execute the first action and the second action corresponding to the control. The first action is used to open and display the second interface, and the second action is used to match information related to the target data in the second interface.
[0117] According to the embodiments of this application, by detecting the user's trigger operation on the controls in the first interface of the terminal device, in response to the user's trigger operation, the first action and the second action corresponding to the control are executed. The first action is used to open and display the second interface, and the second action is used to match the information related to the target data in the second interface, so that the user can obtain the required information with just one click. At the same time, the application is made more intelligent, saving the user multiple steps and improving the user experience.
[0118] The control can be a button control, a UI control, a link control, etc., and this application embodiment does not limit this. The triggering operation can include user click on the control, long press on the control, etc.
[0119] The first action can be considered as the action that the control was originally supposed to perform, such as opening the gallery or opening the camera. The second action can be considered as an action added to the control based on the first action.
[0120] The target data can be data required by the user. Target data may include already collected data, such as data stored on a terminal device, or data stored on a server and accessible via a network. Target data may also include data to be collected. In one possible implementation, target data may include one or more types of data, such as images, videos, audio, and text; this application does not limit the type of target data.
[0121] The second interface can contain various types of information. The matched information in the second interface that is related to the target data can be the target data itself, information with a high degree of similarity to the target data, or information suitable for collecting the target data, etc.
[0122] In one possible implementation, the control is used to acquire the collected target data, and the second interface includes a data browsing interface. The information includes data related to the target data from the collected data displayed in the data browsing interface, wherein the data related to the target data is highlighted in the data browsing interface.
[0123] According to the embodiments of this application, by triggering the control, data related to the target data in the collected data is matched in the data browsing interface, and the data related to the target data is highlighted. This can realize the operation of automatically highlighting the data matching the target data in the data browsing interface, eliminating the need for manual searching and saving time for users, simplifying operations, and improving user experience. At the same time, the embodiments of this application do not only focus on the problem of a certain link in the user's use of the application, but also realize the end-to-end experience improvement of the user in multiple scenarios.
[0124] The methods of highlighting can include displaying information differently from other information, or any method that makes it easy for users to notice it, such as displaying the information at the very top of all information, highlighting the information, or marking the information.
[0125] In one possible implementation, the data browsing interface includes a gallery browsing interface, and matching information related to the target data in the second interface includes: obtaining images related to the target data from the images in the gallery browsing interface.
[0126] According to this embodiment, the terminal device can automatically match the image needed by the user in the image library, making the application more intelligent. Users can find the image they need directly with one operation, avoiding cumbersome operations and improving the user experience.
[0127] For example, see Figure 2 and Figure 3 The example shown responds to a user's triggering operation on the control for browsing photos in the interface for uploading ID card photos (first interface), executing a first action and a second action corresponding to the control. The first action is used to open the gallery interface (second interface) and determine candidate photos in the gallery. The second action is used to determine the ID card photo (image related to the target data) that matches the target data (ID card photo) among the candidate photos; and the ID card photo is displayed at the forefront in the second interface. In one possible implementation, the control is used to collect target data, and the second interface includes a data collection interface of a data collection application. The information includes a data collection mode related to the target data in the candidate data collection modes in the data collection interface, wherein the data collection application is set to the data collection mode related to the target data.
[0128] According to the embodiments of this application, by triggering the control, the data acquisition mode related to the target data is matched in the data acquisition interface of the data acquisition application, and the data acquisition application is set to the data acquisition mode related to the target data. The user does not need to perform manual switching of modes, making the application more intelligent and the user more convenient.
[0129] The methods of data collection can include shooting, recording, etc.
[0130] In one possible implementation, the data acquisition application includes a camera, and the data acquisition interface includes the camera's photo-taking interface. Matching information related to the target data in the second interface includes: obtaining a photo-taking mode related to the target data from the candidate photo-taking modes of the camera's photo-taking interface, and setting the camera to the photo-taking mode related to the target data.
[0131] According to the embodiments of this application, the terminal device can automatically set the camera to the shooting mode required by the user, making the application more intelligent. The user can obtain the automatically set camera mode with one operation, which can more conveniently obtain target data, avoid tedious operations, and improve the user experience.
[0132] For example, see Figure 4 and Figure 5In the example shown, in response to a user's triggering operation on the camera control in the interface for uploading food photos (first interface), the first action and the second action corresponding to the control are executed. The first action is used to open the camera's photo-taking interface (second interface) and determine the candidate photo-taking modes in the gallery. The second action is used to determine the "food" mode (the photo-taking mode related to the target data) that matches the target data (food photo) among the candidate photo-taking modes. The camera can be set to food mode in the second interface.
[0133] Figure 7 A flowchart illustrating an execution method for control operations according to an embodiment of this application is shown, such as... Figure 7 As shown, information related to the target data in the second interface is matched, specifically including:
[0134] Step S701: Determine the action attribute of the second action corresponding to the control. The action attribute includes the execution parameters of the second action, and the execution parameters correspond to the target data.
[0135] Step S702: Match the information according to the execution parameters.
[0136] According to the embodiments of this application, by determining the action attribute of the second action corresponding to the control and matching the information according to the execution parameters, the user can achieve the effect of obtaining multiple operations with one operation, thereby simplifying the user's operation and making the application more intelligent.
[0137] The action attribute of the second action can represent the second action to be performed, and the action attribute of the second action can encapsulate the function that performs the corresponding action. The execution parameters can correspond to the target data, such as representing the feature information of the target data, so as to match information related to the target data. For example, when the target data is an ID card photo, the execution parameters can represent the content of the photo, such as "ID card".
[0138] For example, if the second action represents retrieving images from the gallery, its action attribute can encapsulate a function for retrieving images from the gallery, or it can also include a function for reordering the retrieved images. The execution parameters of the action can include keywords for retrieving images. If the second action represents setting the camera shooting mode, its action attribute can encapsulate a function for setting the camera shooting mode. The execution parameters of the action can include the shooting mode to be set.
[0139] For example, when the terminal device obtains the action attribute of the second action bound to the control, it can use the encapsulated function to search for photos in the gallery based on the execution parameters of the action attribute (e.g., "ID card"), and find the ID card photo.
[0140] In one possible implementation, the action attribute includes execution parameters that are pre-set in the terminal device's operating system and associated with the control.
[0141] According to the embodiments of this application, specific operations can be implemented more accurately, resulting in more precise operation results for users and improving their user experience. Simultaneously, developers do not need to implement related methods in the functional code and call interfaces provided by the operating system. For example, when implementing a search function, there is no need to construct complex Structured Query Language (SQL) parameters, nor to call the search function interface provided by the operating system in the functional code. This prevents the operating system from exposing its interfaces, reducing the risk of operating system attacks. Pre-setting in the operating system reduces the risk of operating system attacks due to exposed interfaces. Furthermore, it does not limit the type of operating system, allowing the method to be applied across multiple operating systems. Developers only need to preset action attributes in the operating system, without needing to worry about the differences between different operating systems or the different versions of interfaces provided by different operating systems, nor maintaining multiple sets of code, thus reducing the amount of code maintenance required by developers. Pre-setting in the operating system also reduces the amount of development work required to implement the corresponding actions.
[0142] The action attribute of the second action can be newly added in the operating system. After adding it, the newly added action attribute can be bound to the control, and the execution parameters of the action attribute can be set in the action attribute.
[0143] For example, an action attribute for searching photos in the gallery can be pre-added to the operating system. This new action attribute can then be bound to a button control for browsing photos on the interface for uploading ID card photos, with the execution parameter set to "ID card". Thus, when the user triggers the button control, the operating system can obtain this new action attribute and, in addition to executing the button control's original action (the first action, such as opening the gallery), can also execute the second action corresponding to the new action attribute (such as searching for ID card photos in the gallery).
[0144] In one possible implementation, the action attribute includes execution parameters associated with the control, obtained by the terminal device in the first interface.
[0145] According to the embodiments of this application, information can be transmitted between controls, so that the function of the controls can automatically adapt to the needs of the interface. Specific actions can be implemented in combination with business scenarios, making the application more intelligent. At the same time, without presetting execution parameters, the amount of code that developers need can also be reduced.
[0146] For example, if the second action is to retrieve an image from the gallery, the execution parameters of the second action can initially be default values. When the interface for uploading ID card photos is opened, the interface is scanned and the target keyword (such as "ID card") in the text content contained in the interface is identified, and "ID card" is used as the execution parameter of the second action.
[0147] In the case where the interface is found to contain a target keyword (such as "ID card"), the target keyword can be extracted and passed to the next step through the terminal device (such as inside the operating system). For example, the content of the target keyword can be saved to the shared memory of the operating system, so that the next step can extract the content of the target keyword from the shared memory as an execution parameter for the second action.
[0148] Specifically, the action attribute used to scan and identify target keywords in the first interface can be bound to the first interface. In response to the user opening the first interface, the terminal device can obtain the action attribute corresponding to the first interface.
[0149] For example, an action attribute can be added in advance to the operating system to scan the interface for uploading ID card photos and extract target keywords. This new action attribute can then be bound to the interface for uploading ID card photos, and the execution parameter of the action attribute can be set to the target keyword to be extracted from the interface (e.g., ID card).
[0150] Figure 8 A flowchart illustrating an execution method for control operations according to an embodiment of this application is shown. This method is used in a terminal device, such as... Figure 8 As shown, the method includes:
[0151] Step S801: Detect the user's trigger operation on a control in the first interface of the terminal device, the control being used to open the second interface;
[0152] Step S802: In response to the user's trigger operation, execute the first action and the second action corresponding to the control. The first action is used to open and display the second interface, and the second action is used to set the display state corresponding to the second interface.
[0153] According to the embodiments of this application, by detecting the user's trigger operation on the control in the first interface of the terminal device, in response to the user's trigger operation, the first action and the second action corresponding to the control are executed. The first action is used to open and display the second interface, and the second action is used to set the display state corresponding to the second interface. This allows the user to obtain the desired display state of the interface with just one click, without the need for the user to set it manually. This saves the user multiple steps and makes the application more intelligent, thus improving the user experience.
[0154] The first action can be seen as the action that the control was originally supposed to perform, such as the action of opening the interface corresponding to the link control. The second action can be seen as the action added to the control. The display state of the interface can include the display state adapted to the display needs of the second interface.
[0155] In one possible implementation, setting the display state corresponding to the second interface includes: when displaying the second interface, setting the screen of the terminal device to eye protection mode.
[0156] According to the embodiments of this application, the application can automatically switch to eye protection mode when the user is browsing the interface, so that the user does not need to manually adjust the interface, making the application more intelligent and improving the user experience.
[0157] The eye-protection mode can be set when a document requiring extended reading time is displayed on the second interface. Documents requiring extended reading time include lengthy user agreements, novels, etc. For example, in response to a user's triggering action on the link control in the first interface used to open the user agreement, the corresponding first and second actions are executed. The first action is used to open the interface for browsing the user agreement (the second interface) and display the user agreement; the second action is used to set the screen to eye-protection mode.
[0158] In one possible implementation, setting the display state corresponding to the second interface includes: when displaying the second interface, setting the screen of the terminal device to always-on mode.
[0159] The always-on mode can be set when displaying static or dynamic images or videos that need to be viewed for an extended period of time on the second interface. For example, in response to a user's trigger operation on a button control in the first interface used to display static images, the corresponding first and second actions are executed. The first action is used to open the interface (second interface) for displaying static images and to display the static images, while the second action is used to set the screen to always-on mode.
[0160] According to the embodiments of this application, the screen can be automatically switched to always-on mode when the user is viewing the interface, without the need for the user to manually prevent the screen from turning off, making the application more intelligent and improving the user experience.
[0161] Figure 9 A flowchart illustrating an execution method for control operations according to an embodiment of this application is shown, such as... Figure 9 As shown, setting the display state corresponding to the second interface specifically includes:
[0162] Step S901: Determine the action attribute of the second action corresponding to the control. The action attribute includes the execution parameters of the second action, and the execution parameters correspond to the display state.
[0163] Step S902: Set the display state according to the execution parameters.
[0164] According to the embodiments of this application, by determining the action attribute of the second action corresponding to the control, and setting the display state according to the execution parameters, the terminal device can automatically set the display state after the user opens the interface, so that the user can achieve the effect of multi-step operation with one step, thereby simplifying the user's operation and making the application more intelligent.
[0165] For example, the second action could be setting the screen display state. The action attribute of the second action could encapsulate a function for setting the screen display state, and the execution parameters of the second action could be the specific screen display state being set, such as always-on mode or eye protection mode. The execution parameters of the second action could also include the screen-on duration after entering always-on mode.
[0166] In one possible implementation, the action attribute includes execution parameters that are pre-set in the operating system of the terminal device and associated with the control.
[0167] According to the embodiments of this application, specific operations can be implemented more accurately, providing users with more precise results and improving their user experience. Simultaneously, developers do not need to implement related methods in the functional code and call interfaces provided by the operating system. For example, when implementing a search function, there is no need to construct complex SQL parameters or call the search function interface provided by the operating system in the functional code. This prevents the operating system from exposing its interfaces, reducing the risk of the operating system being attacked. Pre-setting in the operating system reduces the risk of operating system attacks due to exposed interfaces. Furthermore, it does not limit the type of operating system, allowing the method to be applied across multiple operating systems. Developers only need to preset the action attributes in the operating system, without needing to worry about the differences between different operating systems or the different versions of interfaces provided by different operating systems, nor do they need to maintain multiple sets of code, reducing the amount of code maintenance required by developers. Furthermore, pre-setting in the operating system also reduces the amount of development work required to implement the corresponding actions.
[0168] In one possible implementation, the method further includes: the action attribute includes execution parameters associated with the control obtained by the terminal device in the first interface.
[0169] According to the embodiments of this application, information can be transmitted between controls, so that the function of the controls can automatically adapt to the needs of the interface. Specific actions can be implemented in combination with business scenarios, making the application more intelligent. At the same time, without presetting execution parameters, the amount of code that developers need can also be reduced.
[0170] For example, when the first interface is opened, the system can scan and identify the target keyword "user agreement" contained in the first interface, and based on the correspondence between "user agreement" and the execution parameter "eye protection mode", set the execution parameter of the action attribute of the control that opens the user agreement to "eye protection mode".
[0171] Figure 10 A structural diagram of an execution device for control operation according to an embodiment of this application is shown. This device is used in a terminal device, such as... Figure 10 As shown, the device includes:
[0172] The first detection module 1001 is used to detect user trigger operations on controls in the first interface of the terminal device, wherein the controls are used to acquire target data;
[0173] The first execution module 1002 is used to respond to the user's trigger operation by executing a first action and a second action corresponding to the control. The first action is used to open and display a second interface, and the second action is used to match information related to the target data in the second interface.
[0174] According to the embodiments of this application, by detecting the user's trigger operation on the controls in the first interface of the terminal device, in response to the user's trigger operation, the first action and the second action corresponding to the control are executed. The first action is used to open and display the second interface, and the second action is used to match the information related to the target data in the second interface, so that the user can obtain the required information with just one click. At the same time, the application is made more intelligent, saving the user multiple steps and improving the user experience.
[0175] In one possible implementation, the control is used to acquire the collected target data, the second interface includes a data browsing interface, and the information includes data related to the target data from the collected data displayed in the data browsing interface, wherein the data related to the target data is highlighted in the data browsing interface.
[0176] According to the embodiments of this application, by triggering the control, data related to the target data in the collected data is matched in the data browsing interface, and the data related to the target data is highlighted. This can realize the operation of automatically highlighting the data matching the target data in the data browsing interface, eliminating the need for manual searching and saving time for users, simplifying operations, and improving user experience. At the same time, the embodiments of this application do not only focus on the problem of a certain link in the user's use of the application, but also realize the end-to-end experience improvement of the user in multiple scenarios.
[0177] In one possible implementation, the data browsing interface includes a gallery browsing interface, and matching information related to the target data in the second interface includes: obtaining images related to the target data from the images in the gallery browsing interface.
[0178] According to the embodiments of this application, the terminal device can automatically match the image needed by the user in the image library, making the application more intelligent. The user can find the image needed directly with one operation, avoiding tedious operations and improving the user experience.
[0179] In one possible implementation, the control is used to collect target data, the second interface includes a data collection interface of a data collection application, and the information includes a data collection mode related to the target data among the candidate data collection modes in the data collection interface, wherein the data collection application is set to the data collection mode related to the target data.
[0180] According to the embodiments of this application, by triggering the control, the data acquisition mode related to the target data is matched in the data acquisition interface of the data acquisition application, and the data acquisition application is set to the data acquisition mode related to the target data. The user does not need to perform manual switching of modes, making the application more intelligent and the user more convenient.
[0181] In one possible implementation, the data acquisition application includes a camera, and the data acquisition interface includes the camera's photo-taking interface. Matching information related to the target data in the second interface includes: obtaining a photo-taking mode related to the target data from the candidate photo-taking modes of the camera's photo-taking interface, and setting the camera to the photo-taking mode related to the target data.
[0182] According to the embodiments of this application, the terminal device can automatically set the camera to the shooting mode required by the user, making the application more intelligent. The user can obtain the automatically set camera mode with one operation, which can more conveniently obtain target data, avoid tedious operations, and improve the user experience.
[0183] In one possible implementation, the target data includes one or more of images, videos, audio, and text.
[0184] According to the embodiments of this application, the end-to-end user experience can be improved in various scenarios.
[0185] In one possible implementation, matching information related to the target data in the second interface specifically includes: determining the action attribute of the second action corresponding to the control, the action attribute including the execution parameters of the second action, the execution parameters corresponding to the target data; and matching the information based on the execution parameters.
[0186] According to the embodiments of this application, by determining the action attribute of the second action corresponding to the control and matching the information according to the execution parameters, the user can achieve the effect of obtaining multiple operations with one operation, thereby simplifying the user's operation and making the application more intelligent.
[0187] In one possible implementation, the action attribute includes execution parameters pre-set in the operating system of the terminal device and associated with the control.
[0188] According to the embodiments of this application, specific operations can be implemented more accurately, providing users with more precise results and improving their user experience. Simultaneously, developers do not need to implement related methods in the functional code and call interfaces provided by the operating system. For example, when implementing a search function, there is no need to construct complex SQL parameters or call the search function interface provided by the operating system in the functional code. This prevents the operating system from exposing its interfaces, reducing the risk of the operating system being attacked. Pre-setting in the operating system reduces the risk of operating system attacks due to exposed interfaces. Furthermore, it does not limit the type of operating system, allowing the method to be applied across multiple operating systems. Developers only need to preset the action attributes in the operating system, without needing to worry about the differences between different operating systems or the different versions of interfaces provided by different operating systems, nor do they need to maintain multiple sets of code, reducing the amount of code maintenance required by developers. Furthermore, pre-setting in the operating system also reduces the amount of development work required to implement the corresponding actions.
[0189] In one possible implementation, the action attribute includes execution parameters associated with the control obtained by the terminal device in the first interface.
[0190] According to the embodiments of this application, information can be transmitted between controls, so that the function of the controls can automatically adapt to the needs of the interface. Specific actions can be implemented in combination with business scenarios, making the application more intelligent. At the same time, without presetting execution parameters, the amount of code that developers need can also be reduced.
[0191] Figure 11 A structural diagram of an execution device for control operation according to an embodiment of this application is shown. This device is used in a terminal device, such as... Figure 11 As shown, the device includes:
[0192] The second detection module 1101 is used to detect user trigger operations on controls in the first interface of the terminal device, the controls being used to open the second interface;
[0193] The second execution module 1102 is used to respond to the user's trigger operation by executing a first action and a second action corresponding to the control. The first action is used to open and display the second interface, and the second action is used to set the display state corresponding to the second interface.
[0194] According to the embodiments of this application, by detecting the user's trigger operation on the control in the first interface of the terminal device, in response to the user's trigger operation, the first action and the second action corresponding to the control are executed. The first action is used to open and display the second interface, and the second action is used to set the display state corresponding to the second interface. This allows the user to obtain the desired display state of the interface with just one click, without the need for the user to set it manually. This saves the user multiple steps and makes the application more intelligent, thus improving the user experience.
[0195] In one possible implementation, setting the display state corresponding to the second interface includes: when displaying the second interface, setting the screen of the terminal device to eye protection mode.
[0196] According to the embodiments of this application, the application can automatically switch to eye protection mode when the user is browsing the interface, so that the user does not need to manually adjust the interface, making the application more intelligent and improving the user experience.
[0197] In one possible implementation, setting the display state corresponding to the second interface includes: when displaying the second interface, setting the screen of the terminal device to always-on mode.
[0198] According to the embodiments of this application, the screen can be automatically switched to always-on mode when the user is viewing the interface, without the need for the user to manually prevent the screen from turning off, making the application more intelligent and improving the user experience.
[0199] In one possible implementation, setting the display state corresponding to the second interface specifically includes: determining the action attribute of the second action corresponding to the control, the action attribute including the execution parameters of the second action, the execution parameters corresponding to the display state; and setting the display state according to the execution parameters.
[0200] According to the embodiments of this application, by determining the action attribute of the second action corresponding to the control, and setting the display state according to the execution parameters, the terminal device can automatically set the display state after the user opens the interface, so that the user can achieve the effect of multi-step operation with one step, thereby simplifying the user's operation and making the application more intelligent.
[0201] In one possible implementation, the action attribute includes execution parameters that are pre-set in the terminal device's operating system and associated with the control.
[0202] According to the embodiments of this application, specific operations can be implemented more accurately, providing users with more precise results and improving their user experience. Simultaneously, developers do not need to implement related methods in the functional code and call interfaces provided by the operating system. For example, when implementing a search function, there is no need to construct complex SQL parameters or call the search function interface provided by the operating system in the functional code. This prevents the operating system from exposing its interfaces, reducing the risk of the operating system being attacked. Pre-setting in the operating system reduces the risk of operating system attacks due to exposed interfaces. Furthermore, it does not limit the type of operating system, allowing the method to be applied across multiple operating systems. Developers only need to preset the action attributes in the operating system, without needing to worry about the differences between different operating systems or the different versions of interfaces provided by different operating systems, nor do they need to maintain multiple sets of code, reducing the amount of code maintenance required by developers. Furthermore, pre-setting in the operating system also reduces the amount of development work required to implement the corresponding actions.
[0203] In one possible implementation, the action attribute includes execution parameters associated with the control obtained by the terminal device in the first interface.
[0204] According to the embodiments of this application, information can be transmitted between controls, so that the function of the controls can automatically adapt to the needs of the interface. Specific actions can be implemented in combination with business scenarios, making the application more intelligent. At the same time, without presetting execution parameters, the amount of code that developers need can also be reduced.
[0205] This application also proposes a control that corresponds to at least a first action attribute and a second action attribute. The first action attribute is used to determine a first action, and the second action attribute is used to determine a second action. The first action is used to enter a first interface. In response to a user's triggering operation on the control, the first action is executed according to the first action attribute, and the second action is executed according to the second action attribute.
[0206] According to the embodiments of this application, users can perform multiple actions with just one click, making the application more intelligent, saving users multiple steps and improving the user experience.
[0207] The first action attribute can be an existing action attribute of the control, and the second action attribute can be a newly added action attribute of the control.
[0208] In one possible implementation, the control is used to acquire target data, and the second action is used to match information related to the target data in the first interface after entering the first interface.
[0209] According to the embodiments of this application, users can obtain the information they need with just one click, making the application more intelligent, saving users multiple steps and improving the user experience.
[0210] In one possible implementation, the second action is used to set the display state corresponding to the first interface after entering the first interface.
[0211] According to the embodiments of this application, users can obtain the desired interface display state with just one click, without the need for manual settings. This saves users multiple steps, makes the application more intelligent, and improves the user experience.
[0212] In one possible implementation, the second action attribute includes execution parameters for the second action, the execution parameters corresponding to the target data; the step of matching information related to the target data in the first interface specifically includes: matching the information based on the execution parameters.
[0213] According to the embodiments of this application, information related to the target data in the first interface is matched according to the execution parameters of the second action in the second action attribute. After the user enters the interface, the required information can be automatically matched, so that the user can achieve the effect of multi-step operation in one step, thereby simplifying the user's operation and making the application more intelligent.
[0214] In one possible implementation, the second action attribute includes execution parameters for the second action, the execution parameters corresponding to the display state; setting the display state corresponding to the first interface specifically includes setting the display state according to the execution parameters.
[0215] According to the embodiments of this application, the display state corresponding to the first interface is set according to the execution parameters of the second action in the second action attribute. After the user enters the interface, the display state can be automatically set, so that the user can achieve the effect of multi-step operation with one step, thereby simplifying the user's operation and making the application more intelligent.
[0216] In one possible implementation, the second action attribute includes execution parameters pre-set in the operating system of the terminal device and associated with the control.
[0217] According to the embodiments of this application, specific operations can be implemented more accurately, providing users with more precise results and improving their user experience. Simultaneously, developers do not need to implement related methods in the functional code and call interfaces provided by the operating system. For example, when implementing a search function, there is no need to construct complex SQL parameters or call the search function interface provided by the operating system in the functional code. This prevents the operating system from exposing its interfaces, reducing the risk of the operating system being attacked. Pre-setting in the operating system reduces the risk of operating system attacks due to exposed interfaces. Furthermore, it does not limit the type of operating system, allowing the method to be applied across multiple operating systems. Developers only need to preset the action attributes in the operating system, without needing to worry about the differences between different operating systems or the different versions of interfaces provided by different operating systems, nor do they need to maintain multiple sets of code, reducing the amount of code maintenance required by developers. Furthermore, pre-setting in the operating system also reduces the amount of development work required to implement the corresponding actions.
[0218] In one possible implementation, the second action attribute includes execution parameters associated with the control obtained by the terminal device in the first interface.
[0219] According to the embodiments of this application, information can be transmitted between controls, so that the function of the controls can automatically adapt to the needs of the interface. Specific actions can be implemented in combination with business scenarios, making the application more intelligent. At the same time, without presetting execution parameters, the amount of code that developers need can also be reduced.
[0220] Figure 12 This diagram illustrates the structure of a terminal device according to an embodiment of the present application. Taking a mobile phone as an example, the terminal device is shown below. Figure 12 A structural schematic diagram of mobile phone 200 is shown.
[0221] Mobile phone 200 may include a processor 210, an external memory interface 220, an internal memory 221, a USB interface 230, a charging management module 240, a power management module 241, a battery 242, antenna 1, antenna 2, a mobile communication module 251, a wireless communication module 252, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, a headphone jack 270D, a sensor module 280, buttons 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a SIM card interface 295, etc. The sensor module 280 may include a gyroscope sensor 280A, an accelerometer sensor 280B, a proximity sensor 280G, a fingerprint sensor 280H, and a touch sensor 280K (of course, mobile phone 200 may also include other sensors, such as a temperature sensor, a pressure sensor, a proximity sensor, a magnetic sensor, an ambient light sensor, a barometric pressure sensor, a bone conduction sensor, etc., not shown in the figure).
[0222] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the mobile phone 200. In other embodiments of this application, the mobile phone 200 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0223] Processor 210 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the central nervous system and command center of the mobile phone 200. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.
[0224] The processor 210 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. This memory can store instructions or data that the processor 210 has just used or that are used repeatedly. If the processor 210 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.
[0225] The processor 210 can run the control operation execution method provided in this application embodiment, so that the terminal device can detect the user's trigger operation on the control in the first interface of the terminal device, and in response to the user's trigger operation, execute the first action and the second action corresponding to the control. The first action is used to open and display the second interface, and the second action is used to match information related to the target data in the second interface or to set the display state corresponding to the second interface. The user only needs to operate with one click to obtain the required information or the display state of the interface, without the need for the user to manually search or set it. For the user, this saves multiple steps and makes the application more intelligent, improving the user experience. The processor 210 may include different devices. For example, when integrating a CPU and a GPU, the CPU and GPU can cooperate to execute the control operation execution method provided in this application embodiment. For example, in the control operation execution method, some algorithms are executed by the CPU and other algorithms are executed by the GPU to obtain faster processing efficiency.
[0226] Display screen 294 is used to display images, videos, etc. Display screen 294 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, mobile phone 200 may include one or N displays 294, where N is a positive integer greater than 1. Display screen 294 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces (GUIs). For example, display screen 294 can display photos, videos, web pages, or documents, etc. As another example, display screen 294 can display a graphical user interface. The graphical user interface (GUI) includes a status bar, a hideable navigation bar, a time and weather widget, and icons representing specific parameter values, such as browser icons. The status bar includes the carrier name (e.g., China Mobile), mobile network (e.g., 4G), time, and remaining battery power. The navigation bar includes a back button icon, a home button icon, and a forward button icon. Furthermore, it is understood that in some embodiments, the status bar may also include Bluetooth icons, Wi-Fi icons, and external device icons. It is also understood that in other embodiments, the GUI may include a Dock bar, which may include frequently used application icons. When the processor 210 detects a touch event from a user's finger (or stylus, etc.) on an application icon, in response to the touch event, it opens the user interface of the application corresponding to that application icon and displays the application's user interface on the display 294.
[0227] In this embodiment of the application, the display screen 294 can be an integral flexible display screen, or it can be a splicing display screen composed of two rigid screens and a flexible screen located between the two rigid screens.
[0228] When the processor 210 runs the execution method for control operations provided in the embodiments of this application, the terminal device can control the display screen 294 to display the corresponding graphical user interface according to the execution method for control operations provided in the embodiments of this application.
[0229] Camera 293 (either a front-facing camera or a rear-facing camera, or a single camera that can function as both) is used to capture still images or videos. Typically, camera 293 may include a photosensitive element such as a lens assembly and an image sensor. The lens assembly includes multiple lenses (convex or concave lenses) for collecting light signals reflected from the object being photographed and transmitting these signals to the image sensor. The image sensor then generates a raw image of the object being photographed based on the light signals.
[0230] Internal memory 221 can be used to store computer executable program code, which includes instructions. Processor 210 executes various functional applications and data processing of mobile phone 200 by running the instructions stored in internal memory 221. Internal memory 221 may include a program storage area and a data storage area. The program storage area can store the operating system, application code (such as camera applications, WeChat applications, etc.), etc. The data storage area can store data created during the use of mobile phone 200 (such as images and videos captured by the camera application, etc.).
[0231] The internal memory 221 may also store one or more computer programs 1310 corresponding to the execution method for control operations provided in this application embodiment. These one or more computer programs 1304 are stored in the aforementioned memory 221 and configured to be executed by the one or more processors 210. The one or more computer programs 1310 include instructions that can be used to perform actions such as... Figure 3 , Figures 5-9 In the corresponding embodiments, the computer program 1310 may include a first detection module 1001 and a first execution module 1002. The first detection module 1001 detects user trigger operations on controls in a first interface of the terminal device, where the controls are used to acquire target data. The first execution module 1002, in response to the user's trigger operation, executes a first action and a second action corresponding to the control. The first action opens and displays a second interface, and the second action matches information related to the target data in the second interface. The computer program 1310 may also include a second detection module 1101 and a second execution module 1102. The second detection module 1101 detects user trigger operations on controls in a first interface of the terminal device, where the controls are used to open a second interface. The second execution module 1102, in response to the user's trigger operation, executes a first action and a second action corresponding to the control. The first action opens and displays the second interface, and the second action sets the display state of the second interface.
[0232] In addition, the internal memory 221 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0233] Of course, the code for the control operation execution method provided in this embodiment can also be stored in external memory. In this case, the processor 210 can run the code for the control operation execution method stored in external memory through the external memory interface 220.
[0234] The functions of sensor module 280 are described below.
[0235] The gyroscope sensor 280A can be used to determine the motion attitude of the mobile phone 200. In some embodiments, the gyroscope sensor 280A can determine the angular velocity of the mobile phone 200 about three axes (i.e., the x, y, and z axes). That is, the gyroscope sensor 280A can be used to detect the current motion state of the mobile phone 200, such as whether it is shaking or stationary.
[0236] When the display screen in this embodiment is a foldable screen, the gyroscope sensor 280A can be used to detect folding or unfolding operations performed on the display screen 294. The gyroscope sensor 280A can report the detected folding or unfolding operations as events to the processor 210 to determine the folding or unfolding state of the display screen 294.
[0237] Accelerometer 280B can detect the magnitude of acceleration of mobile phone 200 in various directions (generally three axes). That is, gyroscope sensor 280A can be used to detect the current motion state of mobile phone 200, such as whether it is shaking or stationary. When the display screen in this embodiment is a foldable screen, accelerometer 280B can be used to detect folding or unfolding operations acting on display screen 294. Accelerometer 280B can report the detected folding or unfolding operations as events to processor 210 to determine the folding or unfolding state of display screen 294.
[0238] The proximity sensor 280G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The mobile phone emits infrared light outward through the LED. The mobile phone uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the mobile phone. When insufficient reflected light is detected, the mobile phone can determine that there is no object near the mobile phone. When the display screen in this embodiment is a foldable screen, the proximity sensor 280G may be disposed on the first screen of the foldable display screen 294. The proximity sensor 280G may detect the size of the folding angle or unfolding angle between the first screen and the second screen based on the optical path difference of the infrared signal.
[0239] The gyroscope sensor 280A (or accelerometer 280B) can send the detected motion state information (such as angular velocity) to the processor 210. The processor 210 determines whether the current state is handheld or tripod based on the motion state information (for example, if the angular velocity is not 0, it means that the phone 200 is handheld).
[0240] The fingerprint sensor 280H is used to collect fingerprints. The mobile phone 200 can use the collected fingerprint characteristics to achieve fingerprint unlocking, app access lock, fingerprint photography, fingerprint answering of incoming calls, etc.
[0241] Touch sensor 280K, also known as a "touch panel," can be located on display screen 294. The touch sensor 280K and display screen 294 together form a touchscreen, also known as a "touchscreen." Touch sensor 280K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 294. In other embodiments, touch sensor 280K may also be located on the surface of mobile phone 200, in a different position than display screen 294.
[0242] For example, the display screen 294 of the mobile phone 200 displays the main interface, which includes icons for multiple applications (such as a camera application, a WeChat application, etc.). The user taps the camera application icon on the main interface using the touch sensor 280K, triggering the processor 210 to launch the camera application and open the camera 293. The display screen 294 then displays the camera application's interface, such as the viewfinder.
[0243] The wireless communication function of mobile phone 200 can be implemented through antenna 1, antenna 2, mobile communication module 251, wireless communication module 252, modem processor and baseband processor.
[0244] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in mobile phone 200 can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.
[0245] The mobile communication module 251 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the mobile phone 200. The mobile communication module 251 may include at least one filter, switch, power amplifier, low-noise amplifier (LNA), etc. The mobile communication module 251 can receive electromagnetic waves via the antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to the modem processor for demodulation. The mobile communication module 251 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via the antenna 1. In some embodiments, at least some functional modules of the mobile communication module 251 may be housed in the processor 210. In some embodiments, at least some functional modules of the mobile communication module 251 and at least some modules of the processor 210 may be housed in the same device. In this embodiment, the mobile communication module 251 can also be used for information interaction with other terminal devices.
[0246] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through audio devices (not limited to speaker 270A, receiver 270B, etc.) or displays images or videos through the display screen 294. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 210 and may be housed in the same device as the mobile communication module 251 or other functional modules.
[0247] The wireless communication module 252 can provide solutions for wireless communication applications on the mobile phone 200, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 252 can be one or more devices integrating at least one communication processing module. The wireless communication module 252 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 210. The wireless communication module 252 can also receive signals to be transmitted from processor 210, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2. In this embodiment, the wireless communication module 252 is used to transmit data between other terminal devices under the control of processor 210.
[0248] In addition, mobile phone 200 can implement audio functions through audio module 270, speaker 270A, receiver 270B, microphone 270C, headphone jack 270D, and application processor, such as music playback and recording. Mobile phone 200 can receive key input 290, generating key signal inputs related to user settings and function control. Mobile phone 200 can use motor 291 to generate vibration alerts (such as vibration alerts for incoming calls). The indicator 292 in mobile phone 200 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. The SIM card interface 295 in mobile phone 200 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 295 to achieve contact and separation with mobile phone 200.
[0249] It should be understood that in practical applications, mobile phone 200 can include more than Figure 12 The number of components shown is not limited in this application embodiment. The illustrated mobile phone 200 is merely an example, and the mobile phone 200 may have more or fewer components than shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.
[0250] The software system of a terminal device can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application uses the layered architecture Android system as an example to illustrate the software structure of the terminal device.
[0251] Figure 13 This is a software structure block diagram of a terminal device according to an embodiment of this application.
[0252] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0253] The application layer can include a series of application packages.
[0254] like Figure 13 As shown, the application package may include applications such as phone, camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.
[0255] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0256] like Figure 13 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0257] The window manager is used to manage window programs. The window manager can obtain the screen size, determine if a status bar exists, lock the screen, and capture the screen. The window manager can also be used to detect whether there are operations on controls as described in this embodiment, such as clicking or swiping controls.
[0258] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0259] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0260] A phone manager is used to provide communication functions for terminal devices. For example, it manages call status (including connection and disconnection).
[0261] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0262] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating the device, and flashing indicator lights.
[0263] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
[0264] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.
[0265] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0266] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0267] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0268] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0269] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0270] A 2D graphics engine is a graphics engine for 2D drawing.
[0271] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0272] Embodiments of this application provide an execution device for control operations, including: a processor and a memory for storing processor-executable instructions; wherein the processor is configured to implement the above-described method when executing the instructions.
[0273] Embodiments of this application provide a non-volatile computer-readable storage medium storing computer program instructions thereon, which, when executed by a processor, implement the above-described method.
[0274] Embodiments of this application provide a computer program product including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, wherein when the computer-readable code is run in a processor of an electronic device, the processor in the electronic device performs the above-described method.
[0275] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), electrically programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), compact disc read-only memory (CD-ROM), digital video disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination of the foregoing.
[0276] The computer-readable program instructions or code described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.
[0277] The computer program instructions used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as "C" or similar languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state information from computer-readable program instructions. These electronic circuits can execute computer-readable program instructions to implement various aspects of this application.
[0278] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.
[0279] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.
[0280] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.
[0281] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved.
[0282] It should also be noted that each block in the block diagram and / or flowchart, as well as combinations of blocks in the block diagram and / or flowchart, can be implemented using hardware (such as circuits or ASICs (Application Specific Integrated Circuits)) that performs the corresponding function or action, or using a combination of hardware and software, such as firmware.
[0283] Although the invention has been described herein in conjunction with various embodiments, those skilled in the art will understand and implement other variations of the disclosed embodiments by reviewing the accompanying drawings, disclosure, and appended claims in carrying out the claimed invention. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude a plurality. A single processor or other unit can implement several functions listed in the claims. While different dependent claims may recite certain measures, this does not mean that these measures cannot be combined to produce good results.
[0284] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or improvement of the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.
Claims
1. A method for performing operations on controls, characterized in that, The method is used in a terminal device, and the method includes: The system detects user actions on controls in the first interface of the terminal device, whereby the controls are used to acquire target data. In response to the user's trigger operation, the control executes a first action and a second action. The first action is used to open and display a second interface, and the second action is used to match information related to the target data in the second interface. The control includes an action attribute added to the operating system. The action attribute added to the operating system is used to execute the second action. The action attribute includes execution parameters obtained by the terminal device in the first interface. The execution parameters represent the feature information of the target data. The acquisition of target data includes collecting target data. The second interface includes a data collection interface of a data collection application. The information related to the target data includes a data collection mode related to the target data among the candidate data collection modes in the data collection interface. The data collection application is set to the data collection mode related to the target data.
2. The method according to claim 1, characterized in that, The control is used to acquire the collected target data. The second interface includes a data browsing interface. The information includes data related to the target data from the collected data displayed in the data browsing interface. In the data browsing interface, the data related to the target data is highlighted.
3. The method according to claim 2, characterized in that, The data browsing interface includes a gallery browsing interface. Matching information related to the target data in the second interface includes: obtaining images related to the target data from the images in the browsing interface of the gallery.
4. The method according to claim 3, characterized in that, The data acquisition application includes a camera, and the data acquisition interface includes the camera's image capture interface. Matching information related to the target data in the second interface includes: obtaining a shooting mode related to the target data from the candidate shooting modes of the camera's shooting interface, and setting the camera to the shooting mode related to the target data.
5. The method according to any one of claims 1-4, characterized in that, The target data includes one or more of the following: images, videos, audio, and text.
6. The method according to claim 1, characterized in that, The step of matching the information in the second interface that is related to the target data specifically includes: Determine the action attribute of the second action corresponding to the control, the action attribute including the execution parameters of the second action, the execution parameters corresponding to the target data; The information is matched based on the execution parameters.
7. The method according to claim 6, characterized in that, The action attribute includes execution parameters that are pre-set in the operating system of the terminal device and associated with the control.
8. A method for performing operations on controls, characterized in that, The method is used in a terminal device, and the method includes: The system detects user actions on controls in the first interface of the terminal device, the controls being used to open a second interface. In response to the user's trigger operation, the control executes a first action and a second action. The first action is used to open and display the second interface, and the second action is used to set the display state of the second interface. The control includes action attributes newly added to the operating system. The action attributes newly added to the operating system are used to execute the second action. The action attributes include execution parameters obtained by the terminal device in the first interface. The execution parameters correspond to the display state. The execution parameters are determined based on the target keywords contained in the first interface, or the execution parameters are determined based on the type of target data displayed in the second interface. The type of target data includes any one or more of long text, images, and videos.
9. The method according to claim 8, characterized in that, Setting the display state corresponding to the second interface includes: in response to the target data displayed on the second interface being of the type of long text, setting the screen of the terminal device to eye protection mode when displaying the second interface.
10. The method according to claim 8, characterized in that, Setting the display state corresponding to the second interface includes: in response to the target data displayed on the second interface being of the type of image or video, setting the screen of the terminal device to always-on mode when displaying the second interface.
11. The method according to claim 8, characterized in that, Setting the display state corresponding to the second interface specifically includes: Determine the action attribute of the second action corresponding to the control, the action attribute including the execution parameters of the second action; The display state is set according to the execution parameters.
12. The method according to claim 11, characterized in that, The action attribute includes execution parameters that are pre-set in the operating system of the terminal device and associated with the control.
13. An execution device for operating controls, characterized in that, The device is used in a terminal device, and the device includes: The first detection module is used to detect user trigger operations on controls in the first interface of the terminal device, wherein the controls are used to acquire target data; The first execution module is used to respond to the user's trigger operation and execute a first action and a second action corresponding to the control. The first action is used to open and display a second interface, and the second action is used to match information related to the target data in the second interface. The control includes an action attribute added to the operating system. The action attribute added to the operating system is used to execute the second action. The action attribute includes execution parameters obtained by the terminal device in the first interface. The execution parameters represent the feature information of the target data. The acquisition of target data includes collecting target data. The second interface includes a data collection interface of a data collection application. The information related to the target data includes a data collection mode related to the target data among the candidate data collection modes in the data collection interface. The data collection application is set to the data collection mode related to the target data.
14. An execution device for operating controls, characterized in that, The device is used in a terminal device, and the device includes: The second detection module is used to detect user trigger operations on controls in the first interface of the terminal device, the controls being used to open the second interface; The second execution module is used to respond to the user's trigger operation and execute a first action and a second action corresponding to the control. The first action is used to open and display the second interface, and the second action is used to set the display state corresponding to the second interface. The control includes action attributes added to the operating system. The action attributes added to the operating system are used to execute the second action. The action attributes include execution parameters obtained by the terminal device in the first interface. The execution parameters correspond to the display state. The execution parameters are determined based on the target keywords contained in the first interface, or the execution parameters are determined based on the type of target data displayed in the second interface. The type of target data includes any one or more of long text, images, and videos.
15. An execution device for operating controls, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to implement the method of any one of claims 1-7 or the method of any one of claims 8-12 when executing the instructions.
16. A control, characterized in that, The control corresponds to at least a first action attribute and a second action attribute. The first action attribute is used to determine a first action, and the second action attribute is used to determine a second action. The first action is used to enter a first interface, and the second action attribute is an action attribute newly added to the operating system. In response to a user's triggering operation on the control, the first action is executed according to the first action attribute, and the second action is executed according to the second action attribute. The second action attribute includes execution parameters obtained by the terminal device in the first interface. The second action is used to set the display state corresponding to the first interface after entering the first interface. The execution parameters correspond to the display state and are determined based on the target keywords contained in the first interface.
17. The control according to claim 16, characterized in that, The control is used to obtain target data. The second action is used to match information related to the target data in the first interface after entering the first interface.
18. The control according to claim 17, characterized in that, The second action attribute includes execution parameters for the second action, the execution parameters corresponding to the target data; The step of matching the information in the first interface that is related to the target data specifically includes: The information is matched based on the execution parameters.
19. The control according to claim 17, characterized in that, The second action attribute includes the execution parameters of the second action; Setting the display state corresponding to the first interface specifically includes: The display state is set according to the execution parameters.
20. The control according to claim 18 or 19, characterized in that, The second action attribute includes execution parameters that are pre-set in the operating system of the terminal device and associated with the control.
21. A non-volatile computer-readable storage medium storing computer program instructions thereon, characterized in that, When the computer program instructions are executed by the processor, they implement the method according to any one of claims 1-7, or the method according to any one of claims 8-12.
22. A computer program product comprising computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code, wherein when the computer-readable code is executed in an electronic device, a processor in the electronic device performs the method of any one of claims 1-7, or performs the method of any one of claims 8-12.
Citation Information
Patent Citations
Photo displaying method and device
CN107239207A
Method and device for controlling camera to shoot, and computer readable storage medium
CN108540722A
Payment method, mobile terminal and computer readable storage medium
CN112101933A