Operation method and device, electronic equipment and readable storage medium

By receiving user input in an electronic device and automatically prioritizing the components in the operation link, the problem of cumbersome operation steps of users in multiple scenarios is solved, and the user experience and concentration is improved.

CN118915935APending Publication Date: 2024-11-08VIVO MOBILE COMM CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411065912.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-05
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

When a user handles other scene events in one use scenario of an electronic device, there are many operation steps, resulting in a decline in user experience.

Method used

Provides an operation method and device to automatically operate on each component in the order of operation priority from high to low at the spatial level in which each component is located, by receiving input from a user to a first component in the display operation link. This simplifies multi-step operations and improves users' concentration and user experience in the current scenario.

Benefits of technology

The user can trigger the system to automatically perform multiple operation steps without exiting the current scenario, which improves the user's experience in the current scenario and reduces operational complexity and time consumption.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118915935A_ABST
    Figure CN118915935A_ABST
Patent Text Reader

Abstract

The invention discloses an operation method and device, electronic equipment and a readable storage medium, and belongs to the technical field of electronics. The operation method comprises the following steps: under the condition that a first component in an operation link is displayed, receiving a first input for the first component; responding to the first input, and according to a sequence from high operation priority to low operation priority of a spatial level where each component in the operation link is located, performing corresponding operation on each component in sequence; wherein the operation link comprises the first component located at a first spatial level and any component located at any spatial level, and the operation priority of the first spatial level is higher than that of any spatial level.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of electronic technology, and specifically relates to an operating method, a device, an electronic device and a readable storage medium. Background Art

[0002] With the popularization of electronic devices, users are increasingly using electronic devices in their work and life. For example, users read on electronic devices, users watch movies on electronic devices, and users handle work affairs on electronic devices.

[0003] In the prior art, when a user is using an electronic device to do something, interference from other events in the electronic device often occurs. For example, when a user is watching a live broadcast, he receives a chat message that includes a purchase link. The user needs to copy the purchase link, open the shopping application, and paste the link in the search box of the shopping application. The above series of operations will delay the user from watching the live broadcast, causing the user to miss the wonderful moments of the live broadcast.

[0004] It can be seen that in the prior art, when a user processes other scenario events in a usage scenario of an electronic device, there are many operation steps, which causes the user's usage experience in the current scenario to deteriorate. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide an operation method that can solve the problem that when a user processes other scenario events in a usage scenario of an electronic device, there are many operation steps, resulting in a decrease in the user's usage experience in the current scenario.

[0006] In a first aspect, an embodiment of the present application provides an operation method, the method comprising: receiving a first input to a first component in an operation link while displaying the first component; in response to the first input, performing corresponding operations on each component in the operation link in order of the operation priority of the spatial levels at which the components are located from high to low; wherein the operation link includes the first component located at a first spatial level and any component located at any spatial level, and the operation priority of the first spatial level is higher than the operation priority of the any spatial level.

[0007] In a second aspect, an embodiment of the present application provides an operating device, which includes: a receiving module, for receiving a first input to the first component when displaying the first component in an operation link; an operating module, for responding to the first input, and performing corresponding operations on each component in the operation link in order of the operation priority of the spatial levels where the components are located from high to low; wherein the operation link includes the first component located at the first spatial level and any component located at any spatial level, and the operation priority of the first spatial level is higher than the operation priority of the any spatial level.

[0008] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps described in the first aspect are implemented.

[0009] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0010] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0011] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0012] In an embodiment of the present application, when the first component in a certain operation link is displayed, the user makes a first input to the first component, and the first input is used to trigger the corresponding operation to be automatically performed on each component of the operation link starting from the first component, wherein the operation is performed in descending order according to the operation priority of the spatial hierarchy where each component is located, and the operation priority of the first spatial hierarchy where the first component is located is the highest in the operation link. It can be seen that when the user is in the current scene, if the first component in other scenes appears on the screen, the user can trigger the system to automatically perform multiple operation steps in the background through a simple input, and the user does not need to exit the current scene, so that the user can focus more on the current scene, thereby improving the user's experience in the current scene. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a flowchart of the operation method of some embodiments of the present application;

[0014] Figure 2 is a display schematic diagram of an electronic device in some embodiments of the present application;

[0015] Figure 3 is a display schematic diagram of an electronic device in some embodiments of the present application;

[0016] Figure 4 is a display schematic diagram of an electronic device in some embodiments of the present application;

[0017] Figure 5 is a display schematic diagram of an electronic device in some embodiments of the present application;

[0018] Figure 6 is a display schematic diagram of an electronic device in some embodiments of the present application;

[0019] Figure 7 is a display schematic diagram of an electronic device in some embodiments of the present application;

[0020] Figure 8 is a block diagram of an operating device of some embodiments of the present application;

[0021] Fig. 9 Schematic diagram of the hardware structure of the electronic device of some embodiments of the present application;

[0022] Fig.10 It is a schematic diagram of the hardware structure of an electronic device of some embodiments of the present application. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings of the embodiments of the present application to clearly describe the technical solutions of the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present application belong to the scope of protection of this application.

[0024] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally a class, and the number of objects is not limited. For example, the target object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0025] The operating method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0026] like Figure 1 FIG. 1 is a flowchart showing an operation method of an embodiment of the present application, and taking the method applied to an electronic device as an example, the method includes:

[0027] Step 110: When a first component in the operation link is displayed, a first input to the first component is received.

[0028] In some embodiments of the present application, the above-mentioned first input is used to trigger automatic operation processing of multiple components involved in a certain scene, wherein the scene includes the components involved including the first component. The first input can be a first operation. Exemplarily, the above-mentioned first input includes but is not limited to: the user's touch input to the controls on the screen or the screen area through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be determined according to actual use requirements, and the embodiments of the present invention are not limited. The specific gesture in the embodiment of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input.

[0029] For example, when a user is reading an e-book, the screen displays the e-book interface, and then receives a chat message from a friend, such as Figure 2 As shown, a notification box 201 of the chat application is displayed at the top of the screen, and the chat message of the friend Mengmeng is displayed in the notification box 201. The notification box 201 here is the first component. Correspondingly, the first input can be that the user long presses the notification box 201, and then a pop-up window is displayed near the notification box 201, and each component in the operation link is displayed in the pop-up window. The user drags the shadow of the notification box 201 to the pop-up window.

[0030] Step 120: In response to the first input, perform corresponding operations on each component in the operation link in descending order of the operation priority of the spatial hierarchy at which the components are located.

[0031] The operation link includes a first component at a first spatial level and any component at any spatial level, and the operation priority of the first spatial level is higher than the operation priority of any spatial level.

[0032] In this step, an operation link is generated based on a certain scenario. For the operation link, the system can perform corresponding operations on each component in the operation link in order from high to low in the spatial hierarchy of each component.

[0033] For example, the user drags the shadow of the notification box into the pop-up window, so that the system copies the text content on the notification box, pastes and searches the copied text content on the search box of the music application, clicks on a song object found on the search list, and finally clicks the play button on the current song on the playback control component. In this example, an operation link includes the components: notification box, search box, search list, and playback control component. Among them, the operation priority of the spatial level where each component is located is in the following order from high to low: the spatial level where the notification box is located, the spatial level where the search box is located, the spatial level where the search list is located, and the spatial level where the playback control component is located.

[0034] Optionally, each component is stacked in the pop-up window from top to bottom in the order of the operation priority of the spatial hierarchy in which it is located from high to low.

[0035] In this step, corresponding operations are performed on each component in turn. These operations may be performed automatically in the background, and the jumps between components and the operation process may not be displayed on the screen.

[0036] In some embodiments, starting from the first component until all operations on the operation link are completed, the entire operation process does not involve user input, and the final operation result of the entire operation link can be directly output.

[0037] For example, when a user is reading an e-book and receives a song recommended by his friend Meng Meng through a chat message, based on this embodiment, the song with the same title can be automatically played in the background.

[0038] In some embodiments, for a component in an operation link, if operation on the component involves user intervention, the component is displayed on the screen for the user to input, thereby completing the operation on the component.

[0039] For example, when a user is reading an e-book and receives a song recommended by his friend Mengmeng through a chat message, the song name can be automatically searched in the background, and multiple song objects included in the search list can be displayed. If the user manually confirms one of the song objects, the song will be automatically played in the background.

[0040] Optionally, in the operation link, the operation priority of the spatial hierarchy where the first component is located is higher than the operation priority of the spatial hierarchy where the remaining components are located, so that corresponding operations can be performed on the remaining components in sequence starting from the first component.

[0041] For example, based on an operation link in which the first component is located and based on the complete layout of the operation link, if the operation priority of the spatial layer in which the first component is located is not the highest, the operation link is cut to obtain a part of it, and in the cut part, the operation priority of the spatial layer in which the first component is located is the highest.

[0042] In more embodiments, the first component is located in multiple operation links, that is, the first component is involved in multiple scenarios. After the user makes a first input to the first component, multiple options corresponding to the multiple operation links are displayed, such as displaying multiple pop-up windows, which can be stacked together. The user drags the shadow of the first component to a pop-up window, thereby performing a series of automatic operations based on the operation link in the pop-up window. The user can expand the stacked components in the pop-up window for confirmation through input.

[0043] In an embodiment of the present application, when the first component in a certain operation link is displayed, the user makes a first input to the first component, and the first input is used to trigger the corresponding operation to be automatically performed on each component of the operation link starting from the first component, wherein the operation is performed in descending order according to the operation priority of the spatial hierarchy where each component is located, and the operation priority of the first spatial hierarchy where the first component is located is the highest in the operation link. It can be seen that when the user is in the current scene, if the first component in other scenes appears on the screen, the user can trigger the system to automatically perform multiple operation steps in the background through a simple input, and the user does not need to exit the current scene, so that the user can focus more on the current scene, thereby improving the user's experience in the current scene.

[0044] In the process of the operating method of another embodiment of the present application, before step 110, the method further includes:

[0045] Step A1: Based on historical operation data of a user in a scene, at least two components and operations performed on the at least two components are determined, wherein the at least two components are from the same application, or the at least two components are from different applications.

[0046] For example, a user is reading an e-book; at this time, a friend shares a new song that has just been released. The chat message sent by the friend is displayed at the top of the screen. The user copies the song name in the chat message and then returns to the desktop interface to open the music application. Figure 3 As shown, the user clicks the search box 301 in the music application, pastes the song name and clicks the search option, thereby displaying the search result list 302, and then clicks a song object 302, such as Figure 4As shown, the playback control component 401 of the music application is displayed, and the user clicks the play button to start playing the song in the electronic device. In the above example, the user is currently in the reading scene, and the playback scene is from the user copying in the chat message to clicking the play button in the playback control component. It can be seen that in the playback scene, the user performs corresponding operations on a series of components.

[0047] Based on the explanation of the above examples, in this step, in a scene, according to the user's historical operation data, each component involved in the scene is extracted separately, and the operations performed on each component are also extracted, such as the user's copy operation, the user's paste operation and search operation, the user's click operation on the song object, and the user's click operation on the play button.

[0048] For example, in the above-mentioned playback scenario, the components that can be extracted include: the notification box of the chat application, the search box of the music application, the search list of the music application, and the playback control component of the music application; and the operations that can be extracted include: the user copying the content in the notification box, the user pasting and searching in the search box, the user clicking in the search list, and the user clicking the play button in the playback control component.

[0049] Optionally, a component can be a control, a region, a window, or the entire interface. An operation can be a user input or a system action.

[0050] In one scenario, the extracted components may be components from the same application to simplify user operations within the application; in another scenario, the extracted components may be components from different applications to simplify user operations across applications.

[0051] Step A2: Generate an operation link based on at least two components and operations performed on at least two components. In the operation link, at least two components are located at different spatial levels, and based on the order of operations performed by the user on at least two components, the spatial levels of the at least two components are arranged from high to low.

[0052] Among them, at least two components include a first component.

[0053] In this step, for the aforementioned determined component, the circumscribed rectangular area of ​​the interface where the component is located is circled, and a component of the same shape is generated with the help of artificial intelligence (AI) capabilities, thereby completing the replication of the component, and the replicated component is used to generate an operation link.

[0054] like Figure 5As shown, based on the circled area in the interface where each component is located, each component is replicated in the same area to obtain a replicated notification box 501, a search box 502, a search list 503 and a playback control component 504.

[0055] Furthermore, the components in the application are given the function of independently receiving operations, independently responding to operations, independently displaying, etc., and specifically the button execution capability, transition animation parameters, etc. in the components. That is, on the basis of replicating the shape of the components, the functions of the components in the original application can also be replicated.

[0056] Optionally, scene slices are used as a bridge between the replica component and the original application. Scene slices are a method of decomposing an application into multiple scenes or functions, each of which can be processed as an independent component. Therefore, scene slices are extracted from the original application as a bridge between the replica component and the original application.

[0057] Furthermore, in subsequent steps, the operations performed on the replicated components are passed to the original application through scene slices. After the original application queries and processes the data, it is passed back to the replicated components through scene slices to achieve a responsive effect.

[0058] For example, in one scenario, jump from component W1 of application A1 to application A2, call the search function of component W2 of application A2, present the search results on component W3 of application A2, and use the broadcast control capability of component W4 of application A2 to play songs. Based on this, after an operation link is generated, the above components are stacked, that is, component W1 is presented above component W2, component W2 is presented above component W3, and component W3 is presented above component W4. From the perspective of spatial hierarchy, the stacking order of components is: component W1, component W2, component W3, component W4; the corresponding spatial hierarchy operation priorities are from high to low: component W1, component W2, component W3, component W4, that is, the higher the component, the higher its operation priority at the spatial hierarchy.

[0059] Optionally, in the process of generating an operation link, if the system detects that there is data flow between two applications, it is determined that the two applications have a cascade relationship, and a boundary linker is designed for the application component. The boundary linker is used to limit whether it is an up-down link or a down-up link, thereby limiting the high-low ranking order between the operation priorities of the two application components in the spatial hierarchy. Among them, components of different applications need to use boundary linkers to limit whether cross-application components are up-down links or down-up links.

[0060] Optionally, the user can set an interactive area to display an operation link in some cases. The displayed operation link allows the user to perform operations such as storage, replacement, and editing on the components therein, so that the user can centrally process components of different applications in the same operation link in the interactive area. Among them, storage is such as saving a component to ensure that the component is in the operation link; replacement is such as replacing a component in the operation link with another component; editing is such as editing in a component so that the display state of the component can assist the system to complete the entire operation link. In addition, the user can also share the entire operation link in the interactive area.

[0061] In this embodiment, based on the historical operation data of the user in a certain scene, the components involved in the scene are extracted, which can be components in the same application or components in different applications. The operations performed by the user or the system on the components can also be extracted, so as to generate an operation link for optimizing the scene operation based on the components and operations, and the operation priority between the spatial levels of each component obtained in combination with the operation sequence. Therefore, in the subsequent use of the user, if a component in the above scene appears, only a simple input is needed to trigger the system to automatically perform a series of operations based on the operation link, and the user does not need to spend too much time in the scene.

[0062] In the process of the operating method of another embodiment of the present application, step 120 includes:

[0063] Sub-step B1: Displaying the identification of each component in the operation link in descending order of the operation priority of the spatial level where each component is located, wherein the identification of each component includes the identification of the second component.

[0064] In this step, after the user's first input to the first component, Figure 6 As shown, the identifiers of the various components in the operation link where the first component 601 is located are displayed near the first component 601, such as the identifier 602 of the component W4.

[0065] Optionally, the logo of each component is displayed horizontally; the logo of each component is displayed vertically.

[0066] Alternatively, if Figure 6 As shown, the component identification is a thumbnail or symbol diagram used to represent the corresponding component.

[0067] The logos of the components are displayed in descending order of their operation priority in the spatial hierarchy.

[0068] Alternatively, in some embodiments, the identifiers of the components of the operation link where the stacked first component is located are displayed in the pop-up window. Optionally, the identifier of the component is for the corresponding component itself.

[0069] Sub-step B2: Receive a second input of an identifier that associates the first component with the second component.

[0070] In some embodiments of the present application, the second input is used to associate the identifiers of the first component with the second component to trigger the corresponding operation starting from the first component, and then sequentially performing the corresponding operation on the components of the spatial hierarchy with lower operation priority, until the second component is reached, thereby displaying the second component. The second input can be a second operation. Exemplarily, the second input includes but is not limited to: the user's touch input to the controls on the screen or the screen area through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible input, which can be determined according to actual use requirements, and the embodiments of the present invention are not limited. The specific gesture in the embodiment of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input.

[0071] like Figure 6 As shown, the second input may be that the user long presses the first component 601 and drags the shadow of the first component 601 to the logo 602 of the component W4.

[0072] For another example, the second input may be that the user long presses the first component to display a pop-up window, in which each component is displayed, and the user drags the shadow of the first component to a component in the pop-up window. When the user drags the shadow of the first component to a component, the component may be displayed separately from the stacking layer to facilitate the user's confirmation.

[0073] Sub-step B3: In response to the second input, perform corresponding operations on each component in the operation link in descending order of the operation priority of the spatial hierarchy in which the components are located, starting from the first component, until the second component is displayed before the corresponding operation is performed on the second component.

[0074] For example, the first component is component W1, and the second component is component W4. After operating on component W1, component W2 is opened. After operating on component W2, component W3 is opened. After operating on component W3, component W4 is opened.

[0075] Optionally, in response to the first input, a floating window is displayed on the screen, and most of the area in the floating window is used as the main area to display the component currently being operated, and the remaining area in the floating window is used to display the identifiers of all components in an operation link. Therefore, when the system opens a component, the currently opened component can be displayed in the main area of ​​the floating window, so that the operation progress can be displayed to the user in real time. Correspondingly, in this embodiment, the display effect achieved can be that the second component is displayed in the main area of ​​the floating window.

[0076] Optionally, in response to the first input, a pop-up window is displayed on the screen, and the pop-up window displays the components stacked together. Therefore, when the system opens a component, the component can be expanded to be displayed in the pop-up window, and the remaining components continue to be displayed in a stacked manner. Correspondingly, in this embodiment, the display effect achieved can be that the expanded second component is displayed in the pop-up window.

[0077] In an application scenario, if the operation on the second component requires user participation, the system can be automatically operated on each component through the second input trigger until the second component is manually operated by the user.

[0078] In this embodiment, based on the pre-generated operation link, in the scenario where the operation link is applied, the user uses the second input control to open a component in the operation link, and the current display state of the component is obtained after the system automatically operates at least one component. The user can operate on the component without operating more components. It can be seen that this embodiment can reduce the number of components operated by the user and make the operation results of individual components meet the user's manual operation requirements, thereby providing a semi-automatic scene operation optimization method combined with user manual operation.

[0079] In the process of the operation method of another embodiment of the present application, in the process of performing corresponding operations on each component in the operation link in order from high to low according to the operation priority of the spatial hierarchy where each component is located, each time an operation is performed on a component, the component is displayed on the screen, and the state of the component is based on the state after the corresponding operation is performed.

[0080] For example, in Figure 6In one implementation of the first input, after the user selects content in the notification box, the user long presses the notification box, so that the system automatically copies the selected content in the notification box, and then opens the song search box. At this time, the notification box is replaced by the song search box, and the song search box displays the content copied in the notification box; then, the search list is opened. At this time, the song search box is replaced by the search list. If there is only one song object in the search list, the playback control component continues to be opened. At this time, the search list is replaced by the playback control component, and the above-searched song object starts to be played. In the process of playing songs, the user can manually control the song playback, pause, switch, etc. on the playback control component.

[0081] When any component is displayed, the user can manually change the operation result on the component within the preset display duration. For example, if the content displayed in the song search box cannot accurately express the name of the song, the user can manually edit it; for another example, the system selects the first song object in the search list by default, and the user can also manually select other song objects.

[0082] In this embodiment, when the system automatically completes an operation link, the operation results on each component are displayed on the screen in real time. The user can pay attention to the operation results in real time and intervene in the system operation at any time, so that the final operation result will not have errors, thereby avoiding the phenomenon of users re-operating due to system operation errors.

[0083] In the process of an operation method of another embodiment of the present application, after generating an operation link, the method further includes:

[0084] The components in the operation link are displayed in order of their operation priority from high to low in the spatial hierarchy.

[0085] Optionally, operation links generated based on various scenarios are stored in a designated storage path of the system, and the user can trigger the display of any operation link according to the storage path.

[0086] Alternatively, if Figure 5 As shown, the components are displayed tiled; alternatively, the components are displayed stacked.

[0087] Receives input for adjusting the operational priority of the spatial hierarchy in which each component is located.

[0088] For example, the above input can be: stretching out the stacked components, and the initial spatial hierarchy operation priorities are in the order from high to low: component W1, component W2, component W3, component W4; the user long presses component W2 and drags component W2 between component W3 and component W4, and the adjusted spatial hierarchy operation priorities are in the order from high to low: component W1, component W3, component W2, component W4.

[0089] In an application scenario, a method for adjusting the operation priority between components is provided to make the execution of the operation sequence reasonable. For example, the operation result of component 1 needs to be applied to the operation of component 2, so the operation priority of the spatial layer where component 1 is located is higher than the operation priority of the spatial layer where component 2 is located. If this condition cannot be met in the generated operation chain, manual adjustment is required.

[0090] In an application scenario, based on an operation link automatically generated by the system, a new operation link can be generated through manual adjustment by the user to be applied in other scenarios.

[0091] In this embodiment, the user can adjust the order of operation priorities of the spatial levels where all components in the generated operation chain are located, so that when the system automatically operates, an operation chain can be completed reasonably according to the adjusted operation order.

[0092] In the process of the operation method of another embodiment of the present application, after displaying each component in the operation link in sequence according to the operation priority of the spatial hierarchy where each component is located from high to low, the user can also manually replace one of the components with a component of the same type.

[0093] An application scenario is, for example, replacing the playback control component of a certain audio application in an operation link with the playback control component of another audio application.

[0094] Alternatively, users can manually replace one of the components with any component.

[0095] Application scenarios include replacing a component in an operation link with another component, thereby generating a new operation link for use in other scenarios.

[0096] In this embodiment, the user can replace and adjust the components in the generated operation link so that when the system operates automatically, each component can be opened according to the user's wishes.

[0097] In the process of the operating method of another embodiment of the present application, in step A1, it includes:

[0098] Sub-step C1: when the frequency of a user using a scene is greater than a threshold, at least two components and operations performed on the at least two components are determined based on the historical operation data of the user in the scene.

[0099] For example, taking components as units, identify components 1, 2, and 3 that are used more frequently by users, then identify component 2 that is used in combination with component 1, link combination 1 and component 2, and identify a scenario.

[0100] The threshold in this step is used to limit the scenarios frequently used by users, and a specific value can be set.

[0101] For example, component 1 is used three times a day, component 2 is used five times a day, and component 3 is used four times a day, and they are considered to be the three components with higher user usage frequencies. After calculation, the frequency of combined use of component 1 and component 2 is three times a day, and the frequency of use of this combination scenario is considered to be high. Correspondingly, the threshold here can be twice a day.

[0102] Optionally, based on various applications installed on the electronic device, such as e-book applications, video applications, audio applications, audio book applications, and note applications, components that are frequently used by users in each application are identified. Further, after the components that are frequently used by users are identified, these components are parsed to identify the continuity and interactivity between these components, thereby determining multiple components that need to be linked together.

[0103] Optionally, after an operation link is generated based on a common scenario, the operation link can help a user quickly handle an event in a certain scenario, and thus can be used as a shortcut command, which can be shared with other users to provide convenience for more users.

[0104] In this embodiment, based on the components frequently used by the user, the scenarios frequently used by the user are identified, thereby linking the various components involved in the scenarios together, so that the system can subsequently perform a series of automatic operations without the user having to operate on each component, thereby simplifying user scenario operations.

[0105] In the process of the operating method of another embodiment of the present application, in step A1, it includes:

[0106] Sub-step D1: When a shortcut command includes at least two sub-commands, based on the at least two sub-commands, at least two components corresponding to the at least two sub-commands and operations performed on the at least two components are determined.

[0107] Among them, the execution scenario of the shortcut command is a scene, and the sub-command is used to instruct the operation on the component.

[0108] Optionally, the user creates a shortcut command in advance. For example, a shortcut command is: if it is detected that the electronic device is connected to the headphone device after 22:00 in the evening, open the music application to play light music, open the reading application, and turn on the focus mode of the electronic device. Among them, playing light music, opening the reading application, and turning on the focus mode are all sub-commands.

[0109] For example, a quick command is: if the alarm in the morning is detected to be over, then report the weather conditions of the day, such as the lowest temperature, the highest temperature, and the probability of rainfall, and play the day's to-do list, pending express delivery, and headlines, and finally open the music app to play favorite songs. Among them, reporting weather conditions, reporting to-do lists, reporting pending express delivery, reporting headlines, and playing favorite songs are all sub-commands.

[0110] In this embodiment, after semantically segmenting each processing item in a shortcut command, the components corresponding to each intent are determined, and the operation priority of each component in the spatial hierarchy is determined, and finally the components are spliced ​​into an operation link.

[0111] For example, after semantic intent segmentation, a string is obtained to represent each semantic intent, such as S1, S2...Sn, and the application identifier of the string execution is read out, such as A1, A2...An. With the help of AI capabilities, the system replicates the components that need to be completed in sequence and generates an operation chain, including component W1, component W2...component Wn.

[0112] Alternatively, if Figure 7 As shown, the setting window 701 of the shortcut command is displayed synchronously with the setting window 702 of the scene link, and the user can adjust the order of the operation priority of each component in the scene, and can also replace individual components. Further, after the user clicks the conversion option 703, the content of the shortcut command can be synchronously updated according to the operation link adjusted by the user.

[0113] Thus, in the process of executing a shortcut command, the operation link of the shortcut command generated based on this embodiment can be presented in a flowchart graphical linkage, and the entire operation process can be presented in a replacement manner between components, so as to help users manage shortcut commands.

[0114] In this embodiment, by converting shortcuts into operation links and then using the visualization scheme in the operation links, the effect of converting shortcuts from abstract to visualized can be achieved, which adds a sense of future and technology to the application scenarios of shortcuts and improves the integrity and consistency of operation and display. In addition, combined with the above-mentioned embodiment of converting the operation links of common scenarios into shortcuts, this embodiment can also realize two-way conversion between scenarios and shortcuts.

[0115] In an embodiment of the present application, in order to ensure that the system can automatically complete an operation link, all components involved in the operation link need to be placed at the top level of the spatial system as a whole in order of their operation priority from high to low in the spatial hierarchy, so that the system can complete the operation link with priority.

[0116] In summary, in this application, the system monitors and analyzes the data flow between cross-applications, identifies the scene slices of cross-application interactions, and replicates the operated application components from the scene slices, cascading from top to bottom or from left to right into cross-application service cards to realize complex transaction conversion data flow instructions across cascaded application levels, and then adding them to the AI ​​function library for reuse in the same scene next time, solving the problem of frequent operations of users in cross-application scenarios, and using the same sense of use as convenient as operating in one application; this application can also save the user's manual operation, and directly complete multiple operations between cross-applications through the data flow instruction set; at the same time, this application supports the function of floating display of application component sets; moreover, cross-application service cards can also be shared with friends with the same needs. In addition, this application realizes visual editing and two-way conversion based on the conversion between existing shortcut instructions and component sets. Applicably, when the user is in scenes such as reading, audio-visual, and notes, this application can provide an interactive method that does not interrupt the visibility, interactivity, and immersion of the current scene, realizing information interaction and a new interactive mode of digital content, and converting high-frequency, complex, and repetitive operation processes into a task execution.

[0117] The operating method provided in the embodiment of the present application can be executed by an operating device. In the embodiment of the present application, the operating device provided in the embodiment of the present application is described by taking the operating method executed by the operating device as an example.

[0118] Figure 8 A block diagram of an operating device according to an embodiment of the present application is shown, the device comprising:

[0119] The receiving module 10 is used to receive a first input to the first component in the case where the first component in the operation link is displayed;

[0120] An operation module 20, configured to respond to the first input and perform corresponding operations on each component in the operation link in descending order of the operation priority of the spatial hierarchy at which each component is located;

[0121] The operation link includes a first component at a first spatial level and any component at any spatial level, and the operation priority of the first spatial level is higher than the operation priority of any spatial level.

[0122] In an embodiment of the present application, when the first component in a certain operation link is displayed, the user makes a first input to the first component, and the first input is used to trigger the corresponding operation to be automatically performed on each component of the operation link starting from the first component, wherein the operation is performed in descending order according to the operation priority of the spatial hierarchy where each component is located, and the operation priority of the first spatial hierarchy where the first component is located is the highest in the operation link. It can be seen that when the user is in the current scene, if the first component in other scenes appears on the screen, the user can trigger the system to automatically perform multiple operation steps in the background through a simple input, and the user does not need to exit the current scene, so that the user can focus more on the current scene, thereby improving the user's experience in the current scene.

[0123] Optionally, the device further comprises:

[0124] A determination module, used to determine at least two components and operations performed on the at least two components based on historical operation data of a user in a scene; wherein the at least two components are from the same application, or the at least two components are from different applications;

[0125] A generating module, configured to generate an operation link according to at least two components and operations performed on the at least two components; wherein, in the operation link, the at least two components are located at different spatial levels, and based on the order of operations performed by the user on the at least two components from first to last, the spatial levels at which the at least two components are located are arranged in order from high to low;

[0126] Among them, at least two components include a first component.

[0127] Optionally, the operating module 20 includes:

[0128] A display unit, used to display the identification of each component in the operation link in descending order of the operation priority of the spatial hierarchy where each component is located; wherein the identification of each component includes the identification of the second component;

[0129] A receiving unit, configured to receive a second input of an identification of the first component being associated with the second component;

[0130] The operating unit is used to respond to the second input, and perform corresponding operations on each component in the operation link in the order of the operation priority of the spatial hierarchy from high to low, starting from the first component, until the second component is displayed before the corresponding operation is performed on the second component.

[0131] Optionally, a module is determined, including:

[0132] The first determination unit is used to determine at least two components and operations performed on the at least two components based on historical operation data of the user in the scene when the frequency of the user using a scene is greater than a threshold.

[0133] Optionally, a module is determined, including:

[0134] A second determining unit is used to determine, when a shortcut instruction includes at least two sub-instructions, at least two components corresponding to the at least two sub-instructions and operations performed on the at least two components based on the at least two sub-instructions;

[0135] Among them, the execution scenario of the shortcut command is a scene, and the sub-command is used to instruct the operation on the component.

[0136] The device in the application embodiment can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the present application embodiment is not specifically limited.

[0137] The device of the embodiment of the present application may be a device having an action system. The action system may be an Android action system, an iOS action system, or other possible action systems, which are not specifically limited in the embodiment of the present application.

[0138] The device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0139] Alternatively, if Fig. 9As shown, an embodiment of the present application also provides an electronic device 100, including a processor 101, a memory 102, and a program or instruction stored in the memory 102 and executable on the processor 101. When the program or instruction is executed by the processor 101, each step of any of the above-mentioned operation method embodiments is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0140] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0141] Fig.10 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0142] The electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, a processor 1010, a camera 1011 and other components.

[0143] Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.10 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0144] Among them, the user input unit 1007 is used to receive a first input to the first component when the first component in the operation link is displayed; the processor 1010 is used to respond to the first input and perform corresponding operations on each component in the operation link in the order of the operation priority of the spatial level from high to low; wherein the operation link includes the first component located at the first spatial level and any component located at any spatial level, and the operation priority of the first spatial level is higher than the operation priority of the any spatial level.

[0145] In an embodiment of the present application, when the first component in a certain operation link is displayed, the user makes a first input to the first component, and the first input is used to trigger the corresponding operation to be automatically performed on each component of the operation link starting from the first component, wherein the operation is performed in descending order according to the operation priority of the spatial hierarchy where each component is located, and the operation priority of the first spatial hierarchy where the first component is located is the highest in the operation link. It can be seen that when the user is in the current scene, if the first component in other scenes appears on the screen, the user can trigger the system to automatically perform multiple operation steps in the background through a simple input, and the user does not need to exit the current scene, so that the user can focus more on the current scene, thereby improving the user's experience in the current scene.

[0146] Optionally, the processor 1010 is further used to determine at least two components and operations performed on the at least two components based on the historical operation data of the user in a scene; wherein the at least two components are from the same application, or the at least two components are from different applications; generate an operation link according to the at least two components and the operations performed on the at least two components; wherein, in the operation link, the at least two components are located at different spatial levels, and based on the order of the operations performed by the user on the at least two components from first to last, the spatial levels at which the at least two components are located are arranged in sequence from high to low; wherein the at least two components include the first component.

[0147] Optionally, the display unit 1006 is used to display the identification of each component in the operation link in descending order of the operation priority of the spatial hierarchy where the components are located; wherein the identification of each component includes the identification of a second component; the user input unit 1007 is also used to receive a second input associating the first component with the identification of the second component; the processor 1010 is also used to respond to the second input, and perform corresponding operations on each component in sequence starting from the first component in descending order of the operation priority of the spatial hierarchy where the components in the operation link are located, until the second component is displayed before the corresponding operation is performed on the second component.

[0148] Optionally, the processor 1010 is further configured to determine at least two components and operations performed on the at least two components based on historical operation data of the user in the scene when the frequency of a user using the scene is greater than a threshold.

[0149] Optionally, the processor 1010 is also used to determine, when a shortcut instruction includes at least two sub-instructions, based on the at least two sub-instructions, at least two components corresponding to the at least two sub-instructions and operations performed on the at least two components; wherein the execution scenario of the shortcut instruction is a scenario, and the sub-instructions are used to instruct operations to be performed on the components.

[0150] In summary, in this application, the system monitors and analyzes the data flow between cross-applications, identifies the scene slices of cross-application interactions, and replicates the operated application components from the scene slices, cascading from top to bottom or from left to right into cross-application service cards to realize complex transaction conversion data flow instructions across cascaded application levels, and then adding them to the AI ​​function library for reuse in the same scene next time, solving the problem of frequent operations of users in cross-application scenarios, and using the same sense of use as convenient as operating in one application; this application can also save the user's manual operation, and directly complete multiple operations between cross-applications through the data flow instruction set; at the same time, this application supports the function of floating display of application component sets; moreover, cross-application service cards can also be shared with friends with the same needs. In addition, this application realizes visual editing and two-way conversion based on the conversion between existing shortcut instructions and component sets. Applicably, when the user is in scenes such as reading, audio-visual, and notes, this application can provide an interactive method that does not interrupt the visibility, interactivity, and immersion of the current scene, realizing information interaction and a new interactive mode of digital content, and converting high-frequency, complex, and repetitive operation processes into a task execution.

[0151] It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video image obtained by the image capture device (such as a camera) in the video image capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and an action rod, which will not be repeated here. The memory 1009 can be used to store software programs and various data, including but not limited to applications and action systems. The processor 1010 may integrate an application processor and a modem processor, wherein the application processor mainly processes the action system, user pages and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 1010.

[0152] The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0153] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1010.

[0154] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned operation method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0155] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0156] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned operation method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0157] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0158] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned operation method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0159] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0160] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present application.

[0161] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An operating method, characterized in that: The method comprises: In a case where a first component in the operation link is displayed, receiving a first input to the first component; In response to the first input, performing corresponding operations on the components in the operation link in descending order of the operation priority of the spatial hierarchy at which the components are located; The operation link includes the first component located at a first spatial level and any component located at any spatial level, and the operation priority of the first spatial level is higher than the operation priority of the any spatial level.

2. The method according to claim 1, characterized in that: In the case of displaying the first component in the operation link, before receiving the first input to the first component, the method further includes: Determine at least two components and operations performed on the at least two components based on historical operation data of a user in a scenario; wherein the at least two components are from the same application, or the at least two components are from different applications; An operation link is generated according to the at least two components and the operations performed on the at least two components; wherein, in the operation link, the at least two components are located at different spatial levels, and based on the order of the operations performed by the user on the at least two components from first to last, the spatial levels at which the at least two components are located are arranged in order from high to low; Wherein, the at least two components include the first component.

3. The method according to claim 1, characterized in that The corresponding operations are performed on each component in the operation link in descending order of the operation priority of the spatial hierarchy at which each component is located, including: Displaying the identification of each component in the operation link in descending order of the operation priority of the spatial hierarchy where each component is located; wherein the identification of each component includes the identification of the second component; receiving a second input of an identification of the first component associated with the second component; In response to the second input, the corresponding operation is performed on each component in the operation link in order from high to low according to the operation priority of the spatial hierarchy of each component, starting from the first component, until the second component is displayed before the corresponding operation is performed on the second component.

4. The method according to claim 2, characterized in that: The determining, based on historical operation data of the user in a scene, at least two components and operations performed on the at least two components includes: When the frequency of a user using a scene is greater than a threshold, at least two components and operations performed on the at least two components are determined based on the historical operation data of the user in the scene.

5. The method according to claim 2, characterized in that: The determining at least two components and operations performed on the at least two components based on historical operation data of the user in a scene includes: In the case where a shortcut instruction includes at least two sub-instructions, based on the at least two sub-instructions, determining at least two components corresponding to the at least two sub-instructions and operations performed on the at least two components; The execution scenario of the shortcut command is a scenario, and the sub-command is used to instruct to perform an operation on a component.

6. An operating device, characterized in that: The device comprises: A receiving module, configured to receive a first input to a first component in a display operation link when the first component is displayed; An operation module, configured to respond to the first input and perform corresponding operations on each component in the operation link in descending order of the operation priority of the spatial hierarchy at which each component is located; The operation link includes the first component located at a first spatial level and any component located at any spatial level, and the operation priority of the first spatial level is higher than the operation priority of the any spatial level.

7. The device according to claim 6, characterized in that The device also includes: A determination module, configured to determine at least two components and operations performed on the at least two components based on historical operation data of a user in a scene; wherein the at least two components are from the same application, or the at least two components are from different applications; A generating module, configured to generate an operation link according to the at least two components and the operations performed on the at least two components; wherein, in the operation link, the at least two components are located at different spatial levels, and based on the order of the operations performed by the user on the at least two components from first to last, the spatial levels at which the at least two components are located are arranged in descending order; Wherein, the at least two components include the first component.

8. The device according to claim 6, characterized in that The operation module comprises: A display unit, configured to display the identification of each component in the operation link in descending order of the operation priority of the spatial hierarchy at which each component is located; wherein the identification of each component includes the identification of the second component; A receiving unit, configured to receive a second input of an identifier of the first component being associated with the second component; An operating unit is used to respond to the second input, perform corresponding operations on each component in the operation link in the order of the operation priority of the spatial hierarchy of each component from high to low, starting from the first component, until the second component is displayed before the corresponding operation is performed on the second component.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the operating method according to any one of claims 1 to 5 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the operating method according to any one of claims 1 to 5 are implemented.

Citation Information

Cited By

  • Method, device, apparatus, medium and product for processing components

    CN121501192A