Application operation method and apparatus, configuration method and apparatus, terminal, server, and storage medium

By generating operation combinations on the terminal and server side, and automatically executing application functions and actions, the low operation efficiency problem caused by the application system switching in multiple applications within the same period is solved, and efficient human-computer interaction is achieved.

WO2025157237A1PCT designated stage Publication Date: 2025-07-31CHINA MOBILE COMM LTD RES INST +1
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2025/074478
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-01-25
Filing Date
2025-01-23
Publication Date
2025-07-31

AI Technical Summary

Technical Problem

In the prior art, applications in the application system need to repeatedly switch between multiple applications when calling multiple functions within the same period, resulting in low operational efficiency.

Method used

By implementing a method on the terminal and server side, the operation instruction set is determined based on the operation intention input by the user, and the operation combination is generated using the pre-configured association relationship to automatically execute related application functions and actions without excessive manual operations.

Benefits of technology

This enables users to enter the operation intention only, and the application system can automatically trigger and execute corresponding functions, improving the operation efficiency of human-computer interaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025074478_31072025_PF_FP_ABST
    Figure CN2025074478_31072025_PF_FP_ABST
Patent Text Reader

Abstract

An application operation method and apparatus, a configuration method and apparatus, a terminal, a server, and a storage medium. The application operation method comprises: a terminal determining a first operation instruction set on the basis of first information input by a user (301), wherein the first information represents the operation intent of the user; on the basis of a plurality of pre-configured association relationships, determining a first operation combination associated with the first operation instruction set (302), wherein each association relationship is used for associating an operation instruction with an operation combination used for executing the operation instruction, the operation combination represents an operation sequence consisting of a plurality of elements of different categories, the categories of the elements comprise an application function and / or an application action and / or application content, and the first operation combination is used for executing the operation instructions in the first operation instruction set; configuring operation parameters for all or some elements in the first operation combination on the basis of the first information (303); and executing the first operation combination configured with the operation parameters (304).
Need to check novelty before this filing date? Find Prior Art

Description

Application operation, configuration method, device, terminal, server and storage medium

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application is based on the Chinese patent application with application number 202410108033.1 and application date of January 25, 2024, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby introduced into this application as a reference. Technical Field

[0003] The present application relates to the field of human-computer interaction technology, and in particular to an application operation and configuration method, device, terminal, server and storage medium. Background Art

[0004] At present, applications in the application system run independently of each other. When functions in multiple applications need to be called within the same period, it is necessary to switch back and forth between the multiple applications, which reduces operational efficiency. Summary of the Invention

[0005] To solve related technical problems, the embodiments of the present application provide an application operation, configuration method, device, terminal, server and storage medium.

[0006] The technical solution of the embodiment of the present application is implemented as follows:

[0007] The present application embodiment provides an application operation method, which is applied to a terminal and includes:

[0008] Determining a first set of operation instructions based on first information input by a user, wherein the first information represents the user's operation intention;

[0009] Based on a plurality of pre-configured association relationships, a first operation combination associated with the first operation instruction set is determined; each of the association relationships is used to associate an operation instruction with an operation combination for executing the operation instruction; the operation combination represents an operation sequence composed of a plurality of elements of different categories; the categories of the elements include application functions and / or application actions and / or application content; the first operation combination is used to execute the operation instructions in the first operation instruction set;

[0010] configuring operation parameters for all or part of the elements in the first operation combination based on the first information;

[0011] The first operation combination configured with operation parameters is executed.

[0012] Wherein, in the above solution, the method further comprises:

[0013] The multiple association relationships are obtained locally from the terminal and / or from a server.

[0014] In the above solution, the method further includes:

[0015] After executing the first operation combination, an execution result is output; the execution result includes an application interface or execution information.

[0016] In the above solution, the method further includes:

[0017] Upload second information to the server; the second information represents the user's operation behavior data; the second information is used by the server to pre-configure the multiple association relationships.

[0018] In the above solution, the method further includes:

[0019] When executing the first operation combination configured with operation parameters, outputting a first request; the first request is used to request the user to input third information; the third information represents necessary information for executing the first operation combination;

[0020] The third information input by the user is received.

[0021] The present application also provides a configuration method, which is applied to a server and includes:

[0022] Parsing each of the multiple applications to obtain elements contained in each application; categories of the elements include application functions and / or application actions and / or application content;

[0023] Based on all the elements obtained by parsing, multiple operation combinations are constructed; the operation combinations represent operation sequences composed of multiple elements of different categories;

[0024] Matching the plurality of operation combinations with the plurality of set operation instructions to determine a plurality of association relationships; each of the association relationships is used to associate an operation instruction with an operation combination for executing the operation instruction;

[0025] All the determined association relationships are stored, and / or all or part of the determined association relationships are sent to the terminal.

[0026] In the above solution, the method further includes:

[0027] Optimize all or part of the association relationships.

[0028] In the above solution, the optimization of all or part of the association relationships includes:

[0029] Receiving second information uploaded by at least one terminal; the second information represents user operation behavior data;

[0030] Based on the second information, all or part of the association relationships are optimized.

[0031] The present application also provides an application operation device, including:

[0032] A first determining unit, configured to determine a first set of operation instructions based on first information input by a user, wherein the first information represents an operation intention of the user;

[0033] a second determining unit, configured to determine, based on a plurality of pre-configured association relationships, a first operation combination associated with the first set of operation instructions; each of the association relationships being used to associate an operation instruction with an operation combination for executing the operation instruction; the operation combination representing an operation sequence consisting of a plurality of elements of different categories; the categories of the elements including application functions and / or application actions and / or application content; and the first operation combination being used to execute the operation instructions in the first set of operation instructions;

[0034] a configuration unit, configured to configure operation parameters for all or part of the elements in the first operation combination based on the first information;

[0035] An execution unit is configured to execute the first operation combination configured with operation parameters.

[0036] The present application also provides a configuration device, including:

[0037] A parsing unit, configured to parse each of the plurality of applications to obtain elements contained in each application; categories of the elements include application functions and / or application actions and / or application content;

[0038] A construction unit, configured to construct a plurality of operation combinations based on all elements obtained through parsing; the operation combinations represent operation sequences composed of a plurality of elements of different categories;

[0039] a matching unit, configured to match the plurality of operation combinations with a plurality of set operation instructions to determine a plurality of association relationships; each of the association relationships is configured to associate an operation instruction with an operation combination for executing the operation instruction;

[0040] The output unit is configured to store all the determined association relationships and / or send all or part of the determined association relationships to the terminal.

[0041] The embodiment of the present application further provides a terminal, comprising: a first processor and a first communication interface; wherein,

[0042] The first processor is configured to:

[0043] Determining a first set of operation instructions based on first information input by a user, wherein the first information represents the user's operation intention;

[0044] Based on a plurality of pre-configured association relationships, a first operation combination associated with the first operation instruction set is determined; each of the association relationships is used to associate an operation instruction with an operation combination for executing the operation instruction; the operation combination represents an operation sequence composed of a plurality of elements of different categories; the categories of the elements include application functions and / or application actions and / or application content; the first operation combination is used to execute the operation instructions in the first operation instruction set;

[0045] configuring operation parameters for all or part of the elements in the first operation combination based on the first information;

[0046] The first operation combination configured with operation parameters is executed.

[0047] The embodiment of the present application further provides a server, comprising: a second processor and a second communication interface; wherein,

[0048] The second processor is configured to:

[0049] Parsing each of the multiple applications to obtain elements contained in each application; categories of the elements include application functions and / or application actions and / or application content;

[0050] Based on all the elements obtained by parsing, multiple operation combinations are constructed; the operation combinations represent operation sequences composed of multiple elements of different categories;

[0051] Matching the plurality of operation combinations with the plurality of set operation instructions to determine a plurality of association relationships; each of the association relationships is used to associate an operation instruction with an operation combination for executing the operation instruction;

[0052] The method further comprises storing all the determined association relationships, and / or controlling the second communication interface to send all or part of the determined association relationships to the terminal.

[0053] An embodiment of the present application further provides a terminal, comprising: a first processor and a first memory for storing a computer program that can be run on the processor,

[0054] Wherein, the first processor is used to execute the steps of any of the above-mentioned application operation methods when running the computer program.

[0055] The embodiment of the present application further provides a server, comprising: a second processor and a second memory for storing a computer program that can be run on the processor,

[0056] The second processor is configured to execute any one of the steps of the above configuration method when running the computer program.

[0057] An embodiment of the present application further provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, the computer program implements the steps of any of the above-mentioned application operation methods, or implements the steps of any of the above-mentioned configuration methods.

[0058] An embodiment of the present application further provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of any of the above-mentioned application operation methods, or implements the steps of any of the above-mentioned configuration methods.

[0059] In the application operation, configuration method, device, terminal, server and storage medium, and computer program product provided in the embodiments of the present application, the user inputs first information representing the user's operation intention, and the terminal determines a first operation instruction based on the first information. Thereafter, based on multiple pre-configured association relationships, a first operation combination associated with the first operation instruction is determined. The first operation combination is composed of multiple elements of different categories in the categories of application functions and / or application actions and / or application content, including for executing the first operation instruction. Moreover, the terminal configures operation parameters for all or part of the elements in the first operation combination based on the first information, and finally executes the first operation combination configured with the operation parameters. The above scheme provides a new human-computer interaction method. The user only needs to input the operation intention, and the application system can automatically trigger one or more application functions that match the operation intention, and automatically execute the corresponding application action and / or output related application content. The user's operation intention can be completed without excessive manual operation, thereby improving the operational efficiency of human-computer interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] FIG1 is a diagram illustrating an example of a system architecture of an application system according to an embodiment of the present application;

[0061] FIG2 is a flowchart of a configuration method according to an embodiment of the present application;

[0062] FIG3 is a flowchart of an implementation method of an application operation according to an embodiment of the present application;

[0063] FIG4 is a structural block diagram of a configuration device according to an embodiment of the present application;

[0064] FIG5 is a structural block diagram of an application operating device according to an embodiment of the present application;

[0065] FIG6 is a block diagram of a server structure according to an embodiment of the present application;

[0066] FIG7 is a block diagram of a terminal structure according to an embodiment of the present application. DETAILED DESCRIPTION

[0067] At present, applications in the application system run independently of each other. When functions in multiple applications need to be called within the same period, it is necessary to switch back and forth between the multiple applications, which reduces operational efficiency.

[0068] Based on this, in each embodiment of the present application, the user inputs first information representing the user's operation intention, and the terminal determines a first operation instruction based on the first information. Thereafter, based on multiple pre-configured association relationships, a first operation combination associated with the first operation instruction is determined. The first operation combination is composed of multiple elements of different categories in the categories of application functions and / or application actions and / or application content, including for executing the first operation instruction. Moreover, the terminal configures operation parameters for all or part of the elements in the first operation combination based on the first information, and finally executes the first operation combination configured with the operation parameters. The above scheme provides a new human-computer interaction method. The user only needs to input the operation intention, and the application system can automatically trigger one or more application functions that match the operation intention, and automatically execute the corresponding application action and / or output related application content. The user's operation intention can be completed without excessive manual operation, thereby improving the operational efficiency of human-computer interaction.

[0069] The present application will be described in further detail below with reference to the accompanying drawings and embodiments.

[0070] First, the system architecture of the application system provided by the embodiment of the present application is described. Referring to Figure 1, the application system is deployed on the terminal side and the server side respectively. Among them, the terminal may include a mobile phone, a tablet, a car computer, a personal digital assistant, and other devices configured with a mobile operating system and installed with a variety of applications. From an architectural point of view, in addition to installing local applications (device local APP), the terminal is also deployed with an operation processing module, a storage module and other modules. Among them, the storage module operation processing module stores a computer program, and the operation processing module is used to run the computer program. When the computer program is run, it is used to implement the application operation method on the terminal side provided by the embodiment of the present application. An application library (APP library) is deployed in the server. The application library is oriented to currently released applications. For applications in the library, the application library parses and stores the application functions, application actions and application content involved in the application. In addition, an operation processing module and a storage module are also deployed in the server. The storage module operation processing module stores a computer program. The operation processing module is used to run the computer program. When the computer program is run, it is used to implement the configuration method on the server side provided by the embodiment of the present application.

[0071] In actual application, the server can be understood as a cloud server, server cluster, etc.

[0072] Based on the system architecture of the application system shown in Figure 1, the application operation method provided in the embodiment of the present application is described below.

[0073] 2 , an embodiment of the present application provides a configuration method, which is applied to a server. The method involves establishing the application library in FIG1 , including:

[0074] Step 201: parse each application among a plurality of applications to obtain elements contained in each application.

[0075] The categories of the elements include application functions and / or application actions and / or application content.

[0076] Applications here include, but are not limited to, operating systems such as iOS, Android, and Windows, development tools such as JAVA, and applications published on various app markets. During actual application, the server traverses the applications published by various app markets or developer organizations, parses them, and identifies the corresponding application functions, / or application actions, and / or application content for each application. Three sub-databases, namely application functions, application actions, and application content, are then constructed under the application library to centrally manage the application functions, application actions, and application content associated with these applications.

[0077] For example, for video playback apps, the app functions include video search, video playback, category browsing, video upload, video commenting, etc.; the app actions include play, volume up, volume down, mute, pause, etc.; and the app content includes various TV series, movies, live streams, etc. In other words, app functions can be understood as the functional modules provided by the app to users, app actions can be understood as the operations that users can perform on the app, and app content can be understood as the content or information output by the app to users.

[0078] The traversal process may be performed based on script traversal, or may be completed based on the decomposition of existing codes, or may be performed based on user behavior data, or may be completed based on manual use of the application.

[0079] Among them, the script traversal method, that is, by editing the script, automatically completing the click of each operation control and trigger area in the application operation interface based on the execution of the script, recording which application page and / or application content each operation control and trigger area jumps to after being clicked, and then clicking in the application page that jumps to, and repeating this cycle, thereby obtaining the operational association relationship between multiple types of elements such as operation controls, application pages, and application content, and determining the application functions, application actions, and application content involved in an application based on the relevant application pages, application page titles, text, pictures, and other contextual content, and entering the determined application functions, application actions, and application content into the three sub-databases of application functions, application actions, and application content respectively. The code decomposition method, that is, when the open source code of the application can be obtained, that is, based on the code content, obtaining the operational association relationship between multiple types of elements such as the application's operation controls, application pages, and application content, and then determining the application functions, application actions, and application content involved in an application, and entering the determined application functions, application actions, and application content into the three sub-databases of application functions, application actions, and application content respectively. The user behavior data-based approach involves obtaining the user behavior data of an application and, based on user operations, obtaining the operational relationships between multiple elements of the application, such as the operating controls, application pages, and application content, to determine the application functions, application actions, and application content involved in an application. The determined application functions, application actions, and application content are then entered into the three sub-databases of application functions, application actions, and application content. The manual application usage approach involves technicians personally operating the application to obtain the operational relationships between multiple elements, such as the operating controls, application pages, and application content, to determine the application functions, application actions, and application content involved in an application. The determined application functions, application actions, and application content are then entered into the three sub-databases of application functions, application actions, and application content.

[0080] Furthermore, in actual applications, application functions, application actions, and application content can be clarified based on image recognition. For example, based on the text or graphics on the recognized menu item, the application page with the same text or graphics can be determined as the application page with an operational association relationship with the corresponding menu item, and the direction of the operational association can be determined, that is, the menu item points to the application page, that is, triggering the menu item will jump to the application page.

[0081] Step 202: Construct multiple operation combinations based on all elements obtained through parsing.

[0082] The operation combination represents an operation sequence composed of multiple elements of different categories.

[0083] Here, an operation combination is a directional operation sequence composed of multiple elements of different categories as described above. It should be noted that one operation combination may involve multiple elements of different categories in different applications.

[0084] For example, application function A1 of application A can form an operation combination with application function B1 of application B. Application function A1 of application A can also form an operation combination with application content A2 of application A. Application content A2 of application A can also form an operation combination with application content B2 of application B. Application function A1 of application A can also form an operation combination with application action A3 of application A. Application action A3 of application A can also form an operation combination with application action B3 of application B. Application action of application A can also form an operation combination in series with application action B3 of application B and application action C3 of application C.

[0085] For example, the application function A1 of playing a video in application A is realized through application action A3: clicking the "Play" button or sliding a certain area. After executing application action A3, application A outputs application content A2, including a specific movie, TV series, or short video, etc.

[0086] For example, the function of playing videos can not only refer to playing a video in application A, but also refer to playing a video in application B.

[0087] Furthermore, after generating multiple operation combinations, they can be linked together to form longer operation sequences. For example, application function A1 and application function B1 form operation combination 1, which can then be linked together with application content A2 and application content B2 to form operation combination 2, which can then be linked together with application content C2 and application content D2 to form operation combinations, which can then be linked together with application action A3, application action B3, and application action C3 to form operation combinations, ultimately forming operation combinations A1B1A2B2C2D2A3B3C3.

[0088] In step 202, the construction of the operation combination can be based on script traversal, or it can be completed based on the decomposition of existing code, or it can be based on user behavior data, or it can be completed based on manual use of the application. The implementation principle can refer to the relevant implementation principle of the above method in step 201 above, and will not be repeated here.

[0089] Furthermore, operation combinations can be constructed by vectorizing application functions, application actions, and application content, and then measuring the vector distances between these elements. Similar to word2Vec, an action library is first established based on all application functions, application actions, and application content. This library contains all application functions, application actions, and application content. A corpus is then built based on the relationships between actions. Based on this corpus, action vectors are calculated using autoregression, or vector distances can be used to calculate the correlation between elements. This allows the calculation of the element that follows each element or sequence of elements, allowing for the construction of more operation combinations.

[0090] Step 203: Match the multiple operation combinations with the multiple set operation instructions to determine multiple association relationships.

[0091] Each of the association relationships is used to associate an operation instruction with an operation combination for executing the operation instruction.

[0092] For example, for an operation instruction Z1, the associated operation combinations of application functions, application actions and application contents are A1B1A2B2A3B3C3 and A1B1D2C2A3B3C3. Then there are two association relationships here, one is the association relationship between the operation instruction Z1 and the operation combination A1B1A2B2A3B3C3, and the other is the association relationship between the operation instruction Z1 and the operation combination A1B1D2C2A3B3C3.

[0093] Step 204: storing all the determined association relationships, and / or sending all or part of the determined association relationships to the terminal.

[0094] In actual applications, the server can store all associations, so that the terminal can request the corresponding operation combination from the server based on the parsed operation instruction set. Alternatively, the server can send all or part of the associations to the terminal, and the terminal can obtain the corresponding operation combination locally based on the parsed operation instruction set.

[0095] In one embodiment, the method further comprises:

[0096] Optimize all or part of the association relationships.

[0097] Due to the fast development speed and frequent updates of applications, the operation combination needs to be continuously optimized, and the association relationship between the operation instructions and the operation combination also needs to be continuously optimized. Therefore, the server side can optimize the association relationship based on the relevant operations of steps 201 to 203 above, including: adding or deleting association relationships, modifying some association relationships, etc.

[0098] In one embodiment, optimizing all or part of the association relationships includes:

[0099] Receiving second information uploaded by at least one terminal; the second information represents user operation behavior data;

[0100] Based on the second information, all or part of the association relationships are optimized.

[0101] Here, optimization can be performed based on the user's actual behavior data to improve the operational efficiency of the operation combination based on multiple considerations such as operation time, number of operation steps, number of jump application pages involved in the operation, number of clicks, etc.

[0102] Based on the above-mentioned pre-process on the server side, correspondingly, the embodiment of the present application further provides an application operation method, which is applied to a terminal. Referring to FIG3 , the method includes:

[0103] Step 301: Determine a first operation instruction set based on first information input by a user.

[0104] The first information represents the user's operation intention.

[0105] Step 302: Based on a plurality of pre-configured association relationships, determine a first operation combination associated with the first operation instruction set.

[0106] In which, each of the association relationships is used to associate an operation instruction with an operation combination for executing the operation instruction; the operation combination represents an operation sequence composed of multiple elements of different categories; the categories of the elements include application functions and / or application actions and / or application content; the first operation combination is used to execute the operation instructions in the first operation instruction set.

[0107] Step 303: Based on the first information, configure operation parameters for all or part of the elements in the first operation combination.

[0108] Step 304: Execute the first operation combination configured with operation parameters.

[0109] Combined with practical examples:

[0110] The terminal receives the first message "I'm going to Harbin on a business trip from X / X to X / X, please help me arrange all the related matters" input by the user via voice or text, and determines a first operation instruction set: "Arrangements for the business trip to Harbin from X / X to X / X", which includes the operation instructions: 1 "Check the weather forecast for Harbin from X / X to X / X", "Get clothing recommendations for Harbin from X / X to X / X", "Book a round-trip flight to Harbin from X / X to X / X", "Book a hotel in Harbin from X / X to X / X", and "Book an online taxi from the airport to the hotel", thereby matching the following first operation combination:

[0111] 1. Get Harbin's weather conditions and clothing recommendations during your travel time from the weather forecast app;

[0112] 2. Get travel reminders for Harbin during travel time from the weather forecast app, such as whether to bring an umbrella and sunscreen;

[0113] 3. Obtain travel flight information from the travel app and book round-trip tickets after user confirmation;

[0114] 4. Ask the user for their travel destination details, then retrieve hotel information from the travel app based on the user's provided location details. After the user confirms the details, book the hotel and related check-in services.

[0115] 5. Based on the flight and hotel information, book a ride-hailing service to and from the airport using the travel app;

[0116] 6. Set events in the calendar app based on relevant travel information.

[0117] After determining the first operation combination, the user's travel date and detailed travel address in Harbin are used as operation parameters to configure operation parameters for all or part of the elements in the first operation combination. For example, in the operation "Get Harbin's weather conditions and clothing recommendations during the travel time from the weather forecast application," the travel date and travel location are entered as operation parameters. In this way, after the weather forecast application is triggered to run, it can return the application page related to the relevant date and location based on the travel date and travel location, allowing the user to obtain weather conditions and clothing recommendations during the business trip.

[0118] For example, if the first information input by the user is "Play the most popular short video of Application A today for ten minutes", then the application function involved in the corresponding operation combination is "Application A", the application content is related to "today", "most popular", and "short video", the application action is "play", and the corresponding operation parameter is "ten minutes".

[0119] In one embodiment, the method further comprises:

[0120] When executing the first operation combination configured with operation parameters, outputting a first request; the first request is used to request the user to input third information; the third information represents necessary information for executing the first operation combination;

[0121] The third information input by the user is received.

[0122] For example, when the terminal executes the operation of "obtaining travel flight information from the travel application and booking a round-trip ticket after user confirmation", user confirmation and payment authorization are required to successfully complete the ticket booking operation. Therefore, the user needs to enter relevant information on the ticket confirmation page and the payment page to enable the first operation combination to be successfully executed.

[0123] In contrast, in related technologies, to complete the above combination of operations, users need to manually open at least four applications: the weather forecast application, the travel application, the transportation application, and the calendar application, and perform multiple operations in each application to enable the relevant application functions. Based on the embodiment of the present application, users only need to enter a sentence "I am going to Harbin on a business trip from X / X to X / X, please help me arrange the relevant matters" and confirm the flight information and hotel information. The terminal can automatically complete the rest of the matters, greatly improving operational efficiency.

[0124] In actual application, an operation instruction set is set to semantically identify the first information input by the user, and then match the first operation instruction set according to the identified semantics. Among them, the operation instruction set can be obtained by constructing a knowledge graph or an event graph, and then decomposing the semantically identified operation intention, combining the knowledge graph or the event graph to obtain the corresponding operation instruction set; or it can be obtained through a large-scale language model; or it can be obtained by using a co-occurrence probability method to find which operation instructions have the highest co-occurrence probability with this operation intention, and then select instructions with a contribution probability value higher than a certain value to form an operation instruction set; or it can be generated by using a vector distance method to find which operation instructions have a close vector distance with this operation intention, and then select instructions with a distance value lower than a certain value to form an operation instruction set; or it can be generated by manual traversal, or by a co-occurrence mechanism in user behavior data, or by a collaborative filtering method in a recommendation system. The determination of the operation instruction set is not used to limit the present disclosure.

[0125] In one embodiment, the method further comprises:

[0126] The multiple association relationships are obtained locally from the terminal and / or from a server.

[0127] As previously mentioned, in actual applications, the server can store all associations, so that the terminal can request the corresponding operation combination from the server based on the parsed operation instruction set. Alternatively, the server can send all or part of the associations to the terminal, and the terminal can obtain the corresponding operation combination locally based on the parsed operation instruction set.

[0128] In one embodiment, the method further comprises:

[0129] After executing the first operation combination, an execution result is output; the execution result includes an application interface or execution information.

[0130] For example, in the example above, the application pages that need to be displayed to the user include: Harbin's weather conditions and clothing recommendations, Harbin's travel reminders, successfully booked flight information and hotel information, online car-hailing information, and schedules.

[0131] In one embodiment, the method further comprises:

[0132] Upload second information to the server; the second information represents the user's operation behavior data; the second information is used by the server to pre-configure the multiple association relationships.

[0133] Here, the user's actual behavior data is uploaded through the terminal, and the server can configure and optimize the association relationship based on the user's actual behavior data to improve the operational efficiency of the operation combination based on multiple considerations such as operation time, number of operation steps, number of jump application pages involved in the operation, number of clicks, etc.

[0134] The above embodiment provides a new human-computer interaction method. The user only needs to input the operation intention, and the application system can automatically trigger one or more application functions that match the operation intention, and automatically execute the corresponding application actions and / or output related application content. The user's operation intention can be completed without excessive manual operation, thereby improving the operational efficiency of human-computer interaction.

[0135] In order to implement the configuration method on the server side of the embodiment of the present application, the embodiment of the present application further provides a configuration device, which is provided on the server, as shown in FIG4 , and includes:

[0136] The parsing unit 401 is configured to parse each of the multiple applications to obtain elements contained in each application; the categories of the elements include application functions and / or application actions and / or application content;

[0137] A construction unit 402 is configured to construct a plurality of operation combinations based on all elements obtained through parsing; the operation combinations represent operation sequences composed of a plurality of elements of different categories;

[0138] A matching unit 403 is configured to match the plurality of operation combinations with a plurality of set operation instructions to determine a plurality of association relationships; each association relationship is configured to associate an operation instruction with an operation combination for executing the operation instruction;

[0139] The output unit 404 is configured to store all the determined association relationships and / or send all or part of the determined association relationships to the terminal.

[0140] In one embodiment, the device further comprises:

[0141] The optimization unit is used to optimize all or part of the association relationships.

[0142] In one embodiment, the optimization unit is configured to:

[0143] Receiving second information uploaded by at least one terminal; the second information represents user operation behavior data;

[0144] Based on the second information, all or part of the association relationship is optimized.

[0145] In actual application, the above units can be implemented by a processor in the configuration device in combination with a communication interface.

[0146] It should be noted that the configuration device provided in the above embodiment is merely illustrated by the division of the aforementioned program modules. In actual applications, the aforementioned processing can be assigned to different program modules as needed, that is, the internal structure of the device can be divided into different program modules to complete all or part of the aforementioned processing. Furthermore, the configuration device provided in the above embodiment and the configuration method embodiment are based on the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0147] In order to implement the application operation method on the terminal side of the embodiment of the present application, the embodiment of the present application also provides an application operation device, which is provided on the terminal, as shown in Figure 5, and includes:

[0148] The first determining unit 501 is configured to determine a first set of operation instructions based on first information input by a user, wherein the first information represents the user's operation intention;

[0149] A second determining unit 502 is configured to determine a first operation combination associated with the first operation instruction set based on a plurality of pre-configured association relationships; each association relationship is configured to associate an operation instruction with an operation combination for executing the operation instruction; the operation combination represents an operation sequence composed of a plurality of elements of different categories; the categories of the elements include application functions and / or application actions and / or application content; the first operation combination is configured to execute the operation instructions in the first operation instruction set;

[0150] a configuration unit 503, configured to configure operation parameters for all or part of the elements in the first operation combination based on the first information;

[0151] The execution unit 504 is configured to execute the first operation combination configured with operation parameters.

[0152] In one embodiment, the device further comprises:

[0153] An acquiring unit is configured to acquire the multiple association relationships from the terminal locally and / or from a server.

[0154] In one embodiment, the apparatus further comprises:

[0155] The first output unit is used to output an execution result after executing the first operation combination; the execution result includes an application interface or execution information.

[0156] In one embodiment, the apparatus further comprises:

[0157] The uploading unit is used to upload second information to the server; the second information represents the user's operation behavior data; the second information is used by the server to pre-configure the multiple association relationships.

[0158] In one embodiment, the apparatus further comprises:

[0159] a second output unit, configured to output a first request when executing the first operation combination configured with operation parameters; the first request is used to request the user to input third information; the third information represents necessary information for executing the first operation combination;

[0160] A receiving unit is configured to receive the third information input by a user.

[0161] In actual application, the above units can be implemented by a processor in the application operating device in combination with a communication interface.

[0162] It should be noted that the configuration of the application operation device provided in the above embodiment is merely exemplified by the division of the aforementioned program modules. In actual applications, the aforementioned processing can be assigned to different program modules as needed, i.e., the internal structure of the device can be divided into different program modules to complete all or part of the aforementioned processing. Furthermore, the application operation device provided in the above embodiment and the application operation method embodiment are based on the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0163] Based on the hardware implementation of the above program modules, and in order to implement the server-side method of the embodiment of the present application, the embodiment of the present application further provides a server, as shown in FIG6 , where the server 600 includes:

[0164] The first communication interface 601 is capable of exchanging information with other network nodes;

[0165] The first processor 602 is connected to the first communication interface 601 to implement information exchange with other network nodes and is used to execute the methods provided by one or more technical solutions on the server side when running a computer program. The computer program is stored in the first memory 603.

[0166] Specifically, the first processor 602 is configured to:

[0167] Parsing each of the multiple applications to obtain elements contained in each application; categories of the elements include application functions and / or application actions and / or application content;

[0168] Based on all the elements obtained by parsing, multiple operation combinations are constructed; the operation combinations represent operation sequences composed of multiple elements of different categories;

[0169] Matching the plurality of operation combinations with the plurality of set operation instructions to determine a plurality of association relationships; each of the association relationships is used to associate an operation instruction with an operation combination for executing the operation instruction;

[0170] All determined association relationships are stored, and / or the first communication interface 601 is used to send all or part of the determined association relationships to the terminal.

[0171] In one embodiment, the first processor 602 is further configured to:

[0172] Optimize all or part of the association relationships.

[0173] In one embodiment, the first communication interface 601 is further configured to:

[0174] Receiving second information uploaded by at least one terminal; the second information represents user operation behavior data;

[0175] The first processor 602 is further configured to:

[0176] Based on the second information, all or part of the association relationship is optimized.

[0177] It should be noted that the specific processing process of the first processor 602 and the first communication interface 601 can be understood by referring to the above method.

[0178] Of course, in actual applications, the various components in server 600 are coupled together via bus system 604. It will be appreciated that bus system 604 is used to enable communication between these components. In addition to a data bus, bus system 604 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in FIG6 , all of these buses are labeled as bus system 604.

[0179] The first memory 603 in the embodiment of the present application is used to store various types of data to support the operation of the server 600. Examples of such data include: any computer program used to operate on the server 600.

[0180] The methods disclosed in the above embodiments of the present application can be applied to the first processor 602 or implemented by the first processor 602. The first processor 602 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by hardware integrated logic circuits in the first processor 602 or by software instructions. The above first processor 602 may be a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The first processor 602 can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of the present application can be directly implemented as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium located in the first memory 603. The first processor 602 reads the information in the first memory 603 and completes the steps of the above method in combination with its hardware.

[0181] In an exemplary embodiment, the server 600 may be implemented by one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers (MCUs), microprocessors, or other electronic components to execute the aforementioned method.

[0182] Based on the hardware implementation of the above program modules, and in order to implement the method on the terminal side of the embodiment of the present application, the embodiment of the present application further provides a terminal, as shown in FIG7 , the terminal 700 includes:

[0183] The second communication interface 701 is capable of exchanging information with other network nodes;

[0184] The second processor 702 is connected to the second communication interface 701 to implement information exchange with other network nodes and is used to execute the methods provided by one or more technical solutions on the terminal side when running a computer program. The computer program is stored in the second memory 703.

[0185] Specifically, the second processor 702 is configured to:

[0186] Determining a first set of operation instructions based on first information input by a user, wherein the first information represents the user's operation intention;

[0187] Based on a plurality of pre-configured association relationships, a first operation combination associated with the first operation instruction set is determined; each of the association relationships is used to associate an operation instruction with an operation combination for executing the operation instruction; the operation combination represents an operation sequence composed of a plurality of elements of different categories; the categories of the elements include application functions and / or application actions and / or application content; the first operation combination is used to execute the operation instructions in the first operation instruction set;

[0188] configuring operation parameters for all or part of the elements in the first operation combination based on the first information;

[0189] The first operation combination configured with operation parameters is executed.

[0190] In one embodiment, the second processor 702 is further configured to:

[0191] Acquire the multiple association relationships locally from the terminal; and / or,

[0192] The second communication interface 701 is configured to:

[0193] The multiple association relationships are obtained from the server.

[0194] In one embodiment, the second communication interface 701 is further configured to:

[0195] After executing the first operation combination, an execution result is output; the execution result includes an application interface or execution information.

[0196] In one embodiment, the second communication interface 701 is further configured to:

[0197] Upload second information to the server; the second information represents the user's operation behavior data; the second information is used by the server to pre-configure the multiple association relationships.

[0198] In one embodiment, the second communication interface 701 is further configured to:

[0199] When executing the first operation combination configured with operation parameters, outputting a first request; the first request is used to request the user to input third information; the third information represents necessary information for executing the first operation combination;

[0200] The third information input by the user is received.

[0201] It should be noted that the specific processing procedures of the second processor 702 and the second communication interface 701 can be understood with reference to the above method.

[0202] Of course, in actual use, the various components in terminal 700 are coupled together via bus system 704. It will be appreciated that bus system 704 is used to enable communication between these components. In addition to a data bus, bus system 704 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in FIG7 , all of these buses are labeled as bus system 704.

[0203] The second memory 703 in the embodiment of the present application is used to store various types of data to support the operation of the terminal 700. Examples of such data include: any computer program used to operate on the terminal 700.

[0204] The methods disclosed in the above embodiments of the present application can be applied to or implemented by the second processor 702. The second processor 702 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by hardware integrated logic circuits or software instructions in the second processor 702. The above second processor 702 may be a general-purpose processor, a DSP, or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, etc. The second processor 702 can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of the present application can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium located in the second memory 703. The second processor 702 reads the information in the second memory 703 and, in conjunction with its hardware, completes the steps of the above method.

[0205] In an exemplary embodiment, the terminal 700 may be implemented by one or more ASICs, DSPs, PLDs, CPLDs, FPGAs, general-purpose processors, controllers, MCUs, Microprocessors, or other electronic components to perform the aforementioned methods.

[0206] It can be understood that the memory (first memory 603, second memory 703) of the embodiment of the present application can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM); the magnetic surface memory can be a magnetic disk memory or a tape memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct rambus random access memory (DRRAM).The memories described in the embodiments of this application are intended to include, but are not limited to, these and any other suitable types of memories.

[0207] In an exemplary embodiment, the present application also provides a storage medium, namely a computer storage medium, specifically a computer-readable storage medium, which includes, for example, a first memory 603 storing a computer program. The computer program can be executed by the first processor 602 of the server 600 to complete the steps of the aforementioned server-side method. For another example, the present application also includes a second memory 703 storing a computer program. The computer program can be executed by the second processor 702 of the terminal 700 to complete the steps of the aforementioned terminal-side method. The computer-readable storage medium can be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface storage, optical disk, or CD-ROM.

[0208] It should be noted that: "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0209] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0210] In addition, the technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict.

[0211] The above description is merely a preferred embodiment of the present application and is not intended to limit the scope of protection of the present application.

Claims

1. An application operation method, applied to a terminal, includes: Determining a first set of operation instructions based on first information input by a user; The first information represents the operation intention of the user; Determining a first operation combination associated with the first set of operation instructions based on a plurality of pre-configured association relationships; each association relationship is used to associate an operation instruction with an operation combination for executing the operation instruction; the operation combination represents an operation sequence composed of a plurality of elements of different categories; the categories of the elements include application functions and / or application actions and / or application contents; the first operation combination is used to execute the operation instructions in the first set of operation instructions; Configuring operation parameters for all or part of the elements in the first operation combination based on the first information; Executing the first operation combination with configured operation parameters.

2. The method according to claim 1, further includes: Obtaining the plurality of association relationships from the local terminal and / or from a server.

3. The method according to claim 1 or 2, further includes: Outputting an execution result after executing the first operation combination; The execution result includes an application interface or execution information.

4. The method according to any one of claims 1-3, further includes: Uploading second information to a server; The second information represents the operation behavior data of the user; The second information is used for the server to pre-configure the plurality of association relationships.

5. The method according to any one of claims 1-4, further includes: Outputting a first request when executing the first operation combination with configured operation parameters; The first request is used to request the user to input third information; The third information represents the necessary information for executing the first operation combination; Receiving the third information input by the user.

6. A configuration method, applied to a server, includes: Parsing each application among a plurality of applications to obtain elements included in each application; The categories of the elements include application functions and / or application actions and / or application contents; Based on all the elements obtained by parsing, constructing a plurality of operation combinations; the operation combination represents an operation sequence composed of a plurality of elements of different categories; Matching the plurality of operation combinations with a set of a plurality of operation instructions to determine a plurality of association relationships; each association relationship is used to associate an operation instruction with an operation combination for executing the operation instruction; Storing all the determined association relationships, and / or, sending all or part of the determined association relationships to a terminal.

7. The method according to claim 6, further includes: Optimizing all or part of the association relationships.

8. The method according to claim 7, wherein The optimizing all or part of the association relationships includes: Receiving second information uploaded by at least one terminal; the second information represents the operation behavior data of the user; Optimizing all or part of the association relationships based on the second information.

9. An application operation device, includes: A first determination unit, configured to determine a first set of operation instructions based on first information input by a user; The first information represents the operation intention of the user; A second determination unit, configured to determine a first operation combination associated with the first operation instruction set based on a plurality of pre-configured association relationships; Each of the association relationships is used to associate an operation instruction with an operation combination for executing the operation instruction; the operation combination represents an operation sequence composed of a plurality of elements of different categories; the categories of the elements include application functions and / or application actions and / or application contents; the first operation combination is used to execute the operation instructions in the first operation instruction set; A configuration unit, configured to configure operation parameters for all or part of the elements in the first operation combination based on the first information; An execution unit, configured to execute the first operation combination with operation parameters configured; 10. A configuration device, comprising: An analysis unit, configured to analyze each of a plurality of applications to obtain the elements included in each application; The categories of the elements include application functions and / or application actions and / or application contents; A construction unit, configured to construct a plurality of operation combinations based on all the elements obtained by analysis; the operation combination represents an operation sequence composed of a plurality of elements of different categories; A matching unit, configured to match the plurality of operation combinations with a set of a plurality of operation instructions to determine a plurality of association relationships; Each of the association relationships is used to associate an operation instruction with an operation combination for executing the operation instruction; An output unit, configured to store all the determined association relationships, and / or send all or part of the determined association relationships to a terminal.

11. A terminal, comprising: A first processor and a first communication interface; wherein, The first processor is configured to: Determine a first operation instruction set based on first information input by a user; the first information represents the operation intention of the user; Determine a first operation combination associated with the first operation instruction set based on a plurality of pre-configured association relationships; each of the association relationships is used to associate an operation instruction with an operation combination for executing the operation instruction; the operation combination represents an operation sequence composed of a plurality of elements of different categories; the categories of the elements include application functions and / or application actions and / or application contents; the first operation combination is used to execute the operation instructions in the first operation instruction set; Configure operation parameters for all or part of the elements in the first operation combination based on the first information; Execute the first operation combination with operation parameters configured.

12. A server, comprising: A second processor and a second communication interface; wherein, The second processor is configured to: Analyze each of a plurality of applications to obtain the elements included in each application; the categories of the elements include application functions and / or application actions and / or application contents; Construct a plurality of operation combinations based on all the elements obtained by analysis; the operation combination represents an operation sequence composed of a plurality of elements of different categories; Match the plurality of operation combinations with a set of a plurality of operation instructions to determine a plurality of association relationships; each of the association relationships is used to associate an operation instruction with an operation combination for executing the operation instruction; Store all the determined association relationships, and / or control the second communication interface to send all or part of the determined association relationships to the terminal.

13. A terminal, comprising: A first processor and a first memory for storing a computer program that can run on the processor, wherein, when the first processor is used to run the computer program, it executes the steps of the method according to any one of claims 1 to 5.

14. A server, comprising: A second processor and a second memory for storing a computer program that can run on the processor, wherein, when the second processor is used to run the computer program, it executes the steps of the method according to any one of claims 6 to 8.

15. A storage medium, on which a computer program is stored, characterized in that, When the computer program is executed by the processor, it implements the steps of the method according to any one of claims 1 to 5, or implements the steps of the method according to any one of claims 6 to 8.

16. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the method according to any one of claims 1 to 5, or implements the steps of the method according to any one of claims 6 to 8.

Citation Information

Patent Citations

  • Method and apparatus for combining multiple application operations on terminal and terminal

    CN105589616A

  • Terminal control method, terminal and computer readable storage medium

    CN107506103A

  • View-based voice interaction method, device, server, terminal and medium

    CN108877791A

  • Method and apparatus for voice operation

    CN109389974A

  • Application running method and device and storage medium

    CN110968362A