Task execution method, device, equipment and system

By generating and executing target tasks on the server side, the problem that applications in the terminal device cannot be controlled by voice or text instructions is solved, improving user experience and convenience.

CN118968987AInactive Publication Date: 2024-11-15SHENZHEN UCLOUDLINK NETWORK TECH CO LTD

Patent Information

Application Number
CN202411424408.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-12
Publication Date
2024-11-15
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In existing terminal devices, some applications cannot be controlled through voice or text commands, resulting in inconvenient user experience.

Method used

The server obtains user instructions sent by the terminal device, generates target tasks, and runs the target application in the target cloud mobile phone, supporting service types that support voice or text instructions, thereby realizing voice control of the application.

Benefits of technology

It improves the user experience and convenience of the user terminal equipment, so that applications that cannot be controlled through voice can also provide voice control services, and enhances the convenience of task execution.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118968987A_ABST
    Figure CN118968987A_ABST
Patent Text Reader

Abstract

The invention provides a task execution method, device, equipment and system, relates to the technical field of software engineering, and is used for meeting the requirement of a user for controlling an application program through a voice instruction or a text instruction and improving the terminal equipment use experience of the user. The method comprises the following steps: a server obtains a user instruction sent by terminal equipment, generates a target task according to the user instruction, and obtains task key information from the user instruction according to a service type corresponding to the target task; furthermore, the server determines a target cloud mobile phone allocated to the terminal device and a target application program corresponding to the target task, and operates the target application program in the target cloud mobile phone, and the service types supported by the target application program comprise the service type corresponding to the target task. And further, the server executes the target task in the target application program according to the task key information.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of software engineering technology, and in particular to a task execution method, device, equipment and system. Background Art

[0002] With the development of artificial intelligence technology, many terminal devices are able to support interaction with users, bringing greater convenience to users. For example, users can interact with terminal devices through voice or text. When the terminal device recognizes the user's instructions, the terminal device can run local applications according to the recognized instructions.

[0003] However, after running the local application, whether the user can further realize the services provided by the application through voice control depends on the design of the application by the application manufacturer. If the application can recognize the instructions issued by the user and is configured with the automatic implementation logic of the service corresponding to the instruction, it can respond to the instructions issued by the user and call the automatic implementation logic to provide the user with the corresponding service; if the application does not support the recognition of voice instructions or text instructions, or the recognized instructions are not configured with the corresponding automatic implementation logic, the application will not be able to run automatically and provide the user with the corresponding service, resulting in reduced convenience for the user to use the terminal device. Summary of the invention

[0004] The present application proposes a task execution method, apparatus, device and system for satisfying the needs of users to control applications through voice commands or text commands, thereby improving the user's terminal device usage experience.

[0005] In order to achieve the above purpose, this application adopts the following technical solutions: In a first aspect, a task execution method is provided, which is applied to a server, and the method includes: the server obtains a user instruction sent by a terminal device, generates a target task according to the user instruction, and then obtains task key information from the user instruction according to the service type corresponding to the target task. Further, the server determines the target cloud phone assigned to the terminal device, and the target application corresponding to the target task, and runs the target application in the target cloud phone, and the service types supported by the target application include the service type corresponding to the target task. Further, the server executes the target task in the target application according to the task key information.

[0006] In the task execution method provided in the present application, the user only needs to issue a voice command or a text command in the terminal device, and the terminal device will send the user command to the server. Accordingly, the server generates a target task according to the user command, and obtains the key task information corresponding to the target task from the user command. Then, the server allocates a target cloud phone to the terminal device, and runs the target application in the target cloud phone to execute the target task, so that some applications that cannot be controlled by voice can also provide voice control services to users, thereby improving the user experience and the convenience of using the target application to complete the target task.

[0007] In one possible design, the task execution method further includes the server generating and sending a task execution result to the terminal device, so that the terminal device displays the task execution result after receiving it. In this design, the server will promptly feedback the execution status of the task to the user through the terminal device after the task execution is completed.

[0008] In a possible design, the task execution method further includes the server generating task interruption information when a task interruption occurs during the execution of the target task, and the task interruption information is used to indicate the content that needs to be supplemented by the user to complete the target task. Further, the server sends the task interruption information to the terminal device and obtains the supplementary information input by the user through the terminal device; and then executes the target task in the target application according to the supplementary information. This design implements that when the target task cannot be completed normally according to the user instruction input by the user at the initial moment, the task interruption information is sent to the user to guide the user to supplement or confirm the corresponding content, so as to continue to execute the target task.

[0009] In a possible design, the server obtains the key information of the task from the user instruction according to the service type corresponding to the target task, including: the server determines multiple key information items required to execute the target task according to the service type corresponding to the target task; and obtains the key information of the task corresponding to the multiple key information items from the user instruction according to the multiple key information items. This design ensures that the key information required to execute the task can be obtained before the task is executed, so as to ensure the normal execution of the task.

[0010] In a possible design, the task execution method further includes: the server determines a target key information item, where the target key information item is a key information item for which the corresponding task key information cannot be obtained from the user instruction. Further, the server generates and sends a key information reminder to the terminal device, where the key information reminder is used to instruct the terminal device to remind the user to supplement the key information corresponding to the target key information item. In this design, the user is helped to complete the supplement of the key information by reminding the user.

[0011] In one possible design, the task execution method further includes: when the target task is completed or an interrupt instruction is received from the user through the terminal device, the target cloud phone is released and the target cloud phone is marked as idle. In this design, when the target task is completed or the user needs to exit, the server can release the target cloud phone allocated to the terminal device to avoid wasting server resources.

[0012] In one possible design, the server determines the target cloud phone to be assigned to the terminal device, including: the server determines any cloud phone in the idle cloud phones that is configured as the location belonging area as the target cloud phone according to the location of the terminal device. Alternatively, after determining the target application corresponding to the target task, the server determines any cloud phone in the idle cloud phones that has the target application installed as the target cloud phone. Alternatively, the server creates a cloud phone instance based on the location of the terminal device and / or the target application corresponding to the target task, and determines the cloud phone instance as the target cloud phone. In this design, three implementation methods for determining the target cloud phone assigned to the terminal are provided. The target cloud phone can be assigned to the terminal device from the idle cloud phones, or a new cloud phone instance can be created and assigned to the terminal device according to the location of the terminal device or the needs of the user, so as to ensure that the target cloud phone can provide services to the user normally.

[0013] In a second aspect, a task execution method is provided, which is applied to a terminal device, and the method includes the terminal device obtaining a user instruction and sending the user instruction to a server, so that the server generates a target task according to the user instruction, and controls a target application to execute the target task in a target cloud phone, wherein the target cloud phone is a cloud phone allocated to the terminal device by the server from idle cloud phones, and the service types supported by the target application include the service types corresponding to the target task. Further, the terminal device obtains the task execution result returned by the server and displays it.

[0014] In a possible design, the task execution method further includes: the terminal device obtains task interruption information generated by the server when a task interruption occurs during the execution of the target task, the task interruption information is used to indicate the content that needs to be supplemented by the user to complete the target task; and displays the task interruption information so that the user can supplement it according to the task interruption information. Furthermore, the terminal device obtains and sends the supplementary information input by the user to the server, so that the server executes the target task in the target application according to the supplementary information.

[0015] In a third aspect, a task execution system is provided, including a terminal device and a server. The terminal device is used to obtain user instructions and send the user instructions to the server. The server is used to generate a target task according to the user instructions and obtain task key information from the user instructions according to the service type corresponding to the target task. The server is also used to determine the target cloud phone assigned to the terminal device. The server is also used to determine the target application corresponding to the target task, and run the target application in the target cloud phone, and the service types supported by the target application include the service type corresponding to the target task. The server is also used to execute the target task in the target application according to the task key information.

[0016] In a possible design, the server is also used to generate and send the task execution result to the terminal device; the terminal device is also used to display the task execution result after receiving it.

[0017] In a fourth aspect, a task execution device is provided, which is deployed on a server and includes an acquisition unit and a processing unit. The acquisition unit is used to acquire a user instruction sent by a terminal device. The processing unit is used to generate a target task according to the user instruction. The acquisition unit is also used to acquire task-critical information from the user instruction according to the service type corresponding to the target task. The processing unit is also used to determine the target cloud phone assigned to the terminal device. The processing unit is also used to determine the target application corresponding to the target task, and run the target application in the target cloud phone, and the service types supported by the target application include the service types corresponding to the target task. The processing unit is also used to execute the target task in the target application according to the task-critical information.

[0018] In a possible design, the task execution device further includes a sending unit. The processing unit is further used to generate a task execution result. The sending unit is used to send the task execution result to the terminal device so that the terminal device displays the task execution result after receiving it.

[0019] In a possible design, the processing unit is further used to generate task interruption information when a task interruption occurs during the execution of the target task, and the task interruption information is used to indicate the content that needs to be supplemented by the user to complete the target task. The sending unit is further used to send the task interruption information to the terminal device. The acquiring unit is further used to acquire the supplementary information input by the user through the terminal device. The processing unit is further used to execute the target task in the target application according to the supplementary information.

[0020] In one possible design, the processing unit is specifically used to determine multiple key information items required to execute the target task according to the service type corresponding to the target task; and obtain task key information corresponding to the multiple key information items from user instructions based on the multiple key information items.

[0021] In one possible design, the processing unit is further used to determine a target key information item, which is a key information item for which the corresponding mission key information cannot be obtained from the user instruction. The processing unit is further used to generate a key information reminder, which is used to instruct the terminal device to remind the user to supplement the key information corresponding to the target key information item. The sending unit is further used to send the key information reminder to the terminal device.

[0022] In one possible design, the processing unit is also used to release the target cloud phone and mark the target cloud phone as idle when the target task is completed or an interrupt instruction sent by the user through the terminal device is received.

[0023] In one possible design, the processing unit is specifically used to determine, based on the location of the terminal device, any cloud phone among the idle cloud phones that is configured as a location-attributing area as a target cloud phone; or, after determining the target application corresponding to the target task, determine, among the idle cloud phones, any cloud phone with the target application installed as a target cloud phone; or, based on the location of the terminal device and / or the target application corresponding to the target task, create a cloud phone instance and determine the cloud phone instance as the target cloud phone.

[0024] In a fifth aspect, a server is provided, which includes a memory and a processor; the memory and the processor are coupled, the memory is used to store computer program code, the computer program code includes computer instructions, and when the processor executes the computer instructions, the server executes the task execution method provided by the first aspect or any possible design thereof.

[0025] In a sixth aspect, a terminal device is provided, which includes a memory and a processor; the memory and the processor are coupled, the memory is used to store computer program code, the computer program code includes computer instructions, and when the processor executes the computer instructions, the terminal device executes the task execution method provided in the second aspect.

[0026] In a seventh aspect, a computer-readable storage medium is provided, in which instructions are stored. When the instructions are executed on a server, the server executes the task execution method provided in the first aspect or any possible implementation thereof.

[0027] In an eighth aspect, a computer program product is provided, the computer program product comprising computer instructions, which, when executed on a server, cause the server to execute a task execution method as provided in the first aspect or any possible implementation thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1A schematic diagram of a task execution system structure provided in an embodiment of the present application Figure 1 ; Figure 2 A schematic diagram of a task execution system structure provided in an embodiment of the present application Figure 2 ; Figure 3 A task execution method flow diagram provided for an embodiment of the present application Figure 1 ; Figure 4 A task execution method flow diagram provided for an embodiment of the present application Figure 2 ; Figure 5 A schematic diagram of the structure of a task execution device provided in an embodiment of the present application; Figure 6 A schematic diagram of the structure of a mobile terminal provided for an embodiment of the present application. DETAILED DESCRIPTION

[0029] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0030] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0031] In the description of this application, unless otherwise specified, " / " means "or", for example, A / B can mean A or B. "And / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, "at least one" and "plurality" refer to two or more. The words "first", "second", etc. do not limit the quantity and execution order, and the words "first", "second", etc. do not limit them to be different.

[0032] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0033] (1) Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new type of intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is also the study of the design principles and implementation methods of various intelligent machines, so that machines have the functions of perception, reasoning and decision-making. Artificial intelligence technology is an interdisciplinary subject that covers a wide range of fields, including both hardware-level and software-level technologies. Basic artificial intelligence technologies generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics and other technologies. Artificial intelligence software technology mainly includes computer vision technology, speech processing technology, natural language processing technology and machine learning / deep learning. With the research and advancement of artificial intelligence technology, artificial intelligence technology has been studied and applied in many fields, such as common smart homes, smart wearable devices, virtual assistants, smart speakers, smart marketing, unmanned driving, automatic driving, drones, robots, smart medical care, smart customer service, etc. I believe that with the development of technology, artificial intelligence technology will be applied in more fields and play an increasingly important role.

[0034] (2) Natural Language Processing (NLP) is an important direction in the fields of computer science and artificial intelligence. It studies various theories and methods that can enable effective communication between humans and computers using natural language. Natural language processing is a science that integrates linguistics, computer science, and mathematics. Therefore, research in this field will involve natural language, that is, the language people use in daily life, so it is closely related to the study of linguistics. Natural language processing technology usually includes text processing, semantic understanding, machine translation, robot question answering, knowledge graph and other technologies.

[0035] (3) Large Language Model (LLM) is a natural language processing technology based on deep learning. It can predict and generate text by training a large amount of corpus data. Large language models generally use recurrent neural networks (RNN) or their variants, such as long short-term memory networks (LSTM) and gated recurrent units (GRU), to capture contextual information in text sequences, thereby achieving tasks such as natural language text generation, language model evaluation, text classification, and sentiment analysis. In the field of natural language processing, large language models have been widely used in fields such as speech recognition, machine translation, automatic summarization, dialogue systems, and intelligent question and answer.

[0036] (4) Terminal device, generally refers to a device connected to a computer network or host for sending, receiving and processing data. A terminal device can be a physical device (such as a computer, smart phone, tablet computer, router, etc.) or a virtual device. When the terminal device is a physical device, it can be, for example, a computer, smart phone, tablet computer, router, etc. When the terminal device is a virtual device, it can be, for example, a remote desktop, SSH terminal device (SecureShell Terminal), etc.

[0037] Currently, when users control terminal devices that support voice or text interaction, some applications can run in response to user commands, but some applications cannot be controlled by voice commands, which affects the user experience and makes it inconvenient for users to use the terminal devices.

[0038] To solve the above problems, the present application proposes a task execution method, device, equipment and system. The task execution method is applied to a server, and the method includes: the server obtains the user instruction sent by the terminal device, and generates a target task according to the user instruction, and then obtains the task key information from the user instruction according to the service type corresponding to the target task. Furthermore, the server determines the target cloud phone assigned to the terminal device, and the target application corresponding to the target task, and runs the target application in the target cloud phone. The service types supported by the target application include the service types corresponding to the target task. Furthermore, the server executes the target task in the target application according to the task key information.

[0039] In this way, the user only needs to issue voice commands or text commands in the terminal device, and the terminal device will send the user commands to the server. Accordingly, the server generates a target task based on the user commands, and obtains the key task information corresponding to the target task from the user commands, and then allocates a target cloud phone to the terminal device in the server, enables the target cloud phone, and runs the target application in the target cloud phone to perform the target task. In this way, some applications that cannot be controlled by voice can also provide users with voice control services, thereby improving the user experience and convenience when using the target application to complete the target task.

[0040] Figure 1 A task execution system is shown. The task execution method provided in the embodiment of the present application can be applied to Figure 1 The task execution system shown is used to meet the needs of users to control applications through voice or text commands, thereby improving the user's terminal device usage experience. Figure 1 As shown, the task execution system 10 includes a terminal device 11 and a server 12 .

[0041] The terminal device 11 can be connected to the server 12 through the network to achieve data transmission. Taking the terminal device 11 as a mobile phone as an example, the terminal device 11 can establish a communication connection with the server 12 by opening a data network or connecting to a WiFi wireless network; taking the terminal device 11 as a PC as an example, it can be connected to the network through a wired or WiFi wireless method to establish a communication connection with the server 12.

[0042] An application client corresponding to the server 12 is deployed in the terminal device 11 .

[0043] The client is a user interface directly provided to the user, that is, a UI interface. After entering the UI interface, the user can issue voice commands or text commands to enable the server 12 to execute the task execution method proposed in this application to meet the user's needs.

[0044] Exemplarily, a user can enter the UI interface of the client in the following two ways.

[0045] First, the user installs the application corresponding to the server 12 on the terminal device, completes the login and obtains the right to use the system (the first login requires a registered username / password), and then enters the client's UI interface, and then uses natural language to issue instructions on the UI interface, such as through voice input, or typing text information on the keyboard.

[0046] Secondly, the user registers and logs in to the system in the browser through the web page on the terminal device and enters the UI interface.

[0047] The task execution system includes the large language model LLM module, cloud phone module, application service platform and control module.

[0048] Among them, the large language model LLM module can adopt a large language model based on the GPT-4 series, or an open source large language model such as Llama, to recognize and understand the user's natural language. The cloud phone module is a program that simulates a mobile phone. Multiple software simulated mobile phones are installed on the server cluster, and are remotely controlled by the server 12, including the creation, release, and operation of cloud phone instances. The application service platform is a server for applications that provide services to users, such as taxi service platforms, ticket booking service platforms, and food delivery service platforms. The control module is used to control the operation of each module to implement the above-mentioned task execution method.

[0049] It should be noted that the application required by the application scenario provided by the task execution system 10 for the user is pre-installed on each cloud phone in the server cluster. For example, if a taxi service is implemented, a taxi application is pre-installed. The number of cloud phones corresponds to the number of terminal devices of the users in use. That is, every time a user terminal is opened, the server remotely controls the server cluster to enable a cloud phone program to provide actual services for the user terminal.

[0050] In some embodiments, different regions may provide different applications for the same service. For example, in region A, the application "xx Travel" provides taxi services, and in region B, the application "xxBER" provides taxi services. The server selects the application that provides services in the current region for pre-installation according to the region. For example, in the server cluster deployed in region A, "xx Travel" is pre-installed to provide taxi services for users, and in the server cluster deployed in region B, "xxBER" is pre-installed to provide taxi services for users, so as to ensure that the corresponding services can be provided to users normally.

[0051] In the initial state, the types and number of cloud phones deployed in the server cluster and the APPs initially installed on the cloud phones need to be determined according to the planning and design needs of the system. For example, the system is planned to cover taxi and hotel services in countries and regions such as Country A, Country B, Region A, and Region B, and the terminal capacity supported by the system is planned to be 100,000 terminals, 50,000 terminals, 20,000 terminals, and 20,000 terminals in these four regions, respectively. Therefore, the number of cloud phones installed on the server cluster is determined according to the preset convergence ratio, such as 1:5 (that is, one cloud phone program is installed for every 5 terminals, and this ratio can be updated according to the actual system operation needs to meet the needs of the actual online customer terminals). The total number of cloud phones to be installed, that is, 20,000 country A cloud phones, 10,000 country B cloud phones, 4,000 region A cloud phones, and 4,000 region B cloud phones need to be installed on the server cluster for the four regions of Country A, Country B, Region A, and Region B. The APP installed on the cloud phone is the APP software that is legally available in each country or region. The type of software is determined according to the target task types that the system plans to support. For example, if the system plans to support users to complete taxis, ticket booking, and takeout, then the taxi APP (client), ticket booking APP (client), and takeout APP (client) available in the country or region are installed on each cloud phone. After the system installs and deploys the cloud phone and the corresponding APP, the cloud phone is dispatched by the system as a public resource of the system according to actual operations: when a terminal device in a certain area accesses the system and requests service, the system selects an idle and suitable cloud phone from the cloud phones in the area for the terminal device to use; when the terminal device chooses to exit the system at the end of the service, the system releases the cloud phone, and the cloud phone state returns to an idle state, and can be allocated to other terminals in need.

[0052] In other embodiments, cloud phones can be deployed according to the type of application, such as deploying 10,000 cloud phones with taxi-hailing software, 10,000 cloud phones for ordering takeout, and 10,000 cloud phones for booking tickets on a server cluster. Or the taxi-hailing and takeout-ordering applications are installed on the same phone, and the ticket booking application is installed on another cloud phone, that is, a combination of several applications installed on the same cloud phone. There is no restriction here. When the server allocates a cloud phone to a terminal, it allocates an idle cloud phone with the corresponding application installed according to the instruction requirements of the terminal user.

[0053] In some embodiments, the structural diagram of the task execution system provided by the present application is as follows: Figure 2As shown, multiple terminal devices establish wireless or wired network connections with the server. The server obtains corresponding services from the large language model server through the calling interface provided by the large language model. Multiple cloud phones are deployed in the server, and an application client is installed in each cloud phone. A connection is established with the server corresponding to the application to provide users with corresponding application services on the cloud phone.

[0054] In some embodiments, the task execution system 10 implements the task execution method including the following process.

[0055] The terminal device 11 can be used to obtain user instructions.

[0056] Among them, after obtaining the user instruction, the terminal device 11 can forward the user instruction to the server 12, and the server 12 calls the large language model to complete the recognition of the user instruction and generate the target task.

[0057] The server 12 may be used to obtain mission-critical information from user instructions according to the service type corresponding to the target task.

[0058] Among them, the server 12 is pre-set with key information items required for target tasks of different service types (for example, for taxi services, the user is required to provide the following through the interaction of the UI interface: departure address, destination address, required vehicle model, etc.). After determining the service type of the target task, the server 12 identifies and obtains the key information of the task from the user instructions based on the required key information items.

[0059] The server 12 can also be used to determine a target cloud phone to be allocated to the terminal device from idle cloud phones according to the location of the terminal device 11, and start the target cloud phone.

[0060] The cloud phone is deployed in a server cluster and is remotely controlled by a server 12. The server 12 allocates a target cloud phone to the terminal device 11 from idle cloud phones in the corresponding area according to the location of the terminal device 11 or the target application corresponding to the target task, or creates a cloud phone instance and allocates it to the terminal device 11, and controls the operation of the target cloud phone.

[0061] The server 12 may also be used to determine a target application corresponding to a target task and run the target application in a target cloud phone.

[0062] The service types supported by the target application include the service types corresponding to the target tasks.

[0063] The server 12 may also be used to execute a target task in a target application based on the mission-critical information.

[0064] Furthermore, after executing the target task, the server 12 can also be used to generate and send the task execution result to the terminal device 11.

[0065] Correspondingly, the terminal device 11 receives the task execution result and displays it on the terminal device 11 to provide feedback on the task execution status to the user.

[0066] It should be noted that during the entire task execution process, the natural language used by the user of the terminal device when issuing user instructions can be any language that the LLM large model can recognize (such as Chinese, English), and there is no need to translate it into the language of the terminal's location (for example, a user who uses the language of country A, using the terminal of this system in country B, can interact with the terminal in the language of country A throughout the process, without having to use the language of country B).

[0067] Figure 3 is a flowchart of a task execution method according to some exemplary embodiments. In some embodiments, the task execution method can be applied to Figure 1 The task execution system 10 shown includes a terminal device 11 and a server 12. The task execution method described above is described below.

[0068] like Figure 3 As shown, the task execution method provided in the embodiment of the present application includes the following S301-S307.

[0069] S301: The terminal device obtains a user instruction.

[0070] As a possible implementation manner, the user opens a client on a terminal device and issues a voice command or a text command, and the terminal device responds to the user's input and obtains the user's command.

[0071] It should be noted that the embodiment of the present application does not specifically limit the language of the speech uttered by the user, as long as it is a language that can be recognized by the large language model in the server, for example, different languages ​​such as Chinese and English.

[0072] S302: The terminal device sends a user instruction to the server.

[0073] Correspondingly, the server obtains the user instruction sent by the terminal device.

[0074] In some embodiments, when the terminal device sends user instructions to the server, it also reports to the server information such as the current location of the terminal device, device ID (such as the IMEI number of the user terminal), user ID (such as the unique user name registered by the user in this system), etc.

[0075] Correspondingly, after obtaining the current location of the terminal device, the server can configure an idle cloud phone in the corresponding area for the terminal device to activate, and further log in to the cloud phone and the application on the cloud phone based on the obtained device ID and user ID, and bind and store the activated cloud phone with the device ID information and user ID information to ensure that the server obtains the necessary user information used when performing the target task, so as to facilitate the subsequent provision of diversified services to users.

[0076] S303: The server generates a target task according to the user instruction.

[0077] As a possible implementation method, the server calls a large language model to recognize user instructions and match them with preset words corresponding to the task to generate a target task.

[0078] It should be noted that the preset words corresponding to the tasks can be set in advance on the server by the operation and maintenance personnel of the task execution system. For example, the preset words corresponding to the taxi task include taxi, taxi or taxi, etc., the preset words corresponding to the ticket booking task include air tickets, train tickets or high-speed rail tickets, etc., and the preset words corresponding to the takeaway task include takeaway, dining, etc. The embodiment of the present application does not make specific limitations on this.

[0079] For example, if the server identifies the user instructions obtained by the terminal device and determines that the user instructions include words such as "take a taxi, take a cab or taxi", the target task generated by the server is a taxi-hailing task; if the server identifies the user instructions obtained by the terminal device and determines that the user instructions include words such as "air ticket, train ticket or high-speed rail ticket", the target task generated by the server is a ticket booking task.

[0080] S304: The server obtains key task information from the user instruction according to the service type corresponding to the target task.

[0081] As a possible implementation method, the server determines multiple key information items required to perform the target task from the mapping relationship between the service type and the key information items according to the service type corresponding to the target task. Further, the server obtains the task key information corresponding to the multiple key information items from the user instruction according to the multiple key information items.

[0082] It should be noted that the mapping relationship between the service type and the key information item can be pre-set in the server by the operation and maintenance personnel of the task execution system, and the embodiment of the present application does not make any specific limitation on this.

[0083] Exemplarily, the mapping relationship between service types and key information items may be as shown in Table 1 below.

[0084] Table 1: Mapping relationship between service types and key information items

[0085] Based on the mapping relationship table shown in Table 1 above, if the service type corresponding to the target task is a taxi service, and the user instruction is "take an express car from A to B at 6 o'clock tonight", the server identifies the key information of the task based on the key information items corresponding to the taxi service, such as based on the departure place item, identifying the departure place as A; based on the destination item, identifying the destination as B; based on the departure time item, identifying the departure time as 6 o'clock in the evening; based on the vehicle type item, identifying the vehicle type as an express vehicle.

[0086] In some embodiments, when a user issues a request to a terminal device through an instruction, it may not be possible to fully express the information required for the target task at one time. In order to enable the server to complete the execution of the target task, the server will detect whether the key information is fully obtained, which includes the following steps.

[0087] The server determines a target key information item, where the target key information item is a key information item for which corresponding task key information cannot be obtained from the user instruction.

[0088] For example, if the user's instruction is "Take a taxi to place A at 6 o'clock tonight", the server recognizes the time and destination as the key task information, but does not obtain the departure place and car model, so the target key information items are determined to be "departure place" and "car model".

[0089] Furthermore, the server generates and sends key information reminders to the terminal device.

[0090] Among them, the key information reminder is used to instruct the terminal device to remind the user to supplement the key information corresponding to the target key information item.

[0091] For example, based on the above example, the server generates a key information reminder "preset prompt word + target key information item" (please supplement the vehicle model and departure place) based on the target key information items "departure place", "vehicle model", and the preset prompt word "please supplement". Accordingly, after receiving the key information reminder, the terminal device displays it on the terminal device or plays a sound to remind the user to supplement the key information of the task until the key information of the task of all key information items is obtained to ensure that the subsequent execution of the target task can be successfully completed.

[0092] S305. The server determines the target cloud phone to be assigned to the terminal device.

[0093] As a possible implementation method, the server determines any cloud phone configured as a location-attributing area among idle cloud phones as a target cloud phone according to the location of the terminal device.

[0094] Specifically, the server determines the country or region to which the terminal device belongs based on the acquired location of the terminal device, and determines the idle cloud phones in the country or region. Furthermore, the server selects a cloud phone from the idle cloud phones determined as the target cloud phone, allocates it to the terminal device, and establishes a temporary binding relationship between the device ID and user ID of the terminal device and the target cloud phone.

[0095] It should be noted that the cloud phones in the server are pre-configured with their respective regions by the operation and maintenance personnel of the task execution system. For example, 10,000 cloud phones are deployed to provide services for region A, and 20,000 cloud phones are deployed to provide services for region B. The embodiments of the present application do not make specific limitations on this.

[0096] Exemplarily, the server has multiple cloud phones deployed in regions A, B, and C, respectively. If the location of the terminal device obtained by the server belongs to region B, the server selects one cloud phone from the multiple idle cloud phones deployed in region B as the target cloud phone, and establishes a temporary binding relationship between the device ID and user ID of the target cloud phone and the terminal device to provide services to the user.

[0097] As another possible implementation, after determining the target application corresponding to the target task, the server determines any cloud phone with the target application installed among the idle cloud phones as the target cloud phone.

[0098] Specifically, after determining the target application corresponding to the target task, the server determines the idle cloud phones that have the target application installed, and then selects any cloud phone from the determined cloud phones as the target cloud phone, allocates it to the terminal device, and establishes the device ID and user ID of the terminal device, and a temporary binding relationship with the target cloud phone.

[0099] It should be noted that the applications installed in the cloud phones can be installed in advance by the operation and maintenance personnel of the task execution system when the cloud phones are deployed. For example, a taxi-hailing application and a ticket booking application can be installed in 10,000 cloud phones, and a food delivery application can be installed in 20,000 cloud phones. The embodiments of the present application do not make specific limitations on this.

[0100] For example, the server includes multiple cloud phones A with food delivery applications installed, multiple cloud phones B with ticket booking applications installed, and multiple cloud phones C with taxi-hailing applications installed. If the server determines that the target application corresponding to the target task is a taxi-hailing application, any idle cloud phone among the multiple cloud phones C in the server is selected as the target cloud phone, and a temporary binding relationship between the target cloud phone and the device ID and user ID of the terminal device is established to provide services to the user.

[0101] In some embodiments, the above two methods of determining the target cloud phone can also be combined, such as: the server determines the idle cloud phones in the area where the terminal device is located from all idle cloud phones based on the location of the terminal device, and then among the idle cloud phones in the area, any cloud phone with the target application installed is determined as the target cloud phone.

[0102] As another possible implementation method, when an idle cloud phone cannot complete the target task or there is no idle cloud phone, the server creates a cloud phone instance based on the location of the terminal device and / or, based on the target application corresponding to the target task, and determines the cloud phone instance as the target cloud phone.

[0103] Exemplarily, the server creates a cloud phone instance based on the location of the terminal device, including: the server determines a server cluster corresponding to the location of the terminal device, creates a cloud phone instance in the server cluster that can provide services for the location of the terminal device, determines the created cloud phone instance as the target cloud phone, allocates it to the terminal device, and establishes a device ID, user ID of the terminal device, and a temporary binding relationship with the target cloud phone.

[0104] Exemplarily, the server creates a cloud phone instance based on the target application corresponding to the target task, including: the server creates a cloud phone instance with the target application installed in the server cluster, identifies the created cloud phone instance as the target cloud phone, allocates it to the terminal device, and establishes the device ID and user ID of the terminal device, and a temporary binding relationship with the target cloud phone.

[0105] Exemplarily, the server creates a cloud phone instance based on the location of the terminal device and the target application corresponding to the target task, including: the server determines a server cluster corresponding to the location of the terminal device, creates a cloud phone instance with the target application installed in the server cluster, determines the created cloud phone instance as the target cloud phone, allocates it to the terminal device, and establishes a device ID, user ID of the terminal device, and a temporary binding relationship with the target cloud phone.

[0106] S306: The server determines a target application corresponding to the target task, and runs the target application in the target cloud phone.

[0107] The service types supported by the target application include the service types corresponding to the target tasks.

[0108] As a possible implementation, the server matches the service type corresponding to the target task with the service types supported by multiple applications installed in the target cloud phone, and determines the application including the service type corresponding to the target task as the target application. Further, the server enables the target application in the target cloud phone.

[0109] In some embodiments, after determining the target application, the server can identify the target application in the target cloud phone through a large language model, and enable the target application by simulating user clicks.

[0110] For example, after the server enables the cloud phone according to the device ID of the terminal device, the cloud phone includes application A, application B and application C, among which application A supports taxi service, application B supports ticket booking service, and application C supports food delivery service. The service type corresponding to the target task is taxi service, then the server determines that the target application in the target cloud phone is application A. Furthermore, the server program simulates the user's click operation, locates and clicks application A on the interface of the target cloud phone, and realizes the operation of the target application.

[0111] S307: The server executes the target task in the target application according to the key information of the task.

[0112] As a possible implementation method, after the target cloud phone starts running the target application (i.e., APP client), the server transmits the mission-critical information to the service platform corresponding to the target application (the server corresponding to the APP), and the service platform of the target application executes the target task based on the mission-critical information transmitted by the server.

[0113] For example, if the mission-critical information includes express, 6:00 p.m. today, and from location A to location B, the target application provides the user with a taxi service based on the mission-critical information.

[0114] In some embodiments, after the server starts the target application in the target cloud phone, it identifies the input location of the key information based on the large language model, and inputs the key information into the corresponding location by simulating clicks and inputs to implement operations on the target application, so that the target application responds to the simulated operation, calls the corresponding service of the target application, and completes the execution of the target task.

[0115] In some embodiments, after the target task is executed, the server generates a task execution result and sends it to the terminal device.

[0116] Among them, the task execution result is used to provide feedback to the user on the task execution status. For example, if the task is successfully executed, xx service has been provided to you, and the service details are xx; for another example, if the task fails, the reason for failure is xx.

[0117] In some embodiments, if the server is interrupted during the execution of the target task because the user needs to provide additional information or confirm information, in order to ensure that the server can complete the execution of the target task normally, the following steps S3071-S3073 are included.

[0118] S3071. The server generates task interruption information.

[0119] The task interruption information is used to indicate the content that needs to be supplemented by the user to complete the target task.

[0120] As a possible implementation method, when a task interruption occurs during the execution of the target task, the server calls the large language model to perform recognition on the running interface of the target application of the target cloud phone, determines the content required by the user to be provided in the current running stage of the target application, and generates task interruption information based on the content.

[0121] For example, if the target application is a "taxi" application, the server calls the large language model to determine that the target application is currently in the car model selection stage, then the task interruption information generated by the server is used to instruct the user to supplement the selection of the car model, such as "Please select a car model."

[0122] Exemplarily, based on the above example, a pop-up window appears on the current interface of the target application, including "please select from model A and model B", then the task interruption information generated by the server includes model A and model B, which is used to instruct the user to select a model from model A and model B, for example, "please select a model from model A and model B".

[0123] S3072. The server sends task interruption information to the terminal device and obtains supplementary information input by the user through the terminal device.

[0124] Correspondingly, after receiving the task interruption information sent by the server, the terminal device displays the task interruption information so that the user can complete the content supplement on the terminal device. Further, the terminal device sends the content supplemented by the user to the server for further processing by the server.

[0125] S3073. The server executes the target task in the target application according to the supplementary information.

[0126] As a possible implementation method, the server responds to the supplementary content sent by the terminal device, recognizes the user's supplementary information based on the large voice model, and makes a selection or inputs information at the current interruption point of the target application according to the supplementary information, so that the target application resumes the execution of the target task.

[0127] Exemplarily, based on the above example, if the user's supplementary content is to select the car model as "Express Car Model", the server enters "Express Car Model" or selects "Express Car Model" in the current running interface of the target application to continue executing the target task.

[0128] In some embodiments, if the target task involves payment, the user can recharge the user's corresponding account in advance and automatically complete the bill payment during the payment stage.

[0129] In some embodiments, when the target task is completed, the server releases the target cloud phone and marks the target cloud phone as idle to avoid wasting server resources.

[0130] It can be understood that in the task execution method provided in the above-mentioned embodiment of the present application, the user only needs to issue a voice command or a text command in the terminal device, and the terminal device will send the target task that the user needs to execute to the server. Accordingly, the server obtains the key task information corresponding to the target task from the user command, opens the corresponding target application in the server's cloud phone, and executes the target task, so that some applications that cannot be controlled by voice can also provide voice control services to users, thereby improving the user experience and the convenience of using the target application to complete the target task.

[0131] In one design, when the user does not need to use the services provided by the task execution system, the server can release the target cloud phone to avoid wasting server resources. Figure 4 As shown, the task execution method provided in the embodiment of the present application also includes the following steps S401-S402.

[0132] S401: The terminal device generates and sends an interrupt instruction to the server.

[0133] Correspondingly, the server receives the interrupt instruction sent by the terminal device.

[0134] As a possible implementation manner, the terminal device generates an interrupt instruction in response to the user's exit operation, and sends the interrupt instruction to the server.

[0135] S402: The server releases the target cloud phone and marks the target cloud phone as idle.

[0136] As a possible implementation method, the server responds to the interrupt instruction sent by the terminal device and releases the target cloud phone allocated to the terminal device, including: exiting all open and running applications on the target cloud phone, exiting the target cloud phone program, unbinding the target cloud phone from the device ID, user ID and other information of the terminal device, and resetting the target cloud phone status to idle.

[0137] In this way, when a new terminal device requests to be allocated a cloud phone, a cloud phone can be allocated to the terminal device from multiple idle cloud phones including the target cloud phone, providing corresponding services and improving the resource utilization of the server.

[0138] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. In order to realize the above functions, it includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiment disclosed herein, the embodiment of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0139] The embodiment of the present application can divide the functional modules of the user equipment according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. Optionally, the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0140] Figure 5 The structure diagram of a task execution device provided in an embodiment of the present application is shown in FIG. The task execution device is used to execute the above-mentioned task execution method. Figure 5 As shown, the task execution device 50 includes an acquisition unit 501 and a processing unit 502 .

[0141] The acquisition unit 501 is used to acquire a user instruction sent by a terminal device.

[0142] The processing unit 502 is used to generate a target task according to a user instruction.

[0143] The acquisition unit 501 is further used to acquire key task information from the user instruction according to the service type corresponding to the target task.

[0144] The processing unit 502 is further configured to determine a target cloud phone to be allocated to the terminal device.

[0145] The processing unit 502 is further used to determine a target application corresponding to the target task, and run the target application in the target cloud phone. The service types supported by the target application include the service types corresponding to the target task.

[0146] The processing unit 502 is further configured to execute the target task in the target application according to the task key information.

[0147] Optional, such as Figure 5 As shown, the task execution device 50 provided in the embodiment of the present application also includes a sending unit 503.

[0148] The processing unit 502 is further configured to generate a task execution result.

[0149] The sending unit 503 is used to send the task execution result to the terminal device, so that the terminal device displays the task execution result after receiving it.

[0150] Optional, such as Figure 5 As shown, in the task execution device 50 provided in the embodiment of the present application, the processing unit 502 is also used to generate task interruption information when a task interruption occurs during the execution of the target task. The task interruption information is used to indicate the content that needs to be supplemented by the user to complete the target task.

[0151] The sending unit 503 is further configured to send task interruption information to the terminal device.

[0152] The acquisition unit 501 is further used to acquire the supplementary information input by the user through the terminal device.

[0153] The processing unit 502 is further configured to execute a target task in a target application according to the supplementary information.

[0154] Optional, such as Figure 5 As shown, in the task execution device 50 provided in the embodiment of the present application, the processing unit 502 is specifically used to determine multiple key information items required to execute the target task according to the service type corresponding to the target task; and based on the multiple key information items, obtain task key information corresponding to the multiple key information items from user instructions.

[0155] Optional, such as Figure 5 As shown, in the task execution device 50 provided in the embodiment of the present application, the processing unit 502 is also used to determine the target key information item, and the target key information item is a key information item for which the corresponding task key information cannot be obtained from the user instruction.

[0156] The processing unit 502 is further configured to generate a key information reminder, where the key information reminder is used to instruct the terminal device to remind the user to supplement key information corresponding to the target key information item.

[0157] The sending unit 503 is also used to send key information reminders to the terminal device.

[0158] Optional, such as Figure 5 As shown, in the task execution device 50 provided in the embodiment of the present application, the processing unit 502 is also used to release the target cloud phone and mark the target cloud phone as idle when the target task is completed or an interrupt instruction sent by the user through the terminal device is received.

[0159] Optional, such as Figure 5 As shown, in the task execution device 50 provided in the embodiment of the present application, the processing unit 502 is specifically used to determine, according to the location of the terminal device, any cloud phone in the idle cloud phones that is configured as the location belonging area as the target cloud phone; or, after determining the target application corresponding to the target task, determine, among the idle cloud phones, any cloud phone with the target application installed as the target cloud phone; or, based on the location of the terminal device, and / or the target application corresponding to the target task, create a cloud phone instance, and determine the cloud phone instance as the target cloud phone.

[0160] In the case of implementing the functions of the above-mentioned integrated modules in the form of hardware, the embodiment of the present application provides a possible structural diagram of a server. The server is used to execute the task execution method executed by the server in the above-mentioned embodiment. Figure 6 As shown, the server 60 includes a processor 601, a memory 602 and a bus 603. The processor 601 and the memory 602 may be connected via a bus 603.

[0161] The processor 601 is the control center of the server, which can be a processor or a general term for multiple processing elements. For example, the processor 601 can be a general-purpose central processing unit (CPU) or other general-purpose processors. Among them, the general-purpose processor can be a microprocessor or any conventional processor.

[0162] As an embodiment, the processor 601 may include one or more CPUs, such as Figure 6 CPU 0 and CPU 1 are shown in .

[0163] The memory 602 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0164] As a possible implementation, the memory 602 may exist independently of the processor 601, and the memory 602 may be connected to the processor 601 via a bus 603 to store instructions or program codes. When the processor 601 calls and executes the instructions or program codes stored in the memory 602, the method provided in the embodiment of the present application can be implemented.

[0165] In another possible implementation, the memory 602 may also be integrated with the processor 601 .

[0166] The bus 603 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 6 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0167] It should be pointed out that Figure 6 The structure shown does not constitute a limitation on the server 60. Figure 6 In addition to the components shown, the server 60 may include Figure 6 More or fewer components, or combinations of certain components, or different arrangements of components may be shown.

[0168] As an example, combining Figure 5 The functions implemented by the acquisition unit 501, the processing unit 502 and the sending unit 503 in the task execution device 50 are similar to those Figure 6 The function of processor 601 in is the same.

[0169] Optional, such as Figure 6 As shown, the server provided in the embodiment of the present application may further include a communication interface 604 .

[0170] The communication interface 604 is used to connect with other devices through a communication network. The communication network may be Ethernet, wireless access network, wireless local area network (WLAN), etc. The communication interface 604 may include an acquisition unit for receiving data and a sending unit for sending data.

[0171] In one design, in the server provided in the embodiment of the present application, the communication interface can also be integrated into the processor.

[0172] Through the description of the above implementation methods, those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above functional units is used as an example. In practical applications, the above functions can be assigned to different functional units as needed, that is, the internal structure of the device can be divided into different functional units to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0173] An embodiment of the present application also provides a computer-readable storage medium, in which instructions are stored. When a computer executes the instructions, the computer executes each step in the method flow shown in the above method embodiment.

[0174] An embodiment of the present application provides a computer program product including instructions. When the instructions are executed on a computer, the computer is enabled to execute the task execution method in the above method embodiment.

[0175] Among them, the computer-readable storage medium, for example, can be but not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any combination of the above. More specific examples of computer-readable storage media (non-exhaustive list) include: an electrical connection with one or more wires, a portable computer disk, and a hard disk. Random Access Memory (RAM), Read-Only Memory (ROM), Erasable Programmable Read Only Memory (EPROM), registers, hard disks, optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any other form of computer-readable storage media in a suitable combination of the above, or numerical values ​​in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an Application Specific Integrated Circuit (ASIC). In the embodiments of the present application, a computer-readable storage medium may be any tangible medium that contains or stores a program, which may be used by or in conjunction with an instruction execution system, apparatus, or device.

[0176] Since the apparatus, device computer-readable storage medium, and computer program product in the embodiments of the present application can be applied to the above-mentioned method, the technical effects that can be obtained can also refer to the above-mentioned method embodiments, and the embodiments of the present application will not be described in detail here.

[0177] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A task execution method, characterized in that: Applied to a server, the method comprises: Obtaining a user instruction sent by a terminal device, and generating a target task according to the user instruction; Acquire key task information from the user instruction according to the service type corresponding to the target task; Determining a target cloud phone to be assigned to the terminal device; Determine a target application corresponding to the target task, and run the target application in the target cloud phone, wherein the service types supported by the target application include the service types corresponding to the target task; The target task is executed in the target application according to the task key information.

2. The task execution method according to claim 1, characterized in that: The method further comprises: Generate and send the task execution result to the terminal device, so that the terminal device displays the task execution result after receiving it.

3. The task execution method according to claim 1, characterized in that: The method further comprises: In the event that a task interruption occurs during the execution of the target task, generating task interruption information, wherein the task interruption information is used to indicate content that needs to be supplemented by the user to complete the target task; Sending the task interruption information to the terminal device, and acquiring supplementary information input by the user through the terminal device; The target task is executed in the target application according to the supplementary information.

4. The task execution method according to claim 1, characterized in that: The acquiring task key information from the user instruction according to the service type corresponding to the target task includes: Determining, according to the service type corresponding to the target task, a plurality of key information items required to execute the target task; According to the plurality of key information items, the task key information corresponding to the plurality of key information items one by one is acquired from the user instruction.

5. The task execution method according to claim 4, characterized in that: The method further comprises: determining a target key information item, if the target key information item is a key information item for which corresponding task key information cannot be obtained from the user instruction; A key information reminder is generated and sent to the terminal device, wherein the key information reminder is used to instruct the terminal device to remind the user to supplement the key task information corresponding to the target task key information item.

6. The task execution method according to any one of claims 1 to 5, characterized in that: The method further comprises: When the target task is completed or an interrupt instruction is received from the user through the terminal device, the target cloud phone is released and marked as idle.

7. The task execution method according to any one of claims 1 to 5, characterized in that: The determining of the target cloud phone to be allocated to the terminal device includes: According to the location of the terminal device, any cloud phone configured as the location belonging area among the idle cloud phones is determined as the target cloud phone; Alternatively, after determining the target application corresponding to the target task, any cloud phone installed with the target application among the idle cloud phones is determined as the target cloud phone; Alternatively, a cloud phone instance is created according to the location of the terminal device and / or a target application corresponding to the target task, and the cloud phone instance is determined as the target cloud phone.

8. A task execution method, characterized in that: Applied to a terminal device, the method comprises: Get user instructions; Sending the user instruction to the server, so that the server generates a target task according to the user instruction, and controls a target application to execute the target task in a target cloud phone, wherein the target cloud phone is a cloud phone allocated by the server to the terminal device from idle cloud phones, and the service types supported by the target application include the service type corresponding to the target task; Obtain the task execution result returned by the server and display it.

9. The task execution method according to claim 8, characterized in that: The method further comprises: Acquire task interruption information generated by the server when a task interruption occurs during the execution of the target task, wherein the task interruption information is used to indicate content that needs to be supplemented by the user to complete the target task; Displaying the task interruption information; The supplementary information input by the user is acquired and sent to the server, so that the server executes the target task in the target application according to the supplementary information.

10. A task execution system, characterized in that: Including terminal equipment and servers; The terminal device is used to obtain user instructions; The terminal device is also used to send the user instruction to the server; The server is used to generate a target task according to the user instruction, and obtain key task information from the user instruction according to the service type corresponding to the target task; The server is also used to determine the target cloud phone assigned to the terminal device; The server is further used to determine a target application corresponding to the target task, and run the target application in the target cloud phone, wherein the service types supported by the target application include the service types corresponding to the target task; The server is further configured to execute the target task in the target application according to the task-critical information.

11. The task execution system according to claim 10, characterized in that: The server is also used to generate and send task execution results to the terminal device; The terminal device is also used to display the task execution result after receiving it.

12. A task execution device, characterized in that: Deployed on the server, including an acquisition unit and a processing unit; The acquisition unit is used to acquire the user instruction sent by the terminal device; The processing unit is used to generate a target task according to the user instruction; The acquisition unit is further used to acquire task key information from the user instruction according to the service type corresponding to the target task; The processing unit is further used to determine a target cloud phone to be allocated to the terminal device; The processing unit is further used to determine a target application corresponding to the target task, and run the target application in the target cloud phone, wherein the service types supported by the target application include the service types corresponding to the target task; The processing unit is further configured to execute the target task in the target application according to the task-critical information.

13. A server, characterized in that: including memory and processor; The memory is coupled to the processor; The memory is used to store computer program code, wherein the computer program code includes computer instructions; When the processor executes the computer instructions, the server executes the task execution method as described in any one of claims 1-7.

14. A computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium, characterized in that: When the instruction is executed on the server, the server executes the task execution method as described in any one of claims 1 to 7.

Citation Information

Patent Citations

  • Application control method and device, terminal and server

    CN110797022A

  • Data processing method, device and equipment and computer readable storage medium

    CN111790159A

  • Virtual terminal distributed system based on elastic cloud server and intelligent terminal

    CN112261152A

  • Operation instruction processing method, storage medium, program product and user terminal

    CN112929246A

  • Electronic equipment and control method of electronic equipment

    CN113138672A

Cited By

  • Cloud mobile phone and client connection establishing method and system, computer equipment and storage medium

    CN121567774A