Control method and apparatus, and electronic device

Abstract

A control method and apparatus, and an electronic device, are provided. In this method, an electronic device can obtain command information of an application on another electronic device and generate a control application based on the command information. In this manner, a user can start the control application to enable another electronic device to implement the application's actions. According to this method, the electronic device can implement cross-device application control functions by generating the control application, implement multi-device collaboration, and improve the user experience.

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to Chinese Patent Application No. 202011193906.1, entitled "CONTROL METHOD AND APPARATUS, AND ELECTRONIC DEVICE," filed with the State Intellectual Property Office of the People's Republic of China on October 30, 2020, which is incorporated herein by reference in its entirety.

[0002] The present application relates to the field of electronic device technology, in particular to a control method and apparatus, and an electronic device. [Background technology]

[0003] With the prevalence of various types of electronic devices in all scenarios, multi-device collaboration has become a development trend. However, currently, to implement multi-device collaboration, users need to perform operations on each electronic device separately in multi-device collaboration. This process is complicated, the operation is complicated, and the user experience is unsatisfactory. Summary of the Invention

[0004] The present application provides a control method and apparatus, and an electronic device, for implementing cross-device application control functions.

[0005] According to a first aspect, an embodiment of the present application provides a control method. The method can be applied to various application scenarios in which multiple electronic devices may communicate. In the following, a first electronic device is used as an example to describe steps in the method. The method includes:

[0006] The first electronic device obtains command information of the first application and then generates a control application based on the command information of the first application. The first application is on the second electronic device. The command information of the first application is used to implement an action of the first application. The control application is used to enable the second electronic device to implement the action of the first application. For example, the command information of the first application can be an Intent of the first application.

[0007] In this method, the first electronic device may generate a control application based on command information of an application on another electronic device. In this way, a user may start the control application to enable another electronic device to implement an action of the application. Obviously, based on this method, the electronic device may implement a cross-device application control function by generating a control application, implement multi-device cooperation, and improve the user experience.

[0008] In a possible design, the first electronic device may obtain the command information of the first application in the following manner.

[0009] Method 1: Receive command information of a first application from a second electronic device.

[0010] Method 2: Obtain command information of the first application and input by the user.

[0011] Based on this method, the first electronic device can flexibly obtain command information of an application on another electronic device in multiple ways.

[0012] In a possible design, the first electronic device may further generate a control icon corresponding to the control application and display the control icon on the display.

[0013] Based on this method, the first electronic device may generate a control icon and initiate a control application by tapping the control icon.

[0014] In a possible design, the first electronic device may generate the control icon in the following manner, but is not limited to the following:

[0015] Method 1: The first electronic device obtains icon information corresponding to a first application, and generates a control icon according to the icon information corresponding to the first application.

[0016] Method 2: The first electronic device may generate a control icon based on a pre-defined image or an image selected by the user.

[0017] According to the method, the first electronic device generates a control icon corresponding to the control application.

[0018] In a possible design, after obtaining the start command of the control application, the first electronic device further sends command information of the first application to the second electronic device, so that the second electronic device can perform an action of the first application based on the received command information of the first application.

[0019] Based on the method, a first electronic device may implement cross-device application control by sending command information of a first application to a second electronic device.

[0020] In a possible design, the first electronic device may generate the control application in the following steps: obtaining command information of a second application, where the second application is on the first electronic device and / or the third electronic device, and the command information of the second application is used to implement an action of the second application; and A step of generating a control application based on the command information of the first application and the command information of the second application, where the control application is further used to enable the first electronic device and / or the third electronic device to implement actions of the second application.

[0021] When the second application is on the first electronic device, after obtaining the start command of the control application, the first electronic device may further execute an action of the second application based on the command information of the second application. When the second application is on the third electronic device, after obtaining the start command of the control application, the first electronic device may further transmit the command information of the second application to the third electronic device, so that the third electronic device executes an action of the second application based on the received command information of the second application.

[0022] In this design, the control application may not only enable the second electronic device to implement the action of the first application, but also enable the first electronic device or the third electronic device to implement the action of the second application. It should be noted that in this embodiment of the present application, the number of electronic devices that need to be controlled in cooperation is not limited, and the number of applications that need to be controlled in cooperation is not limited.

[0023] In this design, the controlling application may integrate multiple applications on multiple electronic devices. In this design, the first electronic device may implement application control functions of the multiple electronic devices by initiating the controlling application.

[0024] In a possible design, the first electronic device may obtain a start command for the control application in the following manner.

[0025] Method 1: Detect an operation performed by a user on a control icon corresponding to a control application, and generate a start command for the control application in response to the operation.

[0026] Method 2: Receive a user's voice command by the voice assistant application, and obtain a start command of the control application which is obtained after the voice assistant application analyzes the voice command.

[0027] In this design, the user can flexibly initiate a control application through multiple operations.

[0028] In a possible design, before obtaining the start command of the control application and obtained after the voice assistant application analyzes the voice command, the first electronic device further needs to add the first application to an application list managed by the voice assistant application.

[0029] In this design, the scope of use of the voice assistant application can be expanded, which allows the user to open applications on other electronic devices based on voice commands.

[0030] In a possible design, when obtaining the command information of the first application, the first electronic device may further obtain information about the second electronic device. In this manner, the first electronic device may send the command information of the first application to the second electronic device based on the information about the second electronic device.

[0031] In a possible design, if it is determined that a connection to the second electronic device has not been established before sending the command information of the first application to the second electronic device, the first electronic device sends a turn-on signal to the second electronic device; and establishes a connection to the second electronic device after the second electronic device is turned on.

[0032] In this design, the first electronic device may further automatically initiate another electronic device and establish a connection to the other electronic device, thereby reducing user operations in the coordinated control process and improving user experience.

[0033] In a possible design, the first electronic device may further obtain information about a fourth electronic device associated with the second electronic device, where if it is determined that a connection to the fourth electronic device is not established before sending the command information of the first application to the second electronic device, the first electronic device sends a turn-on signal to the fourth electronic device; and establishes a connection to the fourth electronic device after the fourth electronic device is turned on.

[0034] In this design, the first electronic device may further control the initiation of a fourth electronic device associated with the second electronic device, and thus a connection may be automatically established between the fourth electronic device in an on state and the second electronic device in an on state, ensuring that the second electronic device can cooperate with the fourth electronic device to implement the actions of the first application.

[0035] In a possible design, the first electronic device may obtain the command information of the first application in the following manner.

[0036] Method 1: Send a first control request to the second electronic device, so that the second electronic device feeds back command information of the first application according to the first control request; receive command information of the first application and sent by the second electronic device.

[0037] Manner 2: receiving a second control request from a second electronic device, where the second control request includes command information of the first application.

[0038] In this design, the first electronic device may obtain the command information of the first application in multiple ways.

[0039] In a possible design, after generating the control application, the first electronic device may further send command information of the control application to the fifth electronic device. The command information of the control application is used to start the control application. In this way, the fifth electronic device may generate a new control application on the fifth electronic device based on the command information of the control application.

[0040] According to a second aspect, an embodiment of the present application further provides a control device, the control device being capable of being used in an electronic device and including a unit or module configured to perform each of the steps in the first aspect.

[0041] According to a third aspect, the present application provides an electronic device comprising at least one processing element and at least one storage element, the at least one storage element being configured to store programs and data, the at least one processing element being configured to perform the method provided in the first aspect of the present application.

[0042] According to a fourth aspect, an embodiment of the present application further provides a computer storage medium, the storage medium storing a software program, which when read and executed by one or more processors may implement the method provided in the first aspect or any design in the first aspect.

[0043] According to a fifth aspect, embodiments of the present application further provide a computer program product comprising instructions, which when executed on a computer enable said computer to perform the method provided in the first aspect or any design in the first aspect.

[0044] According to a sixth aspect, an embodiment of the present application provides a chip system. The chip system includes a processor configured to support an electronic device in implementing the functionality of the first aspect. In a possible design, the chip system further includes a memory. The memory is configured to store program instructions and data required by the electronic device. The chip system may include a chip, or may include a chip and another discrete component. [Brief description of the drawings]

[0045] [Figure 1] FIG. 2 is a schematic diagram of an application scenario according to an embodiment of the present application;

[0046] [Diagram 2] FIG. 1 is a diagram of a structure of an electronic device according to an embodiment of the present application.

[0047] [Diagram 3] FIG. 2 is a diagram of a software architecture of an electronic device according to an embodiment of the present application.

[0048] [Figure 4A] FIG. 2 is a schematic diagram of a process for generating a control application according to an embodiment of the present application.

[0049] [Figure 4B] FIG. 2 is a schematic diagram of a process for initiating a control application according to an embodiment of the present application.

[0050] [Diagram 5] 4 is a flowchart of a control method according to an embodiment of the present application.

[0051] [Figure 6A] FIG. 2 is a schematic diagram of an example of a control method according to an embodiment of the present application. [Figure 6B] FIG. 2 is a schematic diagram of an example of a control method according to an embodiment of the present application.

[0052] [Figure 7A] FIG. 13 is a schematic diagram of another control method example according to an embodiment of the present application. [Figure 7B] FIG. 13 is a schematic diagram of another control method example according to an embodiment of the present application.

[0053] [Figure 8A] FIG. 13 is a schematic diagram of yet another control method example according to an embodiment of the present application. [Figure 8B] FIG. 13 is a schematic diagram of yet another control method example according to an embodiment of the present application. [Figure 8C] FIG. 13 is a schematic diagram of yet another control method example according to an embodiment of the present application.

[0054] [Figure 9A] FIG. 13 is a schematic diagram of another control method example according to an embodiment of the present application. [Figure 9B] FIG. 13 is a schematic diagram of another control method example according to an embodiment of the present application.

[0055] [Figure 10] FIG. 2 is a diagram of the structure of a control device according to an embodiment of the present application.

[0056] [Figure 11] FIG. 1 is a structural diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0057] The present application provides a control method and apparatus, and an electronic device, for implementing a cross-device application control function, thereby implementing multi-device cooperation. The method and electronic device are based on the same technical concept. Since the method, the apparatus and the electronic device have similar problem-solving approaches, cross-references can be made between the implementations of the apparatus, the electronic device and the method. No repeated description is provided.

[0058] In the solution provided in the embodiment of the present application, an electronic device can obtain command information of an application on another electronic device, and generate a control application based on the command information. In this way, a user can start the control application to enable another electronic device to implement the action of the application. Obviously, based on this method, an electronic device can implement a cross-device application control function by generating a control application, implement multi-device cooperation, and improve user experience.

[0059] In the following, some terms in the present application are explained to help those skilled in the art to have a better understanding.

[0060] (1) An electronic device is a device or equipment having data connection, data calculation, and data processing capabilities. For example, the electronic device may be a mobile phone, a tablet computer, a notebook computer, a netbook, an in-vehicle device, a business smart terminal (including a videophone, a conference desktop smart terminal, and the like), a personal digital assistant (PDA), an augmented reality (AR) device / virtual reality (VR) device, or the like. The specific form of the electronic device is not limited in this application.

[0061] (2) An application (APP) is installed on an electronic device, and has a function of providing a service to a user, such as a camera application providing a photographing service function, a WeChat application or a QQ application providing a chat service function, an iQIYI application or a WeTV application providing a video service function, or a QQ music application providing a music service function. The above application may be developed by the manufacturer of the electronic device, or may be developed by the operating system provider of the electronic device, or may be developed by a third-party application provider. This is not limited in the present application.

[0062] (3) The application's command information is used to implement an application's action (i.e., a function, a service, a task, an operation, or the like). In some implementations, the application's command information may include information related to the action, including, in particular, the type of action, associated data, additional data, and the like.

[0063] In the Android system, the command information of an application may be indicated by an Intent. The Android system may assist in the interaction and communication between applications by using the intent mechanism. An intent is an abstract description of an action that needs to be performed in an application, and may be used as a parameter of an application. Based on the description of the intent, the Android system may be responsible for finding a corresponding component and sending the intent to the component that needs to be invoked, thereby completing the invocation of the component. Intents may be used not only between applications, but also for interactions between Activities and Services within an application. Thus, intents provide relevant information about the invocation of a component, and act as a medium to implement decoupling between the invoking party and the invoked party. The expression form of intent is: This includes starting an activity, starting a service, binding an activity and a service to establish communication between the two, and sending a broadcast.

[0064] The broadcast is sent to the broadcast receivers based on the broadcast functions Context.sendBroadcasts() / Context.sendOrderedBroadcast() / Context.sendStickyBroadcast().

[0065] The primary attributes of the intent information include the type of action to be performed and operation data, and the secondary attributes (i.e., additional data included in the intent information) include category, data type, component, and extras.

[0066] (4) "Multiple" means two or more. "At least one" means one or more.

[0067] (5) The term "and / or" describes an association relationship between related objects and indicates that three relationships may exist. For example, A and / or B may represent three cases: only A is present, both A and B are present, and only B is present. The symbol " / " generally indicates an "or" relationship between related subjects.

[0068] In addition, it should be understood that in the description of this application, terms such as "first" and "second" are used merely to distinguish the description and are not to be understood as an indication or implication of relative importance or as an indication or implication of order.

[0069] In the following, an architectural diagram of an application scenario in which the embodiments of the present application may be used is described. As shown in Figure 1, the application scenario includes multiple electronic devices.

[0070] In this application scenario, different electronic devices may communicate with each other through a communication network. For example, the communication network may be a local area network (e.g., a home local area network or a smart home local area network). In another example, the communication network may alternatively be a network formed by using technologies such as wireless-fidelity (Wi-Fi), Bluetooth (BT), near field communication (NFC) technology, infrared (IR) technology, or sidelink communication technology, which is not limited in this application. In this application scenario, when a communication connection is established between two electronic devices in the same communication network, the two electronic devices are both in an on state, the communication in the communication network is normal, the two electronic devices can both automatically access the communication network, and a connection is established between the two electronic devices.

[0071] It should be noted that any electronic device in the above application scenarios can act as a controlling device having a controlling function, and similarly, any electronic device can also act as an associated device, i.e. a controlled device, whose applications are being controlled.

[0072] For example, in the application scenario of the smart home system shown in FIG. 1, a smartphone may control at least one of electronic devices such as a smart TV, a smart speaker, a notebook computer, and a wearable device.

[0073] It can be understood that the above application scenarios described in the embodiments of the present invention are intended to more clearly describe the technical solutions in the embodiments of the present invention, and do not constitute limitations on the technical solutions provided in the embodiments of the present invention. Those skilled in the art may recognize that the technical solutions provided in the embodiments of the present invention can also be applied to similar technical problems with the development of network architectures and the emergence of new services. For example, the above method can be further applied to various other application scenarios, such as application scenarios such as vehicle to everything (V2X), long term evolution-Internet of vehicles (LTE-vehicle, LTE-V), vehicle to vehicle (V2V), Internet of vehicles, machine type communication (MTC), internet of things (IoT), long term evolution-machine to machine (LTE-machine to machine, LTE-M), and machine to machine (M2M).

[0074] The control method provided in the embodiment of the present application can be applied to any electronic device in the application scenario shown in Fig. 1. The structure of the electronic device is described below. Fig. 2 is a diagram of a possible structure of an electronic device to which the method according to the embodiment of the present application can be applied. As shown in Fig. 2, the electronic device 200 includes components such as a communication unit 201, a processor 202, a memory 203, a display unit 204, an input unit 205, an audio circuit 206, a sensor 207, and a camera 208. The components of the electronic device 200 are specifically described below with reference to Fig. 2.

[0075] The communication unit 201 is configured to implement functions of the electronic device 200 and implement data communication with another device. Optionally, the communication unit 201 may include a wireless communication module 2011 and a mobile communication module 2012. In addition to the communication unit 201, the electronic device 200 further needs to cooperate with components such as an antenna, a modem processor, and a baseband processor in the processor 202 to implement communication functions.

[0076] The wireless communication module 2011 may be applied in electronic devices and provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC) technology, infrared (IR) technology, and the like. The wireless communication module 2011 may be one or more components integrating at least one communication processing module. The wireless communication module 2011 receives electromagnetic waves via an antenna, performs signal frequency modulation and filtering processing on the electromagnetic waves, and transmits the processed signals to the processor 202. The wireless communication module 2011 may further receive signals to be transmitted from the processor 202, perform frequency modulation and amplification on the signals, and convert the signals obtained after frequency modulation and amplification into electromagnetic waves for radiation via the antenna.

[0077] The mobile communication module 2012 may be applied to electronic devices and provide mobile communication solutions including 2G / 3G / 4G / 5G or the like. The mobile communication module 2012 may include at least one filter, switch, power amplifier, and low noise amplifier (LNA), etc. The mobile communication module 2012 may receive electromagnetic waves via an antenna, perform processing such as filtering and amplification on the received electromagnetic waves, and send the processed electromagnetic waves to a modem processor for demodulation. The mobile communication module 2012 may further amplify signals modulated by the modem processor and convert the amplified signals into electromagnetic waves for emission via an antenna. In some embodiments, at least some functional modules of the mobile communication module 2012 may be located in the processor 202. In some embodiments, at least some functional modules of the mobile communication module 2012 may be located in the same device as at least some modules of the processor 202.

[0078] The electronic device 200 may establish a wireless connection to a base station of the mobile communication system via the mobile communication module 2012 and receive services of the mobile communication system via the mobile communication module 2012.

[0079] When the electronic device 200 implements the control method provided in the embodiments of the present application, through the wireless communication module 2011 or the mobile communication module 2012 in the communication unit 201, the electronic device 200 may send command information of an application to another electronic device or receive command information of an application of another electronic device, or the like, and may further send a turn-on signal to another electronic device or receive a turn-on signal from another electronic device.

[0080] The communication unit 201 may further include a communication interface configured to implement a physical connection between the electronic device 200 and another device. The communication interface may be connected to a communication interface of another device via a cable to implement data transmission between the terminal device 200 and the other device.

[0081] The memory 203 may be configured to store software programs and data. The processor 202 executes the software programs and data stored in the memory 203 to perform various functions of the terminal device 200 and process data. In this embodiment of the present application, the software programs may be control programs for implementing a control method, programs of each application, or the like.

[0082] Optionally, the memory 203 may mainly include a program storage area and a data storage area. The program storage area may store an operating system, various software programs, and the like. The data storage area may store data input by a user or data created by the terminal device 200 in the process of running a software program, and the like. The operating system may be HarmonyOS®, IOS®, Android®, Microsoft®, or the like. In addition, the memory 203 may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or another volatile solid-state storage device. For example, in this embodiment of the present application, the control program for implementing the control method, the program of each application, and the like may be stored in the program storage area; data such as command information and icons of the application may be stored in the data storage area.

[0083] The input unit 205 may be configured to receive text information and signals input by a user. Optionally, the input unit 205 may include a touch panel 2051 and another input device (e.g., function keys). The touch panel 2051, also referred to as a touch screen, collects touch operations performed by a user on or near the touch panel 2051, generates corresponding touch information, and transmits the touch information to the processor 202, so that the processor 202 can execute a command corresponding to the touch information. The touch panel 2051 may be implemented in multiple types, such as resistive type, capacitive type, infrared type, and surface acoustic wave type. For example, in this embodiment of the present application, a user may select an application that needs to be integrated or started by the touch panel 2051.

[0084] The display unit 204 is configured to present a user interface and implement human-computer interaction. For example, the display unit 204 may display information entered by or provided to a user, and contents such as various menus, a main interface (including icons of various applications), and windows of various applications of the terminal device 200. In this embodiment of the present application, the processor 202 may display icons of various applications on the display unit 204.

[0085] The display unit 204 may include a display panel 2041. The display panel 2041 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0086] It should be noted that the touch panel 2051 may cover the display panel 2041. In Fig. 2, the touch panel 2051 and the display panel 2041 function as two independent components to implement the input and output functions of the electronic device 200. However, in this embodiment of the present application, the touch panel 2051 and the display panel 2041 may be integrated (i.e., a touch screen) to implement the input and output functions of the electronic device 200.

[0087] The processor 202 is the control center of the electronic device 200, and is connected to the components through various interfaces and lines, and executes or implements the software programs and / or modules stored in the memory 203 to invoke the data stored in the memory 203, thereby performing various functions of the electronic device 200 and processing data. Thus, multiple services of the electronic device 200 are implemented. For example, the processor 202 may implement the control method provided in the embodiments of the present application by executing the control program stored in the memory 203, and generate a control application. In addition, after generating the control application, the processor 202 may further control the communication unit 201 to obtain a start command of the control application, and then send the command information of the application to another electronic device.

[0088] Optionally, the processor 202 may include one or more processing units. The processor 202 may integrate an application processor, a modem processor, a baseband processor, a graphics processing unit (GPU), and the like. The application processor mainly processes an operating system, a user interface, application programs, and the like. The modem processor mainly processes wireless communication. It may be understood that the aforementioned modem processor may alternatively not be integrated into the processor 202.

[0089] The audio circuit 206 (including the speaker 2061 and the microphone 2062) may provide an audio interface between the user and the terminal device 200. The audio circuit 206 may transmit an electrical signal converted from the received audio data to the speaker 2061, which converts the electrical signal into a sound signal for output. In addition, the microphone 2062 converts the collected sound signal into an electrical signal; the audio circuit 206 receives the electrical signal; and then converts the electrical signal into audio data for further processing, such as transmission or storage. In this embodiment of the present application, the voice assistant application on the electronic device 200 may collect the user's voice command by the microphone 2062, analyze the voice command, and obtain a corresponding command.

[0090] The electronic device 200 may further include one or more sensors 207, such as a light sensor, a motion sensor, an ultrasonic sensor, and other sensors. The electronic device 200 may implement various functions based on real-time sensor data collected by the sensors 207.

[0091] The electronic device 200 may further include a camera 208 for collecting images.

[0092] Those skilled in the art may understand that the structure of the terminal device shown in Figure 1 does not constitute a limitation on the terminal device. The terminal device provided in this embodiment of the present application may include more or less components than those shown in the drawings, some components may be combined, or different component deployments may be used.

[0093] The software system of the electronic device provided in the present application may use a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of the present application, the Android system having a layered architecture is used as an example to describe the software structure of the electronic device.

[0094] 3 is a block diagram of a software structure of an electronic device according to an embodiment of the present application. As shown in FIG. 3, the software structure of the electronic device may be a layered architecture. For example, the software may be divided into several layers, each layer having a clear role and responsibility. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, namely, from top to bottom, an application layer, a framework (FWK) layer, an Android runtime and system library, and a kernel layer.

[0095] The application layer may include a set of applications. As shown in Figure 3, the application layer may include a camera application, a voice assistant application, a desktop management (e.g., Huawei Launcher) application, a music application, a video application, a map application, a third-party application, and the like. The third-party application may include a WeChat application, an iQIYI application, and the like.

[0096] The framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer may include some predefined functions. As shown in Figures 6A and 6B, the application framework layer may include System Service, View System, Web Service, Telephone Manager, Resource Manager, and the like.

[0097] The system services may include a window manager service (WMS) and an activity manager service (AMS). In this embodiment of the present application, a new system level service, namely, a remote system service, may be further added to the system services. In the following, various services in the system services are described individually.

[0098] Window Manager Service: A window manager service is provided to windows, specifically controlling the visibility and hiding of all windows and the position of all windows on the display. A window manager service may be specifically responsible for the following functions: 1. Assigning a display surface to each window; 2. Managing the display order, size, and position of the surfaces; 3. Invoking management functions (such as surface control functions (SurfaceControl.Transaction)) to adjust the transparency, stretch factor, position, size of windows, and implement animation effects of windows; 4. Associating with the input system. For example, when an electronic device receives a touch event, the electronic device may display or process a message by providing an appropriate window to the user through the window manager service.

[0099] The Activity Manager Service provides management services for activities within an application. The Activity Manager Service may be responsible for, but is not limited to, the following functions: 1. Uniformly schedule the lifecycle of activities across all applications. 2. Start or stop the processes of an application. 3. Start and schedule the lifecycle of services. 4. Register Broadcast Receivers to receive and distribute broadcasts. 5. Query the current execution status of the system. 6. Schedule tasks.

[0100] The remote system service is used to implement signaling interactions between different electronic devices, command information of applications, and the like in the control method in the embodiment of the present application. For example, an electronic device may send a first control request to another electronic device through the remote system service, so that the other electronic device may feed back command information of the application that needs to be controlled based on the first control request. In addition, the electronic device may subsequently receive the command information, which is the command information of the application and is sent by the other electronic device, through the remote system service. In another example, the electronic device may receive a second control request (including the command information of the application) sent by the other electronic device. In yet another example, after obtaining the start command of the application to be controlled, the electronic device may further send the command information of the application to the other electronic device through the remote system service.

[0101] The view system includes visual controls, such as a text display control and an image display control. The view system can be used to structure an application. An interface can include one or more controls. For example, an interface that includes an SMS notification icon can include a text display control and an image display control.

[0102] A Web Service is an API that can be called by a web page. The telephone manager is configured to provide management of communication functions of the electronic device, such as call status (including answering or rejecting), or the like. The resource manager provides various resources to an application, such as localized strings, icons, images, layout files, and video files.

[0103] Android Runtime includes Kernel Library and Virtual Machine. Android Runtime is responsible for scheduling and managing Android system. Kernel Library includes two parts: one part is the function that needs to be called in java language, and the other part is the kernel library of Android system and is used to provide Input / Output Service and Kernel Service for Android system. The application layer and the framework layer may be executed in a virtual machine, which executes java files as binary files in the application layer and the framework layer, and is configured to implement functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0104] The system library may include multiple function modules, for example, an icon management module, an integrated application management module, media libraries, and an image processing library.

[0105] The control application management module is configured to determine command information of a local application that needs to be controlled and is selected by a user, or to generate a control application (which may also be referred to as an integrated application) based on command information of an application obtained on another electronic device.

[0106] The icon management module is configured to accordingly generate a control icon for the controlling application in the process of generating the controlling application.

[0107] The media library supports playing and recording audio and video in multiple formats and opening static images in multiple formats. The media library may support multiple audio and video encoding formats, such as MPEG-4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0108] The kernel layer is a layer between the hardware and the software. The kernel layer includes at least a display driver, a sensor driver, a processor driver, a camera driver, an audio driver, and the like; and is configured to drive the hardware in the hardware layer.

[0109] The hardware layer may include various types of sensors, displays, processors, input devices, memory, cameras, and the like.

[0110] In order to implement cross-device application control and multi-device cooperation of electronic devices, an embodiment of the present application provides a control method. The method can be applied to an application scenario including multiple electronic devices as shown in FIG. 1. The method specifically includes two processes: a process of generating a control application and a process of starting the control application. Based on the software structure of the electronic device shown in FIG. 3, the two processes of generating a control application and a process of starting the control application are respectively described in detail below with reference to FIG. 4A and FIG. 4B using an example in which a first electronic device controls a first application of the first electronic device and a second application of the second electronic device in cooperation with each other.

[0111] As shown in FIG. 4A, the process of generating a control application includes the following steps.

[0112] When a user expects to generate a control application for a first application and a second application on a first electronic device, the user needs to operate the second electronic device, select the second application to be controlled in cooperation on the second electronic device, and determine that the device to be controlled in cooperation is the first electronic device.

[0113] The second electronic device sends an icon 2 (i.e., Icon2) and an intent 2 (i.e., Intent2) of the second application to the remote system service of the second electronic device according to the user's operation. In this case, the icon 2 and the intent 2 may be sent to the remote system service by multiple network communication methods, for example, broadcast and socket. After establishing a connection to the remote system service of the first electronic device by verification, the remote system service of the second electronic device sends a control request to the remote system service of the first electronic device. The control request includes the icon 2 and the intent 2 of the second application and information about the second electronic device. Optionally, the control request may further include related information of the second application (e.g., application name and application function information).

[0114] After receiving the control request of the second electronic device by the remote system service, the first electronic device may prompt the user to select a local application for coordinated control (i.e., integration / combination) with the second application, and send various information in the control request to an activity manager service (AMS) of the first electronic device. After the user operates the first electronic device to select the first application to be coordinated, the first electronic device sends an icon 1 (i.e., Icon1) and an intent 1 (i.e., Intent1) of the first application to the activity manager service according to the user's operation. For example, the icon 1 and the intent 1 may be sent by a network communication method such as broadcast or socket. The activity manager service of the first electronic device sends the received icon 1 and intent 1 of the first application, the received icon 2 and intent 2 of the second application, and the received information of the second electronic device to a desktop management function (e.g., Huawei Launcher) of the first electronic device. For example, the aforementioned information may be sent to the desktop management function by a network communication method such as broadcast or socket. The desktop management function generates a control application and a control icon based on the received information. As shown in the figure, this process specifically includes the following steps:

[0115] 1. The desktop management function creates a control application based on intent 1 of a first application and intent 2 of a second application.

[0116] 2. The desktop management function newly draws an icon (e.g., draws in a combinatorial manner) based on the first application's icon 1 and the second application's icon 2 to generate the control icon. In some other embodiments, the desktop management function may further generate the control icon based on a pre-set image or an image selected by the user.

[0117] 3. The desktop management function associates the control icon with a control application (ie, associates the control icon with intent 1 and intent 2) and associates the control icon with information about the second electronic device.

[0118] It should be noted that a control icon is actually a new type of shortcut icon, where a single icon can be associated with an intent of an application on at least one electronic device.

[0119] Finally, the first electronic device may store the generated control application and the generated control icon in a database.

[0120] As shown in FIG. 4B, the process of starting a control application includes the following steps.

[0121] When a user expects to start a control application of a first electronic device, the user needs to operate the first electronic device and tap a control icon of the first electronic device.

[0122] The first electronic device instructs an internal activity manager service (AMS) to start the integrated activity (StartMultiActivity) according to the user's operation. The activity manager service of the first electronic device determines that the current start time is a cross-device start of the control application. Thus, the activity manager service of the first electronic device determines that the first application corresponding to intent 1 is on the first electronic device, and the second application corresponding to intent 2 is on the second electronic device based on the intents (intent 1 and intent 2) associated with the control application. The activity manager service of the first electronic device directly starts the first application by starting an activity (StartActivity) to implement the action corresponding to intent 1. In addition, for the second electronic device, the first electronic device first checks whether a connection to the second electronic device has been established. If it is determined that the connection has not been established (identifying that the second electronic device has not been turned on), the first electronic device sends a turn-on signal (e.g., an infrared signal) to the second electronic device. In this way, after the second electronic device is turned on, the second electronic device automatically establishes a connection to the first electronic device. When the first electronic device decides to establish a connection to the second electronic device, the first electronic device instructs an internal activity manager service (AMS) to start a remote activity (StartRemoteActivity). The activity manager service of the first electronic device starts the remote system service, so that the remote system service of the first electronic device sends Intent 2 to the remote system service of the second electronic device based on information about the second electronic device.

[0123] After receiving Intent 2, the remote system service of the second electronic device sends Intent 2 to an internal Activity Manager Service (AMS). The Activity Manager Service of the second electronic device starts the second application by starting an activity (StartActivity) and implements an action corresponding to Intent 2.

[0124] In this embodiment of the present application, the first electronic device generates a control application based on the intent of the application on the second electronic device, and sends the intent to the second electronic device when the user starts the control application, so that the second electronic device can implement an action corresponding to the intent. Finally, cross-device application control is implemented, and multi-device cooperation is further implemented.

[0125] It should be noted that for the description of the intent of the application in this embodiment of the present application, reference may be made to the description of the terminology of the command information of the application in the preceding content, and the details will not be described again in this specification.

[0126] An embodiment of the present application provides another control method. The method can be applied to an application scenario with multiple electronic devices as shown in FIG. 1. In this embodiment of the present application, a first electronic device serves as an electronic device for controlling another device. The first electronic device can be an electronic device that is portable and easy for users to operate, such as a smartphone or a wearable device. As a controlled electronic device, the second electronic device can be various electronic devices. This is not limited in the present application. The specific process of the method will be described in detail below with reference to the flow chart of the control method shown in FIG. 5.

[0127] S501: A first electronic device obtains command information of a first application, the first application being on a second electronic device, the command information of the first application being used to implement an action of the first application.

[0128] Optionally, the command information of the first application may be an Intent of the first application.

[0129] In different specific scenarios, the first electronic device may obtain the command information of the first application in three ways, including but not limited to, as shown in the drawings, which will be described below separately.

[0130] Method 1: In step S501a, a first electronic device receives command information of a first application, which is input by a user or comes from another device.

[0131] Method 2: A user operates a second electronic device, selects a first application to be controlled in cooperation from applications of the second electronic device, and selects a first electronic device to be controlled in cooperation. Then, in step S501b, the second electronic device transmits a control request to the first electronic device. The control request carries command information of the first application. The first electronic device receives the command information of the first application from the second electronic device.

[0132] [Method 3]

[0133] In the implementation, a user operates a first electronic device, selects a second electronic device to be controlled in a coordinated manner from the first electronic device, and selects a first application to be controlled in a coordinated manner. Then, in step S501c1, the first electronic device sends a control request to the second electronic device. The control request holds information about the first application. Thus, the second electronic device feeds back command information of the first application based on the control request. After receiving the control request, the second electronic device prompts the user whether the first electronic device needs to perform coordinated control on the first application. When the user selects an option indicating that coordinated control needs to be performed on the first application, in step S501c2, the second electronic device sends a control response of the first electronic device based on the control request. The control response includes command information of the first application.

[0134] In another implementation, a user operates a first electronic device and selects a second electronic device to be controlled in cooperation from the first electronic device. Then, in step S501c1, the first electronic device sends a control request to the second electronic device, so that the second electronic device feeds back command information of the first application to be controlled in cooperation based on the control request. After receiving the control request, the second electronic device prompts the user that the application to be controlled in cooperation needs to be selected. Then, the user operates the second electronic device and selects the first application to be controlled in cooperation from the applications of the second electronic device. The first electronic device sends a control response to the first electronic device. The control response includes the command information of the first application.

[0135] It can be seen from the above description that both Scheme 2 and Scheme 3 are that the second electronic device sends command information of the first application to the first electronic device. Therefore, optionally, in Scheme 2 and Scheme 3, the second electronic device may further send an icon of the first application or information about the second electronic device to the first electronic device. The icon of the first application is subsequently used by the first electronic device to generate a control icon of the control application. The information about the second electronic device may indicate that the first application is on the second electronic device.

[0136] It should be noted that for a specific process of the second electronic device sending the command information of the first application to the first electronic device (for example, step S501b or step S501c2), reference may be made to the process of the second electronic device sending the icon 2 and the intent 2 in Fig. 4A, and details will not be described again in this specification.

[0137] S502: The first electronic device generates a control application based on the command information of the first application, the control application being used to enable the second electronic device to implement an action of the first application.

[0138] In a first implementation, the first electronic device generates a control application based solely on the command information of the first application, where the control application is used by the first electronic device to collaboratively control the first application on the second electronic device.

[0139] In a second implementation, after receiving the command information of the first application in step S501, the first electronic device may prompt the user whether to select a local application for collaborative control with the first application. If the user selects an option indicating that collaborative control does not need to be performed for the local application, the first electronic device generates a control application based only on the command information of the first application. If the user selects a local second application for collaborative control with the first application, the first electronic device generates a control application based on the command information of the second application and the command information of the first application.

[0140] In this case, the controlling application may not only enable the second electronic device to implement actions of the first application, but also enable the first electronic device to implement actions of the second application.

[0141] In a third implementation, the first electronic device may further obtain command information of a third application on another electronic device (the third electronic device is used as an example in the following description).

[0142] Optionally, similar to the first implementation, the first electronic device may generate a control application based on the command information of the first application and the command information of the third application. In this case, the controlling application may not only enable the second electronic device to implement actions of the first application, but also enable the third electronic device to implement actions of the third application.

[0143] Optionally, similar to the second implementation, the first electronic device may further prompt the user whether to select a local application for coordinated control with the first and third applications. If the user selects the local second application for coordinated control with the first and third applications, the first electronic device generates a control application based on the command information of the first application, the command information of the second application, and the command information of the third application. In this case, the control application may enable the three electronic devices to individually implement the actions of the applications of the three electronic devices. If the user selects an option indicating that coordinated control does not need to be performed on the local application, the first electronic device generates a control application based on the command information of the first application and the command information of the third application. In this case, the controlling application may not only enable the second electronic device to implement actions of the first application, but also enable the third electronic device to implement actions of the third application.

[0144] It should be noted that in this embodiment of the present application, the number of electronic devices that need to be controlled in a coordinated manner is not limited, and the number of applications that need to be controlled in a coordinated manner is not limited.

[0145] In addition, in the process of the first electronic device performing step S502 to generate the control application, the first electronic device may further generate a control icon corresponding to the control application and display the control icon on the display of the first electronic device. In this way, the user can intuitively see that the control application has been generated, and the user can start the control application by tapping the control icon.

[0146] In implementations, the first electronic device may generate the control icon based on a pre-defined image or an image selected by the user.

[0147] In another implementation, the first electronic device may further obtain icons of the applications to be controlled in a coordinated manner, and generate a control icon by newly drawing an icon based on the icons (for example, drawing in an integrated manner, drawing in a combined manner, or drawing in a layered manner). For example, the first electronic device may obtain an icon of a corresponding application in the same manner as obtaining command information of an application of another electronic device. For a specific process, please refer to the specific description of obtaining command information of the first application in step S501. Details will not be described again in this specification.

[0148] It should be noted that the control icon is actually a new type of shortcut icon, and a single icon may correspond to command information of applications on at least one electronic device. When generating the control icon, the first electronic device may further associate the control icon with information about the other electronic device, so that the first electronic device can subsequently send the responded command information to the other electronic device when the control application is started.

[0149] For example, the first electronic device may also obtain information about the corresponding electronic device in the same manner as obtaining command information of another electronic device application. For a specific process, please refer to the specific description of obtaining command information of the first application in step S501. Details will not be described again in this specification.

[0150] S503: The first electronic device obtains a start command of the control application, and then sends command information of the first application to the second electronic device, so that the second electronic device performs an action of the first application based on the received command information of the first application.

[0151] In some implementations, when the first electronic device further generates a control application based on the command information of the local second application and executes step S503, the first electronic device further needs to execute an action of the second application based on the command information of the second application. In other words, the first electronic device starts the second application based on the command information of the second application, and executes the action of the second application by the second application.

[0152] In some other implementations, when the first electronic device further generates a control application based on the command information of the third application on the third electronic device and performs step S503, the first electronic device further needs to send command information of the third application to the third electronic device, so that the third electronic device performs an action of the third application based on the received command information of the third application.

[0153] It should be noted that when the first electronic device further associates a control icon with information about another electronic device in the process of generating a control application, the first electronic device may send command information of the first application to the second electronic device based on the information about the second electronic device associated with the control icon; the first electronic device may send command information of the third application to the third electronic device based on the information about the third electronic device associated with the control icon.

[0154] In this embodiment of the present application, the first electronic device may obtain a start command for the control application in the following manner.

[0155] Method 1: The first electronic device detects an operation performed by a user on a control icon corresponding to a control application, and in response to the operation, the first electronic device generates a start command for the control application.

[0156] Method 2: The first electronic device receives a user's voice command through a voice assistant application, and the first electronic device obtains a start command of the control application and obtained after the voice assistant application analyzes the voice command.

[0157] It should be noted that the applications managed by the voice assistant application of the first electronic device are generally applications on the first electronic device, and the number of managed applications is limited. Therefore, in order to enable the voice assistant of the first electronic device to manage an application (e.g., the first application) on another electronic device, before the first electronic device executes step S503, the first electronic device may further add the first application to the application list managed by the voice assistant application (optionally, may further add the managed electronic device, i.e., the second electronic device).

[0158] In this case, the first electronic device adds the first application to the list of voice assistant applications, and then sends a control request to the second electronic device, so that the second electronic device can feedback the command information of the first application according to the control request. For specific process, please refer to the description of method 3 in step S501. Details will not be described again in this specification.

[0159] In addition, before sending the command information of the corresponding application to the other electronic device, the first electronic device may further determine whether the other electronic device is turned on (whether a connection is established between the first electronic device and the other electronic device). If the other electronic device is not turned on, the first electronic device may further send a turn-on signal (e.g., an infrared signal) to the other electronic device. The second electronic device is still used as an example. Before the first electronic device sends the command information of the first application to the second electronic device, the method further includes the following steps:

[0160] When it is determined that a connection to the second electronic device is not established, the first electronic device sends a turn-on signal to the second electronic device; and establishes a connection to the second electronic device after the second electronic device is turned on.

[0161] At this stage, the first electronic device may further automatically initiate another electronic device and establish a connection to the another electronic device, thereby reducing user operations in the coordinated control process and improving user experience.

[0162] In addition, in this embodiment of the present application, when the first electronic device obtains the command information of the first application and information about the second electronic device in step S501, and further obtains information about a fourth electronic device associated with the second electronic device (indicating the cooperation of the fourth electronic device that may be required when the second electronic device implements the action of the first application), before sending the command information of the first application to the second electronic device, the first electronic device further needs to establish a connection to the fourth electronic device, i.e., perform the following steps:

[0163] When it is determined that a connection to the fourth electronic device is not established, the first electronic device sends a turn-on signal to the fourth electronic device; and establishes a connection to the fourth electronic device after the fourth electronic device is turned on. In this way, the first electronic device may further control the initiation of the fourth electronic device associated with the second electronic device. Thus, a connection may be automatically established between the fourth electronic device in an on state and the second electronic device in an on state, ensuring that the second electronic device can cooperate with the fourth electronic device to implement the action of the first application.

[0164] S504: The second electronic device starts the first application based on the received command information of the first application, and executes an action of the first application through the first application.

[0165] It should be further noted that in this embodiment of the present application, after the first electronic device generates the control application, if the user further has an application control requirement or a multi-device cooperation requirement, the first electronic device may further send command information of the control application to the fifth electronic device. The command information of the control application is used to start the control application. In this way, the fifth electronic device may generate a new control application on the fifth electronic device based on the command information of the control application. For the process of the fifth electronic device generating a new control application, please refer to the process of the first electronic device generating a control application in the preceding step. Details will not be described here.

[0166] In addition, in this embodiment of the present application, for the execution actions in each electronic device in the process of generating and launching the control application, please refer to the description in Figures 4A and 4B, and the details will not be described again in this specification.

[0167] An embodiment of the present application provides a control method. According to the method, an electronic device can obtain command information of an application on another electronic device, and generate a control application based on the command information. In this way, a user can start the control application to enable another electronic device to implement the action of the application. Obviously, based on this method, an electronic device can implement a cross-device application control function by generating a control application, implement multi-device cooperation, and improve user experience.

[0168] The method provided in this embodiment of the present application may be applied to various application scenarios. The following describes the control method provided in this embodiment of the present application with reference to some specific cases. It should be noted that in the generation and launch process of the control application in the following cases, reference may be made to the description in FIG. 4A and FIG. 4B and the description in the embodiment shown in FIG. 5. Details will not be described again in the following cases. In addition, in the following cases, the connection between any two electronic devices may be at least one of various wireless communication connections, such as a local area network connection, a Wi-Fi connection, a Bluetooth connection, an IR connection, an NFC connection, and a side link connection.

[0169] Case 1: An applicable application scenario is that a user uses the Huawei video application on a smart TV to watch videos, and the user expects to use the smartphone as a remote control.

[0170] In this case, the process of generating a cross-device control application (which may also be referred to as an integrated application) includes the following steps.

[0171] A user selects the Huawei video application from the application list interface of the smart TV as an application to be collaboratively controlled (shared or integrated), and selects the smartphone as an electronic device to be shared. The smart TV sends the icon and intent of the Huawei video application, and an identifier of the smart TV to the smartphone in a control request.

[0172] After receiving the control request, the smartphone asks the user whether to select a local application for control in cooperation with the Huawei video application (whether to select a local application to be integrated or combined with the Huawei video application). If the user selects a local smart remote application for control in cooperation with the Huawei video application, the smartphone generates a control application based on an intent of the Huawei video application and an intent of the smart remote application, generates a control icon based on an icon of the Huawei video application and an icon of the smart remote application; associates the control icon with the control application, and associates the control icon with an identifier of the smart TV.

[0173] In addition, referring to FIGS. 6A and 6B, the process of starting the control application in this case includes the following steps.

[0174] A user taps a control icon of a control application on a home screen of the smartphone. The smartphone detects a connection to the smart TV. If the smartphone does not detect a connection to the smart TV, it indicates that the smart TV is not turned on. In this case, the smartphone turns on the smart TV by an infrared remote control signal to establish a connection to the smart TV.

[0175] The smart phone launches the smart remote application according to the normal local application launch process.

[0176] The smartphone sends the Huawei video application intent to the smart TV, which then starts the Huawei video application.

[0177] In this way, a user may perform various operations on the smart remote application on the smartphone, and the smartphone will send corresponding infrared remote control signals to the smart TV, so that the Huawei video application on the smart TV performs corresponding actions based on the infrared remote control signals.

[0178] In this case, when the user does not need to operate the smart TV remote control, by tapping the control icon on the smartphone, the user can turn on the smart TV and open the corresponding applications on the smartphone and the smart TV respectively. Then, the user can directly control the program played by using the Huawei video application on the smart TV by using the smartphone as a remote control to operate the smart remote application on the smartphone.

[0179] Obviously, in this case, the functionality of the desktop icon on the smartphone is extended. In other words, the purpose of starting multiple devices and opening multiple applications can be achieved by a single control icon. In addition, the control application on the smartphone is associated with the identifier of the smart TV, so that the smartphone can automatically complete the process of turning on the smart TV and establishing a connection to the smart TV based on the identifier of the smart TV.

[0180] Case 2: An application scenario of use is that a user is playing a game through a badminton motion sensing game application on a smart TV, and the user expects that the smartphone can be used as a motion controller (i.e., an input device for inputting other data).

[0181] In this case, the process of generating a cross-device control application (which may also be referred to as an integrated application) includes the following steps.

[0182] The user selects the badminton motion sensing game application from the application list interface of the smart TV as the application to be jointly controlled (shared or integrated) (i.e., selects the badminton motion sensing game application as the application that needs to be associated with the input device) and selects the smartphone as the electronic device to be shared. The smart TV sends the icon and intent of the badminton motion sensing game application and the identifier of the smart TV to the smartphone via a control request.

[0183] After receiving the control request, the smartphone asks the user whether to select a local application for control in cooperation with the badminton motion sensing game application (whether to select a local application to be integrated or combined with the badminton motion sensing game application). If the user selects a local motion control application for control in cooperation with the badminton motion sensing game application, the smartphone generates a control application based on an intent of the badminton motion sensing game application and an intent of the motion control application, generates a control icon based on an icon of the badminton motion sensing game application and an icon of the motion control application; associates the control icon with the control application, and associates the control icon with an identifier of the smart TV.

[0184] In addition, referring to FIGS. 7A and 7B, the process of starting the control application in this case includes the following steps.

[0185] A user taps a control icon of a control application on a home screen of the smartphone. The smartphone detects a connection to the smart TV. If the smartphone does not detect a connection to the smart TV, it indicates that the smart TV is not turned on. In this case, the smartphone turns on the smart TV by an infrared remote control signal to establish a connection to the smart TV.

[0186] The smart phone will start the motion control application normally following its local application start process.

[0187] The smartphone sends an intent for the badminton motion-sensing game application to the smart TV, which then starts the badminton motion-sensing game application.

[0188] In this way, a user may use the smartphone as a motion controller. When a user changes the position of the smartphone, the smartphone transmits motion sensing input data to the smart TV, so that a badminton motion sensing game application on the smart TV may implement an action corresponding to the received motion sensing input data. The smartphone may transmit the motion sensing input data to the smart TV via an established connection (e.g., a Bluetooth connection or a Wi-Fi connection), or the smartphone establishes a new connection to the smart TV to transmit the motion sensing input data.

[0189] In this case, when the user does not need the gamepad, the user can turn on the smart TV and open the badminton motion-sensing game application on the smart TV by tapping a control icon on the smartphone. The user can then use the smartphone as a motion controller or gamepad to control game objects in the badminton motion-sensing game application on the smartphone.

[0190] Obviously, in this case, the functionality of the desktop icon on the smartphone is extended. In other words, the purpose of starting multiple devices and opening multiple applications can be achieved by a single control icon. In addition, the control application on the smartphone is associated with the identifier of the smart TV, so that the smartphone can automatically complete the process of turning on the smart TV and establishing a connection to the smart TV based on the identifier of the smart TV.

[0191] Case 3: An applicable application scenario is that a user sings using the WeSing application on a smart TV, and expects the user to use the smartphone as a microphone and play the audio through the smart speaker.

[0192] In this case, the process of generating a cross-device control application (which may also be referred to as an integrated application) includes the following steps.

[0193] A user selects the WeSing application from the application list interface of the smart TV as the collaboratively controlled (shared or integrated) application, selects the smartphone as the electronic device to be shared, and selects the smart speaker as the associated device. The smart TV sends the icon and intent of the WeSing application, the smart TV identifier, and the smart speaker identifier to the smartphone in a control request.

[0194] After receiving the control request, the smartphone asks the user whether to select a local application for control in cooperation with the WeSing application (whether to select a local application to be integrated or combined with the WeSing application). If the user selects a local microphone application for control in cooperation with the WeSing application, the smartphone generates a control application based on the intent of the WeSing application and the intent of the microphone application, generates a control icon based on an icon of the WeSing application and an icon of the microphone application; associates the control icon with the control application, and associates the control icon with an identifier of the smart TV and an identifier of the smart speaker.

[0195] In addition, referring to FIGS. 8A, 8B and 8C, the process of starting the control application in this case includes the following steps.

[0196] A user taps a control icon of a control application on a home screen of the smartphone. The smartphone detects a connection to a smart TV and a connection to a smart speaker separately. If the smartphone does not detect a connection to a smart TV, it indicates that the smart TV is not turned on. In this case, the smartphone turns on the smart TV by an infrared remote control signal and establishes a connection to the smart TV. Similarly, if the smartphone does not detect a connection to a smart speaker, it indicates that the smart speaker is not turned on. In this case, the smartphone turns on the smart speaker by an infrared remote control signal and establishes a connection to the smart speaker. In this way, a connection between the smart speaker and the smart TV can be established when both are turned on.

[0197] The smart phone will start the microphone application normally following its local application start process.

[0198] The smartphone sends the WeSing application intent to the smart TV, which then starts the WeSing application.

[0199] In this way, the microphone application on the smartphone allows the user to use the smartphone as a microphone for the smart TV to collect the user's voice data, and the smartphone transmits the voice data to the smart TV so that the WeSing application on the smart TV can process the voice data and generate audio data, which in turn can transmit the audio data to the smart speaker so that the smart speaker can output the audio data.

[0200] The smartphone may send WeSing application intents or voice data to the smart TV via a connection (e.g., a Bluetooth connection) to the smart TV, and the smart TV may also send audio data to the smart speaker via a connection (e.g., a Bluetooth connection) to the smart speaker.

[0201] In this case, when the user does not need to operate the remote control of the smart TV, by tapping the control icon of the smartphone, the user can turn on the smart TV and the smart speaker and open the corresponding applications on the smartphone and the smart TV, respectively. Then, the user can use the smartphone as a microphone of the smart TV to collect voice data. In addition, the smart TV can further play the audio data through the smart speaker, thereby significantly improving the user experience.

[0202] Obviously, in this case, the functionality of the desktop icon on the smartphone is extended. In other words, the purpose of starting multiple devices and opening multiple applications can be achieved by a single control icon. In addition, the control application on the smartphone is associated with the smart TV identifier and the smart speaker identifier, so that the smartphone can automatically complete the process of turning on the smart TV and establishing a connection to the smart TV based on the smart TV identifier, and automatically complete the process of turning on the smart speaker based on the smart speaker identifier.

[0203] Case 4: An applicable application scenario is that a user expects to use a voice assistant application on a smartphone to collaboratively control a Huawei video application on a smart TV and play audio using a smart speaker.

[0204] In this example, the process in which a smartphone generates a cross-device control application includes the following steps.

[0205] The user adds the smart TV to the list of electronic devices managed by the voice assistant application on the smartphone (i.e., the smart TV is a collaboratively controlled electronic device). The smartphone sends a control request to the smart TV.

[0206] After receiving the control request, the smart TV prompts the user to select an application to be controlled in a coordinated manner. The user then operates the smart TV to select the local Huawei video application as the application to be controlled in a coordinated manner, and select the smart speaker as the device associated with the application. The smart TV sends the icon and intent of the Huawei video application, the smart TV identifier, and the smart speaker identifier to the smartphone in a control response.

[0207] After receiving the control request, the smart phone generates a control application based on the intent of the Huawei video application, generates a control icon based on the icon of the Huawei video application; associates the generated control icon with the generated control application, and associates the control icon with an identifier of the smart TV and an identifier of the smart speaker.

[0208] In addition, referring to Figures 9A and 9B, the process of starting a control application (including the second control application in the second implementation) on the smartphone in this case includes the following steps.

[0209] A user starts a voice assistant application on the smartphone and inputs voice information "Play XXXX on TV". The voice assistant application analyzes the voice information and generates a command message indicating to start a control application on the smartphone to play XXXX. The smartphone detects a connection to a smart TV and a connection to a smart speaker separately. If the smartphone does not detect a connection to a smart TV, it indicates that the smart TV is not turned on. In this case, the smartphone turns on the smart TV by an infrared remote control signal and establishes a connection to the smart TV. Similarly, if the smartphone does not detect a connection to a smart speaker, it indicates that the smart speaker is not turned on. In this case, the smartphone turns on the smart speaker by an infrared remote control signal and establishes a connection to the smart speaker. In this way, a connection between the smart speaker and the smart TV can be established when both the smart speaker and the smart TV are turned on.

[0210] After establishing a connection to the smart TV, the smartphone sends the intent of the Huawei video application and a command message obtained by analyzing the voice information to the smart TV. Then, the smart TV starts the Huawei video application and plays the XXXX video according to the command message. In addition, the smart TV sends audio data of the XXXX video to the smart speaker, so that the smart speaker outputs the audio data. The smart TV can send the audio data to the smart speaker through a connection to the smart speaker (e.g., a Bluetooth connection).

[0211] Case 5: The applicable application scenario is the same as that in Case 4.

[0212] It should be noted that the prerequisite of this example is that the smart TV generates a first control application for the user. The first control application is generated based on the intent of the Huawei video application and associated with the smart speaker. The specific generation process is as follows: the user selects the Huawei video application from the application list interface of the smart TV as the application to be controlled in cooperation; selects the smart speaker as the associated electronic device. The smart TV generates the first control application based on the intent of the Huawei video application, generates a first control icon based on the icon of the Huawei video application; associates the first control icon with the first control application, and associates the first control icon with the identifier of the smart speaker.

[0213] In this example, the process in which a smartphone generates a cross-device control application includes the following steps.

[0214] The user adds the smart TV to the list of electronic devices managed by the voice assistant application on the smartphone (i.e., the smart TV is a collaboratively controlled electronic device). The smartphone sends a control request to the smart TV.

[0215] After receiving the control request, the smart TV prompts the user to select an application to be controlled in cooperation. Then, the user operates the smart TV to select the local first control application as the application to be controlled in cooperation. The smart TV sends the icon and intent of the first control application (used to open the Huawei video application and perform playback by the smart speaker), the smart TV identifier, and the smart speaker identifier to the smartphone via a control response.

[0216] After receiving the control request, the smartphone generates a second control application based on the intent of the first control application and generates a second control icon based on the icon of the first control application; associates the generated second control icon with the second control application, and associates the second control icon with an identifier of the smart TV and an identifier of the smart speaker.

[0217] In addition, referring to FIG. 9A and FIG. 9B, the process of starting the second control application on the smartphone in this case includes the following steps.

[0218] A user starts a voice assistant application on the smartphone and inputs voice information "Play XXXX on TV". The voice assistant application analyzes the voice information and generates a command message indicating to start a second control application on the smartphone to play XXXX. The smartphone detects a connection to a smart TV and a connection to a smart speaker separately. If the smartphone does not detect a connection to a smart TV, it indicates that the smart TV is not turned on. In this case, the smartphone turns on the smart TV by an infrared remote control signal and establishes a connection to the smart TV. Similarly, if the smartphone does not detect a connection to a smart speaker, it indicates that the smart speaker is not turned on. In this case, the smartphone turns on the smart speaker by an infrared remote control signal and establishes a connection to the smart speaker. In this way, a connection between the smart speaker and the smart TV can be established when both the smart speaker and the smart TV are turned on.

[0219] After establishing a connection to the smart TV, the smartphone sends the intent of the first control application and a command message obtained by analyzing the voice information to the smart TV. Then, the smart TV starts the first control application (including opening the local Huawei video application and establishing a connection to the smart speaker) and plays the XXXX video in the Huawei video application according to the command message. In addition, the smart TV sends audio data of the XXXX video to the smart speaker, so that the smart speaker outputs the audio data.

[0220] In case 4 and case 5, the user can manage applications on other electronic devices through the voice assistant application, thereby greatly expanding the scope of application of the voice assistant application. In addition, all applications and all electronic devices to meet the user's requirements can be started at once through the voice assistant application. As shown in the above cases, the user can directly operate the voice assistant application on the smartphone side, i.e., turn on the smart TV and smart speaker at once, open the Huawei video application on the smart TV, and play the desired video.

[0221] Apparently, Case 4 and Case 5 extend the functionality of the voice assistant application, so that the voice assistant application can further manage another electronic device. In addition, in the process of managing another electronic device, the voice assistant application can start the corresponding device by starting a control application, without being based on the on state of the other electronic device or the open state of the voice assistant.

[0222] Based on the above-mentioned embodiments and cases, the present application further provides a control device. The device can use the electronic device in the above-mentioned embodiments or cases. The following example is used in the following description: The device is used in a first electronic device. The device can implement the above-mentioned control method. Referring to Figure 10, the control device 1000 includes a communication unit 1001 and a processing unit 1002. The following describes the function of each unit.

[0223] The communication unit 1001 is configured to receive and transmit data. For example, the communication unit 1001 may be implemented by a mobile communication module and / or a wireless communication module.

[0224] The processing unit 1002 is configured to obtain command information of a first application, where the first application is on a second electronic device, and where the command information of the first application is used to implement an action of the first application; and generate a control application based on the command information of the first application, where the control application is used to enable the second electronic device to implement the action of the first application.

[0225] In a possible implementation, when obtaining the command information of the first application, the processing unit 1002: receiving the command information of the first application from the second electronic device by the communication unit 1001; or obtaining the command information of the first application and input by a user. The present invention is specifically configured to:

[0226] In a possible implementation, the processing unit 1002 further comprises: generating a control icon corresponding to the control application; and Displaying the control icon on a display of the first electronic device. The present invention is configured to:

[0227] In a possible implementation, when generating the control icon corresponding to the control application, the processing unit 1002 may: obtaining icon information corresponding to the first application; and generating the control icon based on the icon information corresponding to the first application; The present invention is specifically configured to:

[0228] In a possible implementation, the processing unit 1002 further comprises: Obtaining a start command for the control application; and Then, sending the command information of the first application to the second electronic device by the communication unit 1001, so that the second electronic device executes the action of the first application based on the received command information of the first application. The present invention is configured to:

[0229] In a possible implementation, when generating the control application based on command information of the first application, the processing unit 1002: obtaining command information of a second application, where the second application is on the first electronic device and / or a third electronic device, and the command information of the second application is used to implement an action of the second application; and generating the control application based on the command information of the first application and the command information of the second application, where the control application is further used to enable the first electronic device and / or the third electronic device to implement the action of the second application. The present invention is specifically configured to:

[0230] When the second application is on the first electronic device, the processing unit 1002 is further configured to: obtain the start command of the control application, and then execute the action of the second application based on the command information of the second application.

[0231] When the second application is on the third electronic device, the processing unit 1002 is further configured to: obtain the start command of the control application, and then send the command information of the second application to the third electronic device by the communication unit 1001, so that the third electronic device executes the action of the second application based on the received command information of the second application.

[0232] In a possible implementation, the processing unit 1002 is specifically configured to obtain a start command of a control application in the following manner.

[0233] Method 1: Detect an operation performed by a user on a control icon corresponding to a control application, and generate a start command for the control application in response to the operation.

[0234] Method 2: Receive a user's voice command by the voice assistant application, and obtain a start command of the control application and obtained after the voice assistant application analyzes the voice command.

[0235] In a possible implementation, the processing unit 1002 further comprises: The control application is configured to add the first application to an application list managed by the voice assistant application before obtaining the start command obtained after the voice assistant application analyzes the voice command.

[0236] In a possible implementation, the processing unit 1002 is further configured to obtain information about the second electronic device.

[0237] When the command information of the first application is sent to the second electronic device by the communication unit 1001, the processing unit 1002: sending, by the communication unit 1001, the command information of the first application to the second electronic device based on the information about the second electronic device; The present invention is specifically configured to:

[0238] In a possible implementation, the processing unit 1002 further comprises: sending a turn-on signal to the second electronic device by the communication unit 1001 when it is determined that a connection to the second electronic device has not been established before sending the command information of the first application to the second electronic device; and Establishing the connection to the second electronic device. The present invention is configured to:

[0239] In a possible implementation, the processing unit 1002 further comprises: obtaining information about a fourth electronic device associated with the second electronic device; sending a turn-on signal to the fourth electronic device by the communication unit 1001 when it is determined that a connection to the fourth electronic device has not been established before sending the command information of the first application to the second electronic device; and Establishing the connection to the fourth electronic device. The present invention is configured to:

[0240] In a possible implementation, the processing unit 1002 is further configured to send a first control request to the second electronic device via the communication unit 1001 before acquiring the command information of the first application, so that the second electronic device is configured to feed back the command information of the first application based on the first control request, or when acquiring the command information of the first application, the processing unit 1002 is specifically configured to receive a second control request from the second electronic device via the communication unit 1001, where the second control request includes the command information of the first application.

[0241] In a possible implementation, the processing unit 1002 further comprises: After the control application is generated, sending the command information of the control application to a fifth electronic device by the communication unit 1001, where the command information of the control application is used to start the control application. The present invention is configured to:

[0242] It should be noted that in the embodiment of the present application, the division into modules is an example and is merely a logical functional division. In actual implementation, there may be other division methods. In addition, the functional units in the embodiment of the present application may be integrated into one processing unit, or may exist physically alone, or two or more units may be integrated into one unit. The integrated unit may be implemented in the form of hardware or in the form of a software functional unit.

[0243] When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, the integrated unit may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present application may be essentially implemented in the form of a software product, or a part of the technical solution may be implemented in the form of a software product. The software product is stored in a storage medium and includes some instructions for instructing a computer device (which may be a personal computer, a server, or a network device) or a processor to execute all or part of the steps of the method described in the embodiments of the present application. The aforementioned storage medium includes any medium that can store program code, such as a USB flash drive, a removable hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0244] Based on the above embodiments and examples, the embodiments of the present application further provide an electronic device, which is configured to implement the control method provided in the above embodiments, and has the functions of the control device 1000 shown in Fig. 10. As shown in Fig. 11, the electronic device 1100 includes a transceiver 1101, a processor 1102, a memory 1103, and a display 1104.

[0245] The transceiver 1101, the processor 1102, the memory 1103, and the display 1104 are connected to each other. Optionally, the transceiver 1101, the processor 1102, the memory 1103, and the display 1104 are connected to each other by a bus. The bus can be a peripheral component interconnect (PCI) bus, an extended industry standard architecture (EISA) bus, etc. The bus may be classified into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used to represent a bus in FIG. 11, but this does not mean that there is only one bus or only one type of bus.

[0246] The transceiver 1101 is configured to receive and transmit data to implement communication with another device. For example, the communication unit 1001 may be implemented by a mobile communication module and / or a wireless communication module. In particular, the transceiver 1101 may be implemented by a radio frequency device and an antenna.

[0247] The processor 1102 is configured to implement the control method provided in the above embodiment or example. For specific process, please refer to the description in the above embodiment or example. Details are not described again in this specification.

[0248] The display 1104 is configured to display the interface.

[0249] The processor 1102 may be a central processing unit (CPU), a network processor (NP), a combination of a CPU and a NP, or the like. The processor 1102 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof. The processor 1102 may reliably implement the above-mentioned functions by hardware or by executing corresponding software by the hardware.

[0250] The memory 1103 is configured to store program instructions and the like. In particular, the program instructions may include program code. The program code includes computer operating instructions. The memory 1103 may include a random access memory (RAM) or may further include a non-volatile memory, such as at least one disk memory. The processor 1102 executes the program instructions stored in the memory 1103 to implement the aforementioned functions, and thereby the methods provided in the aforementioned embodiments.

[0251] Based on the above embodiment, an embodiment of the present application further provides a computer program, which, when executed on a computer, enables the computer to perform the method provided in the above embodiment.

[0252] Based on the above embodiment, an embodiment of the present application further provides a computer-readable storage medium, which stores a computer program, which, when executed on a computer, enables the computer to perform the method provided in the above embodiment.

[0253] A storage medium may be any available medium that can be accessed by a computer. The following provides an example, but is not limited to: A computer-readable medium may include RAM, ROM, EEPROM, CD-ROM, or other optical or disk storage medium, or other magnetic storage devices, or any other medium that can hold or store desired program code in the form of instructions or data structures and that can be accessed by a computer.

[0254] Based on the above embodiment, the embodiment of the present application further provides a chip, which is configured to read a computer program stored in a memory to implement the method provided in the above embodiment.

[0255] Based on the above embodiment, an embodiment of the present application provides a chip system. The chip system includes a processor configured to support a computer device in implementing relevant functions of a communication device in the above embodiment. In a possible design, the chip system further includes a memory. The memory is configured to store programs and data required by the computer device. The chip system may include a chip, or may include a chip and another discrete component.

[0256] In conclusion, the embodiments of the present application provide a control method and apparatus, and an electronic device. Based on this solution, an electronic device can obtain command information of an application on another electronic device, and generate a control application based on the command information. In this way, a user can start a control application to enable another electronic device to implement an action of the application. Obviously, based on this method, an electronic device can implement a cross-device application control function by generating a control application, implement multi-device cooperation, and improve user experience.

[0257] Those skilled in the art should understand that the embodiments of the present application may be provided as a method, a system, or a computer program product. Therefore, the present application may take the form of a hardware-only embodiment, a software-only embodiment, or an embodiment combining software and hardware. Furthermore, the present application may take the form of a computer program product embodied in one or more computer usable storage media (including, but not limited to, disk memory, CD-ROM, optical memory, etc.) containing computer usable program code.

[0258] The present application is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the present application. It should be understood that computer program instructions may be used to implement each process and / or each block in the flowcharts and / or block diagrams, and combinations of processes and / or blocks in the flowcharts and / or block diagrams. Providing these computer program instructions to a processor of a general purpose computer, a special purpose computer, an embedded processor, or any other programmable data processing device may result in a machine. As a result, the instructions executed by the processor of the computer or any other programmable data processing device result in an apparatus for implementing a particular function in one or more processes of the flowcharts and / or one or more blocks of the block diagrams.

[0259] Because these computer program instructions may be stored in a computer readable memory that can instruct a computer or any other programmable data processing device to operate in a particular manner, the instructions stored in the computer readable memory result in an artifact that includes an instruction apparatus that implements a particular function(s) in one or more processes of the flowcharts and / or one or more blocks of the block diagrams.

[0260] The computer program instructions may alternatively be loaded onto a computer or other programmable data processing device such that a sequence of operations and steps are executed on the computer or other programmable device, thereby generating a computer-implemented process. Thus, the instructions executed on the computer or other programmable device provide steps for implementing a particular function in one or more processes of the flowcharts and / or one or more blocks of the block diagrams.

[0261] It is obvious to those skilled in the art that various modifications and variations can be made to the present application without departing from the scope of the present application. Thus, the present application intends to cover those modifications and variations of the present application as long as they fall within the scope of protection defined by the following claims and their equivalent technologies.

Claims

1. A control method applied to a first electronic device, comprising: obtaining command information of a first application, where the first application is on a second electronic device, and the command information of the first application is used to perform an action of the first application; and generating a control application based on the command information of the first application, where the control application is used to enable the second electronic device to execute the action of the first application. Equipped with The step of generating the control application based on the command information of the first application further comprises: obtaining command information of a second application for cooperative control with the first application, where the second application is on the first electronic device and / or a third electronic device, and the command information of the second application is used to execute an action of the second application; and generating the control application based on the command information of the first application and the command information of the second application, where the control application is further used to enable the first electronic device and / or the third electronic device to execute the action of the second application. A method comprising:

2. The step of obtaining command information of a first application includes: receiving the command information of the first application from the second electronic device; or obtaining the command information of the first application input by a user; The method of claim 1 , comprising:

3. The method further comprises: generating a control icon corresponding to the control application; and displaying said control icon on a display The method according to claim 1 or 2, comprising:

4. The step of generating a control icon corresponding to the control application comprises: obtaining icon information corresponding to the first application; and generating the control icon based on the icon information corresponding to the first application; The method of claim 3 , comprising:

5. The method further comprises: obtaining a start command for the control application, and then transmitting the command information of the first application to the second electronic device, so that the second electronic device executes the action of the first application based on the received command information of the first application. The method according to claim 1 , comprising:

6. When the second application is on the first electronic device, after the step of obtaining a start command for the control application, the method further comprises: executing the action of the second application based on the command information of the second application; or When the second application is on the third electronic device, after the step of obtaining a start command of the control application, the method further includes the step of: transmitting the command information of the second application to the third electronic device, so that the third electronic device executes the action of the second application based on the received command information of the second application. The method of claim 5 , comprising:

7. The step of obtaining a start command for the control application further comprises: detecting an operation performed by a user on a control icon corresponding to the control application, and generating the start command for the control application in response to the operation; or receiving a voice command of the user by a voice assistant application and obtaining the start command obtained after the voice assistant application analyzes the voice command; The method of claim 5 or 6, comprising:

8. Before the step of obtaining the start command obtained after the voice assistant application analyzes the voice command, the method further comprises: adding the first application to an application list managed by the voice assistant application. The method of claim 7 comprising:

9. The method further comprises: Obtaining information about the second electronic device. With The step of transmitting the command information of the first application to the second electronic device comprises: transmitting the command information of the first application to the second electronic device based on the information about the second electronic device. The method according to any one of claims 5 to 8, comprising:

10. Prior to the step of transmitting the command information of the first application to the second electronic device, the method further comprises: sending a turn-on signal to the second electronic device when it is determined that a connection to the second electronic device has not been established; and Establishing the connection to the second electronic device. The method according to any one of claims 5 to 9, comprising:

11. The method further comprises: Obtaining information about a fourth electronic device associated with the second electronic device. With Prior to the step of transmitting the command information of the first application to the second electronic device, the method further comprises: sending a turn-on signal to the fourth electronic device when it is determined that a connection to the fourth electronic device has not been established; and Establishing the connection to the fourth electronic device. The method according to any one of claims 5 to 10, comprising:

12. Prior to the step of obtaining command information of a first application, the method further comprises: sending a first control request to the second electronic device, such that the second electronic device feeds back the command information of the first application based on the first control request; or The step of obtaining command information of a first application comprises receiving a second control request from the second electronic device, where the second control request comprises the command information of the first application.

12. The method according to any one of claims 1 to 11.

13. After the step of generating a control application, the method further comprises: Sending the command information of the control application to a fifth electronic device, where the command information of the control application is used to start the control application. The method of any one of claims 1 to 12, comprising:

14. The step of generating the control application based on the command information of the first application, comprising:

14. A method according to any one of claims 1 to 13, comprising generating a control icon corresponding to the control application based on a pre-defined image or an image selected by a user.

15. The step of generating the control application based on the command information of the first application, comprising: A method according to any one of claims 1 to 13, comprising a step of obtaining an icon of the first application and an icon of the second application that are controlled in conjunction with each other, and generating a control icon corresponding to the control application by drawing a new icon based on the icon of the first application and the icon of the second application.

16. A control device for a first electronic device, A communication unit configured to receive and transmit data; and obtaining command information of a first application, where the first application is on a second electronic device, and the command information of the first application is used to perform an action of the first application; and a processing unit configured to generate a control application based on the command information of the first application, where the control application is used to enable the second electronic device to execute the action of the first application. Equipped with When generating the control application based on the command information of the first application, the processing unit: obtaining command information of a second application for cooperative control with the first application, where the second application is on the first electronic device and / or a third electronic device, and the command information of the second application is used to execute an action of the second application; and generating the control application based on the command information of the first application and the command information of the second application, where the control application is further used to enable the first electronic device and / or the third electronic device to execute the action of the second application. The apparatus is configured to:

17. When obtaining the command information of the first application, the processing unit: receiving the command information of the first application from the second electronic device by the communication unit; or Obtaining the command information of the first application input by a user 17. The apparatus of claim 16, configured to:

18. The processing unit further comprises: generating a control icon corresponding to the control application; and Displaying the control icon on a display of the first electronic device.

18. Apparatus according to claim 16 or 17, configured to:

19. When generating the control icon corresponding to the control application, the processing unit: obtaining icon information corresponding to the first application; and generating the control icon based on the icon information corresponding to the first application; 20. The apparatus of claim 18 configured to:

20. The processing unit further comprises: Obtaining a start command for the control application; and Then, sending the command information of the first application to the second electronic device by the communication unit, so that the second electronic device executes the action of the first application based on the received command information of the first application.

20. The apparatus of claim 16, configured to:

21. When the second application is on the first electronic device, the processing unit is further configured to obtain the start command of the control application and then execute the action of the second application based on the command information of the second application; or 21. The apparatus of claim 20, wherein when the second application is on the third electronic device, the processing unit is further configured to obtain the start command of the control application and then send the command information of the second application to the third electronic device by the communication unit, such that the third electronic device executes the action of the second application based on the received command information of the second application.

22. When obtaining the start command of the control application, the processing unit: detecting an operation performed by a user on a control icon corresponding to the control application, and generating the start command for the control application in response to the operation; or receiving a voice command of the user by a voice assistant application and obtaining the start command obtained after the voice assistant application analyzes the voice command; 22. Apparatus according to claim 20 or 21, configured to:

23. The processing unit further comprises:

23. The device of claim 22, further comprising: a voice assistant application configured to add the first application to an application list managed by the voice assistant application before the voice assistant application obtains the start command obtained after parsing the voice instruction.

24. The processing unit is further configured to obtain information about the second electronic device; When the command information of the first application is sent to the second electronic device by the communication unit, the processing unit:

24. The apparatus of claim 20, configured to transmit, by the communication unit, the command information of the first application to the second electronic device based on the information about the second electronic device.

25. The processing unit further comprises: sending a turn-on signal to the second electronic device by the communication unit when it is determined that a connection to the second electronic device has not been established before sending the command information of the first application to the second electronic device; and Establishing the connection to the second electronic device.

25. The apparatus of any one of claims 20 to 24, configured to:

26. The processing unit further comprises: obtaining information about a fourth electronic device associated with the second electronic device; sending a turn-on signal to the fourth electronic device by the communication unit when it is determined that a connection to the fourth electronic device has not been established before sending the command information of the first application to the second electronic device; and Establishing the connection to the fourth electronic device.

26. The apparatus of any one of claims 20 to 25, configured to:

27. the processing unit is further configured to send a first control request to the second electronic device by the communication unit before obtaining the command information of the first application, so that the second electronic device feeds back the command information of the first application based on the first control request; or 27. The apparatus of claim 16, wherein when obtaining the command information of the first application, the processing unit is configured to receive a second control request from the second electronic device by the communication unit, wherein the second control request includes the command information of the first application.

28. The processing unit further comprises: After the control application is generated, sending the command information of the control application to a fifth electronic device by the communication unit, where the command information of the control application is used to start the control application.

28. The apparatus of any one of claims 16 to 27, configured to:

29. The method of claim 29, wherein when generating the control application based on the command information of the first application, the processing unit:

29. An apparatus according to any one of claims 16 to 28, configured to generate a control icon corresponding to the control application based on a pre-defined image or an image selected by a user.

30. When generating the control application based on the command information of the first application, the processing unit: The device according to any one of claims 16 to 28, configured to obtain an icon of the first application and an icon of the second application that are controlled in conjunction with each other, and generate a control icon corresponding to the control application by drawing a new icon based on the icon of the first application and the icon of the second application.

31. 16. An electronic device comprising a display, a processor and a memory, wherein the memory stores a computer program, the computer program comprising instructions that, when executed by the processor, enable the electronic device to perform a method according to any one of claims 1 to 15.

32. A computer program product for causing a computer to carry out the method according to any one of claims 1 to 15.

Images