A control method, apparatus and electronic device

Abstract

Embodiments of the present application provide a control method, device and electronic equipment. In the method, the electronic equipment can acquire command information of an application of another electronic equipment, and generate a control application according to the command information, so that the user can start the control application to make the other electronic equipment implement the action of the application. Obviously, through the method, the electronic equipment can implement the cross-device application control function by generating the control application, thereby realizing multi-device cooperation and improving the user experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of electronic devices, and in particular to a control method and device, and an electronic device. BACKGROUND

[0002] With the popularity of various types of electronic devices in all scenarios, multi-device collaboration has become a development trend. However, to achieve multi-device collaboration, the user currently needs to separately operate each electronic device involved in multi-device collaboration, which is tedious, complicated, and has a poor user experience. SUMMARY

[0003] The present application provides a control method, device, and electronic device to implement cross-device application control functions.

[0004] In a first aspect, the present application provides a control method, which can be applied to various application scenarios involving multiple electronic devices capable of communication. The steps of the method are described below with the first electronic device as an example. The method includes:

[0005] After the first electronic device obtains the command information of the first application, the control application is generated according to the command information of the first application. The first application is located in the second electronic device, and the command information of the first application is used to implement the action of the first application. The control application is used to enable the second electronic device to implement the action of the first application. Exemplarily, the command information of the first application can be the intent of the first application.

[0006] In the method, the first electronic device can generate a control application according to the command information of an application located in another electronic device, so that the user can start the control application to enable the other electronic device to implement the action of the application. Obviously, through the method, the electronic device can implement cross-device application control functions by generating a control application, thereby achieving multi-device collaboration and improving the user experience.

[0007] In a possible design, the first electronic device can obtain the command information of the first application in the following ways:

[0008] Method one: receiving the command information of the first application from the second electronic device.

[0009] Method two: obtaining the command information of the first application input by the user.

[0010] Through the method, the first electronic device can flexibly obtain the command information of an application located in another electronic device in multiple ways.

[0011] In a possible design, the first electronic device can further generate a control icon corresponding to the control application, and display the control icon in the display screen.

[0012] By this method, the first electronic device can generate a control icon, which facilitates starting the control application by clicking the control icon.

[0013] In a possible design, the first electronic device can generate the control icon in the following manner, but is not limited to this manner.

[0014] Manner one: The first electronic device acquires icon information corresponding to the first application, and generates the control icon according to the icon information corresponding to the first application.

[0015] Manner two: The first electronic device can generate the control icon according to a preset picture or a picture selected by a user.

[0016] By this method, the first electronic device generates a control icon corresponding to the control application.

[0017] In a possible design, after acquiring the starting command of the control application, the first electronic device can further send command information of the first application to the second electronic device, so that the second electronic device performs an action of the first application according to the received command information of the first application.

[0018] By this method, the first electronic device can realize cross-device application control by sending the command information of the first application to the second electronic device.

[0019] In a possible design, the first electronic device can generate a control application in the following manner, but is not limited to this manner.

[0020] Acquiring command information of a second application, wherein the second application is located in the first electronic device and / or a third electronic device, and the command information of the second application is used to realize an action of the second application.

[0021] Generating the control application according to the command information of the first application and the command information of the second application, wherein the control application is further used to realize the action of the second application by the first electronic device and / or the third electronic device.

[0022] When the second application is located in the first electronic device, the first electronic device can further execute the action of the second application according to the command information of the second application after obtaining the starting command of the control application; when the second application is located in the third electronic device, the first electronic device can further send the command information of the second application to the third electronic device to enable the third electronic device to execute the action of the second application according to the received command information of the second application after obtaining the starting command of the control application.

[0023] Through the design, the control application can not only enable the second electronic device to implement the action of the first application, but also enable the first electronic device or the third electronic device to implement the action of the second application. It should be noted that the number of electronic devices that need to be cooperatively controlled is not limited, and the number of applications that need to be cooperatively controlled is also not limited.

[0024] In this design, the control application can integrate multiple applications located in multiple electronic devices. Through this design, the first electronic device can realize the application control function of multiple electronic devices by starting the control application.

[0025] In a possible design, the first electronic device can obtain the starting command of the control application in the following manner:

[0026] Manner one: detecting the operation of the user on the control icon corresponding to the control application; in response to the operation, generating the starting command of the control application;

[0027] Manner two: receiving the voice instruction of the user through the voice assistant application; obtaining the starting command of the control application obtained by analyzing the voice instruction by the voice assistant application.

[0028] Through this design, the user can flexibly start the control application through multiple operations.

[0029] In a possible design, before obtaining the starting command of the control application obtained by analyzing the voice instruction by the voice assistant application, the first electronic device also needs to add the first application in the application list managed by the voice assistant application.

[0030] Through this design, the use range of the voice assistant application can be expanded, and through the voice assistant application, the user can open the application located in other electronic devices based on the voice instruction.

[0031] In a possible design, the first electronic device can further acquire information of the second electronic device when acquiring the command information of the first application; in this way, the first electronic device can send the command information of the first application to the second electronic device according to the information of the second electronic device.

[0032] In a possible design, before sending the command information of the first application to the second electronic device, the first electronic device can send a power-on signal to the second electronic device if it is determined that no connection is established with the second electronic device, and establish a connection with the second electronic device after the second electronic device is powered on.

[0033] Through this design, the first electronic device can also automatically complete the power-on of the other electronic device and the establishment of the connection with the other electronic device, thereby reducing the operation of the user in the process of cooperative control and improving the user experience.

[0034] In a possible design, the first electronic device can further acquire information of a fourth electronic device associated with the second electronic device. In this case, before sending the command information of the first application to the second electronic device, the first electronic device can send a power-on signal to the fourth electronic device if it is determined that no connection is established with the fourth electronic device, and establish a connection with the fourth electronic device after the fourth electronic device is powered on.

[0035] Through this design, the first electronic device can also control the power-on of the fourth electronic device associated with the second electronic device, so that the fourth electronic device and the second electronic device can automatically establish a connection in the powered-on state, thereby ensuring that the second electronic device can cooperate with the fourth electronic device to implement the action of the first application.

[0036] In a possible design, the first electronic device can acquire the command information of the first application in the following ways:

[0037] Way one: sending a first control request to the second electronic device, so that the second electronic device feeds back the command information of the first application according to the first control request; and receiving the command information of the first application sent by the second electronic device.

[0038] Way two: receiving a second control request from the second electronic device, the second control request containing the command information of the first application.

[0039] Through this design, the first electronic device can acquire the command information of the first application in multiple ways.

[0040] In a possible design, the first electronic device can further send, after the control application is generated, command information of the control application to a fifth electronic device, where the command information of the control application is used to start the control application. In this way, the fifth electronic device can generate a new control application at the fifth electronic device according to the command information of the control application.

[0041] In a second aspect, the embodiments of the present application further provide a control apparatus, which can be applied to an electronic device, and includes units or modules for performing the steps of the first aspect.

[0042] In a third aspect, the present application provides an electronic device, including at least one processing element and at least one storage element, where the at least one storage element is configured to store programs and data, and the at least one processing element is configured to execute the method provided in the first aspect.

[0043] In a fourth aspect, the embodiments of the present application further provide a computer storage medium, which stores a software program, and the software program, when read and executed by one or more processors, can implement the method provided in the first aspect or any of the designs.

[0044] In a fifth aspect, the embodiments of the present application further provide a computer program product including instructions, which, when executed on a computer, cause the computer to perform the method provided in the first aspect or any of the designs.

[0045] In a sixth aspect, the embodiments of the present application provide a chip system, which includes a processor configured to support an electronic device to implement the functions involved in the first aspect. In a possible design, the chip system further includes a memory configured to save necessary program instructions and data of the electronic device. The chip system can be composed of a chip, or include a chip and other discrete devices. BRIEF DESCRIPTION OF DRAWINGS

[0046] Figure 1 An application scenario provided by the embodiments of the present application;

[0047] Figure 2 A structural diagram of an electronic device provided by the embodiments of the present application;

[0048] Figure 3 A software architecture diagram of an electronic device provided by the embodiments of the present application;

[0049] Figure 4A A generation process diagram of a control application provided by the embodiments of the present application;

[0050] Figure 4BA control application starting process schematic diagram provided for an embodiment of the present application;

[0051] Figure 5 A control method flow chart provided for an embodiment of the present application;

[0052] Figure 6 An example control method schematic diagram provided for an embodiment of the present application;

[0053] Figure 7 An example control method schematic diagram provided for another control method of an embodiment of the present application;

[0054] Figure 8 An example control method schematic diagram provided for yet another control method of an embodiment of the present application;

[0055] Figure 9 An example control method schematic diagram provided for still another control method of an embodiment of the present application;

[0056] Figure 10 A control device structure diagram provided for an embodiment of the present application;

[0057] Figure 11 An electronic device structure diagram provided for an embodiment of the present application. DETAILED DESCRIPTION

[0058] The present application provides a control method, device and electronic device, to realize cross-device application control function, and further realize multi-device cooperation. The method and the electronic device are based on the same technical concept. Since the principles of the method and the device, the electronic device are similar, the implementation of the device, the electronic device and the method can be referred to each other, and the repeated parts will not be described.

[0059] In the scheme provided in the embodiments of the present application, the electronic device can obtain the command information of the application located in the other electronic device, and generate a control application according to the command information, so that the user can start the control application to make the other electronic device realize the action of the application. Obviously, through this method, the electronic device can realize cross-device application control function by generating a control application, thereby realizing multi-device cooperation, and further improving user experience.

[0060] In the following, some terms in the present application are explained and described, so as to facilitate the understanding of those skilled in the art.

[0061] 1) electronic device, a device or apparatus with data communication function, data calculation and processing function. For example, the electronic device can be a mobile phone, a tablet computer, a notebook computer, a netbook, a vehicle-mounted device, and a business intelligence terminal (including: a video phone, a conference table desktop intelligent terminal, etc.), a personal digital assistant (PDA), an augmented reality (AR) \ virtual reality (VR) device, etc. The specific form of the electronic device is not limited in the present application.

[0062] 2) application (APP), installed in the electronic device, with the function of providing services to users. For example, a camera application with the function of providing a shooting service, a WeChat application, a QQ application, etc. with the function of providing a chat service, an iQiyi application, a Tencent video application, etc. with the function of providing a video service, and a QQ music application with the function of providing a music service. The application can be developed by the manufacturer of the electronic device, or by the supplier of the operating system of the electronic device, or by a third-party application manufacturer, which is not limited in the present application.

[0063] 3) command information of the application, used to realize the action (i.e. function, service, task, operation, etc.) of the application. In some embodiments, the command information of the application can contain relevant information of the action, including: the type of the action, the data involved, additional data, etc.

[0064] In the Android system, the command information of the application can be represented by Intent. The Android system can assist the interaction and communication between applications through the Intent mechanism. Intent is an abstract description of the action to be performed in the application, which can be used as a parameter of the application. The Android system can find the corresponding component according to the description of Intent, transmit the Intent to the component to be called, and thus complete the calling of the component. Intent can not only be used between applications, but also be used between activities (Activity) and services (Service) within an application. Therefore, Intent plays a mediating role, providing relevant information for the calling of components by each other, and realizing the decoupling between the caller and the callee. The form of Intent includes:

[0065] starting Activity, starting Service, binding Activity and Service to establish communication between them, and sending broadcast (Broadcast).

[0066] Broadcast. Broadcasts are sent to BroadcastReceivers via the broadcast functions Context.sendBroadcasts() / Context.sendOrderedBroadcast() / Context.sendStickyBroadcast().

[0067] The main attributes of an Intent message include: the type of action to perform (Action), the data to operate on (Data). The secondary attributes (i.e. additional data contained in the Intent message) include: the category, the type, the component, and the extras.

[0068] 4) A plurality of means two or more. At least one means one or more.

[0069] 5) "And / or", describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the following three cases: A exists alone, A and B exist together, and B exists alone. The character " / " generally represents that the associated objects before and after it are in an "or" relationship.

[0070] In addition, it should be understood that in the description of the present application, the words "first", "second", etc. are only used for the purpose of distinguishing the description and cannot be understood as indicating or implying relative importance or indicating or implying order.

[0071] The application scenario architecture diagram that can be used by the embodiments of the present application is described below, and reference is made to Figure 1 As shown in the figure, the application scenario includes a plurality of electronic devices.

[0072] In the application scenario, different electronic devices can communicate through a communication network. For example, the communication network can be a local area network (such as a home local area network, a smart home local area network, etc.). For another example, the communication network can also be a network formed by wireless fidelity (Wi-Fi), Bluetooth (BT), near field communication (NFC), infrared technology (IR), sidelink communication technology, etc., which are not limited by the present application. In the application scenario, when a communication connection is established between two electronic devices in the same communication network, and both are in a powered-on state and the communication network is in normal communication, both can automatically access the communication network and establish a connection between them.

[0073] It should be noted that any one of the electronic devices in the application scenarios can serve as a control device with a control function; similarly, any one of the electronic devices can also serve as a collaborative device that is controlled by the controlled device for application control.

[0074] For example, in the smart home system application scenario shown in Figure 1 In the smart home system application scenario shown in

[0075] It can be understood that the above application scenarios described in the embodiments of the present application are for more clearly illustrating the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided by the embodiments of the present application. Those skilled in the art can know that, with the evolution of network architecture and the emergence of new services, the technical solutions provided by the embodiments of the present application are also applicable to similar technical problems. For example, the method can also be applied to various other application scenarios, such as: vehicle to everything (V2X), long term evolution-vehicle (LTE-V), vehicle to vehicle (V2V), Internet of Vehicles, Machine Type Communications (MTC), Internet of Things (IoT), long term evolution-machine to machine (LTE-M), machine to machine (M2M), etc.

[0076] The control method provided by the embodiments of the present application can be applied to any one of the electronic devices in the application scenarios shown in Figure 1 The structure of the electronic device will be described below. Figure 2 A structural diagram of a possible electronic device to which the method provided by the embodiments of the present application is applicable is shown. Referring to Figure 2 As shown in Figure 2 The components of the electronic device 200 will be described in detail below.

[0077] The communication unit 201 is configured to implement the functions of the electronic device 200 and to realize data communication with other devices. Optionally, the communication unit 201 can include a wireless communication module 2011 and a mobile communication module 2012. In addition to the communication unit 201, the electronic device 200 also needs to cooperate with an antenna, a modem processor and a baseband processor in the processor 202 to realize the communication function.

[0078] The wireless communication module 2011 can provide a wireless communication solution applied to the electronic device, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The wireless communication module 2011 can be one or more devices integrated with at least one communication processing module. The wireless communication module 2011 receives electromagnetic waves via an antenna, performs signal frequency modulation and filtering processing on the electromagnetic waves, and sends the processed signals to the processor 202. The wireless communication module 2011 can also receive signals to be sent from the processor 202, perform frequency modulation and amplification, and radiate the signals to electromagnetic waves via an antenna.

[0079] The mobile communication module 2012 can provide a mobile communication solution applied to the electronic device, including 2G / 3G / 4G / 5G, etc. The mobile communication module 2012 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 2012 can receive electromagnetic waves from an antenna and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit them to a modem processor for demodulation. The mobile communication module 2012 can also amplify the signals modulated by the modem processor and radiate them to electromagnetic waves via an antenna. In some embodiments, at least part of the functional modules of the mobile communication module 2012 can be arranged in the processor 202. In some embodiments, at least part of the functional modules of the mobile communication module 2012 and at least part of the modules of the processor 202 can be arranged in the same device.

[0080] The electronic device 200 can establish a wireless connection with a base station in a mobile communication system through the mobile communication module 2012, and accept services of the mobile communication system through the mobile communication module 2012.

[0081] When the electronic device 200 implements the control method provided in the embodiments of the present application, the electronic device 200 can send application command information to other electronic devices, or receive application command information from other electronic devices, etc. through the wireless communication module 2011 or the mobile communication module 2012 in the communication unit 201; and can also send a power-on signal to other electronic devices or receive a power-on signal from other electronic devices.

[0082] The communication unit 201 can also include a communication interface for the electronic device 200 to implement physical connection with other devices. The communication interface can be connected with the communication interface of the other devices through a cable to implement data transmission between the terminal device 200 and the other devices.

[0083] The storage 203 can be used to store software programs and data. The processor 202 can execute various functions and data processing of the terminal device 200 by running the software programs and data stored in the storage 203. In the embodiments of the present application, the software programs can be control programs for implementing the control method, and programs of various applications, etc.

[0084] Optionally, the storage 203 can mainly include a program storage area and a data storage area. The program storage area can store an operating system, various software programs, etc.; and the data storage area can store user input or data created by the terminal device 200 in the process of running software programs, etc. The operating system can be HarmonyOS, Android, iOS, Windows, etc. 、 In addition, the storage 240 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device. For example, in the embodiments of the present application, the control programs for implementing the control method, and the programs of various applications, etc. can be stored in the program storage area, and the application command information, icon data, etc. can be stored in the data storage area.

[0085] The input unit 205 can be used to receive character information and signals input by a user. Optionally, the input unit 205 can include a touch panel 2051 and other input devices (such as function keys). The touch panel 2051, also known as a touch screen, can collect touch operations of a user thereon or nearby, generate corresponding touch information and send it to the processor 202, so that the processor 202 executes the command corresponding to the touch information. The touch panel 2051 can be implemented in various types, such as resistive, capacitive, infrared, and surface acoustic wave, etc. For example, in the embodiments of the present application, a user can select an application to be fused or started through the touch panel 2051.

[0086] The display unit 204 is configured to present a user interface to realize human-computer interaction. For example, the display unit 204 can display information input by a user, or information provided to the user, as well as various menus, various home interfaces (containing icons of various applications), windows of various applications, and the like of the terminal device 200. In embodiments of the present application, the processor 202 can display icons of various applications in the display unit 204.

[0087] The display unit 204 can include a display panel 2041, which can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0088] It should be noted that the touch panel 2051 can cover the display panel 2041, although in Figure 2 In the prior art, the touch panel 2051 and the display panel 2041 are implemented as two independent components to realize the input and output functions of the electronic device 200, but in embodiments of the present application, the touch panel 2051 and the display panel 2041 can be integrated (i.e., a touch display screen) to realize the input and output functions of the electronic device 200.

[0089] The processor 202 is the control center of the electronic device 200, and connects various components via various interfaces and lines, executes or runs software programs and / or modules stored in the storage 203, and calls data stored in the storage 203, to perform various functions of the electronic device 200 and process data, thereby realizing various services of the electronic device 200. For example, the processor 202 can run a control program stored in the storage 203 to realize the control method provided in embodiments of the present application, to generate a control application. In addition, after generating the control application, the processor 202 can control the communication unit 201 to send command information of the application to other electronic devices after obtaining a start command of the control application.

[0090] Optionally, the processor 202 can include one or more processing units. The processor 202 can integrate an application processor, a modem processor, a baseband processor, a graphics processing unit (GPU), and the like, wherein the application processor mainly processes an operating system, a user interface, and an application program, and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 202.

[0091] The audio circuit 206 (including a speaker 2061 and a microphone 2062) can provide an audio interface between the user and the terminal device 200. The audio circuit 206 can convert the received audio data into an electrical signal and transmit the electrical signal to the speaker 2061, which converts the electrical signal into a sound signal for output. On the other hand, the microphone 2062 converts a collected sound signal into an electrical signal, which is received by the audio circuit 206 and converted into audio data for further processing such as transmission or storage. In an embodiment of the present application, a voice assistant application in the electronic device 200 can collect a voice instruction of the user through the microphone 2062, analyze the voice instruction, and obtain a corresponding command.

[0092] The electronic device 200 can also include one or more sensors 207, such as a light sensor, a motion sensor, an ultrasonic sensor, and other sensors. The electronic device 200 can implement various functions according to real-time sensor data collected by the sensors 207.

[0093] The electronic device 200 can also include a camera 208 inside to collect images.

[0094] Those skilled in the art can understand that Figure 1 The structure of the terminal device shown in the above

[0095] The software system of the electronic device provided in the present application can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In an embodiment of the present application, an Android system with a layered architecture is taken as an example to illustrate the software structure of the electronic device.

[0096] Figure 3 A software structure block diagram of the electronic device provided in an embodiment of the present application is shown. As shown in Figure 3 The software structure of the electronic device can be a layered architecture, for example, the software can be divided into several layers, each layer has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the framework layer (FWK), the Android runtime and the system library, and the kernel layer.

[0097] The application layer can include a series of applications. As Figure 3As shown in , the application layer may include camera applications, voice assistant applications, desktop management (such as Huawei desktop HuaWei Launcher) applications, music applications, video applications, map applications, and third-party applications, etc. Among them, third-party applications may include WeChat applications, iQiyi applications, etc.

[0098] The framework layer provides application programming interface (API) and programming framework for applications in the application layer. The application framework layer may include some predefined functions. Figure 6 As shown, the application framework layer may include: system service (System Service), view system (ViewSystem), web service (Web Service), phone manager, resource manager, etc.

[0099] The system services may include a window manager service (WMS) and an activity manager service (AMS). In an embodiment of the present application, a new system-level service, the remote system service, may be added to the system services. Each of the system services is described below.

[0100] The window management service provides window management services for windows, specifically controlling the display, hiding, and position of all windows on the display screen. The window management service is responsible for the following functions: 1. Allocating a display surface to each window; 2. Managing the display order, size, and position of the surface; 3. Adjusting the transparency, stretching coefficient, position, and size of the window by calling management functions (such as the surface control function (SurfaceControl.Transaction)) to achieve window animation effects; 4. Related to the input system, for example, when an electronic device receives a touch event, the electronic device can provide the user with a suitable window to display or process the message through the window management service.

[0101] Activity Management Service, provides management service for activities in the application. The Activity Management Service can be responsible for, but not limited to, the following functions: 1. Uniformly scheduling the life cycle of activities of all applications; 2. Starting or ending the process of the application; 3. Starting and scheduling the life cycle of the service; 4. Registering the Broadcast Receiver, and receiving and distributing the Broadcast; 5. Querying the current running state of the system; 6. Scheduling the task.

[0102] Remote System Service, used to realize the interaction of signaling and application command information between different electronic devices in the control method in the embodiments of the present application. For example, the electronic device can send a first control request to other electronic devices through the Remote System Service, so that the other electronic devices feed back the command information of the application to be controlled according to the first control request, and in the subsequent process, the electronic device can receive the application command information sent by the other electronic devices through the Remote System Service. For another example, the electronic device can receive the second control request (containing the application command information) sent by the other electronic devices. For another example, after the electronic device obtains the start command of the application to be controlled, the electronic device can also send the application command information to the other electronic devices through the Remote System Service.

[0103] The View System includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The View System can be used to build an application. An interface can be composed of one or more controls. For example, an interface including a short message notification icon can include a control for displaying text and a control for displaying pictures.

[0104] Web Service, an API that can be called through a web page. The Phone Manager is used to provide the communication function of the electronic device. For example, the management of the call state (including connection, hang-up, etc.). The Resource Manager provides various resources for the application program, such as localized strings, icons, pictures, layout files, video files, etc.

[0105] The Android runtime includes a kernel library and a virtual machine. The Android runtime is responsible for scheduling and management of the Android system. The kernel library includes two parts: one part is a function function that needs to be called by the java language, and the other part is the kernel library of the Android system, which is used to provide input / output services and kernel services for the Android system. The application layer and the framework layer can run in the virtual machine. The virtual machine executes the java files of the application layer and the framework layer into binary files. The virtual machine is used to perform the management of the object life cycle, the stack management, the thread management, the security and exception management, and the garbage collection and the like.

[0106] The system library can include a plurality of functional modules. For example: an icon management module, a fusion application management module, media libraries, an image processing library, and the like.

[0107] The control application management module is configured to determine command information of a user-selected application located in the local device that needs to be controlled, or generate a control application (which can also be referred to as a fusion application) according to the obtained command information of the application located in the other electronic device.

[0108] The icon management module is configured to generate a control icon of the control application in the process of generating the control application.

[0109] The media library supports playback and recording of audio and video in multiple formats, and supports opening of static images in multiple formats. The media library can support multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, and the like.

[0110] The kernel layer is a layer between hardware and software. The kernel layer at least includes display drivers, sensor drivers, processor drivers, camera drivers, audio drivers, and the like, which are used to drive the hardware in the hardware layer.

[0111] The hardware layer can include various sensors, display screens, processors, input devices, memories, cameras, and the like.

[0112] In order to realize cross-device application control and multi-device collaboration of the electronic device, the embodiment of the present application provides a control method, which can be applied to the application scenario with multiple electronic devices as shown in Figure 1 The method specifically includes two processes of control application generation and control application startup. Next, based on the software structure of the electronic device as shown in Figure 3 , taking the example of realizing the first electronic device to collaboratively control the first application of itself and the second application of the second electronic device, and combining Figure 4A andFigure 4B The two processes of generating and starting the control application are described in detail respectively.

[0113] As shown in the figure, the process of generating the control application includes the following steps: Figure 4A

[0114] When the user wants to generate the control application of the first and second applications on the first electronic device, the user needs to operate the second electronic device, select the second application to be cooperatively controlled on the second electronic device, and the device to be cooperatively controlled is the first electronic device.

[0115] The second electronic device transmits the icon 2 (Icon2) and the intent (Intent2) of the second application to the remote system service of itself according to the operation of the user; wherein the icon 2 and the intent (Intent2) at this time can be transmitted to the remote system service through various network communication modes, such as broadcast (Broadcast), socket (Socket), etc. Figure 2 Figure 2 The remote system service of the second electronic device sends a control request to the remote system service of the first electronic device after establishing a connection with the remote system service of the first electronic device through authentication, wherein the control request contains the icon 2 and the intent (Intent2) of the second application, and the information of the second electronic device. Figure 2 Optionally, the control request can also contain the related information (such as application name, application function information, etc.) of the second application.

[0116] After receiving the control request of the second electronic device through the remote system service, the first electronic device can prompt the user whether to select the local application to cooperatively control (i.e. fusion / combination) with the second application, and transmit the information in the control request to the activity management service (AMS) of itself. After the user operates the first electronic device to select the first application to be cooperatively controlled, the first electronic device transmits the icon 1 (Icon1) and the intent (Intent1) of the first application to the activity management service according to the operation of the user; exemplary, the icon 1 and the intent (Intent1) can also be transmitted through network communication modes such as broadcast or socket. Figure 1 Figure 1 The activity management service of the first electronic device transmits the received icon 1 and the intent (Intent1) of the first application, the icon 2 and the intent (Intent2) of the second application, and the information of the second electronic device to the desktop management function (such as the desktop management application (HuaWei Launcher)) of the first electronic device; exemplary, the above information can also be transmitted to the desktop management function through network communication modes such as broadcast or socket. The desktop management function generates the control application and the control icon according to the received above information, as shown in the figure, which includes the following steps: Figure 1 Figure 2 ​​​​​

[0117] 1. The desktop management function generates a control application according to the intent of the first application. Figure 1 2. The desktop management function generates a control icon according to the icon of the first application and the icon of the second application. In some other embodiments, the desktop management function can also generate a control icon according to a preset picture or a picture selected by a user. Figure 2 3. The desktop management function associates the control icon with the control application (i.e. implements the association of the control icon with the intent and the intent

[0118] ), and associates the control icon with the information of the second electronic device. 4. The first electronic device stores the generated control application and the control icon into a database.

[0119] 5. The first electronic device starts the control application according to the control icon. Figure 1 6. The first electronic device starts the control application according to the control application. Figure 2 7. The first electronic device starts the control application according to the control icon and the control application.

[0120] It should be noted that the control icon is actually a new type of shortcut, and a single icon can be associated with the intent of an application in at least one electronic device.

[0121] Finally, the first electronic device can store the generated control application and the control icon into a database.

[0122] Figure 4B As shown in the figure, the process of starting the control application includes the following steps:

[0123] When the user wants to start the control application of the first electronic device, the user needs to operate the first electronic device and click the control icon on the first electronic device.

[0124] The first electronic device starts a fusion activity (StartMultiActivity) according to the operation of the user. The activity management service (AMS) of the first electronic device determines that this time of starting is the starting of the control application across devices, and thus determines the intent Figure 1 and the intent Figure 2 associated with the control application, determines that the intent Figure 1 corresponds to the first application located in the local, and determines that the intent Figure 2 corresponds to the second application located in the second electronic device. The activity management service of the first electronic device directly starts the first application by starting an activity (StartActivity) to realize the intent Figure 1corresponding action; in addition, for the second electronic device, the first electronic device first checks whether a connection is established with the second electronic device, and if it is determined that the connection is not established (indicating that the second electronic device is not powered on), the first electronic device sends a power-on signal (for example, an infrared signal) to the second electronic device, so that when the second electronic device is powered on, it will automatically establish a connection with the first electronic device; when the first electronic device determines that the connection with the second electronic device is established, it notifies the internal activity management service (AMS) to start a remote activity (StartRemoteActivity). The activity management service of the first electronic device starts a remote system service, so that the remote system service of the first electronic device sends the intent to the remote system service of the second electronic device according to the information of the second electronic device. Figure 2

[0125] The remote system service of the second electronic device receives the intent Figure 2 After that, the intent Figure 2 is sent to the internal activity management service (AMS). The activity management service of the second electronic device starts the second application by starting an activity (StartActivity), so as to realize the corresponding action of the intent. Figure 2

[0126] Through the embodiments of the present application, the first electronic device can generate a control application according to the intent of the application located in the second electronic device, and when the user starts the control application, send the intent to the second electronic device, so that the second electronic device realizes the corresponding action of the intent, and finally realizes cross-device application control, and further realizes multi-device collaboration.

[0127] It should be noted that the description of the intent of the application in the embodiments of the present application can refer to the description in the aforementioned explanation of the command information of the application, which will not be described here.

[0128] The embodiments of the present application provide another control method, which can be applied to the application scenario with multiple electronic devices as shown in Figure 1 In the embodiments of the present application, the first electronic device is an electronic device for controlling other devices, which can be an electronic device that is convenient for the user to operate and carry, such as a smart phone, a wearable device, etc. The second electronic device is an electronic device to be controlled, which can be various electronic devices, which are not limited by the present application. The specific process of the method will be described in detail below with reference to the control method flowchart shown in Figure 5

[0129] S501: The first electronic device obtains command information of a first application, wherein the first application is located in a second electronic device, and the command information of the first application is used to realize an action of the first application.

[0130] ​​​Optionally, the command information of the first application can be an intent of the first application.

[0131] According to different specific scenarios, the first electronic device can obtain the command information of the first application in three ways, but is not limited to the three ways as shown in the figure. Each way will be described below.

[0132] Way one: the first electronic device receives the command information of the first application input by the user or from other devices through S501a.

[0133] Way two: the user operates the second electronic device, selects the first application to be cooperatively controlled in the application of the second electronic device, and selects the first electronic device to be cooperatively controlled; then the second electronic device sends a control request to the first electronic device through S501b, the control request carrying the command information of the first application; the first electronic device receives the command information of the first application from the second electronic device.

[0134] Way three:

[0135] In an embodiment, the user operates the first electronic device, selects the second electronic device to be cooperatively controlled in the first electronic device, and selects the first application to be cooperatively controlled; then the first electronic device sends a control request to the second electronic device through S501c1, the control request carrying the information of the first application, so that the second electronic device feeds back the command information of the first application according to the control request. After the second electronic device receives the control request, it prompts the user whether the first electronic device needs to cooperatively control the first application. If the user selects to cooperatively control, the second electronic device sends a control response to the first electronic device through S501c2 according to the control request, the control response containing the command information of the first application.

[0136] In another embodiment, the user operates the first electronic device, selects the second electronic device to be cooperatively controlled in the first electronic device; then the first electronic device sends a control request to the second electronic device through S501c1, so that the second electronic device feeds back the command information of the first application to be cooperatively controlled according to the control request; after the second electronic device receives the control request, it prompts the user to select the application to be cooperatively controlled; then the user operates the second electronic device, selects the first application to be cooperatively controlled in the application of the second electronic device; the first electronic device sends a control response to the first electronic device, the control response containing the command information of the first application.

[0137] It can be known from the above description that the second and third manners are both that the second electronic device sends the command information of the first application to the first electronic device. Therefore, optionally, the second electronic device can also send the icon of the first application or the information of the second electronic device to the first electronic device in the second and third manners. The icon of the first application is used for the first electronic device to generate a control icon of the control application in the future, and the information of the second electronic device can identify that the first application is located in the second electronic device.

[0138] It should be noted that the specific process in which the second electronic device sends the command information of the first application to the first electronic device (for example, S501b or S501c2) can refer to the process in which the second electronic device sends the icon 2, the intention 2, and the like in the second electronic device to the first electronic device, which will not be described in detail here. Figure 4A Figure 2 It should be noted that the specific process in which the second electronic device sends the command information of the first application to the first electronic device (for example, S501b or S501c2) can refer to the process in which the second electronic device sends the icon 2, the intention 2, and the like in the second electronic device to the first electronic device, which will not be described in detail here.

[0139] S502: The first electronic device generates a control application according to the command information of the first application, wherein the control application is used to enable the second electronic device to implement the action of the first application.

[0140] In the first implementation, the first electronic device generates a control application only according to the command information of the first application. In this case, the control application is used for the first electronic device to cooperatively control the first application on the second electronic device.

[0141] In the second implementation, after the first electronic device receives the command information of the first application through S501, the first electronic device can prompt a user whether to select a local application to cooperatively control the first application; if the user selects not to cooperatively control the first application by the local application, the first electronic device generates a control application only according to the command information of the first application; if the user selects to cooperatively control the first application by a second application, the first electronic device generates a control application according to the command information of the second application and the command information of the first application.

[0142] In this case, the control application can not only enable the second electronic device to implement the action of the first application, but also enable the first electronic device to implement the action of the second application.

[0143] In the third implementation, the first electronic device can also acquire command information of a third application located on another electronic device (hereinafter referred to as a third electronic device as an example).

[0144] ​Optionally, similar to the first embodiment, the first electronic device can generate the control application according to the command information of the first application and the command information of the third application. At this time, the control application can not only enable the second electronic device to implement the action of the first application, but also enable the third electronic device to implement the action of the third application.

[0145] Optionally, similar to the second embodiment, the first electronic device can further prompt the user whether to select a local application to perform collaborative control with the first application and the third application. If the user selects a local second application to perform collaborative control with the first application and the third application, the first electronic device generates a control application according to the command information of the first application, the command information of the second application, and the command information of the third application. At this time, the control application can enable the three electronic devices to implement the action of the respective applications. If the user selects not to perform collaborative control with a local application, the first electronic device generates a control application according to the command information of the first application and the command information of the third application. At this time, the control application can not only enable the second electronic device to implement the action of the first application, but also enable the third electronic device to implement the action of the third application.

[0146] It should be noted that the number of electronic devices that need to be collaboratively controlled and the number of applications that need to be collaboratively controlled are not limited in the embodiments of the present application.

[0147] In addition, during the process of generating the control application in S502, the first electronic device can further generate a control icon corresponding to the control application, and display the control icon on the display screen of the first electronic device, so that the user can intuitively see that the control application has been generated, and the user can start the control application by clicking the control icon.

[0148] In an embodiment, the first electronic device can generate the control icon according to a preset picture or a picture selected by the user.

[0149] In another embodiment, the first electronic device can further acquire the icons of the respective applications to be collaboratively controlled, and generate the control icon according to the icon redrawing (for example, combined drawing, combined drawing, layered drawing, etc.) of the icons. For example, the first electronic device can acquire the icons of the respective applications in the same manner as acquiring the command information of the applications of the other electronic devices. The specific process can refer to the specific description of acquiring the command information of the first application in S501, which will not be described here.

[0150] It should be noted that the control icon is actually a new type of shortcut, and a single icon can correspond to command information of an application located in at least one electronic device. In order to realize that the first electronic device can send a response command information to other electronic devices when the control application is started subsequently, the first electronic device can also associate the control icon with information of other electronic devices when the control icon is generated.

[0151] For example, the first electronic device can also acquire information of the corresponding electronic device in the same manner as acquiring the command information of the application of the other electronic device, and the specific process can refer to the specific description of acquiring the command information of the first application in S501, which will not be described here.

[0152] S503: After the first electronic device acquires the starting command of the control application, the first electronic device sends the command information of the first application to the second electronic device, so that the second electronic device executes the action of the first application according to the received command information of the first application.

[0153] In some embodiments, when the first electronic device also generates the control application according to the command information of the second application located locally, the first electronic device needs to execute the action of the second application according to the command information of the second application when executing S503, in other words, the first electronic device starts the second application according to the command information of the second application, and executes the action of the second application through the second application.

[0154] In another embodiment, when the first electronic device also generates the control application according to the command information of the third application located in the third electronic device, the first electronic device needs to send the command information of the third application to the third electronic device when executing S503, so that the third electronic device executes the action of the third application according to the received command information of the third application.

[0155] It should be noted that, in the case that the first electronic device also associates the control icon with the information of other electronic devices when generating the control application, the first electronic device can send the command information of the first application to the second electronic device according to the information of the second electronic device associated with the control icon, and the first electronic device can send the command information of the third application to the third electronic device according to the information of the third electronic device associated with the control icon.

[0156] In the embodiment of the present application, the first electronic device can acquire the starting command of the control application in the following manner:

[0157] Manner one: the first electronic device detects the operation of the user on the control icon corresponding to the control application; the first electronic device generates the start command of the control application in response to the operation.

[0158] Manner two: the first electronic device receives the voice instruction of the user through the voice assistant application; the first electronic device obtains the start command of the control application by analyzing the voice instruction through the voice assistant application.

[0159] It should be noted that, in general, the applications managed by the voice assistant application of the first electronic device are generally located in the first electronic device and have a limited number. Therefore, in order to realize that the voice assistant of the first electronic device can manage the applications (such as the first application) located on other electronic devices, before the first electronic device executes S503, the first electronic device can also add the first application (and optionally the managed electronic device-second electronic device) to the application list managed by the voice assistant application.

[0160] In this case, after adding the first application to the list of the voice assistant application, the first electronic device can send a control request to the second electronic device to make the second electronic device feedback the command information of the first application according to the control request. The specific process can refer to the description of manner three in S501, which will not be described in detail here.

[0161] In addition, before the first electronic device sends the command information of the corresponding application to other electronic devices, it can also determine whether the other party is powered on (whether the first electronic device establishes a connection with the other party), if the other party is not powered on, the first electronic device can also send a power-on signal (such as an infrared signal) to it. Taking the second electronic device as an example, before the first electronic device sends the command information of the first application to the second electronic device, the following steps are further included:

[0162] When the first electronic device determines that the connection with the second electronic device is not established, it sends a power-on signal to the second electronic device; after the second electronic device is powered on, the connection with the second electronic device is established.

[0163] Through this step, the first electronic device can also automatically complete the start of other electronic devices and the establishment of connection with other electronic devices, thereby reducing the operation of the user in the process of cooperative control and improving the user experience.

[0164] In addition, in the embodiment of the present application, if the first electronic device obtains the command information of the first application and the information of the second electronic device through S501, and further obtains the information of a fourth electronic device associated with the second electronic device (indicating that the fourth electronic device is possibly needed to cooperate when the second electronic device implements the action of the first application), the first electronic device needs to establish a connection with the fourth electronic device before sending the command information of the first application to the second electronic device, that is, the following steps are performed:

[0165] When the first electronic device determines that the connection with the fourth electronic device is not established, the first electronic device sends a power-on signal to the fourth electronic device; and after the fourth electronic device is powered on, the first electronic device establishes a connection with the fourth electronic device. In this way, the first electronic device can also control the fourth electronic device associated with the second electronic device to be powered on, so that the fourth electronic device and the second electronic device can automatically establish a connection in the powered-on state, thereby ensuring that the second electronic device can cooperate with the fourth electronic device to implement the action of the first application.

[0166] S504: The second electronic device starts the first application according to the received command information of the first application, and performs the action of the first application through the first application.

[0167] It should be further noted that in the embodiment of the present application, after the first electronic device generates the control application, if the user has further application control or multi-device cooperation requirements, the first electronic device can also send the command information of the control application to a fifth electronic device, and the command information of the control application is used to start the control application. In this way, the fifth electronic device can generate a new control application according to the command information of the control application. The process of the fifth electronic device generating a new control application can refer to the process of the first electronic device generating a control application, which will not be described again.

[0168] In addition, in the embodiment of the present application, the execution actions in the internal processes of the electronic devices during the generation and start of the control application can refer to the descriptions in Figure 4A and Figure 4B , which will not be described in detail again.

[0169] The embodiment of the present application provides a control method, through the method, the electronic device can acquire the command information of the application located in other electronic device, and generates a control application according to the command information, so that the user can start the control application to make other electronic devices realize the action of the application. Obviously, through the method, the electronic device can realize the cross-device application control function by generating the control application, thereby realizing multi-device cooperation, and further improving the user experience.

[0170] The method provided by the embodiment of the present application can be applied to various application scenarios. The following describes the control method provided by the embodiment of the present application in combination with several specific examples. It should be noted that the generation process and the starting process of the control application involved in the following examples can refer to the description in Figure 4A and Figure 4B , and the description in the embodiments shown in Figure 5 . The following examples will not be described in detail. In addition, the connection between any two electronic devices in the following examples can be various wireless communication connections, for example, at least one of a local area network connection, a Wi-Fi connection, a Bluetooth connection, an IR connection, an NFC connection, a sidelink connection, and the like.

[0171] Example 1: The application scenario is that the user watches a video using the Huawei video application in the smart television, and the user hopes to use the smart phone as a remote controller.

[0172] In this example, the process of generating a cross-device control application (also referred to as a fusion application) includes the following steps:

[0173] The user selects the Huawei video application as the application to be cooperatively controlled (to be shared and fused) in the application list interface of the smart television, and selects the smart phone as the electronic device to be shared. The smart television sends the icon, the intent of the Huawei video application, and the identifier of the smart television to the smart phone through a control request.

[0174] After receiving the control request, the smart phone asks the user whether to select the local application to cooperatively control (whether to select the local application to fuse or combine) the Huawei video application. If the user selects the local smart remote control application to cooperatively control the Huawei video application, the smart phone generates a control application according to the intent of the Huawei video application and the intent of the smart remote control application, and generates a control icon according to the icon of the Huawei video application and the icon of the smart remote control application; associates the control icon with the control application, and associates the control icon with the identifier of the smart television.

[0175] In addition, referring to Figure 6 , the process of starting the control application in this example includes the following steps:

[0176] The user clicks the control icon of the control application in the main interface of the smart phone, and the smart phone detects the connection with the smart TV. If the smart phone does not detect the connection with the smart TV, it means that the smart TV is not turned on, and the smart TV is turned on using the infrared remote control signal, and the connection with the smart TV is established.

[0177] The smart phone starts the smart remote control application according to the normal local application starting process.

[0178] The smart phone sends the intent of the Huawei video application to the smart TV. Then the smart TV starts the Huawei video application.

[0179] In this way, the user can perform various operations on the smart remote control application of the smart phone, and the smart phone will send the corresponding infrared remote control signal to the smart TV, so that the Huawei video application of the smart TV performs the corresponding action according to the infrared remote control signal.

[0180] Through this example, the user does not need to operate the remote control of the smart TV, and by clicking the control icon on the smart phone, the smart TV is started, the smart phone and the smart TV are opened, and then the user can use the smart phone as a remote control to operate the smart remote control application in the smart phone, thereby directly controlling the playing program of the smart TV Huawei video application.

[0181] Obviously, this example expands the function of the desktop icon of the smart phone, that is, a single control icon can achieve the purpose of opening multiple devices and multiple applications. In addition, the control application in the smart phone is associated with the identifier of the smart TV, so that the smart phone can automatically complete the process of turning on the smart TV and establishing a connection with the smart TV according to the identifier of the smart TV.

[0182] Example 2: The application scenario used is that the user uses the smart TV badminton motion game application to play games, and the user hopes to use the smart phone as a motion controller (that is, or an input device for inputting other data).

[0183] In this example, the process of generating a cross-device control application (also called a fusion application) includes the following steps:

[0184] The user selects the application to be cooperatively controlled (to be shared, to be fused) as the badminton motion game application (that is, selects the application that needs to be associated with the input device as the badminton motion game application) in the application list interface of the smart TV, and selects the electronic device to be shared as the smart phone. The smart TV sends the icon, intent, and identifier of the smart TV of the badminton motion game application to the smart phone through a control request.

[0185] The smart phone receives the control request, and inquires whether the user selects the local application to be cooperatively controlled with the badminton motion sensing game application (whether the local application is selected to be fused or combined with the badminton motion sensing game application). If the user selects the local motion sensing control application to be cooperatively controlled with the badminton motion sensing game application, the smart phone generates a control application according to the intention of the badminton motion sensing game application and the intention of the motion sensing control application, and generates a control icon according to the icon of the badminton motion sensing game application and the icon of the motion sensing control application; associates the control icon with the control application, and associates the control icon with the identification of the smart TV.

[0186] In addition, referring to Figure 7 The process of starting the control application in the present example includes the following steps:

[0187] The user clicks the control icon of the control application in the main interface of the smart phone, and the smart phone detects the connection with the smart TV. If the smart phone does not detect the connection with the smart TV, it means that the smart TV is not turned on, and the smart TV is turned on using the infrared remote control signal, and the connection with the smart TV is established.

[0188] The smart phone starts the motion sensing control application according to the normal local application starting process.

[0189] The smart phone sends the intention of the badminton motion sensing game application to the smart TV. Then the smart TV starts the badminton motion sensing game application.

[0190] In this way, the user can use the smart phone as a motion sensing controller, and move the position of the smart phone, and the smart phone sends the motion sensing input data to the smart TV, so that the badminton motion sensing game application of the smart TV can perform corresponding actions according to the received motion sensing input data. The smart phone can transmit the motion sensing input data through the connection (such as Bluetooth connection, Wi-Fi connection, etc.) already established with the smart TV, or the smart phone establishes a new connection with the smart TV to transmit the motion sensing input data.

[0191] Through the present example, the user does not need a gamepad, and by clicking the control icon on the smart phone, the smart TV can be started, the badminton motion sensing game application in the smart TV can be opened, and then the user can use the smart phone as a motion sensing controller or a gamepad to control the game object in the badminton motion sensing game application in the smart phone.

[0192] Obviously, the present example extends the function of the desktop icon of the smart phone, i.e. a single control icon can achieve the purpose of opening multiple devices and multiple applications. In addition, the control application in the smart phone is associated with the identification of the smart TV, so that the smart phone can automatically complete the process of starting up the smart TV and establishing a connection with the smart TV according to the identification of the smart TV.

[0193] Example 3: The applicable application scenario is that the user uses the All-people K song application in the smart TV to sing, and the user wants to use the smart phone as a microphone and use the smart sound to play audio.

[0194] In the present example, the process of generating a cross-device control application (also referred to as a fusion application) includes the following steps:

[0195] The user selects the All-people K song application as the application to be cooperatively controlled (to be shared, to be fused) in the application list interface of the smart TV, selects the smart phone as the electronic device to which sharing is required, and selects the smart sound as the associated device. The smart TV sends the icon, the intent of the All-people K song application, and the identification of the smart TV and the identification of the smart sound to the smart phone through a control request.

[0196] After receiving the control request, the smart phone asks the user whether to select the local application to cooperatively control (whether to select the local application to fuse or combine) with the All-people K song application. If the user selects the local microphone application to cooperatively control with the All-people K song application, the smart phone generates a control application according to the intent of the All-people K song application and the intent of the microphone application, and generates a control icon according to the icon of the All-people K song application and the icon of the microphone application; associates the control icon with the control application, and associates the control icon with the identification of the smart TV and the identification of the smart sound.

[0197] In addition, referring to Figure 8 the process of starting the control application in the present example includes the following steps:

[0198] The user clicks the control icon of the control application in the main interface of the smart phone, and the smart phone detects the connection with the smart TV and the connection with the smart sound, respectively. If the smart phone does not detect the connection with the smart TV, it means that the smart TV is not turned on, and then the smart TV is turned on using an infrared remote control signal and a connection with the smart TV is established. Similarly, if the smart phone does not detect the connection with the smart sound, it means that the smart sound is not turned on, and then the smart sound is turned on using an infrared remote control signal and a connection with the smart sound is established. In this way, under the condition that the smart sound and the smart TV are both turned on, a connection between them can be established.

[0199] The smart phone starts the microphone application according to the normal local application startup process.

[0200] The smartphone sends the intent of the WeSing app to the smart TV, which then launches the WeSing app.

[0201] In this way, through the microphone application in the smartphone, the user can use the smartphone as the microphone of the smart TV to collect user voice data. The smartphone will send the voice data to the smart TV, and the smart TV's national karaoke application will process the voice data to generate audio data. The smart TV can also send the audio data to the smart speaker so that the smart speaker can output the audio data.

[0202] Among them, the smartphone can transmit the intention or voice data of the National K Song application to the smart TV through the connection between the smartphone and the smart TV (such as Bluetooth connection), and the smart TV can also transmit audio data to the smart speaker through the connection between the smartphone and the smart speaker (such as Bluetooth connection).

[0203] Through this example, the user does not need to operate the remote control of the smart TV. By clicking the control icon on the smartphone, the smart TV and smart speaker can be started and the corresponding applications on the smartphone and smart TV can be opened respectively. After that, the user can use the smartphone as the microphone of the smart TV to collect voice data. In addition, the smart TV can also play audio data through the smart speaker, which significantly improves the user experience.

[0204] Clearly, this example extends the functionality of smartphone desktop icons, enabling a single control icon to access multiple devices and applications. Furthermore, the smartphone's control application is associated with the smart TV and smart speaker IDs, allowing the smartphone to automatically power on and connect to the smart TV based on the TV ID, and automatically power on the smart speaker based on the speaker ID.

[0205] Example 4: This scenario applies to users who wish to use the voice assistant app on their smartphone to collaboratively control the Huawei video app on their smart TV and play audio using a smart speaker.

[0206] In this example, the process of generating a cross-device control application on a smartphone includes the following steps:

[0207] The user adds the smart TV to the list of electronic devices managed by the language assistant application on the smartphone (ie, the smart TV is the electronic device to be collaboratively controlled). The smartphone sends a control request to the smart TV.

[0208] After receiving the control request, the smart TV prompts the user to select an app for collaborative control. The user then operates the smart TV, selects the local Huawei Video app as the app for collaborative control, and selects the smart speaker as the associated device for the app. The smart TV then sends the Huawei Video app icon, intent, and the smart TV and smart speaker logos to the smartphone in a control response.

[0209] After receiving the control request, the smartphone generates a control application according to the intent of the Huawei video application; and generates a control icon according to the icon of the Huawei video application; associates the generated control icon with the control application, and associates the control icon with the logo of the smart TV and the logo of the smart speaker.

[0210] Also, see Figure 9 As shown, the process of starting the control application (including the second control application in the second embodiment) on the smart phone in this example includes the following steps:

[0211] The user starts the voice assistant application in the smartphone and enters the voice message "TV plays XXXX"; the voice assistant application parses the voice message, starts the control application on the smartphone, and generates a command message instructing to play XXXX. The smartphone detects the connection with the smart TV and the connection with the smart speaker respectively. If the smartphone does not detect the connection with the smart TV, it means that the smart TV is not turned on, and then the infrared remote control signal is used to turn on the smart TV and establish a connection with the smart TV. Similarly, if the smartphone does not detect the connection with the smart speaker, it means that the smart speaker is not turned on, and then the infrared remote control signal is used to turn on the smart speaker and establish a connection with the smart speaker. In this way, when both the smart speaker and the smart TV are turned on, a connection between the two can be established.

[0212] After establishing a connection with the smart TV, the smartphone sends the Huawei Video app's intent and the command message obtained by parsing the voice information to the smart TV. The smart TV then launches the Huawei Video app and plays the XXXX video according to the command message. In addition, the smart TV sends the audio data of the XXXX video to the smart speaker, so that the smart speaker can output the audio data. The smart TV can transmit audio data to the smart speaker through the connection between the smart speaker and the smart speaker (for example, a Bluetooth connection).

[0213] Example 5: The applicable application scenario is the same as Example 4.

[0214] It should be noted that the premise of the present example is that the user generates a first control application in the smart television. The first control application is generated according to the intent of the Huawei video application and is associated with the smart sound box. The specific generation process is as follows: the user selects the Huawei video application as the application to be cooperatively controlled and selects the smart sound box as the electronic device to be associated in the application list interface of the smart television. The smart television generates the first control application according to the intent of the Huawei video application and generates the first control icon according to the icon of the Huawei video application; the first control icon is associated with the first control application, and the first control icon is associated with the identifier of the smart sound box.

[0215] In the present example, the process in which the smart phone generates the cross-device control application includes the following steps:

[0216] The user adds the smart television (i.e., the smart television is the electronic device to be cooperatively controlled) in the electronic device list managed by the language assistant application of the smart phone. The smart phone sends a control request to the smart television.

[0217] After receiving the control request, the smart television prompts the user to select the application to be cooperatively controlled, and then the user operates the smart television to select the first control application as the application to be cooperatively controlled. The smart television sends the icon, intent (used to open the Huawei video application and play through the smart sound box), identifier of the smart television, and identifier of the smart sound box of the first control application to the smart phone through a control response.

[0218] After receiving the control request, the smart phone generates a second control application according to the intent of the first control application, generates a second control icon according to the icon of the first control application, associates the generated second control icon with the second control application, and associates the second control icon with the identifier of the smart television and the identifier of the smart sound box.

[0219] In addition, referring to Figure 9 the process of starting the second control application on the smart phone in the present example includes the following steps:

[0220] The user starts the voice assistant application in the smart phone and inputs the voice information "television plays XXXX". The voice assistant application analyzes the voice information, starts the second control application on the smart phone, and generates a command message indicating to play XXXX. The smart phone detects the connection with the smart television and the connection with the smart sound box, respectively. If the smart phone does not detect the connection with the smart television, it means that the smart television is not turned on, and then the infrared remote control signal is used to turn on the smart television and establish the connection with the smart television. Similarly, if the smart phone does not detect the connection with the smart sound box, it means that the smart sound box is not turned on, and then the infrared remote control signal is used to turn on the smart sound box and establish the connection with the smart sound box. In this way, when the smart sound box and the smart television are both turned on, the connection between them can be established.

[0221] After the smart phone establishes a connection with the smart TV, the smart phone sends the intent of the first control application and the command message obtained by analyzing the voice information to the smart TV. Then, the smart TV starts the first control application (including opening the local Huawei video application and establishing a connection with the smart speaker), and plays the XXXX video in the Huawei video application according to the command message. In addition, the smart TV sends the audio data of the XXXX video played by the smart TV to the smart speaker, so that the smart speaker outputs the audio data.

[0222] Through Examples 4 and 5, the user can manage the application located in other electronic devices through the voice assistant application, greatly expanding the application range of the voice assistant application, and all applications and electronic devices meeting the user's needs can be started at one time through the voice assistant application. As shown in the above examples, the user can directly operate the voice assistant application on the smart phone side, and the smart TV, the smart speaker, and the Huawei video application in the smart TV can be opened at one time to play the desired video.

[0223] Obviously, Examples 4 and 5 expand the function of the voice assistant application, so that the voice assistant application can also manage other electronic devices. In addition, the voice assistant application does not depend on the boot state of other electronic devices and the start state of the voice assistant in the process of managing other electronic devices, and can start the corresponding device by starting the control application.

[0224] Based on the above embodiments and examples, the application further provides a control device, which can be applied to the electronic devices in the above embodiments or examples. The following is described by taking the application to the first electronic device as an example. The device can implement the above control method. Referring to Figure 10 As shown in the figure, the control device 1000 includes a communication unit 1001 and a processing unit 1002. The functions of each unit are described below.

[0225] The communication unit 1001 is used for receiving and sending data. For example, the communication unit 1001 can be implemented by a mobile communication module and / or a wireless communication module.

[0226] The processing unit 1002 is used for obtaining command information of a first application, wherein the first application is located in a second electronic device, and the command information of the first application is used to implement an action of the first application; and generating a control application according to the command information of the first application, wherein the control application is used to make the second electronic device implement the action of the first application.

[0227] In a possible implementation, the processing unit 1002, when obtaining the command information of the first application, is specifically configured to:

[0228] receiving, by the communication unit 1001, command information of the first application from the second electronic device; or obtaining command information of the first application input by a user.

[0229] In a possible implementation, the processing unit 1002 is further configured to:

[0230] generating a control icon corresponding to the control application;

[0231] displaying the control icon in a display screen of the first electronic device.

[0232] In a possible implementation, the processing unit 1002, when generating the control icon corresponding to the control application, is specifically configured to:

[0233] obtaining icon information corresponding to the first application;

[0234] generating the control icon according to the icon information corresponding to the first application.

[0235] In a possible implementation, the processing unit 1002 is further configured to:

[0236] after obtaining the starting command of the control application, sending, by the communication unit 1001, command information of the first application to the second electronic device, so that the second electronic device performs an action of the first application according to the received command information of the first application.

[0237] In a possible implementation, the processing unit 1002, when generating the control application according to the command information of the first application, is specifically configured to:

[0238] obtaining command information of a second application, wherein the second application is located in the first electronic device and / or a third electronic device, and the command information of the second application is used to implement an action of the second application;

[0239] generating the control application according to the command information of the first application and the command information of the second application, wherein the control application is further used to enable the first electronic device and / or the third electronic device to implement the action of the second application;

[0240] when the second application is located in the first electronic device, the processing unit 1002 is further configured to: after obtaining the starting command of the control application, performing the action of the second application according to the command information of the second application;

[0241] When the second application is located at the third electronic device, the processing unit 1002 is further configured to, after obtaining the starting command of the control application, send, by the communication unit 1001, the command information of the second application to the third electronic device, so that the third electronic device performs the action of the second application according to the received command information of the second application.

[0242] In a possible implementation, the processing unit 1002 is specifically configured to obtain the starting command of the control application in the following manner:

[0243] Manner one: detecting an operation of a user on a control icon corresponding to the control application; and generating the starting command of the control application in response to the operation;

[0244] Manner two: receiving a voice instruction of a user by a voice assistant application; and obtaining the starting command of the control application obtained by analyzing the voice instruction by the voice assistant application.

[0245] In a possible implementation, the processing unit 1002 is further configured to:

[0246] Before obtaining the starting command of the control application obtained by analyzing the voice instruction by the voice assistant application, adding the first application in an application list managed by the voice assistant application.

[0247] In a possible implementation, the processing unit 1002 is further configured to obtain information of the second electronic device.

[0248] When the processing unit 1002 sends the command information of the first application to the second electronic device by the communication unit 1001, the processing unit 1002 is specifically configured to:

[0249] According to the information of the second electronic device, the processing unit 1002 sends the command information of the first application to the second electronic device by the communication unit 1001.

[0250] In a possible implementation, the processing unit 1002 is further configured to:

[0251] Before sending the command information of the first application to the second electronic device, the processing unit 1002 is configured to determine that a connection with the second electronic device is not established, and send, by the communication unit 1001, a power-on signal to the second electronic device.

[0252] The connection with the second electronic device is established.

[0253] In a possible implementation, the processing unit 1002 is further configured to:

[0254] obtain information of a fourth electronic device associated with the second electronic device;

[0255] determine whether a connection with the fourth electronic device is established before sending the command information of the first application to the second electronic device, and send a power-on signal to the fourth electronic device through the communication unit 1001 when the connection with the fourth electronic device is not established;

[0256] establish a connection with the fourth electronic device.

[0257] In a possible implementation, the processing unit 1002 is further configured to send a first control request to the second electronic device through the communication unit 1001 before obtaining the command information of the first application, so that the second electronic device feeds back the command information of the first application according to the first control request; or the processing unit 1002 is configured to receive a second control request from the second electronic device through the communication unit 1001 when obtaining the command information of the first application, and the second control request contains the command information of the first application.

[0258] In a possible implementation, the processing unit 1002 is further configured to:

[0259] After generating the control application, the processing unit 1002 is configured to send the command information of the control application to a fifth electronic device through the communication unit 1001, and the command information of the control application is used to start the control application.

[0260] It should be noted that the division of modules in the embodiments of the present application is illustrative, and is only a logical function division. In actual implementation, another division mode can be used. In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or can be physically separated, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0261] The integrated unit, if implemented in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or say the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a plurality of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor execute all or part of the steps of the method described in various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0262] Based on the above embodiments and examples, the embodiments of the present application further provide an electronic device for implementing the control method provided by the above embodiments, having the functions of the control device 1000 as shown in the above embodiments. Referring to Figure 10 Figure 11 As shown, the electronic device 1100 includes a transceiver 1101, a processor 1102, a memory 1103, and a display screen 1104.

[0263] Among them, the transceiver 1101, the processor 1102, the memory 1103, and the display screen 1104 are connected to each other. Optionally, the transceiver 1101, the processor 1102, the memory 1103, and the display screen 1104 are connected to each other through a bus. The bus can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For the convenience of representation, Figure 11 In the figure, only one thick line is used to represent, but it does not mean that there is only one bus or one type of bus.

[0264] The transceiver 1101 is used to receive and send data, and realize communication with other devices. Illustratively, the communication unit 1001 can be realized through a mobile communication module and / or a wireless communication module. Specifically, the transceiver 1101 can be realized through a radio frequency device and an antenna.

[0265] ​The processor 1102 is configured to implement the control method provided in the above embodiments or examples. The specific process can refer to the description in the above embodiments or examples, and will not be described here.

[0266] The display screen 1104 is configured to display an interface.

[0267] The processor 1102 can be a central processing unit (CPU), a network processor (NP), or a combination of the CPU and the NP, etc. The processor 1102 can further include a hardware chip. The hardware chip can be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The PLD can be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof. The processor 1102 can be implemented by hardware, and of course, can execute corresponding software by hardware.

[0268] The memory 1103 is configured to store program instructions, etc. Specifically, the program instructions can include program codes, and the program codes include computer operation instructions. The memory 1103 can include a random access memory (RAM), and can also include a non-volatile memory such as at least one disk memory. The processor 1102 executes the program instructions stored in the memory 1103 to implement the above functions, thereby implementing the method provided in the above embodiments.

[0269] Based on the above embodiments, the embodiments of the present application further provide a computer program, which, when executed on a computer, causes the computer to perform the method provided in the above embodiments.

[0270] Based on the above embodiments, the embodiments of the present application further provide a computer readable storage medium, which stores a computer program. The computer program is executed by a computer to cause the computer to perform the method provided in the above embodiments.

[0271] The storage medium can be any available medium that can be accessed by a computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or any other

[0272] Based on the above embodiments, the embodiments of the present application further provide a chip for reading a computer program stored in a memory, and implementing the method provided in the above embodiments.

[0273] Based on the above embodiments, the embodiments of the present application provide a chip system, which comprises a processor for supporting a computer device to implement the functions related to the communication device in the above embodiments. In a possible design, the chip system further comprises a memory for storing necessary programs and data of the computer device. The chip system can be composed of a chip, or can include a chip and other discrete devices.

[0274] To sum up, the embodiments of the present application provide a control method and device, and an electronic device. Through the scheme, the electronic device can acquire command information of an application located in another electronic device, and generate a control application according to the command information, so that the user can start the control application to make the other electronic device implement the action of the application. Obviously, through the method, the electronic device can implement the cross-device application control function in the form of generating a control application, thereby realizing multi-device cooperation, and further improving the user experience.

[0275] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0276] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of flows and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing apparatus to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing apparatus produce a device that implements the flowcharts and / or block diagrams. Figure 1a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0277] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0278] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0279] Obviously, those skilled in the art may make various changes and modifications to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include these modifications and variations.

Claims

1. A control method, applied to a first electronic device, characterized in that: The method comprises: obtaining command information of a first application, wherein the first application is located in a second electronic device, and the command information of the first application is used to implement an action of the first application; obtaining command information of a second application, wherein the second application is located in the first electronic device or a third electronic device, and the command information of the second application is used to implement an action of the second application; generating a control application according to the command information of the first application and the command information of the second application, wherein the control application is used to enable the second electronic device to implement the action of the first application, and enable the first electronic device or the third electronic device to implement the action of the second application; when the second application is located in the first electronic device, after obtaining a start command of the control application, sending the command information of the first application to the second electronic device, so that the second electronic device executes the action of the first application according to the received command information of the first application, and executes the action of the second application according to the command information of the second application; when the second application is located in the third electronic device, after obtaining a start command of the control application, sending the command information of the first application to the second electronic device, so that the second electronic device executes the action of the first application according to the received command information of the first application, and sending the command information of the second application to the third electronic device, so that the third electronic device executes the action of the second application according to the received command information of the second application.

2. The method according to claim 1, wherein Obtaining the command information of the first application comprises: receiving the command information of the first application from the second electronic device; or obtaining the command information of the first application input by a user.

3. The method of claim 1, wherein, The method further comprises: generating a control icon corresponding to the control application; displaying the control icon in a display screen.

4. The method of claim 3, wherein, Generating a control icon corresponding to the control application comprises: obtaining icon information corresponding to the first application; generating the control icon according to the icon information corresponding to the first application.

5. The method of claim 1, wherein, Obtaining a start command of the control application comprises: detecting an operation of a user on a control icon corresponding to the control application; and in response to the operation, generating a start command of the control application; or receiving a voice instruction of a user through a voice assistant application; and obtaining a start command of the control application obtained by analyzing the voice instruction by the voice assistant application.

6. The method of claim 5, wherein, Before obtaining the start command of the control application obtained by analyzing the voice instruction by the voice assistant application, the method further comprises: adding the first application in an application list managed by the voice assistant application.

7. The method according to any one of claims 1 to 6, wherein The method further comprises: obtaining information of the second electronic device; sending the command information of the first application to the second electronic device comprises: sending the command information of the first application to the second electronic device according to the information of the second electronic device.

8. The method according to any one of claims 1 to 6, wherein Before sending the command information of the first application to the second electronic device, the method further comprises: determining that a connection with the second electronic device is not established, and sending a power-on signal to the second electronic device; establishing a connection with the second electronic device.

9. The method according to any one of claims 1 to 6, wherein, The method further comprises: obtaining information of a fourth electronic device associated with the second electronic device; Before sending the command information of the first application to the second electronic device, the method further comprises: determining that a connection with the fourth electronic device is not established, and sending a power-on signal to the fourth electronic device; establishing a connection with the fourth electronic device.

10. The method of any one of claims 1-6, wherein, Before obtaining the command information of the first application, the method further comprises: sending a first control request to the second electronic device, so that the second electronic device feeds back the command information of the first application according to the first control request; or Obtaining the command information of the first application comprises: receiving a second control request from the second electronic device, the second control request containing the command information of the first application.

11. The method of any one of claims 1-6, wherein, After generating the control application, the method further comprises: sending the command information of the control application to a fifth electronic device, the command information of the control application being used to start the control application.

12. A control device applied to a first electronic device, characterized in that, comprises: a communication unit configured to receive and send data; a processing unit configured to obtain command information of a first application, wherein the first application is located in a second electronic device, and the command information of the first application is used to implement an action of the first application; obtain command information of a second application, wherein the second application is located in the first electronic device or a third electronic device, and the command information of the second application is used to implement an action of the second application; and generate a control application according to the command information of the first application and the command information of the second application, wherein the control application is used to make the second electronic device implement the action of the first application, and make the first electronic device or the third electronic device implement the action of the second application; when the second application is located in the first electronic device, after obtaining a start command of the control application, send the command information of the first application to the second electronic device through the communication unit, so that the second electronic device executes the action of the first application according to the received command information of the first application; and execute the action of the second application according to the command information of the second application; when the second application is located in the third electronic device, after obtaining the start command of the control application, send the command information of the first application to the second electronic device through the communication unit, so that the second electronic device executes the action of the first application according to the received command information of the first application; and send the command information of the second application to the third electronic device through the communication unit, so that the third electronic device executes the action of the second application according to the received command information of the second application.

13. The apparatus of claim 12, wherein, The processing unit, when obtaining the command information of the first application, is specifically configured to: receive the command information of the first application from the second electronic device through the communication unit; or receive the command information of the first application from the second electronic device through the communication unit; or obtain command information of the first application input by a user.

14. The apparatus of claim 12, wherein, The processing unit is further configured to: generate a control icon corresponding to the control application; display the control icon on a display screen of the first electronic device.

15. The apparatus of claim 14, wherein, When generating the control icon corresponding to the control application, the processing unit is specifically configured to: obtain icon information corresponding to the first application; generate the control icon according to the icon information corresponding to the first application.

16. The apparatus of claim 12, wherein, When obtaining the start command of the control application, the processing unit is specifically configured to: detect an operation of the control icon corresponding to the control application by a user; and in response to the operation, generate the start command of the control application; or receive a voice instruction of the user through a voice assistant application; and obtain the start command of the control application by analyzing the voice instruction through the voice assistant application.

17. The apparatus of claim 16, wherein, The processing unit is further configured to: add the first application in an application list managed by the voice assistant application before obtaining the start command of the control application by analyzing the voice instruction through the voice assistant application.

18. The apparatus of any one of claims 12-17, wherein, The processing unit is further configured to obtain information of a second electronic device; When sending the command information of the first application to the second electronic device through the communication unit, the processing unit is specifically configured to: send the command information of the first application to the second electronic device through the communication unit according to the information of the second electronic device.

19. The apparatus of any one of claims 12-17, wherein, The processing unit is further configured to: determine that a connection with the second electronic device is not established before sending the command information of the first application to the second electronic device, and send a power-on signal to the second electronic device through the communication unit; establish a connection with the second electronic device.

20. The apparatus of any one of claims 12-17, wherein, The processing unit is further configured to: obtain information of a fourth electronic device associated with the second electronic device; determine that a connection with the fourth electronic device is not established before sending the command information of the first application to the second electronic device, and send a power-on signal to the fourth electronic device through the communication unit; establish a connection with the fourth electronic device.

21. The apparatus of any one of claims 12-17, wherein, The processing unit is further configured to, before obtaining the command information of the first application, send a first control request to the second electronic device through the communication unit, so that the second electronic device feeds back the command information of the first application according to the first control request; or When obtaining the command information of the first application, the processing unit is specifically configured to: receive a second control request from the second electronic device through the communication unit, and the second control request includes the command information of the first application.

22. The apparatus of any one of claims 12-17, wherein, The processing unit is further configured to: after generating the control application, send command information of the control application to a fifth electronic device through the communication unit, and the command information of the control application is used to start the control application.

23. An electronic device, comprising: comprise: a display screen, a processor, and a memory; wherein the memory stores a computer program, the computer program includes instructions, when the instructions are executed by the processor, the electronic device executes the method in any one of claims 1-11.

24. A computer storage medium, comprising, The computer storage medium stores a computer program, and when the computer program is executed by a computer, the computer executes the method of any one of claims 1-11.

25. A chip, characterized by The chip is used to read the computer program stored in the memory, and execute the method of any one of claims 1-11.

Images