Cross-device flow operation method and device for large-screen service

Abstract

Embodiments of the present application provide a method and device for cross-device flow operation of a large-screen service. The method comprises: starting a first service application on the large screen; sending, by the large screen, a first operation service request to the terminal, wherein the first operation service request comprises identification information of the first service application and / or identification information of a first operation service, and the first operation service is an operation service corresponding to the first service application; displaying, by the terminal in response to the first operation service request, a first operation interface corresponding to the first operation service; and implementing, by the terminal, operation on the first service application started on the large screen by receiving an operation on the first operation interface. Embodiments of the present application can save the process of selecting a corresponding operation service from the smart screen application according to the foreground service application of the large screen, and improve user experience.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the terminal field, and in particular to a cross-device flow operation method and device for large-screen services. BACKGROUND

[0002] The application scenarios of large screens are increasing, and in addition to the traditional television live broadcast scenario, video on demand, screen projection, smooth continuous calls, karaoke, photographing, sports fitness, and game scenarios have been added. For different application scenarios, the operation methods required by users are also changing, which brings great challenges to the remote control of large screens. However, the physical buttons on the current remote control are limited and cannot meet the operation requirements of various application scenarios on the large screen.

[0003] In related technologies, a mobile phone can be used to remotely control a large screen, that is, a smart screen application is installed on the mobile phone, and commands for the large screen are input through the operation services provided by the smart screen application, such as opening an application, searching for content, and playing a video. Thus, the problem of not being able to meet the operation requirements due to the limited physical buttons of the remote control is solved.

[0004] However, the smart screen application itself has the problem of complex operation when determining the operation service corresponding to the current application scenario of the large screen. SUMMARY

[0005] The present application provides a cross-device flow operation method and device for large-screen services to eliminate the process of selecting a corresponding operation service from a smart screen application according to the foreground service application of a large screen, which is simple to operate and improves user experience.

[0006] In a first aspect, the embodiments of the present application provide a cross-device flow operation method for large-screen services, applied to a system including a large screen and a terminal, and the large screen and the terminal have a binding relationship; the method comprises: starting a first service application on the large screen; the large screen sends a first operation service request to the terminal, wherein the first operation service request includes identification information of the first service application and / or identification information of a first operation service, and the first operation service is an operation service corresponding to the first service application; the terminal displays a first operation interface corresponding to the first operation service in response to the first operation service request; and the terminal realizes the operation of the first service application started on the large screen by receiving the operation on the first operation interface.

[0007] In the embodiment of the application, the terminal can autonomously acquire its control interface after receiving the control service request, and then display the control interface on the screen. In this way, the user can be saved from the process of selecting the corresponding control service from the smart screen application according to the foreground service application of the large screen. Correspondingly, the user does not need to know the corresponding relationship between the service application and the control service, and does not need to remember the selection path of each control service. The operation is simple, and the user experience is improved.

[0008] According to the first aspect, the method further includes: the foreground service application of the large screen switches from the first service application to a second service application; the large screen sends a second control service request to the terminal, wherein the second control service request includes identification information of the second service application and / or identification information of a second control service, and the second control service is a control service corresponding to the second service application; the terminal displays a second control interface corresponding to the second control service in response to the second control service request, wherein the second control interface is different from the first control interface; and the terminal implements control over the second service application opened on the large screen by receiving an operation acting on the second control interface.

[0009] In the embodiment of the application, after the foreground service application of the large screen is switched, the control interface of the control service corresponding to the service application before the switching can be automatically closed on the terminal, and the control interface of the control service corresponding to the service application after the switching can be displayed. In this way, the control interface of the control service corresponding to different service applications can be quickly displayed on the terminal, the user can be saved from the process of selecting the corresponding control service from the smart screen application according to the foreground service application of the large screen, and correspondingly, the user does not need to know the corresponding relationship between the service application and the control service, and does not need to remember the selection path of each control service. The operation is simple, and the user experience is improved.

[0010] According to the first aspect, or any one of the implementation manners of the first aspect, after the large screen sends the second control service request to the terminal, the method further includes: the terminal closes the control interface of the first control service and terminates the first control service; or the terminal closes the control interface of the first control service but retains the first control service.

[0011] According to the first aspect, or any one of the implementation manners of the first aspect, the terminal implements control over the first service application opened on the large screen by receiving an operation acting on the first control interface, including: the terminal receives the operation acting on the first control interface, generates a corresponding operation instruction, and sends the operation instruction to the large screen; and the large screen performs corresponding processing according to the operation instruction to complete the control over the first service application.

[0012] According to a first aspect, or any possible implementation mode of the first aspect, after the terminal displays the first operation interface corresponding to the first operation service in response to the first operation service request, the method further comprises: the large screen sends an operation termination request to the terminal, the operation termination request comprising identification information of the first service application and / or identification information of the first operation service; the terminal no longer displays the first operation interface in response to the operation termination request; and the large screen exits the first service application.

[0013] In the embodiments of the present application, the user can directly operate the large screen to exit the foreground service application, and the terminal can exit the operation interface of the operation service after receiving the operation termination request sent by the large screen, so that the user can save the process of manually exiting the operation service, the process is simple, and the user experience is improved.

[0014] According to a first aspect, or any possible implementation mode of the first aspect, after the terminal displays the first operation interface corresponding to the first operation service in response to the first operation service request, the method further comprises: the terminal sends a service termination request to the large screen; the large screen exits the first service application in response to the service termination request; and the terminal no longer displays the first operation interface.

[0015] According to a first aspect, or any possible implementation mode of the first aspect, before the terminal no longer displays the first operation interface, the method further comprises: the large screen sends a service application exit response to the terminal; and the terminal no longer displays the first operation interface, comprising: the terminal no longer displays the first operation interface in response to the service application exit response.

[0016] In the embodiments of the present application, the user can operate the large screen to exit the foreground service application through the terminal, and the large screen can exit the foreground service application after receiving the service termination request sent by the terminal, so that the whole process of operating the service application on the large screen through the terminal is convenient, and the user experience is improved.

[0017] According to a first aspect, or any possible implementation mode of the first aspect, the first service application is a video on demand application, and the first operation service is a video operation service; and the first operation interface comprises one or more controls of a video progress bar, a video selection set and a recommended video.

[0018] According to a first aspect, or any possible implementation mode of the first aspect, the first service application is a KTV application, and the first operation service is a KTV operation service; and the first operation interface comprises one or more controls of a recommended song list and a selected song list, the recommended song list comprises one or more songs, and the selected song list comprises songs selected by the user from the recommended song list.

[0019] According to the first aspect, or any one of the implementations of the above first aspect, the first service application is a gallery application, and the first control service is a gallery control service; the first control interface includes a plurality of thumbnails corresponding to a plurality of images contained in the gallery application.

[0020] According to the first aspect, or any one of the implementations of the above first aspect, the first service application is a game application, and the first control service is a game control service; the first control interface includes one or more controls of game pictures and / or game operation buttons.

[0021] According to the first aspect, or any one of the implementations of the above first aspect, the first service application is a live broadcast application, and the first control service is a live broadcast control service; the first control interface includes a live broadcast list, and the live broadcast list includes a plurality of classified sub-lists, and any one of the sub-lists includes one or more live broadcast channels.

[0022] According to the first aspect, or any one of the implementations of the above first aspect, the first control interface further includes a "mobile phone remote control" button; when the terminal receives an operation instruction generated by an operation on the "mobile phone remote control" button, a remote control operation interface is displayed, and the remote control operation interface includes one or more controls of up, down, left, and right direction keys, an OK key, an increase / decrease key, an exit key, a menu key, and a power on / off key.

[0023] According to the first aspect, or any one of the implementations of the above first aspect, the large screen pre-stores a correspondence between the first service application and the first control service.

[0024] According to the second aspect, the embodiments of the present application provide a cross-device flow control method of a large screen service, applied to a terminal, including: receiving a first control service request from a large screen, wherein the first control service request includes identification information of a first service application started on the large screen and / or identification information of a first control service, and the first control service is a control service corresponding to the first service application; in response to the first control service request, displaying a first control interface corresponding to the first control service; and by receiving an operation on the first control interface, controlling the first service application started on the large screen.

[0025] In the embodiment of the present application, the terminal can autonomously acquire its control interface after receiving the control service request, and then display the control interface on the screen. In this way, the process of selecting the corresponding control service from the smart screen application according to the foreground service application of the large screen can be omitted, and accordingly, the user does not need to know the corresponding relationship between the service application and the control service, and does not need to remember the selection path of each control service. The operation is simple, and the user experience is improved.

[0026] According to a second aspect, the method further includes: receiving a second control service request from the terminal, wherein the second control service request includes identification information of a second service application after the foreground service application is switched on the large screen and / or identification information of a second control service, and the second control service is a control service corresponding to the second service application; in response to the second control service request, displaying a second control interface corresponding to the second control service, wherein the second control interface is different from the first control interface; and implementing control on the second service application opened on the large screen by receiving an operation on the second control interface.

[0027] According to the second aspect or any one of the implementation forms of the second aspect, after the second control service request from the terminal is received, the method further includes: closing the control interface of the first control service and terminating the first control service; or closing the control interface of the first control service but keeping the first control service.

[0028] According to the second aspect or any one of the implementation forms of the second aspect, the implementing control on the first service application opened on the large screen by receiving the operation on the first control interface includes: generating a corresponding operation instruction by receiving the operation on the first control interface; and sending the operation instruction to the large screen.

[0029] According to the second aspect or any one of the implementation forms of the second aspect, after the implementing control on the first service application opened on the large screen by receiving the operation on the first control interface, the method further includes: receiving a control termination request from the large screen, wherein the control termination request includes identification information of the first service application and / or identification information of the first control service; and in response to the control termination request, no longer displaying the first control interface.

[0030] According to the second aspect or any one of the implementation forms of the second aspect, after the implementing control on the first service application opened on the large screen by receiving the operation on the first control interface, the method further includes: sending a service termination request to the large screen; and no longer displaying the first control interface.

[0031] According to a second aspect, or any possible implementation mode of the second aspect, before the first control interface is no longer displayed, the method further comprises: receiving a service application exit response from the large screen; and the first control interface is no longer displayed, comprising: in response to the service application exit response, the first control interface is no longer displayed.

[0032] According to a second aspect, or any possible implementation mode of the second aspect, the first service application is a video on demand application, and the first control service is a video control service; and the first control interface comprises one or more controls of a video progress bar, a video selection set and a recommended video.

[0033] According to a second aspect, or any possible implementation mode of the second aspect, the first service application is a K song application, and the first control service is a K song control service; and the first control interface comprises one or more controls of a recommended song list and a selected song list, the recommended song list comprises one or more songs, and the selected song list comprises songs selected by a user from the recommended song list.

[0034] According to a second aspect, or any possible implementation mode of the second aspect, the first service application is a gallery application, and the first control service is a gallery control service; and the first control interface comprises a plurality of thumbnails, the plurality of thumbnails correspond to a plurality of images contained in the gallery application.

[0035] According to a second aspect, or any possible implementation mode of the second aspect, the first service application is a game application, and the first control service is a game control service; and the first control interface comprises one or more controls of a game screen and / or a game operation key.

[0036] According to a second aspect, or any possible implementation mode of the second aspect, the first service application is a live broadcast application, and the first control service is a live broadcast control service; and the first control interface comprises a live broadcast list, the live broadcast list comprises a plurality of classified sublists, and any one of the sublists comprises one or more live broadcast channels.

[0037] According to a second aspect, or any possible implementation mode of the second aspect, the first control interface further comprises a "mobile phone remote control" key; when the terminal receives an operation instruction generated by an operation on the "mobile phone remote control" key, a remote control operation interface is displayed, the remote control operation interface comprises one or more controls of up, down, left and right direction keys, an OK key, an increase / decrease key, an exit key, a menu key and a power on / off key.

[0038] In a third aspect, the embodiments of the present application provide a method for cross-device flow control of a large-screen service, applied to a large screen, including: starting a first service application; and sending a first control service request to a terminal, wherein the first control service request comprises identification information of the first service application and / or identification information of a first control service, and the first control service is a control service corresponding to the first service application.

[0039] According to the embodiments of the present application, the terminal can autonomously acquire a control interface thereof after receiving the control service request, and then display the control interface on the screen, so that the user can select a corresponding control service from the smart screen application according to the foreground service application of the large screen, and accordingly, the user does not need to know the corresponding relationship between the service application and the control service, and does not need to remember the selection path of each control service, so that the operation is simple and the user experience is improved.

[0040] According to the third aspect, the method further comprises: switching the foreground service application from the first service application to a second service application; and sending a second control service request to the terminal, wherein the second control service request comprises identification information of the second service application and / or identification information of a second control service, and the second control service is a control service corresponding to the second service application.

[0041] According to the third aspect, or any one of the third aspect and the following third aspect, after the first control service request is sent to the terminal, the method further comprises: receiving an operation instruction from the terminal, the operation instruction being generated by an operation on a first control interface on the terminal; and performing corresponding processing according to the operation instruction to complete the control of the first service application.

[0042] According to the third aspect, or any one of the third aspect and the following third aspect, after the first control service request is sent to the terminal, the method further comprises: sending a control termination request to the terminal, the control termination request comprising the identification information of the first service application and / or the identification information of the first control service; and exiting the first service application.

[0043] According to the third aspect, or any one of the third aspect and the following third aspect, after the first control service request is sent to the terminal, the method further comprises: receiving a service termination request from the terminal; and in response to the service termination request, exiting the first service application.

[0044] According to the third aspect, or any one of the third aspect and the following third aspect, after the first control service request is sent to the terminal, the method further comprises: receiving a service termination request from the terminal; and in response to the service termination request, exiting the first service application.

[0045] According to a third aspect, or any possible implementation of the third aspect, the large screen has pre-stored a corresponding relationship between the first service application and the first control service.

[0046] According to a fourth aspect, or any possible implementation of the fourth aspect, the electronic device is used as a terminal, and includes: a transmission module configured to receive a first control service request from the large screen, wherein the first control service request includes identification information of a first service application opened on the large screen and / or identification information of a first control service, and the first control service is a control service corresponding to the first service application; a display module configured to display a first control interface corresponding to the first control service in response to the first control service request; and a processing module configured to implement control of the first service application opened on the large screen by receiving an operation on the first control interface.

[0047] According to the fourth aspect, the transmission module is further configured to receive a second control service request from the terminal, wherein the second control service request includes identification information of a second service application after foreground service application switching on the large screen and / or identification information of a second control service, and the second control service is a control service corresponding to the second service application; the display module is further configured to display a second control interface corresponding to the second control service in response to the second control service request, wherein the second control interface is different from the first control interface; and the processing module is further configured to implement control of the second service application opened on the large screen by receiving an operation on the second control interface.

[0048] According to the fourth aspect, or any possible implementation of the fourth aspect, the processing module is further configured to close a control interface of the first control service and terminate the first control service, or close the control interface of the first control service but keep the first control service.

[0049] According to the fourth aspect, or any possible implementation of the fourth aspect, the processing module is specifically configured to generate a corresponding operation instruction by receiving an operation on the first control interface; and the transmission module is further configured to send the operation instruction to the large screen.

[0050] According to the fourth aspect, or any possible implementation of the fourth aspect, the transmission module is further configured to receive a control termination request from the large screen, wherein the control termination request includes identification information of the first service application and / or identification information of the first control service; and the processing module is further configured to no longer display the first control interface in response to the control termination request.

[0051] According to the fourth aspect, or any implementation of the fourth aspect above, the transmission module is further configured to send a service termination request to the large screen; the processing module is further configured to stop displaying the first control interface.

[0052] According to the fourth aspect, or any implementation of the fourth aspect above, the transmission module is further configured to receive a business application exit response from the large screen; the processing module is further configured to respond to the business application exit response and no longer display the first control interface.

[0053] According to the fourth aspect, or any implementation of the fourth aspect above, the first business application is a video-on-demand application, and the first control service is a video playback control service; the first control interface includes one or more controls among a video progress bar, a video selection, and recommended videos.

[0054] According to the fourth aspect, or any implementation of the fourth aspect above, the first business application is a karaoke application, and the first control service is a karaoke broadcast control service; the first control interface includes one or more controls in a recommended song list and a selected song list, the recommended song list includes one or more songs, and the selected song list includes songs selected by the user from the recommended song list.

[0055] According to the fourth aspect, or any implementation of the fourth aspect above, the first business application is a gallery application, and the first control service is a gallery control service; the first control interface includes multiple thumbnails, and the multiple thumbnails correspond to multiple images contained in the gallery application.

[0056] According to the fourth aspect, or any implementation of the fourth aspect above, the first business application is a game application, and the first control service is a game control service; the first control interface includes one or more controls among the game screen and / or game operation buttons.

[0057] According to the fourth aspect, or any implementation of the fourth aspect above, the first business application is a live streaming application, and the first control service is a live streaming control service; the first control interface includes a live streaming list, which includes multiple sub-lists of different categories, and any one of the sub-lists includes one or more live streaming channels.

[0058] According to a fourth aspect, or any possible implementation mode of the fourth aspect, the first operation interface further comprises a "mobile phone remote controller" button; when the terminal receives an operation instruction generated by an operation on the "mobile phone remote controller" button, a remote controller operation interface is displayed, the remote controller operation interface comprising one or more controls of up, down, left, right direction keys, an OK key, an increase / decrease key, an exit key, a menu key, and a power on / off key.

[0059] According to a fifth aspect, an embodiment of the present application provides an electronic device used as a large screen, comprising: a processing module configured to start a first service application; and a transmission module configured to send a first operation service request to a terminal, wherein the first operation service request comprises identification information of the first service application and / or identification information of a first operation service, and the first operation service is an operation service corresponding to the first service application.

[0060] According to the fifth aspect, the processing module is further configured to switch a foreground service application from the first service application to a second service application; and the transmission module is further configured to send a second operation service request to the terminal, wherein the second operation service request comprises identification information of the second service application and / or identification information of a second operation service, and the second operation service is an operation service corresponding to the second service application.

[0061] According to the fifth aspect, or any possible implementation mode of the fifth aspect, the transmission module is further configured to receive an operation instruction from the terminal, the operation instruction being generated by an operation on a first operation interface on the terminal; and the processing module is further configured to perform corresponding processing according to the operation instruction, so as to complete operation on the first service application.

[0062] According to the fifth aspect, or any possible implementation mode of the fifth aspect, the transmission module is further configured to send an operation termination request to the terminal, the operation termination request comprising identification information of the first service application and / or identification information of the first operation service; and the processing module is further configured to exit the first service application.

[0063] According to the fifth aspect, or any possible implementation mode of the fifth aspect, the transmission module is further configured to receive a service termination request from the terminal; and the processing module is further configured to exit the first service application in response to the service termination request.

[0064] According to the fifth aspect, or any possible implementation mode of the fifth aspect, the transmission module is further configured to send a service application exit response to the terminal.

[0065] According to a fifth aspect, or any possible implementation mode of the fifth aspect, the electronic device pre-stores a corresponding relationship between the first service application and the first operation service.

[0066] According to a sixth aspect, the embodiments of the present application provide an electronic device, comprising: a processor and a transceiver; a memory for storing one or more programs; when the one or more programs are executed by the one or more processors, the one or more processors implement the method in the second to third aspects or any possible implementation mode of the second to third aspects.

[0067] According to a seventh aspect, the embodiments of the present application provide a computer readable storage medium, comprising a computer program, characterized in that when the computer program runs on a camera, the camera executes the method in the second to third aspects or any possible implementation mode of the second to third aspects.

[0068] According to an eighth aspect, the embodiments of the present application provide a chip, comprising one or more interface circuits and one or more processors; the interface circuit is used to receive a signal from the memory of the electronic device and send the signal to the processor, the signal comprises computer instructions stored in the memory; when the processor executes the computer instructions, the electronic device executes the method in the second to third aspects or any possible implementation mode of the second to third aspects. BRIEF DESCRIPTION OF DRAWINGS

[0069] Figure 1 An exemplary schematic diagram for the remote control to control the large screen;

[0070] Figure 2 An exemplary schematic diagram for the remote control to input text on the large screen;

[0071] Figure 3 An exemplary schematic diagram for the smart screen application;

[0072] Figure 4 An exemplary structural diagram of the application scenario 40 provided by the embodiments of the present application;

[0073] Figure 5 An exemplary structural diagram of the electronic device 500 provided by the embodiments of the present application;

[0074] Figure 6 An exemplary software structural block diagram of the electronic device 500 provided by the embodiments of the present application;

[0075] Figure 7 An exemplary structural block diagram of the cross-device flow operation of the large screen service provided by the embodiments of the present application;

[0076] Figure 8 A flowchart of process 800 of the cross-device flow control method of the large-screen service according to an embodiment of the present application;

[0077] Figure 9 A flowchart of process 900 of the cross-device flow control method of the large-screen service according to an embodiment of the present application;

[0078] Figure 10 A flowchart of process 1000 of the cross-device flow control method of the large-screen service according to an embodiment of the present application;

[0079] Figure 11 An exemplary interactive communication flow diagram for establishing the cross-device flow control of the large-screen service according to an embodiment of the present application;

[0080] Figure 12 An exemplary interactive communication flow diagram for exiting the cross-device flow control of the large-screen service according to an embodiment of the present application;

[0081] Figure 13 An exemplary interactive communication flow diagram for exiting the cross-device flow control of the large-screen service according to an embodiment of the present application;

[0082] Figure 14a An exemplary schematic diagram of the main interface of the P30pro;

[0083] Figure 14b An exemplary schematic diagram of the main interface of the smart screen application;

[0084] Figure 14c An exemplary schematic diagram of the remote control interface;

[0085] Figure 14d An exemplary schematic diagram of the main interface of the V65;

[0086] Figure 14e An exemplary schematic diagram of the cross-device flow control between the V65 and the P30pro;

[0087] Figure 15a An exemplary schematic diagram of the main interface of the V65;

[0088] Figure 15b An exemplary schematic diagram of the cross-device flow control between the V65 and the P30pro;

[0089] Figure 16a An exemplary schematic diagram of the main interface of the V65;

[0090] Figure 16b An exemplary schematic diagram of the cross-device flow control between the V65 and the P30pro;

[0091] Figure 17 An exemplary schematic diagram of cross-device flow operation for V65 and P30pro;

[0092] Figure 18 An exemplary schematic diagram of cross-device flow operation for V65 and P30pro;

[0093] Figure 19 An exemplary schematic diagram of a main interface of P30pro;

[0094] Figure 20 A flowchart of process 2000 of a cross-device flow operation method of a large-screen service of an embodiment of the present application;

[0095] Figure 21a An exemplary schematic diagram of a video call interface of V65;

[0096] Figure 21b An exemplary schematic diagram of cross-device flow operation for V65 and P30pro;

[0097] Figure 22 An exemplary block diagram of an apparatus 2200 of an embodiment of the present application is shown. DETAILED DESCRIPTION

[0098] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0099] The term “and / or” in the present document is merely used to describe an association relationship of associated objects, and indicates that three relationships can exist, for example, A and / or B can represent three cases of existence of A alone, existence of A and B simultaneously, and existence of B alone.

[0100] The terms “first” and “second” and the like in the specification and claims of the embodiments of the present application are used to distinguish different objects, and are not used to describe a specific order of the objects. For example, the first target object and the second target object are used to distinguish different target objects, and are not used to describe a specific order of the target objects.

[0101] In the embodiments of the present application, the words “exemplary” or “for example” are used to mean serving as an example, instance, or illustration. Any embodiment or design solution described as “exemplary” or “for example” in the embodiments of the present application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Rather, the use of the words “exemplary” or “for example” is intended to present concepts in a specific way.

[0102] In the description of the embodiments of the present application, unless otherwise specified, "plural" means two or more. For example, plural processing units mean two or more processing units; plural systems mean two or more systems.

[0103] In the description of the embodiments of the present application, unless otherwise specified, "plural" means two or more. For example, plural processing units mean two or more processing units; plural systems mean two or more systems.

[0104] Figure 1 An exemplary schematic diagram for a remote control to operate a large screen is shown in Figure 1 As shown, the remote control usually includes a power on / off key, a home key, up / down / left / right direction keys, an OK key, a back key, a voice key, a menu key, an increase key, and a decrease key. When a user uses the remote control to operate the large screen, the user can click the up / down / left / right keys to move the focus on the large screen, and a focus animation effect can be accompanied during the movement. Then, the user can click the OK key to select the content corresponding to the current focus. With the development of large screen technology, in addition to the traditional TV live broadcast scenario, new scenarios such as video on demand, KTV, fitness, smooth communication call, and photo gallery have been added to the large screen. For different application scenarios, the operation methods required by users are also changing, which poses a great challenge to the remote control. For example, Figure 2 An exemplary schematic diagram for using a remote control to input text on a large screen is shown in Figure 2 As shown, to input the five characters "My Smart Screen", the user needs to click the up / down / left / right keys to move the focus to all the pinyin letters of each character, and click the OK key once for each selected letter, which takes about 60 steps in total. It can be seen that performing complex operations with a remote control is very cumbersome and cannot meet the control requirements of various application scenarios on the large screen.

[0105] Based on this, in the related art, a mobile phone can be used to remotely control the large screen, that is, install a smart screen application on the mobile phone. Figure 3 An exemplary schematic diagram of the smart screen application is shown in Figure 3 As shown, on the main interface of the smart screen application, the connected large screen is displayed as a Huawei Smart Screen, and the usage duration of the Huawei Smart Screen today is 4 hours and 48 minutes, and the user can click the power on / off key on the right to turn on / off the Huawei Smart Screen. The following keys such as mirror control, remote control, smooth communication call, search for movies, message board, and remote home monitoring can enter the control service interfaces of the corresponding application scenarios respectively after being clicked. For example, when clicking the "Remote Control" key, a simulated remote control similar to the Figure 1 panel of the remote control shown in Figure 14cAs shown in the figure, it can be seen that the input of the command of the large screen by the operation service provided by the smart screen application can solve the problem that the physical keys of the remote controller are too few to meet the operation requirements.

[0106] However, as described above, even if the smart screen application can provide corresponding operation services for various application scenarios of the large screen, the process of selecting the corresponding operation service not only needs the user to know the corresponding relationship between the application scenario and the operation service in advance, but also needs the user to remember the selection path of each operation service, which is not only complicated to operate, but also affects the user experience.

[0107] Therefore, the cross-device flow control method for large screen service provided by the embodiments of the present application solves the above problems. Exemplarily, by applying the cross-device flow control method provided by the embodiments of the present application, in the scenario shown in the figure, the keyboard can be automatically popped up on the terminal device (such as a mobile phone) of the user, and the user can conveniently input text in the input box of the large screen by operating the terminal device. Figure 2 As shown in the figure, in the scenario of inputting text on the large screen, the keyboard can be automatically popped up on the terminal device (such as a mobile phone) of the user, and the user can conveniently input text in the input box of the large screen by operating the terminal device.

[0108] Before the technical solutions of the embodiments of the present application are described, the application scenario of the embodiments of the present application will be described first in combination with the accompanying drawings. Figure 4 An exemplary structural diagram of the application scenario 40 provided by the embodiments of the present application is shown in the figure. Figure 4 As shown in the figure, in the application scenario 40, at least two electronic devices can be included, for example, device A, device B and device C, wherein at least one of the electronic devices is a large screen, which can be a smart screen or a set-top box (such as a television box) running an operating system and an application program, and at least one of the electronic devices is a terminal, which can be a mobile phone or a tablet computer. The application scenario 40 can also include a cloud server.

[0109] In the embodiments of the present application, a plurality of service applications that can be used on the large screen are deployed on the large screen, such as live broadcast, video on demand, karaoke, sports fitness, games, etc.; a plurality of operation services corresponding to the foregoing service applications are deployed on the terminal, such as a mobile phone remote controller, a video broadcast control service, a sports operation service, a game operation service, etc. The plurality of operation services can be provided by an application (such as a smart screen application) installed on the terminal; device data, content data, etc. related to the large screen are deployed on the cloud server, such as card or applet data of the operation service, and for example, video content posters, video recommendations, etc., which are used to be synchronized to the application of the terminal and then displayed on the screen of the terminal.

[0110] It should be understood that the number and form of the electronic devices included in the application scenario 40 are not specifically limited by the embodiments of the present application.

[0111] In addition, any two electronic devices of the application scenario 40 and the cloud server can communicate with each other in various manners, for example, through connection or by means of future communication technology to transmit data. The connection can include wired connection or wireless connection, and the like. For example, the two electronic devices can be connected through a USB data line; the wireless connection between the two electronic devices can be through the establishment of a Wi-Fi connection, a near field communication close connection, a Bluetooth code scanning connection, and the like. The two electronic devices can also communicate by means of future communication technology, for example, by installing different or same applications on a mobile phone and a tablet, and transmitting data by means of a 5G communication network. The connection manner or the communication manner between the two electronic devices and the cloud server is not limited in the present application.

[0112] In the embodiments of the present application, at least two electronic devices in the application scenario 40 can be bound to each other, and the method for establishing a binding relationship can include any one or more of the following:

[0113] (1) The binding relationship between multiple electronic devices in the same local area network and logged in with the same account (for example, a Huawei account) is automatically established.

[0114] (2) The binding relationship between multiple electronic devices can be established through a touch, code scanning, and the like.

[0115] The multiple electronic devices establishing the binding relationship can maintain an electronic device list respectively, which lists the information of the electronic devices having the binding relationship with the electronic device. The information of the electronic device can include the device identifier, the device type, the device model, and the like of the electronic device. For example, the electronic device list maintained by the large screen includes the device identifiers of two electronic devices, which are a mobile phone and a tablet computer. In addition, the electronic device list can also include the control service information of the electronic device, for example, the identifier information (for example, the name, index, and the like) of the control service provided by the electronic device.

[0116] In the embodiments of the present application, the electronic device can periodically update the electronic device list, for example, every interval of a predetermined time length, the electronic device searches the surrounding environment to see whether there is an electronic device in the same local area network and logged in with the same account, and updates the electronic device list according to the search result; the electronic device can also update the electronic device list based on the triggering of an event, for example, when other electronic devices touch the electronic device or scan the two-dimensional code displayed by the electronic device, the electronic device can add the other electronic devices to the electronic device list.

[0117] It should be noted that in addition to the above two methods, the application can also use other methods to establish the binding relationship between the plurality of electronic devices, thereby forming the application scenario, and the application does not make specific limitation thereto.

[0118] Figure 5 An exemplary structural diagram of the electronic device 500 provided by the embodiments of the application is shown in FIG. 5, wherein the electronic device 500 can be any one of the at least two electronic devices included in the application scenario 40 shown in FIG. 4. Figure 5 Figure 4 The application scenario 40 shown in FIG. 4 includes at least two electronic devices.

[0119] It should be understood that the electronic device 500 shown in FIG. 5 is only an example, and the electronic device 500 can have more or fewer components than those shown in the figure, can combine two or more components, or can have a different component configuration. Figure 5 It should be understood that the electronic device 500 shown in FIG. 5 is only an example, and the electronic device 500 can have more or fewer components than those shown in the figure, can combine two or more components, or can have a different component configuration. Figure 5 The various components shown in FIG. 5 can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0120] The electronic device 500 can include a processor 510, an external memory interface 520, an internal memory 521, a universal serial bus (USB) interface 530, a charge management module 540, a power management module 541, a battery 542, an antenna 1, an antenna 2, a mobile communication module 550, a wireless communication module 560, an audio module 570, a speaker 570A, a receiver 570B, a microphone 570C, a headset interface 570D, a sensor module 580, a key 590, a motor 591, an indicator 592, a camera 593, a display screen 594, and a subscriber identification module (SIM) card interface 595, etc. The sensor module 580 can include a pressure sensor 580A, a gyroscope sensor 580B, a barometric pressure sensor 580C, a magnetic sensor 580D, an acceleration sensor 580E, a distance sensor 580F, a proximity light sensor 580G, a fingerprint sensor 580H, a temperature sensor 580J, a touch sensor 580K, an ambient light sensor 580L, a bone conduction sensor 580M, etc.

[0121] ​The processor 510 can include one or more processing units, for example: the processor 510 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices, or can be integrated in one or more processors.

[0122] The controller can be the nerve center and command center of the electronic device 500. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0123] The memory in the processor 510 can also be configured to store instructions and data. In some embodiments, the memory in the processor 510 is a cache memory. The memory can save instructions or data that the processor 510 has just used or repeatedly uses. If the processor 510 needs to use the instructions or data again, it can directly call from the memory. Avoiding repeated access, reducing the waiting time of the processor 510, thus improving the efficiency of the system.

[0124] In some embodiments, the processor 510 can include one or more interfaces. The interface can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0125] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 510 can contain multiple sets of I2C bus. The processor 510 can be coupled to the touch sensor 580K, the charger, the flash, the camera 593, etc. through different I2C bus interfaces respectively. For example, the processor 510 can be coupled to the touch sensor 580K through an I2C interface, so that the processor 510 and the touch sensor 580K communicate through the I2C bus interface, and the touch function of the electronic device 500 is realized.

[0126] The I2S interface can be used for audio communication. In some embodiments, the processor 510 can contain multiple sets of I2S bus. The processor 510 can be coupled to the audio module 570 through the I2S bus, and communication between the processor 510 and the audio module 570 is realized. In some embodiments, the audio module 570 can deliver audio signals to the wireless communication module 560 through the I2S interface, and the function of answering a phone through a Bluetooth headset is realized.

[0127] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 570 and the wireless communication module 560 can be coupled through the PCM bus interface. In some embodiments, the audio module 570 can also deliver audio signals to the wireless communication module 560 through the PCM interface, and the function of answering a phone through a Bluetooth headset is realized. Both the I2S interface and the PCM interface can be used for audio communication.

[0128] The UART interface is a universal serial data bus, which is used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 510 and the wireless communication module 560. For example, the processor 510 communicates with the Bluetooth module in the wireless communication module 560 through the UART interface, and the Bluetooth function is realized. In some embodiments, the audio module 570 can deliver audio signals to the wireless communication module 560 through the UART interface, and the function of playing music through a Bluetooth headset is realized.

[0129] The MIPI interface can be used to connect the processor 510 and the display screen 594, the camera 593 and other peripheral devices. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), and the like. In some embodiments, the processor 510 and the camera 593 communicate through the CSI interface to implement the photographing function of the electronic device 500. The processor 510 and the display screen 594 communicate through the DSI interface to implement the display function of the electronic device 500.

[0130] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 510 and the camera 593, the display screen 594, the wireless communication module 560, the audio module 570, the sensor module 580, and the like. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

[0131] The USB interface 530 is an interface that conforms to the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 530 can be used to connect a charger to charge the electronic device 500, and can also be used to transmit data between the electronic device 500 and a peripheral device. It can also be used to connect a headset to play audio through the headset. The interface can also be used to connect other electronic devices, such as AR devices and the like.

[0132] It should be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the electronic device 500. In other embodiments of the present application, the electronic device 500 can also use different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0133] The charging management module 540 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 540 can receive charging input from a wired charger through the USB interface 530. In some wireless charging embodiments, the charging management module 540 can receive wireless charging input through the wireless charging coil of the electronic device 500. The charging management module 540 can charge the battery 542 while also supplying power to the electronic device through the power management module 541.

[0134] The power management module 541 is configured to connect the battery 542 and the charging management module 540 to the processor 510. The power management module 541 receives input from the battery 542 and / or the charging management module 540 to power the processor 510, the internal memory 521, the external memory, the display screen 594, the camera 593, the wireless communication module 560, and the like. The power management module 541 can also be configured to monitor parameters such as the battery capacity, the number of battery cycles, the state of health of the battery (leakage, impedance), and the like. In some embodiments, the power management module 541 can also be disposed in the processor 510. In some embodiments, the power management module 541 and the charging management module 540 can also be disposed in the same device.

[0135] The wireless communication function of the electronic device 500 can be implemented by the antenna 1, the antenna 2, the mobile communication module 550, the wireless communication module 560, the modem processor, and the baseband processor, and the like.

[0136] The antenna 1 and the antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 500 can be configured to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some embodiments, the antennas can be used in combination with a tuning switch.

[0137] The mobile communication module 550 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, and the like, applied to the electronic device 500. The mobile communication module 550 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like. The mobile communication module 550 can receive electromagnetic waves from the antenna 1, and perform filtering, amplification, and the like on the received electromagnetic waves, and transfer the processed signals to the modem processor for demodulation. The mobile communication module 550 can also amplify signals modulated by the modem processor, and radiate the signals as electromagnetic waves through the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 550 can be disposed in the processor 510. In some embodiments, at least part of the functional modules of the mobile communication module 550 and at least part of the modules of the processor 510 can be disposed in the same device.

[0138] The modem processor can include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 570A, a microphone 570B, etc.), or displays an image or a video through the display screen 594. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 510, and can be disposed in the same device as the mobile communication module 550 or other functional modules.

[0139] The wireless communication module 560 can provide a wireless communication solution including wireless local area networks (WLAN) (such as a wireless fidelity (Wi-Fi) network), Bluetooth (BT), a global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, and the like, which are applied to the electronic device 500. The wireless communication module 560 can be one or more devices that integrate at least one communication processing module. The wireless communication module 560 receives an electromagnetic wave via an antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signal, and transmits the processed signal to the processor 510. The wireless communication module 560 can also receive a signal to be transmitted from the processor 510, perform frequency modulation and amplification thereon, and radiate the signal as an electromagnetic wave via the antenna 2.

[0140] In some embodiments, antenna 1 and mobile communication module 550 of electronic device 500 are coupled, and antenna 2 and wireless communication module 560 are coupled, so that electronic device 500 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidu navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite based augmentation systems (SBAS).

[0141] Electronic device 500 implements a display function through a GPU, display screen 594, and an application processor, etc. The GPU is a microprocessor for image processing, connected to display screen 594 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 510 can include one or more GPUs that execute program instructions to generate or change display information.

[0142] The display screen 594 is configured to display images, videos, and the like. The display screen 594 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 500 can include one or N display screens 594, where N is a positive integer greater than 1.

[0143] The electronic device 500 can implement a photographing function through an ISP, the camera 593, a video codec, a GPU, the display screen 594, and an application processor.

[0144] The ISP is configured to process data fed back by the camera 593. For example, when taking a photo, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, the ISP can be disposed in the camera 593.

[0145] The camera 593 is configured to capture still images or videos. An object generates an optical image through a lens and projects it onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the electronic device 500 can include one or N cameras 593, where N is a positive integer greater than 1.

[0146] The digital signal processor is used to process digital signals, in addition to being able to process digital image signals, it can also process other digital signals. For example, when the electronic device 500 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0147] The video codec is used to compress or decompress digital video. The electronic device 500 can support one or more video codecs. In this way, the electronic device 500 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0148] The NPU is a neural-network (NN) calculation processor, which can quickly process input information by drawing on the structure of a biological neural network, such as drawing on the transmission mode between human brain neurons, and can also constantly self-learn. Through the NPU, the electronic device 500 can realize intelligent cognition applications such as image recognition, face recognition, voice recognition, text understanding, etc.

[0149] The external memory interface 520 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 500. The external memory card communicates with the processor 510 through the external memory interface 520 to realize data storage functions. For example, music, video, etc. Files are saved in the external memory card.

[0150] The internal memory 521 can be used to store computer executable program codes, which include instructions. The processor 510 executes various function applications and data processing of the electronic device 500 by running the instructions stored in the internal memory 521. The internal memory 521 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc. The data storage area can store data created during the use of the electronic device 500 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 521 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), etc.

[0151] The electronic device 500 can realize audio functions through the audio module 570, the speaker 570A, the receiver 570B, the microphone 570C, the earphone interface 570D, and the application processor, etc. For example, music playing, recording, etc.

[0152] The audio module 570 is configured to convert digital audio information into an analog audio signal output, and to convert an analog audio input into a digital audio signal. The audio module 570 can also be configured to encode and decode audio signals. In some embodiments, the audio module 570 can be disposed in the processor 510, or some functional modules of the audio module 570 can be disposed in the processor 510.

[0153] The speaker 570A, also referred to as a "loudspeaker", is configured to convert an audio electrical signal into a sound signal. The electronic device 500 can listen to music or listen to a hands-free call through the speaker 570A.

[0154] The receiver 570B, also referred to as a "earpiece", is configured to convert an audio electrical signal into a sound signal. When the electronic device 500 receives a call or a voice message, the user can listen to the voice by holding the receiver 570B close to the ear.

[0155] The microphone 570C, also referred to as a "microphone", "voice microphone", is configured to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak into the microphone 570C by holding the mouth close to the microphone 570C, and input the sound signal into the microphone 570C. The electronic device 500 can be provided with at least one microphone 570C. In other embodiments, the electronic device 500 can be provided with two microphones 570C, in addition to collecting sound signals, the noise reduction function can also be realized. In other embodiments, the electronic device 500 can also be provided with three, four or more microphones 570C, in addition to collecting sound signals, noise reduction, it can also identify the source of the sound, realize the function of directional recording, etc.

[0156] The earphone interface 570D is configured to connect a wired earphone. The earphone interface 570D can be a USB interface 530, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0157] The pressure sensor 580A is configured to sense a pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 580A can be disposed on the display screen 594. The pressure sensor 580A can be of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, etc. The capacitive pressure sensor can include at least two parallel plates of conductive material. When a force is applied to the pressure sensor 580A, the capacitance between the electrodes changes. The electronic device 500 determines the intensity of the pressure according to the change in capacitance. When a touch operation is applied to the display screen 594, the electronic device 500 detects the intensity of the touch operation according to the pressure sensor 580A. The electronic device 500 can also calculate the position of the touch according to the detection signal of the pressure sensor 580A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view short messages is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

[0158] The gyroscope sensor 580B can be configured to determine the motion attitude of the electronic device 500. In some embodiments, the angular velocity of the electronic device 500 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 580B. The gyroscope sensor 580B can be used for anti-shake photography. For example, when the shutter is pressed, the gyroscope sensor 580B detects the angle of shaking of the electronic device 500, calculates the distance that the lens module needs to compensate according to the angle, and lets the lens offset the shaking of the electronic device 500 by reverse movement to achieve anti-shake. The gyroscope sensor 580B can also be used for navigation and motion sensing game scenarios.

[0159] The barometric pressure sensor 580C is configured to measure air pressure. In some embodiments, the electronic device 500 calculates the altitude, assists positioning and navigation by using the air pressure value measured by the barometric pressure sensor 580C.

[0160] The magnetic sensor 580D includes a Hall sensor. The electronic device 500 can detect the opening and closing of a flip cover by using the magnetic sensor 580D. In some embodiments, when the electronic device 500 is a flip phone, the electronic device 500 can detect the opening and closing of the flip cover according to the magnetic sensor 580D. Further, according to the detected opening and closing state of the cover or the flip cover, the electronic device 500 can set a feature such as automatic unlocking of the flip cover.

[0161] The acceleration sensor 580E can detect the acceleration of the electronic device 500 in various directions (generally three axes). When the electronic device 500 is stationary, the acceleration sensor 580E can detect the magnitude and direction of gravity. The acceleration sensor 580E can also be used to identify the attitude of the electronic device, and can be applied to landscape / portrait screen switching and pedometer applications.

[0162] Distance sensor 580F is configured to measure distance. Electronic device 500 can measure distance by infrared or laser. In some embodiments, electronic device 500 can take a picture of a scene and use distance sensor 580F to measure distance to achieve fast focus.

[0163] Proximity light sensor 580G can include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode can be an infrared light emitting diode. Electronic device 500 emits infrared light outwardly through the light emitting diode. Electronic device 500 detects infrared reflected light from nearby objects using the photodiode. When sufficient reflected light is detected, electronic device 500 can determine that there is an object near electronic device 500. When insufficient reflected light is detected, electronic device 500 can determine that there is no object near electronic device 500. Electronic device 500 can use proximity light sensor 580G to detect that a user is holding electronic device 500 close to the ear for a phone call, so as to automatically turn off the screen to save power. Proximity light sensor 580G can also be used for automatic unlocking and locking of the screen in a holster mode or a pocket mode.

[0164] Ambient light sensor 580L is configured to sense ambient light brightness. Electronic device 500 can adaptively adjust the brightness of display screen 594 according to the sensed ambient light brightness. Ambient light sensor 580L can also be used to automatically adjust white balance when taking a picture. Ambient light sensor 580L can also work with proximity light sensor 580G to detect whether electronic device 500 is in a pocket to prevent accidental touch.

[0165] Fingerprint sensor 580H is configured to collect a fingerprint. Electronic device 500 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application lock, fingerprint photographing, fingerprint answering a call, and the like.

[0166] Temperature sensor 580J is configured to detect temperature. In some embodiments, electronic device 500 uses the temperature detected by temperature sensor 580J to implement a temperature handling strategy. For example, when the temperature reported by temperature sensor 580J exceeds a threshold, electronic device 500 reduces the performance of a processor located near temperature sensor 580J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, electronic device 500 heats battery 542 to avoid abnormal shutdown of electronic device 500 caused by low temperature. In other embodiments, when the temperature is lower than yet another threshold, electronic device 500 performs voltage boosting on the output voltage of battery 542 to avoid abnormal shutdown caused by low temperature.

[0167] Touch sensor 580K, also referred to as "touch panel". Touch sensor 580K can be disposed on display screen 594, and touch sensor 580K and display screen 594 together form a touch screen, also referred to as "touch panel". Touch sensor 580K is configured to detect touch operations applied to or near touch sensor 580K. Touch sensor 580K can transmit detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 594. In other embodiments, touch sensor 580K can also be disposed on the surface of electronic device 500, in a position different from that of display screen 594.

[0168] Bone conduction sensor 580M can obtain vibration signals. In some embodiments, bone conduction sensor 580M can obtain vibration signals of the bone block of the human vocal part. Bone conduction sensor 580M can also contact the human pulse to receive blood pressure pulsation signals. In some embodiments, bone conduction sensor 580M can also be disposed in a headset to form a bone conduction headset. Audio module 570 can analyze voice signals based on the vibration signals of the bone block of the vocal part obtained by bone conduction sensor 580M to realize voice functions. The application processor can analyze heart rate information based on the blood pressure pulsation signals obtained by bone conduction sensor 580M to realize heart rate detection functions.

[0169] Keys 590 include power on / off keys, volume keys, and the like. Keys 590 can be mechanical keys. They can also be touch keys. Electronic device 500 can receive key input and generate key signal input related to user settings and function control of electronic device 500.

[0170] Motor 591 can generate vibration prompts. Motor 591 can be used for incoming call vibration prompts and also for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, and the like) can correspond to different vibration feedback effects. Touch operations applied to different regions of display screen 594 can also correspond to different vibration feedback effects of motor 591. Different application scenarios (such as time reminders, received messages, alarms, games, and the like) can also correspond to different vibration feedback effects. Touch vibration feedback effects can also be customizable.

[0171] Indicator 592 can be an indicator light, which can be used to indicate charging status, power changes, and also to indicate messages, missed calls, notifications, and the like.

[0172] The SIM card interface 595 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 595 to make contact with and separate from the electronic device 500. The electronic device 500 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 595 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 595 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 595 is also compatible with different types of SIM cards. The SIM card interface 595 is also compatible with external memory cards. The electronic device 500 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 500 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 500 and cannot be separated from the electronic device 500.

[0173] The software system of the electronic device 500 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to illustrate the software structure of the electronic device 500.

[0174] Figure 6 This is an exemplary software structure block diagram of the electronic device 500 provided in the embodiments of this application.

[0175] The layered architecture of the electronic device 500 divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0176] The application layer can include a series of application packages.

[0177] like Figure 6 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0178] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0179] like Figure 6 As shown, the application framework layer may include a window manager, a phone manager, a content provider, a view system, a resource manager, a notification manager, etc.

[0180] The window manager is used to manage windows programs. The window manager can acquire the display screen size, determine whether there is a status bar, lock the screen, and intercept the screen, etc.

[0181] The phone manager is used to provide the communication function of the electronic device 500. For example, the management of the call state (including call connection, call hang-up, etc.).

[0182] The content provider is used to store and acquire data, and make the data accessible by the application program. The data can include video, image, audio, dialed and received calls, browsing history and bookmarks, phone book, etc.

[0183] The view system includes visual controls, such as a control for displaying text, a control for displaying pictures, etc. The view system can be used to build an application program. The display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0184] The resource manager provides various resources for the application program, such as localized strings, icons, pictures, layout files, video files, etc.

[0185] The notification manager makes the application program display notification information in the status bar, which can be used to convey a type of message that can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform the completion of downloading, message reminders, etc. The notification manager can also be a notification in the form of a chart or a scroll bar text appearing in the top status bar of the system, such as a notification of an application program running in the background, and can also be a notification in the form of a dialogue window appearing on the screen. For example, the text information is prompted in the status bar, a prompt sound is emitted, the electronic device vibrates, the indicator light flashes, etc.

[0186] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0187] The core library includes two parts: one part is the function function called by the java language, and the other part is the core library of Android.

[0188] The application program layer and the application program framework layer run in the virtual machine. The virtual machine executes the java file of the application program layer and the application program framework layer into a binary file. The virtual machine is used to perform the management of the object life cycle, the management of the stack, the management of the thread, the management of the security and the exception, and the garbage collection, etc.

[0189] System libraries can include multiple functional modules. For example: surface manager, 2D graphics engine (e.g., SGL), 3D graphics processing library (e.g., OpenGL ES), media libraries, etc.

[0190] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0191] A 2D graphics engine is a graphics engine for 2D drawing.

[0192] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0193] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0194] The kernel layer is the layer between hardware and software. The kernel layer includes at least the display driver, audio driver, Wi-Fi driver, sensor driver, and Bluetooth driver.

[0195] It should be understood that, Figure 6 The components included in the illustrated software structure do not constitute a specific limitation on the electronic device 500. In other embodiments of this application, the electronic device 500 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements.

[0196] This application allows for the deployment of large-screen business applications on a large screen and the deployment of control services on a terminal. This enables the control of the corresponding large-screen business applications on the large screen through the control services on the terminal, thereby achieving cross-device control of large-screen business.

[0197] Figure 7 This is an exemplary structural block diagram of cross-device flow control for large-screen services provided in this application embodiment. For example... Figure 7As shown, a plurality of service applications (examples are service applications 1-3) are deployed on the large screen, such as live broadcast, video on demand, karaoke, sports fitness, games, etc.; a plurality of control services (examples are control services 1-3) corresponding to the aforementioned service applications are deployed on the terminal, such as a mobile phone remote controller, a video broadcast control service, a sports control service, a game control service, etc. The service applications on the large screen and the control services on the terminal can have the following corresponding relationship: control service 1 and service application 1 correspond, control service 2 and service application 2 correspond, and control service 3 and service application 3 correspond. For example, the live broadcast service control service controls the live broadcast application, the video broadcast control service controls the video on demand application, the sports control service controls the sports fitness application, the game control service controls the game application, etc.

[0198] In addition, the framework layer is deployed on the large screen and the terminal, and the framework layer includes: a distributed soft bus, a distributed security authentication, a distributed task scheduling, and a flow task management service, wherein,

[0199] The distributed soft bus uses a unified communication base based on mobile phones, tablets, smart wearable devices, smart screens, etc. distributed devices to provide unified distributed communication capabilities for the interconnection between electronic devices; the distributed security authentication provides an E2E encryption channel to provide a secure cross-device transmission mechanism for the user's application program, ensuring that "the correct person uses the correct device to use the data correctly"; the distributed task scheduling provides remote service startup, remote service connection, remote migration, etc. capabilities, which can support the user's application program to complete the cross-device migration or multi-device collaborative business experience through the combination of different capabilities; the flow task management service implements the registration of the user's application program and provides management capabilities such as flow entry, state maintenance, state display, and exit flow.

[0200] Based on the above Figures 4-7 As shown in the embodiments, the application provides a cross-device flow control method for large screen services to simplify the operation process when determining the control service and improve the user experience.

[0201] Figure 8 A flowchart of the process 800 of the cross-device flow control method for large screen services of the embodiments of the application. The process 800 can be executed by two electronic devices in the application scenario 40, wherein one electronic device is a large screen and the other electronic device is a terminal. The process 800 is described as a series of steps or operations, and it should be understood that the process 800 can be executed in various orders and / or simultaneously, and is not limited to the execution order shown. The process 800 can include: Figure 8

[0202] Step 801, a service application is started on the large screen.

[0203] ​The business application on the large screen is started, and the business application is displayed on the screen of the large screen. The business application can be referred to as a foreground business application of the large screen.

[0204] In step 802, the large screen sends a control service request to the terminal.

[0205] In order to realize the cross-device flow control of the business application of the large screen and the terminal, after the business application is started, the large screen can send a control service request to the terminal.

[0206] In a possible implementation, the control service request includes identification information of the requested control service, and the control service is a control service corresponding to the foreground business application of the large screen. That is, the control service requested by the large screen to the terminal is used to control the foreground business application. The large screen can store a pre-set corresponding relationship between the business application and the control service. When the large screen needs to control the foreground business application in a cross-device flow manner, the corresponding relationship can be queried to obtain the control service corresponding to the foreground business application, and then the identification information of the control service is written into the control service request and sent to the terminal, so that the terminal can determine the control service requested by the large screen according to the identification information of the control service. The identification information of the control service can be the name, index, or the like of the control service.

[0207] In a possible implementation, the control service request includes identification information of the foreground business application of the large screen. In this way, the terminal can determine the foreground business application according to the identification information of the foreground business application, and then determine the control service corresponding to the foreground business application according to the pre-set corresponding relationship between the business application and the control service.

[0208] In a possible implementation, the control service request can include both the identification information of the requested control service and the identification information of the foreground business application on the large screen.

[0209] For example, the foreground business application on the large screen is a game application (for example, a racing game), and it is difficult to control the game application only by using a remote controller. Therefore, the large screen sends a control service request to the terminal, and the control service request includes the name of the racing game control service, to request to control the racing game by using the racing game control service on the terminal.

[0210] In step 803, the terminal displays a control interface corresponding to the control service in response to the control service request.

[0211] After receiving the control service request, the terminal can determine the control service requested by the large screen based on the identification information of the control service in the control service request. Alternatively, after receiving the control service request, the terminal can determine the foreground service application on the large screen based on the identification information of the foreground service application in the control service request, and then determine the control service corresponding to the foreground service application according to the pre-set correspondence between the service application and the control service.

[0212] The terminal needs to obtain some data for generating the control interface of the control service. Some of the data can come from the cloud server, and the other part can come from the large screen. The data from the cloud server can include content data of the service application, recommendation information based on the user's personal habits, the user's historical collection, the user's address book, setting information of the service application, and the like. The data from the large screen can include a screenshot of the large screen, a gallery on the large screen, a list of service applications installed on the large screen, and the like. It should be understood that the control interface generated by the terminal is in one-to-one correspondence with the control service, and therefore the data required for generating the control interface is associated with the control service and the service application corresponding to the control service. The data is not limited to the foregoing examples, and can also include other data, which is not limited in the embodiments of the present application.

[0213] When the large screen first requests the control service, the terminal can not have the data required for generating the control interface, or only have part of the data required for generating the control interface. At this time, the terminal can send a service application data request to the cloud server and / or the large screen, so as to obtain the data stored in the cloud server and / or the large screen. The terminal can obtain the control interface of the control service based on the foregoing data, and then display the control interface in the form of a card or a small program on the screen for the user to operate and use.

[0214] When the large screen first requests the control service, the terminal can not have the data required for generating the control interface, or only have part of the data required for generating the control interface. At this time, the terminal can send a service application data request to the cloud server and / or the large screen, so as to obtain the data stored in the cloud server and / or the large screen. The terminal can obtain the control interface of the control service based on the foregoing data, and then display the control interface in the form of a card or a small program on the screen for the user to operate and use.

[0215] The control interface can display corresponding touch components such as buttons, sliders, up / down menus, and thumbnails, use pictures and the like corresponding to the foreground service application according to the needs of the foreground service application. For example, the control interface of the control service corresponding to the video on demand application can include a progress bar of the currently played video, a selection button of the current video, thumbnails of recommended videos and the like, the user can drag the progress bar to adjust the play progress of the currently played video on the large screen, click the selection button to select the video played on the large screen, and click the thumbnail of the video to replace the video played on the large screen; for another example, the control interface of the control service corresponding to the K song application can include a list of popular K songs, a list of songs that have been ordered and the like, the user can click a song to add it to the list of ordered songs, and click a song that has been added to directly play it on the large screen; for another example, the control interface of the control service corresponding to the gallery application can include thumbnails of images stored in the large screen, so that the user can click a thumbnail to display the image corresponding to the thumbnail on the large screen.

[0216] As can be seen, after receiving the control service request, the terminal can independently acquire its control interface and then display it on the screen, whether the control service is requested for the first time or not, so that the user can be saved from the process of selecting the corresponding control service from the smart screen application according to the foreground service application of the large screen.

[0217] Except for some non-interruptible service applications, the terminal can pop up the control interface on any current interface. The aforementioned non-interruptible service application refers to a service application that must be continuously performed once it is started and cannot be interrupted, for example, a video call application. If the user is making a video call, the control interface is popped up on the call interface, on the one hand, the user usually does not interrupt the call to control the large screen, and on the other hand, it is inconvenient to control the large screen in the call. Or, the service application is not convenient to cut into other service applications during the process, for example, the user is playing a game on the terminal, and the control interface is suddenly popped up, which may affect the game. It should be understood that there can be other service applications that also belong to non-interruptible service applications, which are not limited in the embodiments of the present application.

[0218] The scenarios in which the terminal can pop up the control interface can include that the terminal is in a black screen, at which time the terminal lights up the screen and pops up the control interface on the screen-off interface; the terminal is in a bright screen, at which time the terminal pops up the control interface on the main interface; the screen of the terminal displays an interface of an application program, at which time the terminal pops up the control interface on the interface. It should be understood that the terminal can also pop up the control interface on other interfaces, which are not limited in the embodiments of the present application.

[0219] It should be noted that the embodiments of the present application do not specifically limit the service application on the large screen and the operation service on the terminal, and the operation interface of the operation service is not limited by the number and type of physical buttons, and can be set according to the actual operation requirements of the service application, and is not specifically limited.

[0220] For example, the terminal receives the operation service request sent by the large screen, the operation service request includes the name of the racing game operation service, the terminal determines the operation service according to the name, the terminal finds that there is no historical data of the operation service after querying the local data, and therefore sends a service application data request to the cloud server, obtains the operation interface of the racing game operation service according to the device data of the large screen and the content data of the racing game from the cloud server, and then displays the operation interface on the screen in the form of a card or an applet. The operation interface can include left and right direction keys, a racing map rendered, a racing track picture, a racing image, etc. The user can control the forward direction of the racing car on the racing track by clicking the left and right direction keys.

[0221] Exemplarily, in some embodiments, the pop-up can include a dynamic effect process of appearing from the edge of the terminal display interface and gradually entering, displaying more and more content, or a dynamic effect process of appearing from the center of the terminal display interface and gradually enlarging, occupying more and more of the terminal display interface. For example, the pop-up of the operation service card / applet can refer to that the operation service card / applet appears from the bottom of the terminal display interface and gradually enters the terminal display interface, and gradually displays more and more content; or the operation service card / applet appears from the center of the terminal display interface, and then gradually enlarges to occupy more than half of the terminal display interface. In some implementations, the operation service card / applet can include operable controls, and the user can click these controls to move the position of the operation service card / applet, change the size of the operation service card / applet, make the operation service card / applet close / hidden / again pop up.

[0222] Step 804, the terminal sends the operation instruction generated by the operation on the operation interface to the large screen.

[0223] The touch screen of the terminal provides the premise of the diversity of user operations, and the touch screen does not have specific limitations on the way of user operation, and can quickly and efficiently capture the operation of the user on the touch screen, and then generate corresponding operation instructions.

[0224] Based on this, the user operates the touch components displayed on the operation interface on the touch screen to generate corresponding operation instructions. For example, clicking a button indicates that the user selects the button, and the operation instruction indicates that the button is selected; dragging a slider indicates that the user adjusts the value of the value interval to which the slider belongs, and the operation instruction indicates that the value is changed; sliding a finger on the operation interface indicates changing or generating a trajectory, and the operation instruction indicates the trajectory; and the like.

[0225] The terminal sends the obtained operation instruction to the large screen.

[0226] In step 805, the large screen performs corresponding processing according to the operation instruction to complete the operation of the foreground service application.

[0227] After receiving the operation instruction from the terminal, the large screen performs corresponding data processing according to the operation instruction, and when necessary, renders a corresponding picture according to the operation instruction and displays it on the large screen. In this way, the operation of the large screen service is transferred to the terminal for implementation, and the terminal provides the operation service of the large screen service. Based on the characteristics of the touch screen of the terminal, the operation interface of the operation service corresponding to the operation requirement of the large screen service can be set, which is no longer limited by the number and type of physical buttons of the traditional remote controller.

[0228] In the embodiments of the present application, the terminal can independently obtain its operation interface after receiving the operation service request, and then display it on the screen. In this way, the user can save the process of selecting the corresponding operation service of the large screen from the smart screen application according to the foreground service application of the large screen. Correspondingly, the user does not need to know the corresponding relationship between the service application and the operation service, and does not need to remember the selection path of each operation service. The operation is simple and the user experience is improved.

[0229] Figure 9 The process 900 of the cross-device operation method of the large screen service of the embodiments of the present application is shown in the flowchart. The process 900 can be executed by two electronic devices in the application scenario 40, one of which is a large screen and the other of which is a terminal. The process 900 is described as a series of steps or operations. It should be understood that the process 900 can be executed in various orders and / or simultaneously, and is not limited to the execution order shown. The process 900 can include: Figure 9

[0230] In step 901, the large screen sends an operation termination request to the terminal.

[0231] ​The front-end service application on the large screen changes in one possible case that the user exits the service application displayed on the screen of the large screen by operating the physical remote controller or the simulated remote controller on the terminal; in another possible case that the user starts another service application without exiting the service application displayed on the screen by operating the physical remote controller or the simulated remote controller on the terminal, the large screen displays the other service application, the front-end service application is switched to the service application, and the previously displayed service application is switched to the background of the large screen and becomes the background service application of the large screen; and in yet another possible case that the large screen receives an incoming call from a real-time call application during the use of the service application displayed on the large screen, the user answers the incoming call by operating the physical remote controller or the simulated remote controller on the terminal, the large screen displays the real-time call application at this moment, the front-end service application is switched to the real-time call application, and the previous service application is switched to the background of the large screen and becomes the background service application of the large screen.

[0232] Since the large screen and the terminal are in the flow control of the front-end service application, when the front-end service application on the large screen changes, the large screen needs to send a control termination request to the terminal so that the terminal no longer provides the control service of the front-end service application.

[0233] The large screen can send the control termination request to the terminal, which is similar to step 801 in the method embodiment, and the control termination request can also include the identification information of the control service and / or the identification information of the front-end service application on the large screen, and the purpose of the two types of identification information is to let the terminal determine the control service to be exited. The specific determination process can be referred to step 801, which will not be described here.

[0234] Step 902, the terminal no longer displays the control interface of the control service in response to the control termination request.

[0235] After receiving the control termination request, the terminal can determine the control service requested to be terminated by the large screen based on the identification information of the control service in the control termination request. Alternatively, after receiving the control termination request, the terminal can determine the front-end service application on the large screen based on the identification information of the front-end service application in the control termination request, and then determine the control service corresponding to the front-end service application according to the pre-set corresponding relationship between the service application and the control service.

[0236] Optionally, the terminal can directly close the control interface of the control service. For example, the terminal is displaying the control interface of the video broadcast control service at this moment, and the terminal can directly close the control interface of the video broadcast control service.

[0237] Optionally, the terminal can pop up a window on the control interface to prompt the user that the service application on the large screen has been closed, and display "Yes" and "No" buttons on the window for the user to select. For example, the control interface of the terminal is displaying a video on-demand control service, at this time the terminal can pop up a window on the control interface of the video on-demand control service, the window including "The video on-demand application on the large screen has been closed, do you want to stop the control service of the mobile phone?" and "Yes" and "No" buttons. When the user clicks the "Yes" button, indicating that the user agrees to stop the video on-demand control service, the terminal exits the control interface; when the user clicks the "No" button, indicating that the user does not agree to stop the video on-demand control service, the terminal continues to display the control interface and detects the operation instruction generated by the user's operation.

[0238] Step 903, the large screen exits the current foreground service application.

[0239] The large screen can exit the current foreground service application after sending the control termination request.

[0240] It should be noted that in the embodiments of the present application, the execution order of steps 902 and 903 is not specifically limited, and step 902 can be executed first and step 903 can be executed later, or step 903 can be executed first and step 902 can be executed later, or steps 902 and 903 can be executed simultaneously.

[0241] In the embodiments of the present application, the user can directly control the large screen to exit the foreground service application, and the terminal can exit the control interface of the control service after receiving the control termination request sent by the large screen, which can save the process of manually exiting the control service of the user, the process is simple, and the user experience is improved.

[0242] Figure 10 A flowchart of a process 1000 of the cross-device flow control method of the large screen service of the embodiments of the present application. The process 1000 can be executed by two electronic devices in the application scenario 40, one of which is a large screen and the other of which is a terminal. The process 1000 is described as a series of steps or operations, and it should be understood that the process 1000 can be executed in various orders and / or simultaneously, and is not limited to the execution order shown. The process 1000 can include: Figure 10

[0243] Step 1001, the terminal sends a service termination request to the large screen.

[0244] ​When the user wants to quit the foreground service application, the terminal can also control the large screen to quit the foreground service application. For example, the user is watching a video on the large screen, clicks the close button on the control interface of the video broadcast control service on the terminal, thereby generating an operation instruction to close the service application, and the terminal sends a service termination request to the large screen according to the operation instruction. For another example, the user is watching a video on the large screen, clicks the "mobile remote controller" button on the control interface of the video broadcast control service on the terminal, which can pull up the interface of the mobile remote controller on the terminal. The interface simulates a mobile remote controller and enables the mobile phone to have the same function as a physical remote controller. The user clicks the "exit" button on the interface of the mobile remote controller, which generates an operation instruction to close the service application, and the terminal sends a service termination request to the large screen according to the operation instruction.

[0245] Optionally, the service termination request can include the identification information of the foreground service application on the large screen, so that the large screen can determine the foreground service application to be quit according to the identification information.

[0246] Optionally, the service termination request can also not include the identification information of the foreground service application on the large screen. By analyzing the control service from which the service termination request comes, it can be determined that the foreground service application is to be quit, or the large screen can directly quit the foreground service application upon receiving the service termination request. This is because the large screen and the terminal are in the cross-device flow control of the foreground service application, and the terminal sends a service termination request by default, which means that the foreground service application is to be quit.

[0247] Step 1002, the large screen responds to the service termination request and exits the current foreground service application.

[0248] After receiving the service termination request, the large screen can exit the current foreground service application.

[0249] Optionally, the large screen can directly exit the interface of the foreground service application and display the main interface. For example, the large screen directly exits the video on-demand application and returns to the main interface.

[0250] Optionally, the large screen can also pop up a window on the interface of the foreground service application to prompt the user whether to quit the foreground service application, and display "yes" and "no" buttons on the window for the user to select. For example, the large screen pops up a window on the interface of the video on-demand application, which includes "whether to quit the video on-demand application" and "yes" and "no" buttons. When the user clicks the "yes" button, it means that the user agrees to quit the video on-demand application, and the large screen exits the interface of the video on-demand application and returns to the main interface. When the user clicks the "no" button, it means that the user disagrees to quit the video on-demand application, and the terminal continues to display the interface of the video on-demand application and detects the operation instruction from the terminal or the remote controller.

[0251] Step 1003, the large screen sends a service application exit response to the terminal.

[0252] After the large screen exits the foreground service application, the large screen can send an exit response to the terminal to inform the terminal that the foreground service application exits successfully or fails.

[0253] Step 1004, the terminal no longer displays the control interface of the control service in response to the service application exit response.

[0254] When the service application exit response indicates that the large screen exits the foreground service application successfully, the terminal can exit the control interface of the control service. The process can refer to step 902 of the above method embodiment, which will not be described here.

[0255] When the service application exit response indicates that the large screen exits the foreground service application fails, the terminal can continue to display the control interface of the control service and detect the operation instruction generated by the user's operation.

[0256] It should be noted that after the terminal executes step 1001 in the embodiment of the present application, the terminal can directly execute step 1004, that is, the terminal sends a service termination request to the large screen, and then exits the control interface of the control service, without waiting for the large screen to exit the foreground service application according to the service termination request. At this time, the large screen can also not send a service application exit response to the terminal.

[0257] In the embodiment of the present application, the user can control the large screen to exit the foreground service application through the terminal, and the large screen can exit the foreground service application after receiving the service termination request sent by the terminal. In this way, the whole process of controlling the service application on the large screen through the terminal is convenient to operate and improves the user experience.

[0258] In Figure 7 Based on the embodiment shown in Figure 11 An exemplary interactive communication flow chart for establishing cross-device flow control of large screen services provided by the embodiment of the present application is shown in Figure 11 The components involved in the large screen include a service application, a flow task management service, and a distributed task scheduling. The components involved in the terminal include a distributed task scheduling and a control service. In the embodiment of the present application, a plurality of electronic devices have a binding relationship, and the plurality of electronic devices include a large screen and a plurality of terminals. The service application on the large screen can be controlled by the control service on the terminal, and the embodiment of the present application describes the process of establishing cross-device flow control of large screen services by the large screen and the terminal.

[0259] Large screen side:

[0260] 1. The service application requests the registration of the control service from the flow task management service

[0261] The user clicks the icon of the business application on the main interface of the large screen to open the business application. At this time, the business application requests to register the manipulation service from the task flow management service to inform the task flow management service that the business application has been opened and to request the cross-device task flow control of the business application. For example, after the user opens the video on demand application, the video on demand application requests to register the manipulation service from the task flow management service.

[0262] 2. The task flow management service returns the terminal information to the business application

[0263] After receiving the request from the business application, the task flow management service queries the pre-set correspondence between the business application and the manipulation service to determine the manipulation service corresponding to the business application. Then, the task flow management service determines the terminal that can provide the manipulation service according to the local maintained electronic device list. If there is only one electronic device that can provide the manipulation service, the electronic device is the terminal that provides the manipulation service; if there are multiple electronic devices that can provide the manipulation service, the task flow management service selects one from the multiple electronic devices as the terminal that provides the manipulation service. The task flow management service can select the first electronic device in the electronic device list as the terminal that provides the manipulation service according to the arrangement order of the multiple electronic devices in the electronic device list; or the task flow management service can determine the earliest / latest joined electronic device as the terminal that provides the manipulation service according to the online state of the multiple electronic devices; or the task flow management service can transmit the information of the multiple electronic devices to the display module of the large screen, and the display module displays the information of the multiple electronic devices in a pop-up window on the screen for the user to select one as the terminal that provides the manipulation service. It should be noted that the task flow management service can also determine the terminal that provides the manipulation service by other methods, which are not limited in the embodiments of the present application. For example, the task flow management service determines that the manipulation service of the video on demand application is the video broadcast control service, and then queries the electronic device list to find that the mobile phone P30pro can be used as the terminal that provides the manipulation service.

[0264] The task flow management service returns the terminal information to the video on demand application, including the device identifier, device type, device name, etc. of the terminal.

[0265] 3. The business application updates the business manipulation task flow state to the task flow management service

[0266] After receiving the terminal information, the business application can update the business manipulation task flow state to the task flow management service to inform the task flow management service to update the manipulation state of the business application to the cross-device manipulation after preparing for the business manipulation task flow. For example, the video on demand application informs the task flow management service to update the manipulation state of the video on demand application to P30pro manipulation.

[0267] 4. The business application initiates a distributed task scheduling request to the distributed task scheduling

[0268] The distributed task scheduling can maintain a plurality of tasks of the business application, schedule the plurality of tasks based on execution logic, level, etc. between the plurality of tasks, and initialize to create a thread for execution of the plurality of tasks to ensure smooth progress of the plurality of tasks.

[0269] 5. The business application initiates a cross-device control service to the distributed task scheduling

[0270] The business application initiates a cross-device control service to the distributed task scheduling can create a task of the cross-device control service in the distributed task scheduling. The distributed task scheduling can trigger sending a control service request to the terminal when scheduling the task of the cross-device control service.

[0271] 6. The distributed task scheduling of the large screen sends a control service request to the distributed task scheduling of the terminal

[0272] The control service request can refer to step 801 in the method embodiment described above, and will not be repeated here.

[0273] Terminal side:

[0274] 7. The distributed task scheduling initiates a control service

[0275] After receiving the control service request, the distributed task scheduling can determine the control service requested by the large screen based on the identification information of the control service in the control service request. Alternatively, after receiving the control service request, the distributed task scheduling can determine the foreground business application on the large screen based on the identification information of the business application in the control service request, and then determine the control service corresponding to the foreground business application according to the pre-set corresponding relationship between the business application and the control service.

[0276] The distributed task scheduling sends a scheduling instruction to the control service when scheduling the control service, so that the control service pops up a control interface. The way to obtain the control interface can refer to step 802 in the method embodiment described above, and will not be repeated here. For example, the screen of P30pro displays the operation interface of the video broadcast control service.

[0277] 8. The control service returns a call result to the distributed task scheduling

[0278] After the control service pops up the control interface on the screen, the control service can return a call result to the distributed task scheduling, that is, once the function of the control service is started, the distributed task scheduling can be notified that the control service is started successfully.

[0279] 9. The distributed task scheduling of the terminal returns a response of successful initiation of the control service to the distributed task scheduling of the large screen

[0280] After the control interface of the control service is displayed on the terminal, the user can perform a control operation on the control interface, and at this time, the control service on the terminal is started successfully.

[0281] Large screen side:

[0282] 10. Distributed task scheduling notification service application callback cross-device control service completion

[0283] At this point, the cross-device flow transfer control process of the large screen service is established between the large screen and the terminal. The user performs an operation on the control interface of the control service through the terminal, and the operation instruction generated by the user is sent to the large screen by the terminal. The large screen performs corresponding processing based on the operation instruction. If necessary, the large screen can send the processed data to the terminal to achieve data synchronization between the large screen and the terminal, so as to update the control interface in time on the terminal.

[0284] It should be noted that after the distributed task scheduling of the terminal receives the control service request, the control service may also fail to start. The reasons for the failure may include: the control interface of the control service fails to be acquired, the terminal does not start the floating window function of the control service, and the like. In this case, the distributed task scheduling of the terminal returns the control service start failure to the distributed task scheduling of the large screen. At this time, the business application of the large screen can pop up a window to prompt the cross-device flow transfer control failure, or can exit the cross-device flow transfer control and notify the flow transfer task management service to update the business control flow transfer state (the flow transfer task management service can update the control state of the business application to exit the cross-device control). It should be understood that the business application of the large screen can also adopt other ways to handle the failure, and the embodiments of the present application do not make specific limitations in this regard.

[0285] In a possible implementation manner, the flow transfer task management service of the large screen can actively detect the business application of the large screen. The difference between this implementation manner and the embodiment shown in Figure 11 is that: Figure 11 In the embodiment shown in , the business application of the large screen actively requests the flow transfer task management service to register the control service after being opened (step 1), that is, the flow transfer task management service is notified by the business application of the large screen to start the cross-device flow transfer control; while in this implementation manner, the flow transfer task management service can actively detect the business application of the large screen, and automatically determines the terminal that can provide the control service corresponding to the business application when discovering that the business application is opened. The determination method can refer to step 2 of the method embodiment shown in Figure 11 , and details are not described herein again. That is, in this implementation manner, the business application can not need to send a request to the flow transfer task management service to register the control service (that is, step 1 is not needed), and the flow transfer task management service can actively send the terminal information that can provide the control service corresponding to the currently opened business application to the business application.

[0286] In Figure 7 Based on the embodiments shown, Figure 12 An exemplary interactive communication flow diagram of cross-device flow control for exiting a large-screen service provided by embodiments of the present application is shown in FIG. 6. Figure 12 As shown in FIG. 6, the components participating in the large screen include a service application, a flow task management service, and a distributed task scheduling, and the components participating in the terminal include a distributed task scheduling and a control service. In embodiments of the present application, there are multiple electronic devices with a binding relationship, including a large screen and multiple terminals. The service application on the large screen can be controlled by the control service on the terminal, and embodiments of the present application describe the process of cross-device flow control for exiting a large-screen service by the large screen and the terminal.

[0287] Large screen side:

[0288] 1. The service application updates the service control flow state to the flow task management service

[0289] The user can use a remote control to close the service application on the large screen, or if the display screen of the large screen is a touch-sensitive display screen, the user can also click the service application exit control on the display screen of the large screen to close the service application on the large screen. At this time, the flow task management service can be updated to the service control flow state to notify the flow task management service to update the control state of the service application to exit cross-device control. For example, the video on demand application notifies the flow task management service to update the control state of the video on demand application to exit P30pro control.

[0290] 2. The service application requests the distributed task scheduling to exit the cross-device control service

[0291] The service application requests the distributed task scheduling to exit the cross-device control service, and can request the distributed task scheduling to close the task of the cross-device control service. When the distributed task scheduling closes the task of the cross-device control service, it can trigger a control termination request to be sent to the terminal.

[0292] 3. The distributed task scheduling of the large screen sends a control termination request to the distributed task scheduling of the terminal

[0293] The control termination request can refer to the description of step 901 in the method embodiment described above, and will not be described here.

[0294] Terminal side:

[0295] 4. The distributed task scheduling closes the control service

[0296] The distributed task scheduling can determine the control service requested by the large screen based on the identification information of the control service in the control termination request. Alternatively, the distributed task scheduling can determine the foreground business application on the large screen based on the identification information of the business application in the control service request, and then determine the control service corresponding to the foreground business application according to the pre-set correspondence between the business application and the control service.

[0297] The distributed task scheduling sends a closing instruction to the control service when scheduling the control service, so that the control service exits the control interface. The exit mode of the control interface can refer to step 902 of the above method embodiment, and will not be described here.

[0298] 5. The control service returns an exit result to the distributed task scheduling

[0299] After the control service exits the control interface, the control service can return an exit result to the distributed task scheduling, that is, once the control service exits, the distributed task scheduling can be notified that the control service exits successfully.

[0300] 6. The distributed task scheduling of the terminal returns a response that the control service is closed successfully to the distributed task scheduling of the large screen

[0301] 7. The distributed task scheduling closes the task of the cross-device control service

[0302] 8. The business application requests the cancellation of the control service to the flow task management service

[0303] After the control service exits on the terminal side, the business application can request the cancellation of the control service to the flow task management service to notify the flow task management service that the control service can be cancelled. For example, after the user uses the remote controller to control the large screen to exit the video on-demand application, the video on-demand application requests the cancellation of the video control service to the flow task management service.

[0304] It should be noted that after the distributed task scheduling of the terminal receives the control termination request, the control service can also fail to exit. The reasons for the failure can include: the control interface of the control service fails to be obtained, the user selects the "No" button on the pop-up window, and the like. In this case, the distributed task scheduling of the terminal returns the control service exit failure to the distributed task scheduling of the large screen. At this time, the business application of the large screen can prompt the cross-device flow control exit failure in a pop-up window. It should be understood that the business application of the large screen can also use other ways to handle the failure, and the present application embodiment does not make specific limitation thereto.

[0305] In Figure 7 On the basis of the embodiments shown in the above, Figure 13 An exemplary interactive communication flow diagram for exiting the cross-device flow control of the business of the large screen provided by the embodiments of the present application is shown in Figure 13 As shown in the figure, the components participating in the large screen include a business application, a flow task management service, and a distributed task scheduling, and the components participating in the terminal include a distributed task scheduling and a control service. In the embodiment of the present application, a plurality of electronic devices have a binding relationship, and the plurality of electronic devices include a large screen and a plurality of terminals. The business application on the large screen can be controlled by the control service on the terminal to cross-device flow control. The embodiment of the present application describes the process of the large screen and the terminal exiting the cross-device flow control of the large screen business.

[0306] 1. The distributed task scheduling of the terminal sends a business termination request to the distributed task scheduling of the large screen

[0307] When the user wants to exit the foreground business application, the terminal can also control the large screen to exit the foreground business application. For example, the user is watching a video on the large screen, clicks the close button on the control interface of the video broadcast control service on the terminal, thereby generating an operation instruction to close the business application, and the distributed task scheduling of the terminal sends a business termination request to the large screen according to the operation instruction. For another example, the user is watching a video on the large screen, clicks the "mobile remote control" button on the control interface of the video broadcast control service on the terminal, which can pull up the interface of the mobile remote control on the terminal. The interface simulates a mobile remote control and enables the mobile phone to achieve the same function as a physical remote control. The user clicks the "exit" button on the interface of the mobile remote control, which can generate an operation instruction to close the business application, and the distributed task scheduling of the terminal sends a business termination request to the large screen according to the operation instruction.

[0308] The business termination request can refer to the description of step 1001 in the method embodiment, which will not be described here.

[0309] Large screen side:

[0310] 2. The distributed task scheduling closes the task of the cross-device control service

[0311] 3. The business application updates the business control flow state to the flow task management service

[0312] The business application can update the business control flow state to the flow task management service to notify the flow task management service to update the control state of the business application to exit the cross-device control.

[0313] 4. The business application requests the flow task management service to cancel the control service

[0314] The business application can request the flow task management service to cancel the control service to notify the flow task management service to cancel the control service.

[0315] 5. The business application returns a business application exit response to the distributed task scheduling

[0316] 6. The large screen's distributed task scheduling notifies the terminal side of the successful exit of the business application:

[0317] 7. Distributed task scheduling shutdown control service

[0318] After receiving a successful exit response from the business application, the distributed task scheduler knows that the business application on the large screen has exited. It can then send a shutdown command to the control service, causing the control service to exit the control interface. The exit method for the control interface can be referred to step 902 in the above method embodiment, and will not be repeated here.

[0319] 8. The control service returns the exit result to the distributed task scheduler.

[0320] After exiting the control interface, the control service can return an exit result to the distributed task scheduler. In other words, once the control service is exited, it can notify the distributed task scheduler control service that the exit was successful.

[0321] The process of the above method embodiments will be described below through several specific examples.

[0322] Example 1

[0323] In this embodiment, the multiple electronic devices with a binding relationship include: two mobile phones (P30 Pro and Mate30), one tablet computer (MatePad Pro), and one smart screen (V65). The front-end business application of V65 is a video-on-demand application, and the video playback control service is the remote control service corresponding to the video-on-demand application.

[0324] Figure 14a This is a schematic diagram of the P30 Pro's main interface, as shown below. Figure 14a As shown, users can open the smart screen application by clicking the icon of the smart screen application on the main interface.

[0325] Figure 14b This is a schematic diagram of the main interface of a smart screen application, such as... Figure 14b As shown, the main interface of the smart screen application displays the connected V65 as a Huawei smart screen, and the Huawei smart screen's daily usage time is 30 minutes. Users can click the power button on the right to turn the Huawei smart screen on / off. The main interface also includes buttons for various application scenarios such as mirroring, remote control, seamless calling, movie search, message board, and remote home monitoring. Clicking one of these buttons will take the user to the corresponding application scenario's control service interface. In this embodiment, the user clicks the "Remote Control" button.

[0326] Figure 14c This is an exemplary schematic diagram of a remote control interface, such as... Figure 14cAs shown, after the user clicks the "Remote Control" button, the remote control interface will be displayed on the mobile phone in the form of a card. The remote control includes up, down, left, and right directional keys 1401, an OK button 1402, an increase / decrease button 1403, an exit button 1404, a menu button 1405, and a power button 1406. These buttons function similarly to the physical buttons on a physical remote control, so users can control the V65 by operating the remote control on their mobile phone just like using a physical remote control.

[0327] Figure 14d This is an exemplary schematic diagram of the V65 main interface, as shown below. Figure 14d As shown, users can click the up, down, left, and right buttons 1401 on the remote control of the P30pro to move the focus on the V65. During the movement, there can be a focus animation effect. When the focus moves to the video-on-demand application icon, the video-on-demand application is selected. Users can click the OK button 1402 on the remote control to open the content (video-on-demand application) corresponding to the current focus.

[0328] After opening the video-on-demand application on the V65, you will enter the main interface of the video-on-demand application. This main interface may include a list of recommended videos, video applications (Mango TV, iQiyi, Tencent, etc.), and thumbnails of recommended videos. In addition, it also includes the user's historical playback history, favorites history, etc. The main interface of the V65 can be compared with the main interface of smart TVs, TV boxes, set-top boxes, etc., so it will not be described in detail here.

[0329] After opening the video-on-demand application, V65 can perform... Figure 8 or Figure 11 The steps of the illustrated method embodiment are used to start the video playback control service on the P30 Pro. In addition to the P30 Pro, the electronic devices bound to V65 in the above assumptions also include the Mate30 and MatePad Pro. The V65's streaming task management service can adopt... Figure 11 Step 2 in the illustrated method embodiment determines that P30pro is the terminal that can provide video broadcast control services from among the three electronic devices. P30pro can also perform... Figure 8 or Figure 11 The steps of the method embodiment shown are used to pop up the control interface of the video playback control service on the screen.

[0330] Figure 14e An exemplary diagram illustrating cross-device workflow control for the V65 and P30 Pro, as shown below. Figure 14e As shown, when the user-selected video is played on the V65, the video playback control service interface pops up on the P30pro's screen.

[0331] The video on demand application provides a plurality of videos, which can include a cover picture of a video, a name of the video, a video duration, a producer of the video, a score of the video, and the like. On one hand, the key information of the video can be provided for the user to understand, and on the other hand, the effect of attracting the user to click can be achieved, especially the cover picture of the video, which is usually a poster, a promotional picture or a video screenshot that can best reflect the core content of the video. The cover picture of the video displayed on the large screen can be a large size picture of 4K specification. In order to improve the communication efficiency, the thumbnail of the cover picture can be displayed on the terminal. The size of the thumbnail can be adapted to the size of the terminal. The terminal can download the name of the video, the video duration, the producer of the video, the score of the video and the thumbnail of the video from the cloud server before the control interface of the video control service is popped up. The control interface of the video control service is generated based on the foregoing information of the video.

[0332] The control interface of the video control service includes a progress bar 1407 of the video being played on the large screen, a selection (1-5) button 1408 of the video of the same series (for example, a button corresponding to each episode of a certain TV series), a thumbnail 1409 of a video that the user may like, and the like. The user can drag the progress bar 1407 to adjust the playing progress of the video, click the selection button 1408 to replace the video played on the large screen, and click the thumbnail 1409 to replace the video played on the large screen with the video corresponding to the thumbnail.

[0333] In addition, the control interface of the video control service further includes a "mobile phone remote control" button 1410. After the user clicks the "mobile phone remote control" button 1410, a remote control as shown in FIG. 14B can be popped up. In this way, the user can call up the remote control to control the large screen when needed. Figure 14c

[0334] The method for selecting the video played on the V65 can include that the user controls the large screen to select the video through the physical remote control, or the user controls the large screen to select the video through the remote control on the P30pro, or the user controls the large screen to select the video through the control interface of the video control service on the P30pro.

[0335] Embodiment Two

[0336] In the embodiment of the present application, the plurality of electronic devices with a binding relationship include a mobile phone (P30pro) and a smart screen (V65). The foreground service application of the V65 is a KTV application, and the KTV control service is a remote control service of the KTV application.

[0337] The P30pro can execute the method in the embodiment one, and details are not repeated here. Figures 14a-14c

[0338] Figure 15a ​​This is an exemplary schematic diagram of the V65 main interface, as shown below. Figure 15a As shown, users can click the up, down, left, and right buttons 1401 on the remote control of the P30pro to move the focus on the V65. During the movement, there can be a focus animation effect. When the focus moves to the karaoke application icon, karaoke is selected. Users can click the OK button 1402 on the remote control to open the content (karaoke application) corresponding to the current focus.

[0339] After opening the karaoke app on the V65, both the V65 and P30 Pro can perform... Figure 8 or Figure 11 The steps of the method embodiment shown are to start the karaoke broadcast control service on the P30pro, and the karaoke broadcast control service control interface pops up on the P30pro screen.

[0340] Figure 15b An exemplary diagram illustrating cross-device workflow control for the V65 and P30 Pro, as shown below. Figure 15b As shown, the V65 plays the music video of the song selected by the user, and the control interface of the karaoke playback service pops up on the screen of the P30pro.

[0341] The WeSing app offers a wide selection of songs, including information such as song title, artist, and number of times the song has been performed. This information helps users understand key aspects of the songs and also attracts them to click. Before the karaoke control service interface pops up, the terminal can download the song title, artist, and number of times the song has been performed from the cloud server. The karaoke control service interface is then generated based on this information.

[0342] The karaoke playback control service interface includes a list of popular karaoke songs (1501) and a list of selected songs (1502). Users can select a song from the popular karaoke song list, click the "Add" button (1503) to add the song to the selected song list, and click a song in the selected song list to directly switch to playing the music video of that song on the large screen.

[0343] In addition, the karaoke broadcast control service's interface also includes a "Mobile Remote Control" button 1504. Clicking the "Mobile Remote Control" button 1504 will bring up a pop-up window... Figure 14c The remote control shown allows users to access it when needed to control the large screen.

[0344] Methods for selecting songs to play on the V65 may include: the user controlling the large screen to select songs via a physical remote control; or, the user controlling the large screen to select songs via the remote control on the P30pro; or, the user controlling the large screen to select songs via the karaoke playback control service interface on the P30pro.

[0345] The process of selecting the song can include: the user selects the song on the large screen through the physical remote control; or the user selects the song on the large screen through the remote control on the P30pro; or the user selects the video on the large screen through the operation interface of the K song broadcast control service on the P30pro.

[0346] Embodiment three

[0347] In the embodiment of the application, the plurality of electronic devices with a binding relationship includes a mobile phone (P30pro) and a smart screen (V65). The foreground service application of the V65 is a gallery application, and the gallery operation service is a remote operation service of the gallery application.

[0348] The P30pro can execute the method of Figures 14a-14c in the embodiment one, which will not be repeated here.

[0349] Figure 16a An exemplary schematic diagram of the main interface of the V65 is shown in Figure 16a The user can click the up, down, left and right keys 1401 of the remote control on the P30pro to move the focus on the V65. During the movement, the focus can be accompanied by a focus effect. When the focus moves to the gallery application icon, the gallery is selected. The user clicks the OK key 1402 of the remote control to open the content (gallery application) corresponding to the current focus.

[0350] After the gallery application is opened on the V65, the V65 and the P30pro can execute the steps of the method embodiments of Figure 8 or Figure 11 to start the gallery operation service on the P30pro. The operation interface of the gallery operation service pops up on the screen of the P30pro.

[0351] Figure 16b An exemplary schematic diagram of cross-device flow control of the V65 and the P30pro is shown in Figure 16b The V65 displays the image selected by the user, and the operation interface of the gallery operation service pops up on the screen of the P30pro.

[0352] The gallery application contains many images of the user, including screenshots obtained by the user operating the large screen and photos obtained by the user operating the large screen to take pictures. The terminal can download the thumbnails of the images in the gallery from the large screen before the operation interface of the gallery operation service is popped up. The operation interface of the gallery operation service is generated based on the foregoing thumbnails.

[0353] The operation interface of the gallery operation service includes thumbnails 1601 of images in a family camera, which are stored in V65, and P30pro can obtain image information on V65 in the process of obtaining the operation interface, so as to generate the thumbnails. The user can click a thumbnail to indicate that the image corresponding to the thumbnail is displayed on V65.

[0354] In addition, the operation interface of the gallery operation service also includes a "mobile remote control" button 1602. After the user clicks the "mobile remote control" button 1602, a remote control as shown in FIG. 16B can be popped up, so that the user can call up the remote control to control the large screen when needed. Figure 14c

[0355] The method for selecting the image displayed on V65 can include that the user selects the image through the physical remote control to control the large screen, or the user selects the image through the remote control on P30pro to control the large screen, or the user clicks the thumbnail through the operation interface of the gallery operation service on P30pro, so that the image corresponding to the thumbnail is displayed on V65.

[0356] Embodiment Four

[0357] In the embodiments of the present application, the plurality of electronic devices with a binding relationship include a mobile phone (P30pro) and a smart screen (V65). The foreground service application of V65 is a racing game application, and the racing game operation service is a remote operation service of the racing game application.

[0358] P30pro can execute the method of Figures 14a-14c in Embodiment One, which will not be repeated here.

[0359] Figure 17 An exemplary schematic diagram for cross-device flow operation of V65 and P30pro is shown in FIG. 16A. After the racing game application on V65 is opened, V65 and P30pro can execute the method embodiments of Figure 17 or Figure 8 to start the racing game operation service on P30pro, and the operation interface of the racing game operation service is popped up on the screen of P30pro. Figure 11 The screen of V65 displays the racing game, and the operation interface of the racing game operation service is popped up on the screen of P30pro.

[0360]

[0361] ​​The terminal can obtain the user's account information, historical racing ranking, racing game picture data, racing control data, etc. from the cloud server, and obtain the user's historical setting data, game progress, etc. from the large screen. Based on the foregoing data, the terminal can generate a control interface of the racing game control service.

[0362] The control interface of the racing game control service includes left and right direction keys, rendered racing map, track picture, racing image, etc. The user can control the forward direction of the racing car on the track by clicking the left and right direction keys.

[0363] In addition, the control interface of the racing game control service also includes a floating panel 1701, which includes a main interface button 1702, a menu button 1703, and a quit button 1704. The user can click the main interface button 1702 to directly return to the main interface, click the menu button 1703 to pop up the menu options, click the quit button 1704 to exit the racing game application, and click the floating panel "" 1705 to switch the hand type auxiliary mode.

[0364] With the user's operation on the control interface of the racing game control service, the racing game picture displayed on the V65 is switched, including the change of the racing position accompanied by the change of the picture, which includes the track, the surrounding mirror, etc.

[0365] Embodiment five

[0366] In the embodiments of the present application, the plurality of electronic devices with a binding relationship include a mobile phone (P30pro) and a smart screen (V65). The foreground service application of the V65 is a live application, and the live control service is a remote control service of the live application.

[0367] The P30pro can execute the method of embodiment one Figures 14a-14c , which will not be repeated here.

[0368] Figure 18 An exemplary schematic diagram of cross-device flow control for V65 and P30pro is shown in Figure 18 After opening the live application on the V65, the V65 and P30pro can execute the steps of the method embodiments of Figure 8 or Figure 11 to start the live control service on the P30pro, and the control interface of the live control service pops up on the screen of the P30pro.

[0369] The live picture is displayed on the V65, and the control interface of the live control service pops up on the screen of the P30pro.

[0370] The terminal can download channel information for the live streaming application from the cloud server, including channel name, channel number, and channel category. Based on this channel information, a control interface for the live streaming broadcast control service is generated.

[0371] The live broadcast control service's interface includes a live broadcast list, which comprises an all list, a satellite TV list, a CCTV list, a local list, and a digital list. Each list contains buttons for multiple live channels; for example, the all list includes Beijing TV, Sports Channel, Zhejiang TV, Dragon TV, Sichuan TV, Southeast TV, Lifestyle Channel, and Shaanxi TV. Users can click the button for a specific live channel to select that channel and have it played on the V65.

[0372] In addition, the control interface of the live broadcast control service also includes a floating panel 1801, which includes a main interface button 1802, a menu button 1803, and an exit button 1804. Users can click the main interface button to return to the main interface, click the menu button to bring up the menu options, click the exit button to exit the live broadcast application, and click the "" button 1805 on the floating panel to switch the hand gesture assistance mode.

[0373] As the user operates on the live broadcast control service interface, the content displayed on the V65 switches to the screen of the live broadcast channel selected by the user.

[0374] Example 6

[0375] Figure 19 This is a schematic diagram of the P30 Pro's main interface, as shown below. Figure 19 As shown, the P30 Pro's screen can display a power-on / off interface, which includes a "One-Click Power On / Off" button 1901. When the paired V65 is not turned on, the user can click the "One-Click Power On / Off" button 1901 to turn on the V65; when the paired V65 is turned on, the user can click the "One-Click Power On / Off" button 1901 to turn off the V65.

[0376] It should be noted that the above several embodiments are only as examples, and describe that the large screen and the terminal can establish the cross-device flow operation of the large screen service in multiple application scenarios, but the scheme provided by the embodiments of the present application is not limited to the above application scenarios, and can also be applied to other multiple application scenarios, for example, the terminal controls the large screen to take a photo, the terminal controls the large screen to play a sports fitness video, the terminal controls the large screen to make a smooth call, the terminal controls the large screen to share an image, and the like. That is, no matter which business application on the large screen, a corresponding control service can be created, and then the control service is deployed on the terminal, so that the cross-device flow operation of the business can be realized. In addition, the control interface of the control service in the embodiments of the present application is not limited to the graphical interface of the above several embodiments, and other design schemes can also be used, which is not limited herein.

[0377] Figure 20 A flowchart of a process 2000 of the cross-device flow operation method of the large screen service of the embodiments of the present application. The process 2000 can be executed by two electronic devices in the application scenario 40, one of which is a large screen and the other of which is a terminal. The process 2000 is described as a series of steps or operations, and it should be understood that the process 2000 can be executed in various orders and / or simultaneously, and is not limited to the execution order shown. Figure 20

[0378] Before the process 2000 is executed, the two electronic devices can execute the process 800 shown in the embodiments of the present application, and the cross-device flow operation of the first business application is established between the large screen and the terminal, that is, the foreground business application of the large screen is the first business application, and the terminal is controlled by the first control service to control the first business application, and the first control interface corresponding to the first control service is displayed on the terminal. Figure 8

[0379] The process 2000 can include:

[0380] Step 2001, the foreground business application of the large screen is switched from the first business application to the second business application.

[0381] As described above, before the process 2000 starts, the foreground business application of the large screen is the first business application, and the control service of the terminal is the first control service, and the terminal controls the first business application by receiving the operation on the first control interface of the first control service.

[0382] ​​The foreground service application is switched from the first service application to the second service application. One possible case is that the user exits the first service application displayed on the screen of the large screen by operating the physical remote controller or the simulated remote controller on the terminal, and then starts the second service application on the large screen. The second service application is displayed on the screen of the large screen, and the foreground service application is switched to the second service application. Another possible case is that the user starts the second service application without exiting the first service application displayed on the screen by operating the physical remote controller or the simulated remote controller on the terminal. The second service application is displayed on the screen of the large screen, and the foreground service application is switched to the second service application. The first service application displayed before is run in the background of the large screen and becomes the background service application of the large screen. Another possible case is that the large screen receives an incoming call from a real-time call application (such as a smooth call application) during the use of the service application displayed on the large screen. The user answers the incoming call by operating the physical remote controller or the simulated remote controller on the terminal. At this time, the real-time call application is displayed on the large screen, the foreground service application is switched to the real-time call application (the second service application), and the first service application before becomes the background service application of the large screen.

[0383] The simulated remote controller on the terminal can be displayed on the screen of the terminal (for example, as shown in FIG. 6) by clicking the "mobile remote controller" button on the first control interface (for example, as shown in FIG. 5). Figure 14e Figure 14c

[0384] For example, the first service application is a video on demand application, and the first control service corresponding to the first service application is a video control service. During the video playing on the large screen, the large screen receives a video call request of the smooth call application. After the large screen receives an operation instruction of accepting the call, the foreground service application is switched to the smooth call application, and a call interface of the smooth call application is displayed on the screen. The foregoing operation instruction of accepting the call is from the physical remote controller or the simulated remote controller on the terminal.

[0385] Step 2002: The large screen sends a control termination request for the first control service to the terminal.

[0386] The foreground service application on the large screen is switched from the first service application to the second service application, and the first service application is exited or becomes the background service application of the large screen. Therefore, the large screen needs to send a control termination request for the first control service to the terminal, so that the terminal no longer provides the first control service of the first service application and closes the first control interface.

[0387] Step 2003: The large screen sends a control service request for the second control service to the terminal.

[0388] ​​In order to realize the cross-device flow operation of the second service application of the large screen and the terminal, the large screen can send an operation service request to the terminal after switching to the second service application.

[0389] The second operation service request can also include identification information of the second service application and / or identification information of the second operation service, and the second operation service is an operation service corresponding to the second service application.

[0390] Step 2004, the terminal no longer displays the first operation interface corresponding to the first operation service in response to the operation termination request.

[0391] The process in which the terminal no longer displays the first operation interface corresponding to the first operation service in response to the operation termination request can refer to step 902 of the method embodiment described above, and will not be repeated here.

[0392] Step 2005, the terminal displays a second operation interface corresponding to a second operation service in response to the operation service request.

[0393] The process in which the terminal displays the second operation interface corresponding to the second operation service in response to the operation service request can refer to step 803 of the method embodiment described above, and will not be repeated here.

[0394] Since the first service application and the second service application are different, correspondingly, the first operation service and the second operation service are also different, and the content of the first operation interface and the second operation interface, including the interface arrangement, the controls contained in the interface, the text of the interface, etc., are also different.

[0395] Step 2006, the terminal sends operation instructions generated by operations on the second operation interface to the large screen.

[0396] Step 2006 can refer to step 804 of the method embodiment described above, and will not be repeated here.

[0397] Step 2007, the large screen performs corresponding processing according to the operation instructions to complete the operation of the second service application.

[0398] Step 2007 can refer to step 805 of the method embodiment described above, and will not be repeated here.

[0399] In the embodiments of the present application, after the foreground service application of the large screen is switched, the control interface of the control service corresponding to the service application before the switching can be automatically closed on the terminal, and the control interface of the control service of the service application after the switching is displayed. In this way, the control interface of the control service corresponding to different service applications can be quickly displayed on the terminal, and the process of selecting the corresponding control service from the smart screen application according to the foreground service application of the large screen is saved. Correspondingly, the user does not need to know the corresponding relationship between the service application and the control service, and does not need to remember the selection path of each control service. The operation is simple, and the user experience is improved.

[0400] Embodiment seven

[0401] In the above embodiments one to six, the process of cross-device flow control of several service applications on the large screen is exemplarily described. Once the foreground service application on the large screen is started, the control interface of the control service corresponding to the foreground service application will be popped up on the terminal.

[0402] The service applications running on the large screen include foreground service applications and background service applications. The foreground service application refers to the service application displayed on the screen of the large screen. The background service application refers to the service application that is not displayed on the screen of the large screen, but the processor of the large screen still runs the program of the service application. For example, the smooth connection call application, when the user uses the smooth connection call application for video call, the video call interface of the smooth connection call application is displayed on the screen, and at this time, the smooth connection call application is the foreground service application of the large screen. When the user uses the video on demand application, the smooth connection call application is not displayed on the screen, but in order to receive the application of the video call when someone calls in, the processor of the large screen still runs the program of the smooth connection call application. The program can be the minimum program supporting the function of monitoring the incoming call of the smooth connection call application, and at this time, the smooth connection call application is the background service application of the large screen.

[0403] On the terminal, the control service provided corresponds to the foreground service application on the large screen. Once the foreground service application on the large screen is switched from the first service application to the second service application, the terminal will close the first control interface of the first control service corresponding to the first service application, and display the second control interface of the second control service corresponding to the second service application.

[0404] For example, the video on demand application is being used to play video on the large screen, and the control interface of the video control service popped up on the terminal can refer to the embodiment shown in Figures 14a-14e

[0405] Figure 21a A schematic diagram of the video call interface of V65 is shown in Figure 21a ​As shown, during video playback, the V65 receives a video call request from the MeeTime app. Users can answer the video call using either the physical remote control or the analog remote control on the P30 Pro. For example... Figure 14e As shown, users can click the "Mobile Remote Control" button on the video playback control service interface, and a pop-up window will appear on the P30 Pro. Figure 14c The simulated remote control shown allows the user to focus on the target area by pressing the up, down, left, and right arrow keys 1401. Figure 21a Click the "Answer" button in the menu, then click the OK button (1402) to select "Answer Video Call".

[0406] At this time, the call interface of the Changlian Calling application is displayed on the large screen, and the foreground business application on the large screen switches to the Changlian Calling application. The large screen and the terminal can execute automatically. Figure 20 The steps of the method embodiment shown are to automatically start the seamless call control service on the terminal, wherein the first business application is a video-on-demand application, the first control service is a video broadcast control service, the second business application is a seamless call application, and the second control service is a seamless call control service.

[0407] The terminal closes the video playback control service's interface, and the seamless call control service's interface pops up. Correspondingly, Figure 21a A schematic diagram of the V65 video call interface is shown below. Figure 21b As shown, the control interface for the Changlian Calling service includes buttons for "Switch Camera," "Hang Up," "Mute," "Speaker," "Switch Voice," and "Share Screen." Users can click the "Switch Camera" button to switch between the front and rear cameras during a video call, the "Hang Up" button to end the current video call, the "Mute" button to disable local recording, the "Speaker" button to play audio through the speaker, the "Switch Voice" button to switch the video call to an audio call, and the "Share Screen" button to share their large screen with the other party in the video call. Additionally, the Changlian Calling control interface also includes a "Mobile Remote Control" button 2001. Clicking the "Mobile Remote Control" button 2001 will bring up a pop-up menu... Figure 14c The remote control shown allows users to access it when needed to control the large screen.

[0408] When the video call in the Connect app ends, the foreground business application on the large screen switches back from the Connect app to the video-on-demand app, and the video from the video-on-demand app is played again on the large screen. Correspondingly, the large screen and the terminal can perform [operations / tasks]. Figure 20 The steps of the method embodiment shown are to close the control interface of the seamless call control service on the terminal and display the control interface of the video playback control service, such as... Figure 14eThe first service application is a smooth connection call application, the first operation service is a smooth connection call operation service, the second service application is a video on demand application, and the second operation service is a video broadcast operation service.

[0409] It should be understood that, in order to realize the above functions, the electronic device comprises hardware and / or software modules corresponding to the respective functions. The algorithm steps of each example described in conjunction with the embodiments disclosed herein can be realized in the form of hardware or a combination of hardware and computer software. Whether a certain function is realized in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to realize the described functions for each specific application in conjunction with the embodiments. However, such implementation should not be considered beyond the scope of the embodiments of the present application.

[0410] The embodiments can divide the functional modules of the electronic device according to the above method examples. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The integrated module can be realized in the form of hardware. It should be noted that the division of modules in the embodiments is illustrative and is only a logical functional division. Actual implementation can have another division manner.

[0411] In one example, Figure 22 A schematic block diagram of an apparatus 2200 according to an embodiment of the present application is shown in FIG. 22. Figure 22 As shown in FIG. 22, the apparatus 2200 can include a processor 2201 and a transceiver / transceiver pin 2202, and optionally further include a memory 2203.

[0412] The various components of the apparatus 2200 are coupled together by a bus 2204, which includes, in addition to a data bus, a power bus, a control bus, and a state signal bus. However, for the sake of clarity, only one bus is shown in the figure.

[0413] Optionally, the memory 2203 can be used for instructions in the foregoing method embodiments. The processor 2201 can be used to execute the instructions in the memory 2203 and control the receiving pin to receive signals and the transmitting pin to transmit signals.

[0414] The apparatus 2200 can be an electronic device or a chip of an electronic device in the above method embodiments.

[0415] All relevant contents of the steps involved in the above method embodiments can be cited from the functional description of the corresponding functional modules, which will not be repeated here.

[0416] The embodiment further provides a computer storage medium, which stores computer instructions, and when the computer instructions are executed on an electronic device, the electronic device performs the above-mentioned related method steps to realize the cross-device flow manipulation method of the large-screen service in the above-mentioned embodiment.

[0417] The embodiment further provides a computer program product, which, when executed on a computer, causes the computer to perform the above-mentioned related steps to realize the cross-device flow manipulation method of the large-screen service in the above-mentioned embodiment.

[0418] In addition, the embodiment of the present application also provides a device, which can be a chip, a component or a module. The device can include a processor and a memory connected to each other. The memory is used to store computer execution instructions. When the device is running, the processor can execute the computer execution instructions stored in the memory to enable the chip to perform the cross-device flow manipulation method of the large-screen service in the above-mentioned method embodiments.

[0419] The electronic device, the computer storage medium, the computer program product or the chip provided by the embodiment can be used to execute the corresponding method provided above, and thus the beneficial effects achieved thereby can refer to the beneficial effects of the corresponding method provided above, which will not be described herein again.

[0420] Through the above description of the implementation mode, those skilled in the art can understand that, for the convenience and brevity of description, only the division of the above functional modules is taken as an example for illustration. In actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0421] In several embodiments provided by the present application, it should be understood that the disclosed device and method can be implemented by other means. For example, the device embodiment described above is only schematic. For example, the division of the module or unit is only a logical function division. In actual implementation, another division mode can be used, for example, a plurality of units or components can be combined or integrated into another device, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed each other can be indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.

[0422] The units described as separate components may or may not be physically separate, and the components displayed as units may be a physical unit or multiple physical units, that is, may be located in one place, or also can be distributed to multiple different places. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment of the present application.

[0423] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present alone, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0424] Any content of each embodiment of the present application, and any content of the same embodiment, can be freely combined. Any combination of the above is within the scope of the embodiments of the present application.

[0425] If the integrated unit is realized in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of a software product. The software product is stored in a storage medium, including a number of instructions to make a device (which can be a single-chip microcomputer, a chip, etc.) or a processor execute all or part of the steps of the embodiments of the present application method. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various program code storage media.

[0426] The embodiments of the present application are described above in combination with the drawings, but the embodiments of the present application are not limited to the above-mentioned specific implementation. The above-mentioned specific implementation is only illustrative, not limiting, and those skilled in the art can make many forms under the inspiration of the embodiments of the present application without departing from the scope of the embodiments of the present application and the scope protected by the claims.

Claims

1. A method for cross-device flow control of large-screen services, applied to a system including a large screen and a terminal, characterized in that, The large screen and the terminal are bound together; the method includes: The first business application is launched on the large screen; The large screen sends a first control service request to the terminal, wherein the first control service request includes the identification information of the first business application and / or the identification information of the first control service, and the first control service is a control service corresponding to the first business application. The terminal responds to the first control service request and displays the first control interface corresponding to the first control service; The terminal receives operations applied to the first control interface to perform at least two steps of control on the first business application opened on the large screen. The front-end business application of the large screen is switched from the first business application to the second business application; The large screen sends a second control service request to the terminal, wherein the second control service request includes the identification information of the second business application and / or the identification information of the second control service, and the second control service is a control service corresponding to the second business application. The terminal responds to the second control service request and displays a second control interface corresponding to the second control service, wherein the second control interface is different from the first control interface; The terminal controls the second business application that is running on the large screen by receiving operations applied to the second control interface. After the large screen sends the second control service request to the terminal, it also includes: The terminal closes the control interface of the first control service but retains the first control service.

2. The method according to claim 1, characterized in that, The terminal receives operations applied to the first control interface to perform at least two steps of control on the first service application opened on the large screen, including: The terminal receives operations applied to the first control interface, generates corresponding operation instructions, and sends the operation instructions to the large screen. The large screen executes corresponding processing according to the operation instructions to complete the control of the first business application.

3. The method according to claim 1 or 2, characterized in that, After the terminal responds to the first control service request and displays the first control interface corresponding to the first control service, the method further includes: The large screen sends a control termination request to the terminal, and the control termination request includes the identification information of the first business application and / or the identification information of the first control service. In response to the control termination request, the terminal no longer displays the first control interface; The large screen exits the first business application.

4. The method according to claim 1 or 2, characterized in that, After the terminal responds to the first control service request and displays the first control interface corresponding to the first control service, the method further includes: The terminal sends a service termination request to the large screen. The large screen responds to the service termination request and exits the first service application; The terminal no longer displays the first control interface.

5. The method according to claim 4, characterized in that, Before the terminal stops displaying the first control interface, it also includes: The large screen sends a service application exit response to the terminal; The terminal no longer displays the first control interface, including: The terminal responds to the exit response of the service application and no longer displays the first control interface.

6. The method according to any one of claims 1, 2, and 5, characterized in that, The first business application is a video-on-demand application, and the first control service is a video broadcast control service; The first control interface includes one or more controls among a video progress bar, a video selection, and recommended videos.

7. The method according to any one of claims 1, 2, and 5, characterized in that, The first business application is a karaoke application, and the first control service is a karaoke broadcast control service; The first control interface includes one or more controls in a recommended song list and a selected song list. The recommended song list includes one or more songs, and the selected song list includes songs selected by the user from the recommended song list.

8. The method according to any one of claims 1, 2, and 5, characterized in that, The first business application is a gallery application, and the first control service is a gallery control service; The first control interface includes multiple thumbnails, and the multiple thumbnails correspond to multiple images contained in the gallery application.

9. The method according to any one of claims 1, 2, and 5, characterized in that, The first business application is a game application, and the first control service is a game control service; The first control interface includes one or more controls from the game screen and / or game operation buttons.

10. The method according to any one of claims 1, 2, and 5, characterized in that, The first business application is a live streaming application, and the first control service is a live streaming control service; The first control interface includes a live stream list, which includes multiple sub-lists categorized by type, and each sub-list includes one or more live stream channels.

11. The method according to any one of claims 1, 2, and 5, characterized in that, The first control interface also includes a "mobile phone remote control" button; When the terminal receives an operation command generated by the button operation of the "mobile remote control", it displays the remote control operation interface, which includes one or more of the following controls: up, down, left and right directional keys, OK key, increase / decrease key, exit key, menu key, and power button.

12. The method according to any one of claims 1, 2, and 5, characterized in that, The large screen pre-stores the correspondence between the first business application and the first control service.

13. A method for cross-device operation of large-screen services, applied to a terminal, characterized in that, include: Receive a first control service request from the large screen, wherein the first control service request includes the identification information of the first business application opened on the large screen and / or the identification information of the first control service, and the first control service is a control service corresponding to the first business application. In response to the first control service request, the first control interface corresponding to the first control service is displayed; By receiving operations applied to the first control interface, at least two steps of control can be performed on the first business application opened on the large screen. Receive a second control service request from the large screen, wherein the second control service request includes the identification information of the second business application after switching the foreground business application on the large screen and / or the identification information of the second control service, and the second control service is the control service corresponding to the second business application. In response to the second control service request, a second control interface corresponding to the second control service is displayed, wherein the second control interface is different from the first control interface; By receiving operations applied to the second control interface, the second business application opened on the large screen can be controlled. After receiving the second control service request from the large screen, the process further includes: The control interface of the first control service is closed, but the first control service is retained.

14. The method according to claim 13, characterized in that, The step of receiving operations applied to the first control interface to perform at least two steps of control on the first service application opened on the large screen includes: By receiving operations applied to the first control interface, corresponding operation instructions are generated; The operation command is sent to the large screen.

15. The method according to claim 13 or 14, characterized in that, After controlling the first business application opened on the large screen by receiving operations applied to the first control interface, the method further includes: Receive a control termination request from the large screen, the control termination request including the identification information of the first business application and / or the identification information of the first control service; In response to the control termination request, the first control interface is no longer displayed.

16. The method according to claim 13 or 14, characterized in that, After receiving operations applied to the first control interface to perform at least two steps of control on the first service application opened on the large screen, the method further includes: Send a service termination request to the large screen; The first control interface will no longer be displayed.

17. The method according to claim 16, characterized in that, Before the first control interface is no longer displayed, the method further includes: Receive a business application exit response from the large screen; The step of no longer displaying the first control interface includes: In response to the exit of the aforementioned business application, the first control interface will no longer be displayed.

18. The method according to any one of claims 13, 14, and 17, characterized in that, The first business application is a video-on-demand application, and the first control service is a video broadcast control service; The first control interface includes one or more controls among a video progress bar, a video selection, and recommended videos.

19. The method according to any one of claims 13, 14, and 17, characterized in that, The first business application is a karaoke application, and the first control service is a karaoke broadcast control service; The first control interface includes one or more controls in a recommended song list and a selected song list. The recommended song list includes one or more songs, and the selected song list includes songs selected by the user from the recommended song list.

20. The method according to any one of claims 13, 14, and 17, characterized in that, The first business application is a gallery application, and the first control service is a gallery control service; The first control interface includes multiple thumbnails, and the multiple thumbnails correspond to multiple images contained in the gallery application.

21. The method according to any one of claims 13, 14, and 17, characterized in that, The first business application is a game application, and the first control service is a game control service; The first control interface includes one or more controls from the game screen and / or game operation buttons.

22. The method according to any one of claims 13, 14, and 17, characterized in that, The first business application is a live streaming application, and the first control service is a live streaming control service; The first control interface includes a live stream list, which includes multiple sub-lists categorized by type, and each sub-list includes one or more live stream channels.

23. The method according to any one of claims 13, 14, and 17, characterized in that, The first control interface also includes a "mobile phone remote control" button; When the terminal receives an operation command generated by the button operation of the "mobile remote control", it displays the remote control operation interface, which includes one or more of the following controls: up, down, left and right directional keys, OK key, increase / decrease key, exit key, menu key, and power button.

24. A method for cross-device operation of large-screen services, applied to large screens, characterized in that: include: Launch the first business application; Send a first control service request to the terminal so that the terminal displays a first control interface corresponding to the first control service and receives operations performed on the first control interface to realize at least two-step control of the first business application opened on the large screen. The first control service request includes the identification information of the first business application and / or the identification information of the first control service. The first control service is a control service corresponding to the first business application. Switch the front-end business application from the first business application to the second business application; A second control service request is sent to the terminal to cause the terminal to close the control interface of the first control service but retain the first control service and display the second control interface corresponding to the second control service. The second control service request includes the identification information of the second business application and / or the identification information of the second control service. The second control service is a control service corresponding to the second business application.

25. The method according to claim 24, characterized in that, After sending the first control service request to the terminal, the method further includes: Receive an operation instruction from the terminal, the operation instruction being generated by an operation performed on a first control interface on the terminal; The corresponding processing is executed according to the operation instructions to complete the control of the first business application.

26. The method according to claim 24 or 25, characterized in that, After sending the first control service request to the terminal, the method further includes: Send a control termination request to the terminal, the control termination request including the identification information of the first business application and / or the identification information of the first control service; Exit the first business application.

27. The method according to claim 24 or 25, characterized in that, After sending the first control service request to the terminal, the method further includes: Receive a service termination request from the terminal; In response to the service termination request, exit the first service application.

28. The method according to claim 27, further comprising, after exiting the first service application in response to the service termination request: Send a service application exit response to the terminal.

29. The method according to any one of claims 24, 25, and 28, characterized in that, The large screen pre-stores the correspondence between the first business application and the first control service.

30. An electronic device used as a terminal, characterized in that, include: The transmission module is used to receive a first control service request from the large screen, wherein the first control service request includes the identification information of a first business application opened on the large screen and / or the identification information of a first control service, and the first control service is a control service corresponding to the first business application. The display module is used to respond to the first control service request and display the first control interface corresponding to the first control service; The processing module is used to receive operations applied to the first control interface and perform at least two steps of control on the first business application opened on the large screen. The transmission module is further configured to receive a second control service request from the large screen, wherein the second control service request includes the identification information of the second business application after switching the foreground business application on the large screen and / or the identification information of the second control service, and the second control service is a control service corresponding to the second business application. The display module is further configured to respond to the second control service request and display a second control interface corresponding to the second control service, wherein the second control interface is different from the first control interface. The processing module is also used to control the second business application opened on the large screen by receiving operations applied to the second control interface. The processing module is also used to close the control interface of the first control service but retain the first control service.

31. The electronic device according to claim 30, characterized in that, The processing module is specifically used to generate corresponding operation instructions by receiving operations applied to the first control interface; The transmission module is also used to send the operation instructions to the large screen.

32. The electronic device according to claim 30 or 31, characterized in that, The transmission module is also configured to receive a control termination request from the large screen, the control termination request including the identification information of the first business application and / or the identification information of the first control service. The processing module is also configured to stop displaying the first control interface in response to the control termination request.

33. The electronic device according to claim 30 or 31, characterized in that, The transmission module is also used to send a service termination request to the large screen; The processing module is also used to stop displaying the first control interface.

34. The electronic device according to claim 33, characterized in that, The transmission module is also used to receive a business application exit response from the large screen; The processing module is also configured to stop displaying the first control interface in response to the exit response of the business application.

35. The electronic device according to any one of claims 30, 31, and 34, characterized in that, The first business application is a video-on-demand application, and the first control service is a video broadcast control service; The first control interface includes one or more controls among a video progress bar, a video selection, and recommended videos.

36. The electronic device according to any one of claims 30, 31, and 34, characterized in that, The first business application is a karaoke application, and the first control service is a karaoke broadcast control service; The first control interface includes one or more controls in a recommended song list and a selected song list. The recommended song list includes one or more songs, and the selected song list includes songs selected by the user from the recommended song list.

37. The electronic device according to any one of claims 30, 31, and 34, characterized in that, The first business application is a gallery application, and the first control service is a gallery control service; The first control interface includes multiple thumbnails, and the multiple thumbnails correspond to multiple images contained in the gallery application.

38. The electronic device according to any one of claims 30, 31, and 34, characterized in that, The first business application is a game application, and the first control service is a game control service; The first control interface includes one or more controls from the game screen and / or game operation buttons.

39. The electronic device according to any one of claims 30, 31, and 34, characterized in that, The first business application is a live streaming application, and the first control service is a live streaming control service; The first control interface includes a live stream list, which includes multiple sub-lists categorized by type, and each sub-list includes one or more live stream channels.

40. The electronic device according to any one of claims 30, 31, and 34, characterized in that, The first control interface also includes a "mobile phone remote control" button; When the terminal receives an operation command generated by the button operation of the "mobile remote control", it displays the remote control operation interface, which includes one or more of the following controls: up, down, left and right directional keys, OK key, increase / decrease key, exit key, menu key, and power button.

41. An electronic device used as a large screen, characterized in that, include: The processing module is used to start the first business application; The transmission module is used to send a first control service request to the terminal so that the terminal displays a first control interface corresponding to the first control service, and to receive operations performed on the first control interface to realize at least two-step control of the first business application opened on the large screen. The first control service request includes the identification information of the first business application and / or the identification information of the first control service. The first control service is a control service corresponding to the first business application. The processing module is also used to switch the front-end business application from the first business application to the second business application; The transmission module is further configured to send a second control service request to the terminal, so that the terminal closes the control interface of the first control service but retains the first control service and displays the second control interface corresponding to the second control service. The second control service request includes the identification information of the second business application and / or the identification information of the second control service. The second control service is a control service corresponding to the second business application.

42. The electronic device according to claim 41, characterized in that, The transmission module is also used to receive operation instructions from the terminal, the operation instructions being generated by operations performed on the first control interface on the terminal; The processing module is further configured to perform corresponding processing according to the operation instructions in order to complete the control of the first business application.

43. The electronic device according to claim 41 or 42, characterized in that, The transmission module is further configured to send a control termination request to the terminal, the control termination request including the identification information of the first service application and / or the identification information of the first control service. The processing module is also used to exit the first business application.

44. The electronic device according to claim 41 or 42, characterized in that, The transmission module is also used to receive a service termination request from the terminal; The processing module is also configured to exit the first service application in response to the service termination request.

45. The electronic device according to claim 44, wherein the transmission module is further configured to send a service application exit response to the terminal.

46. ​​The electronic device according to any one of claims 41, 42, and 45, characterized in that, The electronic device pre-stores the correspondence between the first business application and the first control service.

47. An electronic device, characterized in that, include: Processor and transceiver; Memory, used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 13-29.

48. A computer-readable storage medium, characterized in that, The method includes a computer program, characterized in that, when the computer program is run on a computer, it causes the computer to perform the method as described in any one of claims 13-29.

49. A chip, characterized in that, The device includes one or more interface circuits and one or more processors; the interface circuits are configured to receive signals from the memory of the electronic device and send the signals to the processors, the signals including computer instructions stored in the memory; when the processor executes the computer instructions, the electronic device performs the method according to any one of claims 13-29.

Images