Device communication method, system and device

Abstract

The embodiments of the present application provide a device communication method, system and apparatus, which are applied in the field of communication technology. In the embodiments of the present application, when a user uses a mobile phone to assist in large-screen input, other auxiliary devices in the same distributed network as the large screen and the mobile phone can preempt the auxiliary input of the mobile phone, and further, can continue to assist in large-screen input based on the input content of the mobile phone, during which the user does not need to use a remote control or other device to select the edit box of the large screen again, thereby achieving convenient and efficient auxiliary large-screen input.

Description

[0001] This application claims the priority of five Chinese patent applications filed with the State Intellectual Property Office of China on October 31, 2020. The five Chinese patent applications are: Chinese patent application with application number 202011197035.0 and application name “Device Communication Method, System and Device”, Chinese patent application with application number 202011197048.8 and application name “Device Communication Method, System and Device”, Chinese patent application with application number 202011197030.8 and application name “Device Communication Method, System and Device”, Chinese patent application with application number 202011198861.7 and application name “Device Communication Method, System and Device”, and Chinese patent application with application number 202011198863.6 and application name “Device Communication Method, System and Device”. The entire contents of the five Chinese patent applications are incorporated into this application by reference. Technical Field

[0002] The present application relates to the field of communication technology, and in particular to a device communication method, system and apparatus. Background Art

[0003] With the continuous development of smart terminal technology, more and more electronic devices have been developed, but different electronic devices often have different advantages and disadvantages, and each electronic device often cannot provide good services to users.

[0004] Taking television and mobile phones as examples, television can provide better video images based on the large screen, but when searching for programs on TV, it is necessary to use the remote control to select pinyin letters one by one for text input, which is inefficient and the input operation is inconvenient; mobile phones can achieve convenient and efficient text input based on the input method framework, but the screen of the mobile phone is usually small, which is not conducive to users watching videos or images. Summary of the invention

[0005] The embodiments of the present application provide a device communication method, system and apparatus, so that different electronic devices can work together, give full play to their respective advantages, and provide users with convenient and comfortable services.

[0006] The first aspect of an embodiment of the present application provides a device communication method, which is applied to a system including a first device, a second device and a third device, and the method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to the second device and the third device; the second device displays a second interface according to the indication message, and the second interface includes a second edit box; when there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box; the third device sends a preemption message to the first device; the third device displays a third interface including a third edit box; and the editing state in the first edit box is synchronized in the third edit box.

[0007] In this way, when the second device assists the first device in inputting, the third device can take over, making the method of assisting the first device in inputting more flexible.

[0008] In a possible implementation, the second device includes an interface service, and the interface service is used for synchronizing the editing state between the first device and the second device. In this way, based on the interface service, the first device can be synchronized to any editing state of the second device.

[0009] In a possible implementation, the editing state includes one or more of the following: text content, a highlight mark of a cursor or text content.

[0010] In one possible implementation, the second device displays the second interface according to the indication message, including: the second device displays the first notification interface in response to the indication message; the first notification interface includes an option to confirm the auxiliary input; in response to the triggering operation of the option, the second device displays the second interface.

[0011] In a possible implementation, the second interface also includes: all or part of the content of the first interface. In this way, the user can see the situation in the first device on the second device, which is convenient for the user to understand the dynamics of the auxiliary first device.

[0012] In a possible implementation, the second edit box is displayed in layers with all or part of the content of the first interface, and the second edit box is displayed on an upper layer of all or part of the content of the first interface.

[0013] In one possible implementation, after the second device displays the second interface according to the indication message, the method further includes: in response to triggering the second edit box, the second device displays a virtual keyboard; the second device displays the editing status in the second edit box according to the virtual keyboard and / or the input operation received in the second edit box.

[0014] In a possible implementation, the first device includes any one of the following: a television, a large screen, or a wearable device; the second device or the third device includes any one of the following: a mobile phone, a tablet, or a wearable device.

[0015] A possible implementation manner further includes: when input content is received in the third edit box, the first device synchronizes the input content to the first edit box.

[0016] In a possible implementation, the third device sends a preemption message to the first device, including: the third device receives a preemption request from the second device; and the third device sends the preemption message to the first device based on the preemption request.

[0017] In one possible implementation, a third device sends a preemption message to a first device, including: the third device displays a second notification interface according to a user operation; the second notification interface includes an option to confirm the preemption; in response to a trigger operation for the option to confirm the preemption, the third device sends a preemption message to the first device.

[0018] The first and second aspects of the embodiments of the present application provide a device communication method, which is applied to a system including a first device, a second device and a third device, and the method includes: the second device displays a fourth interface including options of the first device; in response to a selection operation on the options of the first device, the second device sends an indication message to the first device; the first device displays a first interface including a first edit box; the second device displays a second interface, and the second interface includes a second edit box; when there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box; the third device sends a preemption message to the first device; the third device displays a third interface including a third edit box; and the editing state in the first edit box is synchronized in the third edit box.

[0019] It should be noted that any possible implementation method in the first aspect, as long as it does not conflict with the method provided by the first and second aspects, can be used to limit the method provided by the first and second aspects, and will not be repeated here.

[0020] The first and third aspects of the embodiments of the present application provide a device communication method, which is applied to a first device, and the method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to a second device and a third device; the indication message is used to instruct the second device to display a second interface, and the second interface includes a second edit box; when there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box; the first device receives a preemption message from the third device.

[0021] It should be noted that any possible implementation method in the first aspect, as long as it does not conflict with the method provided by the first and third aspects, can be used to limit the method provided by the first and third aspects, and will not be repeated here.

[0022] The first and fourth aspects of the embodiments of the present application provide a device communication method, which is applied to a second device, and the method includes: the second device displays a fourth interface including options of the first device; in response to a selection operation on an option of the first device, the second device sends an indication message to the first device; the first device displays a first interface including a first edit box; the second device displays a second interface, and the second interface includes a second edit box; when there is an editing state in the second edit box, the second device synchronizes the editing state to the first edit box; the second device receives a preemption message from a third device.

[0023] It should be noted that any possible implementation method in the first aspect, as long as it does not conflict with the method provided in the first four aspects, can be used to limit the method provided in the first four aspects, and will not be repeated here.

[0024] The first and fifth aspects of the embodiments of the present application provide a device communication system, including a first device, a second device and a third device, the first device is used to execute the steps of the first device in any of the first to fourth aspects, the second device is used to execute the steps of the second device in any of the first to fourth aspects, and the third device is used to execute the steps of the third device in any of the first to fourth aspects.

[0025] The first six aspects of the embodiments of the present application provide a first device, comprising: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the first device executes any step executed by the first device in the first one to the first four aspects.

[0026] The first seven aspects of the embodiments of the present application provide a second device, comprising: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the second device executes any step executed by the second device in the first to fourth aspects.

[0027] The first eight aspects of the embodiments of the present application provide a third device, including: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the third device executes any step performed by the third device as described in any of the first to fourth aspects.

[0028] A first and ninth aspect of an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored so that when the computer program is executed by a processor of a first device, the steps executed by the first device in any of the first to fourth aspects are implemented; or, when the computer program is executed by a processor of a second device, the steps executed by the second device in any of the first to fourth aspects are implemented; or, when the computer program is executed by a processor of a third device, the steps executed by the third device in any of the first to fourth aspects are implemented.

[0029] It should be noted that in the embodiments of the present application, the interaction between the first device, the second device and the third device is used as an example to illustrate the specific device communication method. When one of the first device, the second device or the third device is used as the execution subject, the steps performed by each device can be selected in any of the above embodiments to obtain a unilateral implementation of the first device, the second device or the third device, which will not be repeated here. The functions of the second device and the third device are similar, and any steps performed in the second device can be applied to the third device if they do not conflict with the steps of the third device.

[0030] It should be noted that, in the above embodiments, the display screen of each device can be used to implement the display step. The first interface, the second interface, the third interface or the fourth interface, etc. described in the above embodiments are differentiated descriptions of different display interfaces of each device. In subsequent specific embodiments, the first interface, the second interface, the third interface or the fourth interface can be corresponded to the specific interface provided in the specific embodiment through text in combination with the specific content of the embodiment, which will not be repeated here.

[0031] It should be understood that the first two aspects to the ninth aspect of the embodiments of the present application correspond to the technical solutions of the first aspect of the embodiments of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here.

[0032] According to a second aspect of an embodiment of the present application, there is provided a device communication method, which is applied to a system including a first device, a second device and a third device, and the method includes: the first device displays a first interface including a first edit box; in response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network; the first device displays a second interface, and the second interface includes a first option corresponding to the second device and a second option corresponding to the third device; in response to a trigger operation on the first option, the first device sends an indication message to the second device; the second device displays a third interface according to the indication message, and the third interface includes a second edit box; when an editing state exists in the second edit box, the editing state is synchronized to the first edit box.

[0033] In an embodiment of the present application, the first device may provide a selection interface for selecting a second device or a third device. When a selection of the second device is received, an indication message may be sent to the second device to instruct the second device to assist the first device. In this way, the indication message may not be sent to the third device to avoid disturbing the third device.

[0034] In a possible implementation, the second device includes an interface service, and the interface service is used for synchronizing the editing state between the first device and the second device. In this way, based on the interface service, the first device can be synchronized to any editing state of the second device.

[0035] In a possible implementation, the editing state includes one or more of the following: text content, a highlight mark of a cursor or text content.

[0036] In one possible implementation, the second device displays a third interface based on an indication message, including: the second device displays a notification interface in response to the indication message; the notification interface includes a third option for confirming auxiliary input; in response to a trigger operation on the third option, the second device displays a third interface.

[0037] In a possible implementation, the third interface also includes: all or part of the content of the first interface. In this way, the user can see the situation in the first device on the second device, which is convenient for the user to understand the dynamics of the auxiliary first device.

[0038] In a possible implementation, the second edit box is displayed in layers with all or part of the content of the first interface, and the second edit box is displayed on an upper layer of all or part of the content of the first interface.

[0039] In one possible implementation, after the second device displays the third interface according to the indication message, the method also includes: in response to triggering the second edit box, the second device displays a virtual keyboard; the second device displays the editing status in the second edit box according to the virtual keyboard and / or the input operation received in the second edit box.

[0040] In a possible implementation, the first device includes any one of the following: a television, a large screen, or a wearable device; the second device or the third device includes any one of the following: a mobile phone, a tablet, or a wearable device.

[0041] A second aspect of an embodiment of the present application provides a device communication method, which is applied to a system including a first device, a second device and a third device, and the method includes: the first device displays a first interface including a first edit box; in response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network; the first device determines that the second device is an auxiliary input device; the first device sends an indication message to the second device; the second device displays a third interface according to the indication message, and the third interface includes a second edit box; when there is an editing state in the second edit box, the editing state is synchronized to the first edit box.

[0042] It should be noted that any possible implementation of the second aspect, as long as it does not conflict with the method provided by the second aspect, can be used to limit the method provided by the second aspect, and will not be repeated here.

[0043] The second and third aspects of the embodiments of the present application provide a device communication method, which is applied to a system including a first device, a second device and a third device, and the method includes: the second device displays a fourth interface including options of the first device; in response to a selection operation on the options of the first device, the second device sends an indication message to the first device; the first device displays a first interface including a first edit box; the second device displays a third interface, and the third interface includes a second edit box; when an editing state exists in the second edit box, the editing state is synchronized to the first edit box.

[0044] It should be noted that any possible implementation method in the second aspect, as long as it does not conflict with the method provided by the second and third aspects, can be used to limit the method provided by the second and third aspects, and will not be repeated here.

[0045] The second and fourth aspects of the embodiments of the present application provide a device communication method, which is applied to a first device, and the method includes: the first device displays a first interface including a first edit box; in response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network; the first device displays a second interface, and the second interface includes a first option corresponding to the second device and a second option corresponding to the third device; in response to a trigger operation on the first option, the first device sends an indication message to the second device; the indication message is used to instruct the second device to display a third interface, and the third interface includes a second edit box; when there is an editing state in the second edit box, the editing state is synchronized to the first edit box.

[0046] It should be noted that any possible implementation method in the second aspect, as long as it does not conflict with the method provided in the second and fourth aspects, can be used to limit the method provided in the second and fourth aspects, and will not be repeated here.

[0047] The twenty-fifth aspect of an embodiment of the present application provides a device communication method, which is applied to a second device, and the method includes: the second device displays a fourth interface including options of the first device; in response to a selection operation on an option of the first device, the second device sends an indication message to the first device; the indication message is used to instruct the first device to display a first interface including a first edit box; the second device displays a third interface, and the third interface includes a second edit box; when an editing state exists in the second edit box, the editing state is synchronized to the first edit box.

[0048] It should be noted that any possible implementation method in the second aspect, as long as it does not conflict with the method provided in the twenty-fifth aspect, can be used to limit the method provided in the twenty-fifth aspect, and will not be repeated here.

[0049] The twenty-sixth aspect of an embodiment of the present application provides a device communication system, comprising a first device, a second device and a third device, the first device being used to execute the steps of any first device as in the second aspect to the twenty-fifth aspect, the second device being used to execute the steps of any second device as in the second aspect to the twenty-fifth aspect, and the third device being used to execute the steps of any third device as in the second aspect to the twenty-fifth aspect.

[0050] The twenty-seventh aspect of an embodiment of the present application provides a first device, comprising: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the first device executes any step executed by the first device from the second aspect to the twenty-fifth aspect.

[0051] The twenty-eighth aspect of an embodiment of the present application provides a second device, comprising: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the second device executes any step executed by the second device from the second first aspect to the twenty-fifth aspect.

[0052] The twenty-ninth aspect of the embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored so that when the computer program is executed by a processor of a first device, the steps executed by the first device as described in any of the second aspects to the twenty-fifth aspects are implemented; or, when the computer program is executed by a processor of a second device, the steps executed by the second device as described in any of the second aspects to the twenty-fifth aspects are implemented; or, when the computer program is executed by a processor of a third device, the steps executed by the third device as described in any of the second aspects to the twenty-fifth aspects are implemented.

[0053] It should be noted that in the embodiments of the present application, the interaction between the first device, the second device and the third device is used as an example to illustrate the specific device communication method. When one of the first device, the second device or the third device is used as the execution subject, the steps performed by each device can be selected in any of the above embodiments to obtain a unilateral implementation of the first device, the second device or the third device, which will not be repeated here. The functions of the second device and the third device are similar, and any steps performed in the second device can be applied to the third device if they do not conflict with the steps of the third device.

[0054] It should be noted that, in the above embodiments, the display screen of each device can be used to implement the display step. The first interface, the second interface, the third interface or the fourth interface, etc. described in the above embodiments are differentiated descriptions of different display interfaces of each device. In subsequent specific embodiments, the first interface, the second interface, the third interface or the fourth interface can be corresponded to the specific interface provided in the specific embodiment through text in combination with the specific content of the embodiment, which will not be repeated here.

[0055] It should be understood that the twenty-second to twenty-ninth aspects of the embodiments of the present application correspond to the technical solutions of the twenty-first aspect of the embodiments of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here.

[0056] The third aspect of an embodiment of the present application provides a device communication method, which is applied to a system including a first device and a second device, and the method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to the second device; the second device displays a second interface according to the indication message, and the second interface includes a second edit box; when there is a keyword in the second edit box, the first device synchronizes the keyword to the first edit box; the first device determines a candidate word corresponding to the keyword; the second device obtains the candidate word and displays a third interface, and the third interface includes the candidate word.

[0057] In an embodiment of the present application, the keywords input into the second device can be synchronized to the first device, and the candidate words associated with the first device based on the keywords can be synchronized to the second device, so that the second device can realize convenient and efficient auxiliary input of the first device based on the operation of selecting the candidate words of the first device.

[0058] In a possible implementation, the second device includes an interface service, and the interface service is used for synchronizing the editing state between the first device and the second device. In this way, based on the interface service, the first device can be synchronized to any editing state of the second device.

[0059] In a possible implementation, the editing state includes one or more of the following: text content, a highlight mark of a cursor or text content.

[0060] In one possible implementation, the second device displays the second interface according to the indication message, including: the second device displays a notification interface in response to the indication message; the notification interface includes an option to confirm the auxiliary input; in response to the triggering operation of the option, the second device displays the second interface.

[0061] In a possible implementation, the third interface also includes: all or part of the content of the first interface. In this way, the user can see the situation in the first device on the second device, which is convenient for the user to understand the dynamics of the auxiliary first device.

[0062] In a possible implementation, the second edit box is displayed in layers with all or part of the content of the first interface, and the second edit box is displayed on an upper layer of all or part of the content of the first interface.

[0063] In one possible implementation, after the second device displays the second interface according to the indication message, the method further includes: in response to triggering the second edit box, the second device displays a virtual keyboard; the second device displays the editing status in the second edit box according to the virtual keyboard and / or the input operation received in the second edit box.

[0064] In a possible implementation, the first device includes any one of the following: a television, a large screen, or a wearable device; the second device includes any one of the following: a mobile phone, a tablet, or a wearable device.

[0065] In one possible implementation, the third interface also includes local candidate words based on keyword association of the second device, and the display methods of the candidate words and the local candidate words in the third interface include any of the following: the candidate words and the local candidate words are displayed in separate columns in the third interface; the candidate words are displayed in front of the local candidate words in the third interface; the candidate words are displayed behind the local candidate words in the third interface; the candidate words and the local candidate words are mixedly displayed in the third interface; the candidate words and the local candidate words are distinguished by different identifiers in the third interface.

[0066] In a possible implementation, the ranking of candidate words is related to historical user behavior in the first device.

[0067] A possible implementation also includes: the second device displays any candidate word in a second edit box in response to a user triggering any candidate word.

[0068] A thirty-second aspect of an embodiment of the present application provides a device communication method, which is applied to a system including a first device and a second device, and the method includes: the second device displays a fourth interface including options of the first device; in response to a selection operation on an option of the first device, the second device sends an indication message to the first device; the first device displays a first interface including a first edit box; the second device displays a second interface, and the second interface includes a second edit box; when there is a keyword in the second edit box, the first device synchronizes the keyword to the first edit box; the first device determines a candidate word corresponding to the keyword; the second device obtains the candidate word and displays a third interface, and the third interface includes the candidate word.

[0069] It should be noted that any possible implementation method in the third aspect, as long as it does not conflict with the method provided by the thirty-second aspect, can be used to limit the method provided by the thirty-second aspect, and will not be repeated here.

[0070] The third aspect of the embodiment of the present application provides a device communication method, which is applied to a first device, and the method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to a second device; the indication message is used to instruct the second device to display a second interface, and the second interface includes a second edit box; when there is a keyword in the second edit box, the first device synchronizes the keyword to the first edit box; the first device determines a candidate word corresponding to the keyword; the first device synchronizes the candidate word to the second device.

[0071] It should be noted that any possible implementation method in the third aspect, as long as it does not conflict with the method provided by the thirty-third aspect, can be used to limit the method provided by the thirty-third aspect, and will not be repeated here.

[0072] The third and fourth aspects of the embodiments of the present application provide a device communication method, the method comprising: a second device receives an indication message from a first device; a first interface including a first edit box is displayed in the first device; the second device displays a second interface according to the indication message, the second interface including a second edit box; when there is a keyword in the second edit box, the second device synchronizes the keyword to the first edit box, for the first device to determine the candidate word corresponding to the keyword; the second device obtains the candidate word and displays a third interface, the third interface including the candidate word.

[0073] It should be noted that any possible implementation method in the third aspect, as long as it does not conflict with the method provided in the third and fourth aspects, can be used to limit the method provided in the third and fourth aspects, and will not be repeated here.

[0074] The thirty-fifth aspect of the embodiment of the present application provides a device communication method, which is applied to a second device, and the method includes: the second device displays a fourth interface including options of the first device; in response to a selection operation on the options of the first device, the second device sends an indication message to the first device; the indication message is used to instruct the first device to display a first interface including a first edit box; the second device displays a second interface, and the third interface includes a second edit box; when there is a keyword in the second edit box, the second device synchronizes the keyword to the first edit box, so that the first device determines the candidate word corresponding to the keyword; the second device obtains the candidate word and displays a third interface, and the third interface includes the candidate word.

[0075] It should be noted that any possible implementation method in the third aspect, as long as it does not conflict with the method provided in the thirty-fifth aspect, can be used to limit the method provided in the thirty-fifth aspect, and will not be repeated here.

[0076] The thirty-sixth aspect of the embodiment of the present application provides a device communication system, including a first device and a second device, the first device is used to execute the steps of the first device as in any of the third aspects to the thirty-fifth aspects, and the second device is used to execute the steps of the second device as in any of the third aspects to the thirty-fifth aspects.

[0077] The thirty-seventh aspect of an embodiment of the present application provides a first device, comprising: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the first device executes any step executed by the first device in aspects from the thirty-first to the thirty-fifth aspects.

[0078] The thirty-eighth aspect of an embodiment of the present application provides a second device, comprising: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the second device executes any step executed by the second device as in the thirty-first to thirty-fifth aspects.

[0079] The thirty-ninth aspect of the embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored so that when the computer program is executed by a processor of a first device, the steps executed by the first device as described in any of the third aspects to the thirty-fifth aspects are implemented; or, when the computer program is executed by a processor of a second device, the steps executed by the second device as described in any of the third aspects to the thirty-fifth aspects are implemented; or, when the computer program is executed by a processor of a third device, the steps executed by the third device as described in any of the third aspects to the thirty-fifth aspects are implemented.

[0080] It should be noted that in the embodiments of the present application, the interaction between the first device and the second device is taken as an example to illustrate the specific device communication method. When one of the first device or the second device serves as the execution subject, the steps executed by each of the above embodiments can be selected to obtain a unilateral implementation method of the first device or the second device, which will not be repeated here.

[0081] It should be noted that, in the above embodiments, the display screen of each device can be used to implement the display step. The first interface, the second interface, the third interface or the fourth interface, etc. described in the above embodiments are differentiated descriptions of different display interfaces of each device. In subsequent specific embodiments, the first interface, the second interface, the third interface or the fourth interface can be corresponded to the specific interface provided in the specific embodiment through text in combination with the specific content of the embodiment, which will not be repeated here.

[0082] It should be understood that aspects 32 to 39 of the embodiments of the present application correspond to the technical solutions of the 31st aspect of the embodiments of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here.

[0083] The fourth aspect of an embodiment of the present application provides a device communication method, which is applied to a system including a first device, a second device and a third device, and the method includes: the first device, the second device and the third device access a distributed network; the second device obtains a target candidate word, the target candidate word does not belong to the candidate word library of the first device, and the target candidate word does not belong to the candidate word library of the third device; the first device receives a keyword related to the target candidate word input by a user, and the first device displays the target candidate word; and / or the third device receives a keyword related to the target candidate word input by a user, and the third device displays the target candidate word.

[0084] In the embodiment of the present application, the first device, the second device and the third device can be connected to a distributed network and synchronize their respective candidate word libraries with each other, so that efficient and convenient input can be achieved based on the synchronized candidate word libraries.

[0085] A possible implementation manner further includes: the first device, the second device, and the third device synchronizing their respective candidate word libraries with each other.

[0086] A possible implementation method also includes: when the first device, the second device or the third device exits the distributed network, a prompt interface for whether to delete the synchronized candidate vocabulary is displayed in the first device, the second device or the third device; the prompt interface includes an option for indicating deletion and an option for indicating not deleting; in response to a trigger operation on the option indicating deletion, the first device, the second device or the third device deletes the candidate vocabulary synchronized from other devices; or, in response to a trigger operation on the option indicating not deleting, the first device, the second device or the third device retains the candidate vocabulary synchronized from the distributed network.

[0087] A possible implementation method also includes: the first device, the second device or the third device respectively determine their respective access types; when the first device, the second device or the third device exits the distributed network, the first device, the second device or the third device determines whether to delete the candidate vocabulary synchronized from the distributed network according to their respective access types.

[0088] A possible implementation method also includes: the first device displays a first interface including a first edit box; the first device sends an indication message to the second device; the second device displays a second interface according to the indication message, and the second interface includes a second edit box; when there is an editing state in the second edit box, the editing state is synchronized to the first edit box.

[0089] In a possible implementation, the second device includes an interface service, and the interface service is used for synchronizing the editing state between the first device and the second device. In this way, based on the interface service, the first device can be synchronized to any editing state of the second device.

[0090] In a possible implementation, the editing state includes one or more of the following: text content, a highlight mark of a cursor or text content.

[0091] In one possible implementation, the second device displays the second interface according to the indication message, including: the second device displays a notification interface in response to the indication message; the notification interface includes a third option for confirming the auxiliary input; in response to the triggering operation of the third option, the second device displays the second interface.

[0092] In a possible implementation, the second interface also includes: all or part of the content of the first interface.

[0093] In a possible implementation, the second edit box is displayed in layers with all or part of the content of the first interface, and the second edit box is displayed on an upper layer of all or part of the content of the first interface.

[0094] In one possible implementation, after the second device displays the second interface according to the indication message, the method further includes: in response to triggering the second edit box, the second device displays a virtual keyboard; the second device displays the editing status in the second edit box according to the virtual keyboard and / or the input operation received in the second edit box.

[0095] In a possible implementation, the first device includes any one of the following: a television, a large screen, or a wearable device; the second device or the third device includes any one of the following: a mobile phone, a tablet, or a wearable device.

[0096] A possible implementation also includes: the second device displays a fourth interface including options of the first device; in response to a selection operation on an option of the first device, the second device sends an indication message to the first device; the first device displays a first interface including a first edit box; the second device displays a second interface, and the second interface includes a second edit box; when an editing state exists in the second edit box, the editing state is synchronized to the first edit box.

[0097] A forty-second aspect of an embodiment of the present application provides a device communication method, which is applied to a system including a first device, a second device and a third device, and the method includes: the first device, the second device and the third device access a distributed network; the first device, the second device and the third device synchronize their respective candidate word libraries with each other to obtain a candidate word library set; when the first device, the second device or the third device performs text editing, the first device, the second device or the third device displays candidate words according to the candidate word library set.

[0098] It should be noted that any possible implementation of the fourth aspect, as long as it does not conflict with the method provided by the forty-second aspect, can be used to limit the method provided by the forty-second aspect, and will not be repeated here.

[0099] Aspect 43 of an embodiment of the present application provides a device communication method, which is applied to a first device, including: the first device accesses a distributed network; other devices are also connected to the distributed network; the first device synchronizes the candidate word library of other devices based on the distributed network to obtain a candidate word library set; when the first device performs text editing, the first device displays candidate words according to the candidate word library set.

[0100] It should be noted that any possible implementation of the fourth aspect, as long as it does not conflict with the method provided by the forty-third aspect, can be used to limit the method provided by the forty-third aspect, and will not be repeated here.

[0101] The fourth aspect of the embodiment of the present application provides a device communication system, including a first device, a second device and a third device, the first device is used to execute the steps of the first device as in any of the fourth aspects to the fourth aspects, the second device is used to execute the steps of the second device as in any of the fourth aspects to the fourth aspects, and the third device is used to execute the steps of the third device as in any of the fourth aspects to the fourth aspects.

[0102] The 45th aspect of the embodiment of the present application provides a first device, including: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the first device executes any step executed by the first device in aspects 41 to 43.

[0103] The 46th aspect of an embodiment of the present application provides a second device, comprising: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the second device executes any step executed by the second device in aspects 41 to 43.

[0104] The forty-seventh aspect of the embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored so that when the computer program is executed by a processor of a first device, the steps executed by the first device as described in any of the fourth aspects to the forty-third aspects are implemented; or, when the computer program is executed by a processor of a second device, the steps executed by the second device as described in any of the fourth aspects to the forty-third aspects are implemented; or, when the computer program is executed by a processor of a third device, the steps executed by the third device as described in any of the fourth aspects to the forty-third aspects are implemented.

[0105] It should be noted that in the embodiments of the present application, the interaction between the first device, the second device and the third device is used as an example to illustrate the specific device communication method. When one of the first device, the second device or the third device is used as the execution subject, the steps performed by each device can be selected in any of the above embodiments to obtain a unilateral implementation of the first device, the second device or the third device, which will not be repeated here. The functions of the second device and the third device are similar, and any steps performed in the second device can be applied to the third device if they do not conflict with the steps of the third device.

[0106] It should be noted that, in the above embodiments, the display screen of each device can be used to implement the display step. The first interface, the second interface, the third interface or the fourth interface, etc. described in the above embodiments are differentiated descriptions of different display interfaces of each device. In subsequent specific embodiments, the first interface, the second interface, the third interface or the fourth interface can be corresponded to the specific interface provided in the specific embodiment through text in combination with the specific content of the embodiment, which will not be repeated here.

[0107] It should be understood that the 42nd to 47th aspects of the embodiments of the present application correspond to the technical solutions of the 41st aspect of the embodiments of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here.

[0108] The fifth aspect of the embodiment of the present application provides a device communication method, which is applied to a system including a first device, a second device and a third device, and the method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to the second device and the third device; the second device displays a second interface according to the indication message, and the second interface includes a second edit box; the third device displays a third interface according to the indication message, and the third interface includes a third edit box; when there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box, and the third device synchronizes the editing state to the third edit box; or, when there is an editing state in the third edit box, the first device synchronizes the editing state to the first edit box, and the second device synchronizes the editing state to the second edit box; or, when there is an editing state in the first edit box, the second device synchronizes the editing state to the second edit box, and the third device synchronizes the editing state to the third edit box.

[0109] In the embodiment of the present application, the second device can work together with the third device to assist the first device in input, thereby achieving convenient and efficient input.

[0110] In a possible implementation, the second device includes an interface service, and the interface service is used for synchronizing the editing state between the first device and the second device. In this way, based on the interface service, the first device can be synchronized to any editing state of the second device.

[0111] In a possible implementation, the editing state includes one or more of the following: text content, a highlight mark of a cursor or text content.

[0112] In one possible implementation, the second device displays the second interface according to the indication message, including: the second device displays a notification interface in response to the indication message; the notification interface includes an option to confirm the auxiliary input; in response to the triggering operation of the option, the second device displays the second interface.

[0113] In a possible implementation, the second interface also includes: all or part of the content of the first interface. In this way, the user can see the situation in the first device on the second device, which is convenient for the user to understand the dynamics of the auxiliary first device.

[0114] In a possible implementation, the second edit box is displayed in layers with all or part of the content of the first interface, and the second edit box is displayed on an upper layer of all or part of the content of the first interface.

[0115] In one possible implementation, after the second device displays the second interface according to the indication message, the method further includes: in response to triggering the second edit box, the second device displays a virtual keyboard; the second device displays the editing status in the second edit box according to the virtual keyboard and / or the input operation received in the second edit box.

[0116] In a possible implementation, the first device includes any one of the following: a television, a large screen, or a wearable device; the second device or the third device includes any one of the following: a mobile phone, a tablet, or a wearable device.

[0117] In a possible implementation, the editing state in the first edit box includes an identifier of the first device, and / or the editing state in the second edit box includes an identifier of the second device, and / or the editing state in the third edit box includes an identifier of the first device.

[0118] In a possible implementation, when input content is received in the second edit box and the third edit box at the same time, the first device determines the input content of the second edit box and the display mode of the third edit box.

[0119] A fifth aspect of an embodiment of the present application provides a device communication method, which is applied to a system including a first device, a second device and a third device, and the method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to the second device; the second device displays a second interface according to the indication message, and the second interface includes a second edit box; the second device sends an auxiliary input request to the third device; the third device displays a third interface according to the auxiliary input request, and the third interface includes a third edit box; when there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box, and the third device synchronizes the editing state to the third edit box; or, when there is an editing state in the third edit box, the first device synchronizes the editing state to the first edit box, and the second device synchronizes the editing state to the second edit box; or, when there is an editing state in the first edit box, the second device synchronizes the editing state to the second edit box, and the third device synchronizes the editing state to the third edit box.

[0120] It should be noted that any possible implementation method in the fifth aspect, as long as it does not conflict with the method provided by the fifty-second aspect, can be used to limit the method provided by the fifty-second aspect, and will not be repeated here.

[0121] A fifth aspect of an embodiment of the present application provides a device communication method, which is applied to a system including a first device, a second device and a third device, and the method includes: the second device displays a fourth interface including options of the first device; in response to a selection operation on the options of the first device, the second device sends an indication message to the first device; the first device displays a first interface including a first edit box; the second device displays a second interface, and the second interface includes a second edit box; the second device sends an auxiliary input request to the third device; the third device displays a third interface according to the auxiliary input request, and the third interface includes a third edit box; when there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box, and the third device synchronizes the editing state to the third edit box; or, when there is an editing state in the third edit box, the first device synchronizes the editing state to the first edit box, and the second device synchronizes the editing state to the second edit box; or, when there is an editing state in the first edit box, the second device synchronizes the editing state to the second edit box, and the third device synchronizes the editing state to the third edit box.

[0122] It should be noted that any possible implementation method in the fifth aspect, as long as it does not conflict with the method provided by the fifty-third aspect, can be used to limit the method provided by the fifty-third aspect, and will not be repeated here.

[0123] A fifty-fourth aspect of an embodiment of the present application provides a device communication method, which is applied to a first device, and the method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to a second device and a third device; the second device displays a second interface according to the indication message, and the second interface includes a second edit box, and the third device displays a third interface according to the indication message, and the third interface includes a third edit box; when there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box; or, when there is an editing state in the third edit box, the first device synchronizes the editing state to the first edit box.

[0124] It should be noted that any possible implementation method in the fifth aspect, as long as it does not conflict with the method provided by the fifty-fourth aspect, can be used to limit the method provided by the fifty-fourth aspect, and will not be repeated here.

[0125] A fifty-fifth aspect of an embodiment of the present application provides a device communication method, which is applied to a second device, and the method includes: the second device displays a fourth interface including options of the first device; in response to a selection operation on an option of the first device, the second device sends an indication message to the first device; the first device displays a first interface including a first edit box; the second device displays a second interface, the second interface including a second edit box; the second device sends an auxiliary input request to a third device; the third device displays a third interface based on the auxiliary input request, the third interface including a third edit box; when there is an editing state in the third edit box, the second device synchronizes the editing state to the second edit box; or, when there is an editing state in the first edit box, the second device synchronizes the editing state to the second edit box.

[0126] It should be noted that any possible implementation method in the fifth aspect, as long as it does not conflict with the method provided in the fifty-fifth aspect, can be used to limit the method provided in the fifty-fifth aspect, and will not be repeated here.

[0127] The fifth and sixth aspects of the embodiments of the present application provide a device communication system, including a first device, a second device and a third device, the first device is used to execute the steps of the first device in any of the fifth aspects to the fifth fifth aspects, the second device is used to execute the steps of the second device in any of the fifth aspects to the fifth fifth aspects, and the third device is used to execute the steps of the third device in any of the fifth aspects to the fifth fifth aspects.

[0128] The fifty-seventh aspect of an embodiment of the present application provides a first device, comprising: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the first device executes any step executed by the first device in aspects from the fifty-first aspect to the fifty-fifth aspect.

[0129] The fifty-eighth aspect of the embodiment of the present application provides a second device, comprising: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the second device executes any step executed by the second device in aspects from the fifth to the fifth fifth.

[0130] A fifty-ninth aspect of an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored so that when the computer program is executed by a processor of a first device, the steps executed by the first device as described in any of the fifth aspects to the fifty-fifth aspects are implemented; or, when the computer program is executed by a processor of a second device, the steps executed by the second device as described in any of the fifth aspects to the fifty-fifth aspects are implemented; or, when the computer program is executed by a processor of a third device, the steps executed by the third device as described in any of the fifth aspects to the fifty-fifth aspects are implemented.

[0131] It should be noted that in the embodiments of the present application, the interaction between the first device, the second device and the third device is used as an example to illustrate the specific device communication method. When one of the first device, the second device or the third device is used as the execution subject, the steps performed by each device can be selected in any of the above embodiments to obtain a unilateral implementation of the first device, the second device or the third device, which will not be repeated here. The functions of the second device and the third device are similar, and any steps performed in the second device can be applied to the third device if they do not conflict with the steps of the third device.

[0132] It should be noted that, in the above embodiments, the display screen of each device can be used to implement the display step. The first interface, the second interface, the third interface or the fourth interface, etc. described in the above embodiments are differentiated descriptions of different display interfaces of each device. In subsequent specific embodiments, the first interface, the second interface, the third interface or the fourth interface can be corresponded to the specific interface provided in the specific embodiment through text in combination with the specific content of the embodiment, which will not be repeated here.

[0133] It should be understood that the fifty-second to fifty-ninth aspects of the embodiments of the present application correspond to the technical solutions of the fifty-first aspect of the embodiments of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated herein. BRIEF DESCRIPTION OF THE DRAWINGS

[0134] Figure 1 A schematic diagram of the architecture of a communication system provided by an embodiment of the present application is shown;

[0135] Figure 2 A schematic diagram of the architecture of another communication system provided in an embodiment of the present application is shown;

[0136] Figure 3 A schematic diagram of the architecture of another communication system provided in an embodiment of the present application is shown;

[0137] Figure 4 A functional schematic block diagram of a first device provided in an embodiment of the present application is shown;

[0138] Figure 5 A functional schematic block diagram of a second device provided in an embodiment of the present application is shown;

[0139] Figure 6 A schematic diagram of the software architecture of a first device and a second device provided in an embodiment of the present application is shown;

[0140] Figure 7 A schematic diagram of the system architecture of a device communication method provided in an embodiment of the present application is shown;

[0141] Figure 8A schematic diagram of a specific system architecture of a device communication method provided in an embodiment of the present application is shown;

[0142] Fig. 9 A schematic diagram of a large-screen user interface provided in an embodiment of the present application is shown;

[0143] Fig.10 A schematic diagram of a mobile phone user interface provided by an embodiment of the present application is shown;

[0144] Fig.11 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0145] Fig.12 A schematic diagram of a user interface provided by an embodiment of the present application is shown;

[0146] Fig.13 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0147] Fig.14 Another large-screen user interface schematic diagram provided in an embodiment of the present application is shown;

[0148] Fig.15 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0149] Fig.16 Another large-screen user interface schematic diagram provided in an embodiment of the present application is shown;

[0150] Fig.17 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0151] Fig.18 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0152] Fig.19 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0153] Fig. 20 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0154] Fig.21 Another user interface schematic diagram provided by an embodiment of the present application is shown;

[0155] Fig. 22 A schematic diagram of another user interface provided by an embodiment of the present application is shown;

[0156] Fig.23 A schematic diagram of a specific process of communication between a mobile phone and a large screen provided in an embodiment of the present application is shown;

[0157] Fig.24 A schematic diagram of the structure of a device provided in an embodiment of the present application;

[0158] Fig.25 A schematic diagram of the structure of another device according to an embodiment of the present application;

[0159] Fig.26 A schematic diagram of the system architecture of another device communication method provided in an embodiment of the present application is shown;

[0160] Fig. 27 A schematic diagram of a large-screen user interface provided in an embodiment of the present application is shown;

[0161] Fig.28 A schematic diagram of a user interface of a mobile phone provided in an embodiment of the present application is shown;

[0162] Fig.29 A schematic diagram of a large-screen user interface provided in an embodiment of the present application is shown;

[0163] Fig.30 A schematic diagram of a user interface of another mobile phone provided in an embodiment of the present application is shown;

[0164] Fig.31 A schematic diagram of a user interface of another mobile phone provided in an embodiment of the present application is shown;

[0165] Fig.32 A schematic diagram of a mobile phone auxiliary large-screen input interface provided in an embodiment of the present application is shown;

[0166] Fig.33 Another schematic diagram of a mobile phone auxiliary large-screen input interface provided in an embodiment of the present application is shown;

[0167] Fig.34 A schematic diagram of a mobile phone auxiliary large-screen input interface provided in an embodiment of the present application is shown;

[0168] Fig.35 A schematic diagram of a mobile phone interface provided by an embodiment of the present application is shown;

[0169] Fig.36 A schematic diagram of the structure of a device provided in an embodiment of the present application;

[0170] Fig.37 A schematic diagram of the structure of another device according to an embodiment of the present application;

[0171] Fig.38 A schematic diagram of a user interface for communication between a mobile phone and a large screen provided in an embodiment of the present application is shown;

[0172] Fig.39A schematic diagram of a specific system architecture of a device communication method provided in an embodiment of the present application is shown;

[0173] Fig.40 A schematic diagram of a process of communication between a mobile phone and a large screen provided in an embodiment of the present application is shown;

[0174] Fig.41 A schematic diagram of a large-screen user interface provided in an embodiment of the present application is shown;

[0175] Fig.42 A schematic diagram of a mobile phone user interface provided by an embodiment of the present application is shown;

[0176] Fig.43 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0177] Fig.44 Another large-screen user interface schematic diagram provided in an embodiment of the present application is shown;

[0178] Fig.45 A schematic diagram of a mobile phone user interface provided by an embodiment of the present application is shown;

[0179] Fig.46 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0180] Fig.47 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0181] Fig.48 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0182] Fig.49 A schematic diagram of another mobile phone user interface provided by an embodiment of the present application is shown;

[0183] Fig.50 A schematic diagram of another mobile phone user interface provided by an embodiment of the present application is shown;

[0184] Fig.51 A schematic diagram of a specific process of communication between a mobile phone and a large screen provided in an embodiment of the present application is shown;

[0185] Fig.52 A schematic diagram of the structure of a device provided in an embodiment of the present application;

[0186] Fig.53 A schematic diagram of the structure of another device according to an embodiment of the present application;

[0187] Fig.54 A schematic diagram of a specific application scenario of an embodiment of the present application is shown;

[0188] Fig.55 A schematic diagram of a specific system architecture of a device communication method provided in an embodiment of the present application is shown;

[0189] Fig.56 A schematic diagram of a mobile phone user interface provided by an embodiment of the present application is shown;

[0190] Fig.57 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0191] Fig.58 A schematic diagram of a large-screen user interface provided in an embodiment of the present application is shown;

[0192] Fig.59 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0193] Fig.60 A schematic diagram of a user interface for communication between a mobile phone and a large screen provided in an embodiment of the present application is shown;

[0194] Fig.61 Another large-screen user interface schematic diagram provided in an embodiment of the present application is shown;

[0195] Fig.62 A schematic diagram of a mobile phone user interface provided by an embodiment of the present application is shown;

[0196] Fig.63 A schematic diagram of a mobile phone user interface provided by an embodiment of the present application is shown;

[0197] Fig.64 Another mobile phone user interface schematic diagram provided by an embodiment of the present application is shown;

[0198] Fig.65 A schematic diagram of another mobile phone user interface provided by an embodiment of the present application is shown;

[0199] Fig.66 A schematic diagram of the structure of a device provided in an embodiment of the present application;

[0200] Fig.67 A schematic diagram of the structure of another device according to an embodiment of the present application;

[0201] Fig.68 A schematic diagram of the system architecture of another device communication method provided in an embodiment of the present application is shown;

[0202] Fig.69 A schematic diagram of a large screen interface provided by an embodiment of the present application is shown;

[0203] Fig.70A schematic diagram of a mobile phone interface provided by an embodiment of the present application is shown;

[0204] Fig.71 Another mobile phone interface schematic diagram provided by an embodiment of the present application is shown;

[0205] Fig.72 A schematic diagram of a mobile phone interface provided by an embodiment of the present application is shown;

[0206] Fig.73 Another mobile phone interface schematic diagram provided by an embodiment of the present application is shown;

[0207] Fig.74 Another mobile phone interface schematic diagram provided by an embodiment of the present application is shown;

[0208] Fig.75 A schematic diagram of the system architecture of another device communication method provided in an embodiment of the present application is shown;

[0209] Fig.76 A schematic diagram of a mobile phone auxiliary large-screen input interface provided in an embodiment of the present application is shown;

[0210] Fig.77 Another schematic diagram of a mobile phone auxiliary large-screen input interface provided in an embodiment of the present application is shown;

[0211] Fig.78 A schematic diagram of a mobile phone auxiliary large-screen input interface provided in an embodiment of the present application is shown;

[0212] Fig.79 A schematic diagram of a mobile phone auxiliary large-screen input interface provided in an embodiment of the present application is shown;

[0213] Fig.80 A schematic diagram of a mobile phone auxiliary large-screen input interface provided in an embodiment of the present application is shown;

[0214] Fig.81 A schematic diagram of the system architecture of another device communication method provided in an embodiment of the present application is shown;

[0215] Fig.82 A schematic diagram of a mobile phone auxiliary large-screen input interface provided in an embodiment of the present application is shown;

[0216] Fig.83 A schematic diagram of generating a circulating chain provided by an embodiment of the present application is shown;

[0217] Fig.84 A schematic diagram of the system architecture of another device communication method provided in an embodiment of the present application is shown;

[0218] Fig.85A schematic diagram of a mobile phone interface provided by an embodiment of the present application is shown;

[0219] Fig.86 A schematic diagram of the structure of a device provided in an embodiment of the present application;

[0220] Fig.87 This is a schematic diagram of the structure of another device according to an embodiment of the present application. DETAILED DESCRIPTION

[0221] In order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first", "second" and the like are used to distinguish the same items or similar items with substantially the same functions and effects. For example, the first device and the second device are only used to distinguish different devices, and their order is not limited. Those skilled in the art can understand that the words "first", "second" and the like do not limit the quantity and execution order, and the words "first", "second" and the like do not necessarily limit them to be different.

[0222] It should be noted that, in this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0223] In the present application, "at least one" means one or more, and "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0224] Figure 1 FIG. 1 is a schematic diagram showing an architecture of a communication system provided by an embodiment of the present application. Figure 1 As shown, the communication system may include: a first device 101 and a second device 102 .

[0225] Among them, the first device 101 can be a device that is inconvenient for users to edit text and other content, or it can be understood as an auxiliary device with weak input capabilities, such as a TV, a smart screen (or a large screen), a smart watch, etc. In a possible implementation, the first device 101 may also include a camera (not shown in the figure), etc., and the embodiment of the present application does not specifically limit the first device 101. Usually, when inputting text and other content in the first device 101, the user is required to use the remote control 103 to select pinyin in turn and press the confirmation key, which is cumbersome and inefficient.

[0226] The second device 102 may be a device that is convenient for users to edit text and other content, or may be understood as an auxiliary device with strong input capabilities, such as a mobile phone, a tablet, a computer, etc. The present embodiment of the application does not limit the specific types of the first device 101 and the second device 102. For ease of explanation, the present embodiment of the application takes the first device 101 as a large screen as an example, and takes the second device 102 as a mobile phone as an example.

[0227] In a possible implementation, the mobile phone and the large screen can be connected by wire or wirelessly. For example, the wireless connection may include: wireless fidelity (Wi-Fi) connection, Bluetooth connection or ZigBee connection, etc., which is not limited in the embodiments of the present application. Based on the method of the subsequent embodiments of the present application, the user can assist the large screen input in the mobile phone.

[0228] For example, the user moves options on the large screen using the remote control and selects an edit box on the large screen, and an auxiliary input dialog box may pop up in the mobile phone communicating with the large screen. The user uses the mobile phone's input method soft keyboard to enter text and other content in the edit box of the mobile phone dialog box, and the content may be displayed on the large screen. After the user confirms that the input is complete on the mobile phone, functions such as searching for programs on the large screen can be implemented based on the content entered by the user on the mobile phone.

[0229] In some embodiments, the number of mobile phones may be multiple. Figure 2 FIG. 2 shows a schematic diagram of another architecture of a communication system provided by an embodiment of the present application. Figure 2 As shown, the communication system may include: a large screen 201 , a first mobile phone 202 , and a second mobile phone 203 .

[0230] In a possible embodiment, the large screen 201, the first mobile phone 202, and the second mobile phone 203 are in a distributed network, and the distributed network can support the large screen 201, the first mobile phone 202, and the second mobile phone 203 to achieve communication connection. In the same distributed network, a client can simultaneously connect to multiple servers for distributed input, and a server can also be connected to multiple clients at the same time. For example, in the same distributed network, the large screen 201 with weak input capability can be used as a client of distributed input, and the mobile phones 101 and 102 with strong input capabilities can be used as servers of distributed input.

[0231] Based on the distributed networking architecture, the large screen 201, the first mobile phone 202 and the second mobile phone 203 can realize one or more functions such as device discovery, device connection or data transmission with each other.

[0232] Exemplarily, after the large screen 201, the first mobile phone 202, and the second mobile phone 203 join the distributed network, mutual device discovery and device connection can be achieved. Furthermore, the first mobile phone 202 and the second mobile phone 203 can simultaneously assist the large screen 201 in inputting text and other content. Or the first mobile phone 202 and the second mobile phone 203 can respectively assist the large screen 201 in inputting text and other content. Or the first mobile phone 202 or the second mobile phone 203 can be one of the mobile phones assisting the large screen 201 in inputting, while the other mobile phone takes over the input. Or the large screen 201 can select the first mobile phone 202 or the second mobile phone 203 to assist it in inputting, etc. The specific process of assisting input or preempting input will be described in detail in subsequent embodiments and will not be repeated here.

[0233] In some embodiments, there may be multiple mobile phones and multiple large screens. Figure 3 FIG. 2 shows a schematic diagram of another architecture of a communication system provided by an embodiment of the present application. Figure 3 As shown, the communication system may include: a first large screen 301 , a second large screen 302 , a first mobile phone 303 and a second mobile phone 304 .

[0234] In a possible embodiment, the first large screen 301, the second large screen 302, the first mobile phone 303 and the second mobile phone 304 are in a distributed network. Based on the architecture of the distributed network, the first large screen 301, the second large screen 302, the first mobile phone 303 and the second mobile phone 304 can realize functions such as device discovery, device connection or data transmission with each other.

[0235] Exemplarily, after the first large screen 301, the second large screen 302, the first mobile phone 303 and the second mobile phone 304 join the distributed networking, mutual device discovery and device connection can be achieved. Furthermore, the first mobile phone 303 and the second mobile phone 304 can simultaneously assist the first large screen 301 and / or the second large screen 302 in inputting text and other content. Or the first mobile phone 303 and the second mobile phone 304 can respectively assist the first large screen 301 and / or the second large screen 302 in inputting text and other content. Or the first mobile phone 303 or the second mobile phone 304 can assist the first large screen 301 and / or the second large screen 302 in inputting, while the other one preempts the input. Or the first large screen 301 and / or the second large screen 302 can select the first mobile phone 303 or the second mobile phone 304 to assist it in inputting, etc. The specific process of assisting input or preempting input will be described in detail in subsequent embodiments and will not be repeated here.

[0236] Figure 4 FIG. 1 shows a functional block diagram of a first device provided in an embodiment of the present application. In a possible implementation, Figure 4 As shown, the first device 400 may include: a processor 401, a memory 402, a communication interface 403, a speaker 404, a display 405, etc. These components may communicate via one or more communication buses or signal lines (not shown in the figure).

[0237] Combine the following Figure 4 The components of the first device 400 are described in detail:

[0238] The processor 401 is the control center of the first device 400. It uses various interfaces and lines to connect various parts of the first device 400, and executes various functions and processes data of the first device 400 by running or executing applications stored in the memory 402 and calling data stored in the memory 402.

[0239] In some embodiments, the processor 401 may include one or more processing units, for example, the processor 401 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Among them, different processing units may be independent devices or integrated into one or more processors. Among them, the controller may be the nerve center and command center of the first device 400. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. In other embodiments, a memory may also be provided in the processor 401 for storing instructions and data. In some embodiments, the memory in the processor 401 is a high-speed cache memory. The memory may store instructions or data that the processor 401 has just used or circulated. If the processor 401 needs to use the instruction or data again, it may be directly called from the memory, avoiding repeated access, reducing the waiting time of the processor 401, and thus improving the efficiency of the system. The processor 401 can run the software code / module of the device communication method provided in some embodiments of the present application to implement the function of controlling the first device 400.

[0240] The memory 402 is used to store applications and data. The processor 401 executes various functions and data processing of the first device 400 by running the applications and data stored in the memory 402. The memory 402 mainly includes a program storage area and a data storage area, wherein the program storage area can store an operating system (OS) and applications required for at least one function (such as a device discovery function, a video search function, a video playback function, etc.); the data storage area can store data created when using the first device (such as audio and video data, etc.). In addition, the memory 402 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as a disk storage device, a flash memory device or other volatile solid-state storage device. In some embodiments, the memory 402 can store various operating systems. The above-mentioned memory 402 can be independent and connected to the processor 401 through the above-mentioned communication bus; the memory 402 can also be integrated with the processor 401.

[0241] The communication interface 403 may be a wired interface (eg, an Ethernet interface) or a wireless interface (eg, a cellular network interface or a wireless local area network interface). For example, the communication interface 403 may be specifically used to communicate with one or more second devices.

[0242] The speaker 404 , also called a “speaker”, is used to convert an audio electrical signal into a sound signal. The first device 400 can play the sound signal through the speaker 404 .

[0243] The display 405 (or display screen, screen, etc.) can be used to display the display interface of the application, such as the interface for searching videos or the currently playing video screen, etc. The display 405 may include a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode or an active matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, a touch sensor may be provided in the display 405 to form a touch screen, which is not limited in this application. The touch sensor is used to detect a touch operation acting on or near it. The touch sensor may transmit the detected touch operation to the processor 401 to determine the type of touch event. The processor 401 may provide a visual output related to the touch operation through the display 405.

[0244] In addition, the first device 400 may also include a power supply device 406 (such as a battery and a power management chip) for supplying power to each component. The battery can be logically connected to the processor 401 through the power management chip, so that functions such as charging, discharging, and power consumption management can be managed through the power supply device 406.

[0245] In addition, the first device 400 may further include a sensor module (not shown in the figure), and the sensor module may include an air pressure sensor, a temperature sensor, etc. In practical applications, the first device 400 may also include more or fewer sensors, or use other sensors with the same or similar functions to replace the above-listed sensors, etc., which is not limited in this application.

[0246] Understandably, Figure 4The device structure shown in the figure does not constitute a specific limitation on the first device. In other embodiments, the first device may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0247] Figure 5 FIG. 5 shows a functional block diagram of a second device 500 provided in an embodiment of the present application. Figure 5 As shown, the second device 500 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0248] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the second device 500. In other embodiments of the present application, the second device 500 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0249] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0250] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0251] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0252] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0253] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface to realize the touch function of the second device 500.

[0254] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.

[0255] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to implement the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0256] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0257] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the second device 500. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the second device 500.

[0258] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0259] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the second device 500, and can also be used to transmit data between the second device 500 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0260] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is a schematic illustration and does not constitute a structural limitation on the second device 500. In other embodiments of the present application, the second device 500 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0261] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the second device 500. While the charging management module 140 is charging the battery 142, it may also power the terminal device through the power management module 141.

[0262] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0263] The wireless communication function of the second device 500 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0264] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. The antenna in the second device 500 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0265] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied on the second device 500. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0266] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0267] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied on the second device 500. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and filters it, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0268] In some embodiments, the antenna 1 of the second device 500 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the second device 500 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. GNSS may include the global positioning system (GPS), the global navigation satellite system (GLONASS), the Beidou navigation satellite system (BDS), the quasi-zenith satellite system (QZSS) and / or the satellite based augmentation system (SBAS).

[0269] The second device 500 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0270] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the second device 500 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0271] The second device 500 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0272] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0273] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the second device 500 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0274] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the second device 500 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0275] The video codec is used to compress or decompress digital video. The second device 500 may support one or more video codecs. Thus, the second device 500 may play or record videos in multiple coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0276] NPU is a neural network (NN) computing processor, which can quickly process input information and continuously self-learn by drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain. NPU can realize applications such as intelligent cognition of the second device 500, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0277] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the second device 500. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0278] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the second device 500 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the second device 500 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0279] The second device 500 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0280] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0281] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The second device 500 can listen to music or listen to a hands-free call through the speaker 170A.

[0282] The receiver 170B, also called a "earpiece", is used to convert an audio electrical signal into a sound signal. When the second device 500 receives a call or a voice message, the voice can be received by placing the receiver 170B close to the ear.

[0283] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 170C with his mouth to input the sound signal into the microphone 170C. The second device 500 can be provided with at least one microphone 170C. In other embodiments, the second device 500 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the second device 500 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0284] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0285] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The second device 500 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the second device 500 detects the intensity of the touch operation based on the pressure sensor 180A. The second device 500 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions.

[0286] The gyroscope sensor 180B can be used to determine the motion posture of the second device 500. In some embodiments, the angular velocity of the second device 500 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. Exemplarily, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shaking of the second device 500, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the second device 500 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0287] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the second device 500 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0288] The magnetic sensor 180D includes a Hall sensor. The second device 500 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the second device 500 is a flip phone, the second device 500 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover automatic unlocking and other features are set.

[0289] The acceleration sensor 180E can detect the magnitude of the acceleration of the second device 500 in various directions (generally three axes). When the second device 500 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the terminal device and applied to applications such as horizontal and vertical screen switching and pedometers.

[0290] The distance sensor 180F is used to measure the distance. The second device 500 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the second device 500 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0291] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The second device 500 emits infrared light outward through the light emitting diode. The second device 500 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the second device 500. When insufficient reflected light is detected, the second device 500 can determine that there is no object near the second device 500. The second device 500 can use the proximity light sensor 180G to detect that the user holds the second device 500 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0292] The ambient light sensor 180L is used to sense the brightness of the ambient light. The second device 500 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the second device 500 is in a pocket to prevent accidental touch.

[0293] The fingerprint sensor 180H is used to collect fingerprints. The second device 500 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0294] The temperature sensor 180J is used to detect temperature. In some embodiments, the second device 500 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the second device 500 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the second device 500 heats the battery 142 to avoid abnormal shutdown of the second device 500 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the second device 500 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0295] The touch sensor 180K is also called a "touch control device". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch control screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the second device 500, which is different from the position of the display screen 194.

[0296] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.

[0297] The button 190 includes a power button, a volume button, etc. The button 190 may be a mechanical button or a touch button. The second device 500 may receive the button input and generate a key signal input related to the user setting and function control of the second device 500.

[0298] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0299] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0300] The SIM card interface 195 is used to connect a SIM card. The SIM card can be contacted and separated from the second device 500 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The second device 500 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The second device 500 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the second device 500 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the second device 500 and cannot be separated from the second device 500.

[0301] The software systems of the first device 400 and the second device 500 can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture, etc. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the first device 400 and the second device 500.

[0302] Figure 6 The left figure shows a software architecture block diagram of a first device provided in an embodiment of the present application. The software system of the first device can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The present embodiment of the present application takes the Android system as an example for the operating system of the first device. Figure 6 As shown, the Android system is divided into four layers, which are application layer, application framework layer, Android runtime and system library, and kernel layer from top to bottom.

[0303] The application layer can include a series of application packages.

[0304] like Figure 6 As shown, the application layer may include one or more applications such as gallery, calendar, music, video, on-demand, smart home or device control.

[0305] Among them, an input box can be provided in any of the above applications, so that the user can enter keywords in the input box to implement operations such as searching in the application.

[0306] Smart home applications can be used to control or manage home devices with networking functions. For example, home devices may include lights, air conditioners, anti-theft door locks, speakers, sweeping robots, sockets, body fat scales, desk lamps, air purifiers, refrigerators, washing machines, water heaters, microwave ovens, rice cookers, curtains, fans, televisions, set-top boxes, doors and windows, etc.

[0307] The device control application is used to control or manage a single device (eg, the first device).

[0308] In addition, the application layer may also include system applications such as a control center and / or a notification center.

[0309] The control center is a pull-down message notification bar of the first device, such as the user interface displayed by the first device when the user performs a downward operation on the first device. The notification center is a pull-up message notification bar of the first device, that is, the user interface displayed by the first device when the user performs an upward operation on the first device.

[0310] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0311] like Figure 6 As shown, the application framework layer may include one or more of a window manager, a content provider, a resource manager, a view system, a notification manager, a distributed networking framework, a remote input service or an input method framework, and the like.

[0312] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, touch the screen, drag the screen, capture the screen, etc.

[0313] Content providers are used to store and retrieve data and make it accessible to applications. The data can include videos, images, audio, browsing history, and bookmarks.

[0314] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0315] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0316] The notification manager allows applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of an icon or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is emitted, and the indicator light flashes.

[0317] The distributed networking framework enables the first device to discover other devices in the same distributed networking and then establish communication connections with other devices.

[0318] The remote input service (may also be referred to as remote input atomic ability (AA)) enables a first device to receive remote input from another device.

[0319] The input method framework can support the first device to input content in the input box.

[0320] Android runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0321] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0322] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0323] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0324] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0325] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0326] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0327] A 2D graphics engine is a drawing engine for 2D drawings.

[0328] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0329] Figure 6 The figure on the right shows a software architecture block diagram of a second device provided in an embodiment of the present application. Figure 6 As shown, the Android system is divided into four layers, which are application layer, application framework layer, Android runtime and system library, and kernel layer from top to bottom.

[0330] The application layer can include a series of application packages.

[0331] like Figure 6 As shown, the application package may include applications such as camera, calendar, phone, map, call, music, settings, mailbox, video, social, etc.

[0332] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0333] like Figure 6 As shown, the application framework layer may include one or more of a window manager, a content provider, a resource manager, a view system, a notification manager, a distributed networking framework, an input method framework, or an interface service.

[0334] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, touch the screen, drag the screen, capture the screen, etc.

[0335] Content providers are used to store and retrieve data and make it accessible to applications. The data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0336] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0337] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0338] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, the terminal device vibrates, the indicator light flashes, etc.

[0339] The distributed networking framework enables the second device to discover other devices in the same distributed networking and then establish communication connections with other devices.

[0340] The input method framework can support the second device to input content in the input box.

[0341] The interface service may define an interface between the second device and other devices, so that the second device and other devices can implement data transmission based on the interface defined by the interface service. In a possible implementation, the interface service may include: auxiliary AA, wherein the atomic ability (AA) is developed by a developer and is a program entity that implements a single function and may have no user interface (UI).

[0342] Android runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0343] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0344] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0345] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0346] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0347] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0348] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0349] A 2D graphics engine is a drawing engine for 2D drawings.

[0350] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0351] based on Figure 6 The software architecture of the first device and the second device shown, in the embodiment of the present application, the first device and the second device can use their respective distributed networking frameworks to implement communication services such as access to distributed networking, device discovery or data transmission. For example, after the first device and the second device access the distributed networking, the first device can pull up the interface service of the second device based on the remote input service, and then use the interface service of the second device to call the input method framework of the second device to implement the use of the input method framework of the second device to assist the first device in input. The remote input service of the first device can also send the content input based on the input method framework of the first device to the second device through the interface service of the second device, etc.

[0352] Among the possible ways of understanding, Figure 6 A corresponding embodiment is to set up an interface service (such as auxiliary AA) in the framework layer of the second device. Through the interface service, it is similar to building a bridge between the input method framework of the first device and the second device, so that the first device can pull up the input method framework of the second device. Then, the content input using the input method framework of the second device can be displayed identically in the input box of the first device (for example, the cursor, highlight and other contents in the input box of the second device can all be displayed in the input box of the first device), thereby realizing the use of the second device to assist the input of the first device.

[0353] It should be understood that in possible implementations, the interface service (such as auxiliary AA) can also be implemented in the form of an application. For example, an application (application, APP) for implementing the interface service of the embodiment of the present application can be developed, and then the application can be loaded in the mobile phone to implement the functions of the above-mentioned interface service of the embodiment of the present application based on the application. In possible implementations, the application may have an application icon displayed in the user interface (or it can be understood that the user can perceive the application), and the application may not have an application icon displayed in the user interface (or it can be understood that the user does not perceive the application). The embodiment of the present application does not limit the specific implementation of the interface service. For the convenience of description, the interface service is schematically illustrated as auxiliary AA in the following.

[0354] Next, combine Figure 7 , the specific implementation process of mobile phone assisted large-screen input is given as an example.

[0355] Figure 7 FIG. 1 shows a system architecture diagram of a device communication method provided by an embodiment of the present application. Figure 7 As shown, the client (large screen) can set up an application edit box (or search box), a database, and a remote input method framework service (or remote input service). The server (mobile phone) can set up an auxiliary AA, a notification manager (or simply notification), a window manager (or simply window), a database, and an input method framework.

[0356] The application edit box in the large screen may be provided by the input method framework of the large screen, and the application edit box in the large screen may receive input from a remote controller, etc. When the application edit box is selected by the remote controller, the subsequent auxiliary input may be triggered. Alternatively, when the application edit box is selected by the remote controller and content is selected in the soft keyboard (or virtual keyboard) corresponding to the application edit box, the subsequent auxiliary input may be triggered.

[0357] The database in the large screen can store the association between keywords and programs, etc. For example, after the large screen obtains keywords in the application editing box, it can search for programs based on the association between keywords and programs in the database.

[0358] The remote input method framework service in the large screen can enable the large screen to receive remote input. Exemplarily, the remote input method framework may include the local input method framework and the remote input service AA of the large screen. Based on the remote input service AA, the interface between the large screen and the external device can be defined, so that the large screen can receive remote input from the external device through the interface. For example, the remote input service AA on the large screen (or it can be called the remote input service AA interface) may include one or more of the following interfaces: an interface for externally setting text to the large screen, an interface for externally applying for focus switching to the large screen, an interface for externally registering callbacks to the large screen or providing for use with a small keyboard, etc.

[0359] The auxiliary AA in the mobile phone can define the interface between the mobile phone and other devices, so that the mobile phone and other devices can realize data transmission based on the interface defined by the interface service. For example, the mutual call between the local input method framework of the mobile phone and the remote input method framework of the large screen can be established based on the auxiliary AA, so that any content entered in the local input method framework of the mobile phone can be synchronously displayed in the edit box of the large screen.

[0360] In a possible implementation, the mutual call between the local input method framework of the mobile phone and the remote input method framework of the large screen based on the auxiliary AA includes: the large screen remote input method framework and the auxiliary AA hold each other's remote procedure call (RPC) objects. Then, when the large screen and the mobile phone interact with each other, they can call the device process of the other party according to the RPC object of the other party, and notify the device process of the other party to call the local interface of the other party to perform the adaptation operation.

[0361] The notification manager in the mobile phone can display the notification content in the mobile phone interface based on the operation of obtaining the edit box focus on the large screen, and prompt the mobile phone user to perform auxiliary input on the large screen.

[0362] The window manager in the mobile phone can display the user interface, such as the notification interface, the auxiliary input interface, etc.

[0363] The database in the mobile phone can store the association relationship between keywords and candidate content. For example, after the input method edit box of the mobile phone obtains the keywords, the candidate content can be displayed based on the association relationship between the keywords and the candidate content in the database.

[0364] The input method framework in the mobile phone can provide a convenient input method implementation.

[0365] Among them, both large screens and mobile phones can join the distributed network to realize device discovery, communication connection establishment and data transmission in the distributed network. Since joining the distributed network is a relatively common technology, it will not be repeated here.

[0366] In such Figure 7In the system architecture diagram of the device communication method shown, when the large screen and the mobile phone join a distributed network, the database of the large screen (e.g., a candidate word library) and the database of the mobile phone (e.g., a candidate word library) can be synchronized, so that the large screen and the mobile phone can share each other's databases, so that the user can realize more convenient candidate word selection based on the candidate word libraries in the large screen and the mobile phone.

[0367] For example, after the user uses a remote control or other device to select the edit box of the large screen, the large screen can start the local input method channel through the remote input method framework and pass it to the remote input method framework. The remote input method framework (IMF) queries the distributed networking framework for the auxiliary AA in the current distributed network (it should be understood that the auxiliary AA is used as an example here, and it can actually be any application process in the mobile phone that can carry relevant capabilities). The mobile phone returns the RPC object of the auxiliary AA to the large screen, and then the mobile phone calls the interface to pass the RPC object of the input channel of the large screen to the mobile phone. Subsequently, the mobile phone can synchronize the editing status information to the large screen through the RPC object of the input channel of the large screen, and the large screen can also synchronize the editing status information to the mobile phone through the RPC object of the input channel of the mobile phone.

[0368] The auxiliary AA in the mobile phone can further instruct the notification manager to pop up a notification. When the mobile phone receives the user's confirmation by clicking the notification, it can further pop up an input box in the window of the mobile phone, pull up the local input method in the local input method framework of the mobile phone, and then synchronize the content input by the mobile phone user using the local input method to the remote input method framework service of the large screen, so that the content in the mobile phone input box can be synchronously displayed in the edit box on the large screen.

[0369] In a possible implementation of using a mobile phone to assist large-screen input, after a user enters a keyword in an edit box on the mobile phone, the keyword and other information in the edit box on the mobile phone can be synchronized to the edit box on the large screen, thereby improving the efficiency of input on the large screen.

[0370] In a common implementation, when a user uses mobile phone A to assist in large-screen input, if mobile phone A is interrupted during the process of assisting in large-screen input, for example, mobile phone A receives an incoming call during the process of assisting in large-screen input, the auxiliary input of mobile phone A may be interrupted, and mobile phone A cannot continue to assist in large-screen input. Alternatively, the user using mobile phone A does not want to continue using mobile phone A to assist in large-screen input. The user may want to switch to other auxiliary devices to assist in large-screen input, such as switching to mobile phone B to assist in large-screen input. In this case, the user needs to use the large-screen remote control again, re-click the large-screen edit box, and re-trigger the connection between the large screen and mobile phone B, which is a cumbersome process.

[0371] Based on this, an embodiment of the present application provides a device communication method. During the process of a user using a mobile phone to assist in large-screen input, other auxiliary devices in the same distributed network as the large screen and the mobile phone can seize the auxiliary input of the mobile phone. Furthermore, based on the input content of the mobile phone, the large-screen input can continue to be assisted. During this period, the user does not need to use a remote control or other device to select the edit box of the large screen again, thereby achieving convenient and efficient assisted large-screen input.

[0372] For example, Figure 8 A specific system architecture diagram of a device communication method in which multiple devices preempt input according to an embodiment of the present application is shown.

[0373] like Figure 8 As shown, the embodiment of the present application takes the distributed networking including a large screen, mobile phone A and mobile phone B as an example, and illustrates the process of mobile phone B preempting the auxiliary input during the auxiliary input of mobile phone A. It can be understood that the large screen of the embodiment of the present application can have the ability to request remote input, and mobile phone A and mobile phone B can both have distributed input method assistance AA.

[0374] like Figure 8 As shown, the device communication method of the embodiment of the present application may include a pull-up process and a preemption process. During the pull-up process, the large screen can establish a connection with mobile phone A and mobile phone B, and mobile phone A confirms the auxiliary large screen input. During the preemption process, mobile phone B can preempt mobile phone A to realize the use of mobile phone B to assist the large screen input.

[0375] Exemplarily, during the pull-up process, the user can click on the edit box of the large screen through the large screen remote control, and the edit box of the large screen requests the remote input method from the input method framework of the large screen. The large screen finds mobile phone A and mobile phone B in the distributed network, and the large screen can establish connections with the auxiliary AA of mobile phone A and the auxiliary AA of mobile phone B respectively, and pass the data channel interface of the large screen to the auxiliary AA of mobile phone A and the auxiliary AA of mobile phone B respectively. Notifications can pop up in both mobile phone A and mobile phone B, and the notification can be used to indicate that the large screen requests auxiliary input. The user can confirm in the notification of mobile phone A that mobile phone A is used to assist the large screen input, and notify the large screen that the currently occupied device is mobile phone A. An edit box for assisting the large screen input can pop up in mobile phone A, and the user can pull up the local input method of the mobile phone in the edit box of mobile phone A to assist the large screen input. Exemplarily, the user can enter "Hello," in the edit box of mobile phone A, and "Hello," can be displayed synchronously on the large screen.

[0376] Exemplarily, during the preemption process, the user can confirm in the notification of mobile phone B that mobile phone B is used to assist the large screen input, and notify the large screen that the current preempted device is mobile phone B. The large screen can broadcast to mobile phones A and B in the distributed network that the current preempted device is mobile phone B. If mobile phone A does not perform the preemption step again, the edit box for assisting input in mobile phone A can be hidden, and an edit box for assisting large screen input can pop up in mobile phone B. The user can pull up the local input method of the mobile phone in the edit box of mobile phone B to assist large screen input. In a possible implementation, after mobile phone B implements preemption, the content synchronized from mobile phone A to the large screen can be synchronously displayed in the edit box of mobile phone B. For example, if the edit box of the large screen has been synchronized to "Hello," from the edit box of mobile phone A, then the edit box popped up by mobile phone B can be synchronized to "Hello,".

[0377] In a possible implementation, during the above-mentioned pull-up process, the notification on mobile phone B can be hidden first. During the preemption process, the user can trigger the display of the hidden notification in mobile phone B and implement preemption in the notification. For example, after the user clicks on the notification on mobile phone A to confirm the selection, the notification on mobile phone B can be hidden in the notification bar. When the user wants to use mobile phone B to preempt the input, the user can pull down the notification bar of mobile phone B, display the notification in mobile phone B, and click on the notification of mobile phone B to implement preemption of mobile phone B.

[0378] It can be understood that when mobile phone B successfully seizes and assists in large-screen input, mobile phone A can seize and assist in large-screen input again based on a similar process to that of mobile phone B, which will not be elaborated here.

[0379] It should be noted that, in the implementation of mobile phone B preempting the auxiliary input of mobile phone A, mobile phone A can be in a state such as a call that cannot assist the large-screen input, or mobile phone A can be in a state that can assist the large-screen input. Alternatively, it can be understood that mobile phone B can initiate preemption at any time, and the embodiment of the present application does not limit the time when the preemption occurs.

[0380] In a possible implementation, mobile phone A can also request mobile phone B to preempt. For example, in a family scenario, an elderly person holds mobile phone A to assist in large-screen input, but the elderly person may input slowly, and hopes to request a young person holding mobile phone B to assist in large-screen input. Then mobile phone A can send a request to mobile phone B to request mobile phone B to preempt the auxiliary input, and mobile phone B can preempt based on mobile phone A's request.

[0381] In a possible implementation, during the process of mobile phone A assisting the large-screen input, the large-screen can also initiate preemption. For example, during the process of mobile phone A assisting the large-screen input, the user uses the remote control to click on the edit box on the large-screen, and the large-screen can broadcast to all auxiliary devices in the distributed network that the current preempted device ID is the large-screen ID. After receiving the broadcast of the current preempted device ID, the devices in the distributed network will judge the preempted device ID: for the large screen, it is judged to be the current preempted device, and the local input method of the large screen is pulled up, and the user can use the remote control to continue inputting in the edit box of the large screen; for other auxiliary devices, it is judged not to be the current preempted device, and other auxiliary devices can hide the input methods of other auxiliary devices.

[0382] It should be noted that Figure 8 The corresponding embodiment is a possible implementation of the embodiment of the present application. In other possible implementations, the user may select a virtual keyboard under an edit box provided by an application on the large screen through a remote control to trigger a subsequent auxiliary large-screen input process, or the user may trigger the auxiliary large-screen input process in a mobile phone, which is not specifically limited in the embodiment of the present application.

[0383] In combination with the above description, the user interface for the interaction between the large screen and the mobile phone is exemplified below.

[0384] For example, Figure 9-10 A schematic diagram of a user interface for user-triggered auxiliary input is shown.

[0385] Fig. 9 A user interface diagram of a large screen is shown. Fig. 9 As shown, the user can use the remote control 901 to select the edit box 902 in the large screen, which can trigger the subsequent process of the mobile phone-assisted large screen input in the embodiment of the present application. Alternatively, the user can use the remote control 901 to select any content 903 in the virtual keyboard in the large screen, which can trigger the subsequent process of the mobile phone-assisted large screen input in the embodiment of the present application. The specific method of mobile phone-assisted large screen input will be described in the subsequent embodiments and will not be repeated here.

[0386] It should be noted that Fig. 9 A schematic diagram of setting an edit box in the user interface diagram of the large screen is shown. In a possible implementation, the user interface of the large screen may include multiple edit boxes, and the user triggering any edit box may trigger the subsequent mobile phone-assisted large screen input process of the embodiment of the present application, and the embodiment of the present application does not specifically limit this.

[0387] Fig.10 A user interface diagram of a mobile phone is shown. For example, a user can display the following information by pulling down the main screen of the mobile phone. Fig.10 The user interface shown in Figure a is as follows. Fig.10The user interface shown in FIG. a may include one or more of the following functions of the mobile phone: WLAN, Bluetooth, flashlight, mute, flight mode, mobile data, wireless screen projection, screenshot or auxiliary input 1001. The auxiliary input 1001 may be a function of assisting large-screen input of the mobile phone in the embodiment of the present application.

[0388] In a possible implementation, after the user clicks on the auxiliary input 1001, the mobile phone can search for a large screen and other devices in the same distributed network, obtain the search box in the large screen, establish a communication connection with the large screen, and further display the following information in the mobile phone: Fig.10 The user interface shown in Figure c is as follows. Fig.10 In the user interface shown in Figure c, an edit box for assisting large-screen input may be displayed, and the user may assist the large-screen input based on the edit box.

[0389] In a possible implementation, if the mobile phone finds that there are multiple large screen devices in the same distributed network, the mobile phone can also display the following information: Fig.10 The user interface shown in Figure b is as follows. Fig.10 The user interface shown in Figure b can display multiple large screen logos, and the logo of the large screen can be the device number, user name or nickname of the large screen. Fig.10 In the user interface shown in Figure b, select the large screen you want to assist in input (for example, click large screen A or large screen B), and enter the following Fig.10 The user interface is shown in Figure c, and this embodiment of the present application does not make any specific limitation to this.

[0390] After the user triggers large-screen input through any of the above methods, for example, the large screen can search for auxiliary devices with auxiliary input capabilities (such as mobile phones) in the distributed network, and automatically determine the mobile phone used for auxiliary input, or send notifications to all mobile phones found in the distributed network.

[0391] For example, if the large screen finds that there is a mobile phone in the distributed network, the large screen can automatically select the mobile phone as the auxiliary input device.

[0392] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among the multiple mobile phones, there is a default auxiliary input mobile phone set by the user, the large screen can automatically select the default auxiliary input mobile phone as the auxiliary input device.

[0393] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among the multiple mobile phones, there is an auxiliary input mobile phone selected by the user when performing auxiliary input last time, the large screen can automatically select the auxiliary input mobile phone selected by the user when performing auxiliary input last time as the auxiliary input device.

[0394] For example, if the big screen finds that there are multiple mobile phones in the distributed network, the big screen obtains the mobile phone most frequently selected by users as auxiliary input among the multiple mobile phones, and the big screen can automatically select the mobile phone most frequently selected by users as auxiliary input as the auxiliary input device.

[0395] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among the multiple mobile phones, there is a mobile phone with the same user account as the one logged in by the large screen, the large screen can automatically select the mobile phone with the same user account as the one logged in by the large screen as the auxiliary input device.

[0396] By way of example, taking the example of a large screen sending a notification to a mobile phone in a distributed network, the user interface for preemptive input between the large screen and the mobile phone is exemplarily described below.

[0397] One or more mobile phones can be connected to the distributed network. When one mobile phone is connected to the distributed network, the mobile phone can assist the large screen for input. If other mobile phones are also connected to the distributed network later, the distributed network may include multiple mobile phones, and multiple mobile phones can implement the preemption process described in the embodiment of the present application procedure. When multiple mobile phones are connected to the distributed network, multiple mobile phones can implement the preemption process described in the embodiment of the present application procedure.

[0398] For example, Figure 11-23 The process of seizing the auxiliary large screen of the device for input is shown. Take the large screen, mobile phone A and mobile phone B in the distributed network as an example for explanation.

[0399] Fig.11 A user interface diagram of a large screen is shown. The large screen can connect to the auxiliary AA of mobile phone A and the auxiliary AA of mobile phone B, and request auxiliary input from mobile phone A and mobile phone B. Notifications can pop up in both mobile phone A and mobile phone B, and the notification is used to prompt the large screen to request auxiliary input. For example, Fig.11 The figure shows a user interface diagram of receiving a notification in mobile phone A or mobile phone B.

[0400] Fig.12 The figure shows a schematic diagram of the interface for mobile phone A to determine auxiliary large screen input. Fig.12 The user interface diagram of the mobile phone shown on the left is as follows. The user selects mobile phone A for auxiliary input, and the user can click the confirmation button in the notification of mobile phone A. In possible implementations, such as Fig.12 The user interface diagram of the large screen is shown in the right figure. The large screen can prompt that the currently occupied device is mobile phone A. If no other device has occupied it for a period of time, it can be confirmed that mobile phone A assists in large screen input. It can be understood that in another possible implementation, during the process of mobile phone A confirming the auxiliary input, the large screen may not prompt mobile phone A to occupy the input, and the user watching the large screen may not be aware of the process of mobile phone B occupying the input.

[0401] Possible implementations include Fig.10 In the embodiment shown, if the user initiates the process of assisting large-screen input from mobile phone A, then Fig.11 and Fig.12 The corresponding user interface may not be displayed, and the large screen may confirm that mobile phone A assists in the large screen input.

[0402] Fig.13 The figure shows a schematic diagram of the interface using mobile phone A to assist large screen input. Fig.13 In the user interface diagram of mobile phone A shown in the left figure, an edit box for auxiliary input pops up in mobile phone A, and the user can use the edit box to assist the large screen input. Fig.13 In the user interface diagram shown in the right figure of , the user can enter "Hello," in the edit box of mobile phone A, and adapt, such as Fig.14 As shown, in the edit box of the large screen, "Hello," in the edit box of mobile phone A can be displayed synchronously.

[0403] In a possible implementation, the user Fig.13 When entering data in the edit box of mobile phone A shown in the right figure, if the user enters Fig.13 As shown in the right figure of the figure, when deleting, highlighting or moving the cursor in the edit box of mobile phone A, Fig.14 The edit box on the large screen shown can synchronously display the status of deletion, highlight selection or cursor movement in the edit box of mobile phone A.

[0404] When the user uses mobile phone A to assist the large screen in inputting, the auxiliary input of mobile phone A may be interrupted due to some reasons, for example, mobile phone A receives a call during the auxiliary input process, or mobile phone A receives a video or voice call during the auxiliary input process. Or, in the case where the user wants to switch devices to input the large screen during the auxiliary input process, it involves the process of preempting the input, and the preempting device can be mobile phone B or the large screen itself.

[0405] For example, Figure 15-17 The figure shows a schematic diagram of the interface of mobile phone B preempting input on the large screen.

[0406] In a possible implementation, the user of mobile phone B can preempt by triggering the notification bar. Fig.15 The figure shows a schematic diagram of the interface in which mobile phone B pulls down the notification bar to preempt. Fig.15As shown, when mobile phone B is preempting input, the user can pull down the notification bar of mobile phone B, and the notification bar can display the notification that mobile phone B previously received from the large screen to request auxiliary input. The user initiates the preemption through the notification that pops up on mobile phone B to request auxiliary input on the large screen. For example, the user clicks the control in the notification to confirm the auxiliary large-screen input, and mobile phone B can connect to the large screen to preempt input.

[0407] Among the possible implementations, Fig.16 A schematic diagram of a user interface of a large screen is shown, such as Fig.16 As shown, after the user confirms the preemption on mobile phone B, the auxiliary device AA of mobile phone B notifies the large screen of the ID of the preempting device mobile phone B, and the large screen user interface can pop up a notification that the ID of the preempting device mobile phone B is mobile phone B00.

[0408] Optionally, the large screen can broadcast the ID of the currently occupied device, mobile phone B, to mobile phone A and mobile phone B, such as Fig.17 As shown, the user interface of mobile phone A can display a notification that the ID of the current preempting device mobile phone B is mobile phone B00. Mobile phone B determines that the current preempting device is the current device, and mobile phone B can pull up the local input method keyboard. Mobile phone A determines that the current preempting device is not the current device, and mobile phone A can hide the local input method keyboard. The large screen determines that the current preempting device is not the current device, and the large screen hides the local input method keyboard.

[0409] In a possible implementation, after the user confirms the preemption in mobile phone B, the large screen does not need to pop up a notification in the user interface that the ID of the preempting device mobile phone B is mobile phone B00. The large screen will broadcast the ID of the current preempting device mobile phone B to mobile phone A and mobile phone B. Mobile phone B determines that the current preempting device is the current device, and mobile phone B pulls up the local input method keyboard. Mobile phone A determines that the current preempting device is not the current device, and mobile phone A hides the local input method keyboard. The large screen determines that the current preempting device is not the current device, and hides the local input method keyboard. Or it can be understood that when mobile phone B initiates the preemption process, the large screen does not need to prompt mobile phone B to preempt, and users watching the large screen may not be aware of the preemption process of mobile phone B.

[0410] In another possible implementation, the user of mobile phone B can preempt the request of mobile phone A. For example, Fig.18 As shown, Fig.18 Mobile phone A can display an interface for requesting auxiliary input from mobile phone B. The user can request auxiliary large-screen input from mobile phone B by clicking the OK option in mobile phone A. Fig.18 Mobile phone B can notify mobile phone A to request auxiliary large-screen input, and the user can accept the request of mobile phone A in mobile phone B to seize the auxiliary large-screen input.

[0411] In another possible implementation, initially, the large screen and mobile phone A are connected to the distributed network, and mobile phone A assists the large screen input. Afterwards, mobile phone B is connected to the distributed network, and mobile phone B can display an interface for prompting the user whether to seize the auxiliary input. For example, Fig.19 As shown, mobile phone B displays an interface prompting the user whether to seize the auxiliary input. The user can click the confirmation option in mobile phone B to seize the auxiliary large-screen input.

[0412] It can be understood that the way in which mobile phone B implements preemption can also be set according to the actual application scenario, and the embodiment of the present application does not make any specific limitation on this.

[0413] For example, Fig. 20 FIG. 4 shows a schematic diagram of a user interface of mobile phone B. Fig. 20 As shown in the left figure, after the mobile phone B successfully seizes the content, the content "Hello," in the edit box of the mobile phone B can be synchronized to the content in the edit box of the large screen. The user can continue to enter in the edit box of the mobile phone B. For example, the user continues to enter "friends" in the edit box of the mobile phone B. Fig. 20 As shown in the right figure of , "Hello, friend" can be displayed in the edit box of mobile phone B. Suitably, the "Hello, friend" in the edit box of mobile phone B can be displayed synchronously in the edit box of the large screen.

[0414] It can be understood that during the process of mobile phone B assisting in large-screen input, mobile phone A can preempt again. The preemption process is similar to the above-mentioned preemption process of mobile phone B, which will not be repeated here.

[0415] In a possible implementation, when mobile phone A or mobile phone B assists in large-screen input, the large-screen can also be preempted.

[0416] For example, mobile phone A is assisting large-screen input, and "Hello," has been entered in the edit box of mobile phone A and the edit box of the large screen, and the user hopes to use the large-screen input.

[0417] like Fig.21 The user interface of the large screen on the left can be used to select the edit box on the large screen by using a remote control. The large screen can broadcast the ID of the current preempted device to the large screen, mobile phone A and mobile phone B in the distributed network. After receiving the broadcast, mobile phone A and mobile phone B can pop up a pop-up window on mobile phone A or mobile phone B. Fig.18 The user interface shown on the right shows the Fig.21 In the user interface shown in the right figure, a notification may be displayed to indicate that the currently occupied device is a large screen. In a possible implementation, mobile phone A and mobile phone B may not display a notification to indicate that the current account clearing device is a large screen, and this embodiment of the application does not specifically limit this.

[0418] Furthermore, the large screen, mobile phone A and mobile phone B can determine the ID of the preempted device. Mobile phone A and mobile phone B determine that the current preempted device is not the current device. Mobile phone A and mobile phone B hide the local input method keyboard. The large screen determines that the current preempted device is the current device. The large screen pulls up the local input method keyboard, and the user can use the remote control to continue inputting in the edit box of the large screen.

[0419] It should be noted that the above-mentioned user interface diagrams when the mobile phone assists in large-screen input are all exemplary illustrations. In possible implementation methods, the interface when the mobile phone assists in large-screen input can also synchronize part or all of the content on the large screen, so that the mobile phone user can understand the status of the large screen based on the mobile phone interface.

[0420] For example, Fig. 22 FIG. 1 shows a user interface of a mobile phone. Fig. 22 As shown, when the user uses the mobile phone to assist in large-screen input, the user can project all or part of the content of the large screen to the mobile phone. For example, the content related to the edit box of the large screen is displayed on the mobile phone, and the edit box of the mobile phone is displayed on the upper layer of the large-screen content. In this way, when the user inputs in the edit box of the mobile phone, the status of the edit box on the large screen can be synchronously seen in the user interface of the mobile phone. The user does not need to look up at the input status on the large screen when assisting input.

[0421] It should be noted that in the above embodiments, the example of user-assisted large-screen input of Chinese characters is used for illustration. In possible implementations, the user can assist the large screen in inputting English phrases or other forms of text input. The embodiments of the present application do not limit the specific content of the assisted input.

[0422] Corresponding to the above framework and user interface examples, exemplary, Fig.23 A schematic diagram of a specific process of using a mobile phone to assist a large screen in inputting is shown in an embodiment of the present application.

[0423] like Fig.23 As shown, the mobile phone assisted large-screen input may include: a remote input method launching process and a remote input method grabbing process.

[0424] For example, during the process of launching the remote input method, a distributed network can be established, and a large screen, two mobile phones (such as mobile phone A and mobile phone B), and a tablet, etc. can be connected to the distributed network.

[0425] The user can use a remote control or other device to click on the edit box on the large screen to make the edit box on the large screen focus.

[0426] The large screen can query all auxiliary devices with auxiliary AA in the distributed network. When auxiliary devices are found, the large screen connects to the auxiliary AA of each auxiliary device and transmits the data channel interface to each auxiliary AA. The auxiliary AA of each auxiliary device pops up a notification, which is used to prompt the large screen that auxiliary input is required. For example, if the auxiliary devices found by the large screen include mobile phone A and mobile phone, a notification can pop up in mobile phone A and mobile phone B to wait for the user to select and confirm.

[0427] The user clicks on the notification of mobile phone A to confirm the use of mobile phone A to assist in large-screen input. Mobile phone A can pop up an edit box, and at the same time, the edit box pulls up the input method keyboard, and the user can input in the edit box of mobile phone A.

[0428] During the input process on mobile phone A, for some reason, the user wants to switch to other auxiliary devices for input, such as mobile phone B, and enter the remote input method preemption process.

[0429] During the remote input method preemption process, the user clicks on the notification (or edit box) of mobile phone B, and the auxiliary AA of mobile phone B will notify the large screen that the current preemption device ID is the ID of mobile phone B. At the same time, the large screen will broadcast the current preemption device ID. All auxiliary devices in the distributed network (such as mobile phone A and mobile phone B) will determine whether the device is the current preemption device based on the preemption device ID broadcast by the large screen.

[0430] For example, if mobile phone B determines that the current preempting device is the current device, mobile phone B will pull up the local input method keyboard and synchronize the content of the large screen edit box to the edit box of mobile phone B through the data channel interface, and the user can input in the edit box of mobile phone B. If mobile phone A determines that the current preempting device is not the current device, mobile phone A can determine whether the input method keyboard has been pulled up. If mobile phone A pulls up the input method keyboard, mobile phone A can hide the local input method keyboard.

[0431] In this way, based on the above method of the embodiment of the present application, any auxiliary device in the distributed network can initiate convenient preemption at any time, and after the preemption is successful, it can assist the large screen in input.

[0432] In the case of dividing each functional module into corresponding functional modules, such as Fig.24 As shown, a possible structural diagram of a first device, a second device or a third device provided in an embodiment of the present application is shown, and the first device, the second device or the third device includes: a display screen 2401 and a processing unit 2402.

[0433] The display screen 2401 is used to support the first device, the second device or the third device to perform the display steps in the above embodiment, or other processes of the technology described in the embodiment of the present application. The display screen 2401 can be a touch screen or other hardware or a combination of hardware and software.

[0434] The processing unit 2402 is used to support the first device, the second device or the third device to execute the processing steps in the above method embodiments, or other processes of the technology described in the embodiments of the present application.

[0435] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here.

[0436] Of course, the electronic device includes but is not limited to the unit modules listed above. Moreover, the specific functions that can be realized by the above functional units also include but are not limited to the functions corresponding to the method steps described in the above examples. The detailed description of other units of the electronic device can refer to the detailed description of the corresponding method steps, and the embodiments of this application are not repeated here.

[0437] In the case of adopting an integrated unit, the first device, the second device or the third device involved in the above embodiment may include: a processing module, a storage module and a display screen. The processing module is used to control and manage the actions of the first device, the second device or the third device. The display screen is used to display content according to the instructions of the processing module. The storage module is used to save the program code and data of the first device, the second device or the third device. Further, the first device, the second device or the third device may also include an input module and a communication module, and the communication module is used to support the communication between the first device, the second device or the third device and other network entities, so as to realize the functions of the first device, the second device or the third device, such as calls, data interaction, and Internet access.

[0438] The processing module may be a processor or a controller. The communication module may be a transceiver, an RF circuit or a communication interface, etc. The storage module may be a memory. The display module may be a screen or a display. The input module may be a touch screen, a voice input device, or a fingerprint sensor, etc.

[0439] The communication module may include an RF circuit, and may also include a wireless fidelity (Wi-Fi) module, a near field communication (NFC) module, and a Bluetooth module. Communication modules such as the RF circuit, the NFC module, the WI-FI module, and the Bluetooth module may be collectively referred to as a communication interface. The processor, the RF circuit, the display screen, and the memory may be coupled together via a bus.

[0440] like Fig.25As shown, another possible structural diagram of the first device, the second device or the third device provided in an embodiment of the present application is shown, including: one or more processors 2501, a memory 2502, a camera 2504 and a display screen 2503; the above-mentioned devices can communicate through one or more communication buses 2506.

[0441] Among them, one or more computer programs are stored in the memory 2502 by 2505 and are configured to be executed by one or more processors 2501; one or more computer programs 2505 include instructions, and the instructions are used to execute the display method of any of the above steps. Of course, the electronic device includes but is not limited to the devices listed above. For example, the above electronic device may also include a radio frequency circuit, a positioning device, a sensor, etc.

[0442] The present application also provides the following embodiments. It should be noted that the numbering of the following embodiments does not necessarily need to follow the numbering sequence of the previous embodiments.

[0443] Embodiment 21. A device communication method, applied to a system including a first device, a second device, and a third device, the method comprising:

[0444] The first device displays a first interface including a first edit box;

[0445] In response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network;

[0446] The first device displays a second interface, where the second interface includes a first option corresponding to the second device and a second option corresponding to the third device;

[0447] In response to a triggering operation on the first option, the first device sends an indication message to the second device;

[0448] The second device displays a third interface according to the instruction message, wherein the third interface includes a second edit box;

[0449] When an editing state exists in the second editing box, the editing state is synchronized to the first editing box.

[0450] Embodiment 22. According to the method of embodiment 21, the second device includes an interface service, and the interface service is used for synchronization of the editing status between the first device and the second device.

[0451] Embodiment 23. According to the method described in Embodiment 21 or 22, the editing state includes one or more of the following: a highlight mark of text content, cursor or text content.

[0452] Embodiment 24. According to the method of any one of Embodiments 21-23, the second device displays a third interface according to the indication message, including:

[0453] The second device displays a notification interface in response to the indication message; the notification interface includes a third option for confirming the auxiliary input;

[0454] In response to a triggering operation on the third option, the second device displays the third interface.

[0455] Embodiment 25. According to the method described in any one of Embodiments 21-24, the third interface also includes: all or part of the content of the first interface.

[0456] Embodiment 26. According to the method described in Embodiment 25, the second edit box is displayed in layers with all or part of the content of the first interface, and the second edit box is displayed on an upper layer of all or part of the content of the first interface.

[0457] Embodiment 27. According to the method of any one of Embodiments 21-26, after the second device displays the third interface according to the indication message, the method further includes:

[0458] In response to triggering the second edit box, the second device displays a virtual keyboard;

[0459] The second device displays the editing status in the second editing box according to the input operation received in the virtual keyboard and / or the second editing box.

[0460] Embodiment 28. According to the method described in any one of Embodiments 21-27, the first device includes any one of the following: a television, a large screen or a wearable device; the second device or the third device includes any one of the following: a mobile phone, a tablet or a wearable device.

[0461] Embodiment 29. A device communication method, applied to a system including a first device, a second device, and a third device, the method comprising:

[0462] The first device displays a first interface including a first edit box;

[0463] In response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network;

[0464] The first device determines that the second device is an auxiliary input device;

[0465] The first device sends an indication message to the second device;

[0466] The second device displays a third interface according to the instruction message, wherein the third interface includes a second edit box;

[0467] When an editing state exists in the second editing box, the editing state is synchronized to the first editing box.

[0468] Embodiment 210. A device communication method, applied to a system including a first device, a second device, and a third device, the method comprising:

[0469] The second device displays a fourth interface including options of the first device;

[0470] In response to a selection operation on an option of the first device, the second device sends an indication message to the first device;

[0471] The first device displays a first interface including a first edit box;

[0472] The second device displays a third interface, wherein the third interface includes a second edit box;

[0473] When an editing state exists in the second editing box, the editing state is synchronized to the first editing box.

[0474] Embodiment 211. A device communication method, applied to a first device, the method comprising:

[0475] The first device displays a first interface including a first edit box;

[0476] In response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network;

[0477] The first device displays a second interface, where the second interface includes a first option corresponding to the second device and a second option corresponding to the third device;

[0478] In response to a triggering operation on the first option, the first device sends an instruction message to the second device; the instruction message is used to instruct the second device to display a third interface, and the third interface includes a second edit box;

[0479] When an editing state exists in the second editing box, the editing state is synchronized to the first editing box.

[0480] Embodiment 212. A device communication method, applied to a second device, the method comprising:

[0481] The second device displays a fourth interface including options of the first device;

[0482] In response to a selection operation on an option of the first device, the second device sends an instruction message to the first device; the instruction message is used to instruct the first device to display a first interface including a first edit box;

[0483] The second device displays a third interface, wherein the third interface includes a second edit box;

[0484] When an editing state exists in the second editing box, the editing state is synchronized to the first editing box.

[0485] Embodiment 213. A device communication system comprises a first device, a second device and a third device, wherein the first device is used to execute the steps of the first device as described in any one of Embodiments 21-29 and 210-212, the second device is used to execute the steps of the second device as described in any one of Embodiments 21-29 and 210-212, and the third device is used to execute the steps of the third device as described in any one of Embodiments 21-29 and 210-212.

[0486] Embodiment 214. A first device comprising: at least one memory and at least one processor;

[0487] The memory is used to store program instructions;

[0488] The processor is used to call the program instructions in the memory so that the first device executes the steps performed by the first device described in any one of Examples 21-29, 210-212.

[0489] Embodiment 215. A second device comprising: at least one memory and at least one processor;

[0490] The memory is used to store program instructions;

[0491] The processor is used to call the program instructions in the memory so that the second device executes the steps performed by the second device described in any one of Examples 21-29, 210-212.

[0492] Embodiment 216. A computer-readable storage medium having a computer program stored thereon, so that when the computer program is executed by a processor of a first device, the steps performed by the first device as described in any one of embodiments 21-29, 210-212 are implemented; or, when the computer program is executed by a processor of a second device, the steps performed by the second device as described in any one of embodiments 21-29, 210-212 are implemented; or, when the computer program is executed by a processor of a third device, the steps performed by the third device as described in any one of embodiments 21-29, 210-212 are implemented.

[0493] The specific implementation of the above-mentioned embodiments 21-29 and embodiments 210-216 can refer to the following Figure 26-37 Description.

[0494] In a possible implementation of using a mobile phone to assist large-screen input, when the large screen finds an auxiliary device with an auxiliary input function in a distributed network, the large screen can send a broadcast to all auxiliary devices with an auxiliary input function in the distributed network to notify all auxiliary devices that the large screen requires auxiliary input.

[0495] However, only one or some of the auxiliary devices may participate in the auxiliary large-screen input, and the large screen broadcasts to all auxiliary devices in the distributed network, which may cause certain interference to other auxiliary devices in the distributed network that do not participate in the auxiliary large-screen input.

[0496] Based on this, the embodiment of the present application provides a device communication method, where the user can select a target auxiliary device in the large screen, and then send a notification to the target auxiliary device, and do not send notifications to other auxiliary devices, thereby avoiding interference with other devices. Alternatively, the user can select a target auxiliary device in the large screen, establish a communication connection with the target auxiliary device, and pop up an edit box for assisting large screen input in the target auxiliary device. During this period, the notification interface may not be displayed in the target auxiliary device, and the user does not need to trigger the notification.

[0497] For example, Fig.26 A schematic diagram of a specific system architecture of a device communication method according to an embodiment of the present application is shown.

[0498] The user clicks on an edit box provided by an application on the large screen through a remote control, and the large screen can search for a device with auxiliary input capability (such as a mobile phone with auxiliary AA) in the distributed network. After the large screen finds the device with auxiliary input capability, an interface including the identification of the device with auxiliary input capability can pop up on the large screen. The identification of the device with auxiliary input capability can be the device number, user name or nickname of the device with auxiliary input capability.

[0499] If the user selects a target device from devices with auxiliary input capabilities, taking a mobile phone as an example, the large screen can pass the input data interface to the input method management framework IMF of the large screen, the input method management framework of the large screen can establish a connection with the auxiliary AA of the mobile phone, the auxiliary AA of the mobile phone can simulate a click event to pull up the local input method of the mobile phone, and include an input window of an edit box in the mobile phone. Subsequently, the user can use the local input method of the mobile phone to input content in the edit box, and the auxiliary AA of the mobile phone can return a cross-process interface to the input method management framework of the large screen. The input method management framework of the large screen can use the cross-process interface to cross-process package the input data interface of the large screen and pass it to the auxiliary AA of the mobile phone. Subsequently, the auxiliary AA of the mobile phone can synchronize the content of the mobile phone edit box to the large screen based on the input data interface of the large screen.

[0500] For example, when a user inputs text, deletes text, highlights selected text, or moves the cursor in the edit box of the mobile phone, the auxiliary AA of the mobile phone can call the input data interface of the large screen to synchronize the content in the edit box of the mobile phone to the edit box of the large screen.

[0501] It is understandable that if the large screen does not have the ability of remote input, or the large screen does not find the auxiliary device in the distributed network, the large screen can use the local input method of the large screen for input.

[0502] It should be noted that Fig.26 This is a possible implementation of the embodiment of the present application. In other possible implementations, the user may select a virtual keyboard under an edit box provided by an application on the large screen through a remote control to trigger a subsequent auxiliary large-screen input process, or the user may trigger the auxiliary large-screen input process on a mobile phone, which is not specifically limited in the embodiment of the present application.

[0503] In combination with the above description, the user interface for the interaction between the large screen and the mobile phone is exemplified below.

[0504] For example, Figure 27-28 A schematic diagram of a user interface for user-triggered auxiliary input is shown.

[0505] Fig. 27 A user interface diagram of a large screen is shown. Fig. 27 As shown, the user can use the remote control 2701 to select the edit box 2702 in the large screen, which can trigger the subsequent process of the mobile phone-assisted large screen input in the embodiment of the present application. Alternatively, the user can use the remote control 2701 to select any content 2703 in the virtual keyboard in the large screen, which can trigger the subsequent process of the mobile phone-assisted large screen input in the embodiment of the present application. The specific method of mobile phone-assisted large screen input will be described in the subsequent embodiments and will not be repeated here.

[0506] It should be noted that Fig. 27 A schematic diagram of setting an edit box in the user interface diagram of the large screen is shown. In a possible implementation, the user interface of the large screen may include multiple edit boxes, and the user triggering any edit box may trigger the subsequent mobile phone-assisted large screen input process of the embodiment of the present application, and the embodiment of the present application does not specifically limit this.

[0507] Fig.28 A user interface diagram of a mobile phone is shown. For example, a user can display the following information by pulling down the main screen of the mobile phone. Fig.28 The user interface shown in Figure a is as follows. Fig.28 The user interface shown in FIG. a may include one or more of the following functions of the mobile phone: WLAN, Bluetooth, flashlight, mute, flight mode, mobile data, wireless screen projection, screenshot or auxiliary input 2801. The auxiliary input 2801 may be a function of assisting large-screen input of the mobile phone in the embodiment of the present application.

[0508] In a possible implementation, after the user clicks on the auxiliary input 2801, the mobile phone can search for a large screen and other devices in the same distributed network, obtain the search box in the large screen, establish a communication connection with the large screen, and further display the following information in the mobile phone: Fig.28 The user interface shown in Figure c is as follows. Fig.28 In the user interface shown in Figure c, an edit box for assisting large-screen input may be displayed, and the user may assist the large-screen input based on the edit box.

[0509] In a possible implementation, if the mobile phone finds that there are multiple large screen devices in the same distributed network, the mobile phone can also display the following information: Fig.28 The user interface shown in Figure b is as follows. Fig.28 The user interface shown in Figure b can display multiple large screen logos, and the logo of the large screen can be the device number, user name or nickname of the large screen. Fig.28 In the user interface shown in Figure b, select the large screen you want to assist in input (for example, click large screen A or large screen B), and enter the following Fig.28 The user interface shown in Figure c is not specifically limited in the present application embodiment. After the user triggers the large screen input through any of the above methods, for example, Fig.29 -34 shows a schematic diagram of the user interface for mobile phone-assisted large-screen input.

[0510] Fig.29 A user interface diagram of a large screen is shown. Fig.29 As shown, users can use Fig. 27The auxiliary input scene is triggered in a corresponding manner, and the large screen can search for auxiliary devices with auxiliary input capabilities in the distributed network, and display the found auxiliary devices "mobile phone A" and "mobile phone B" on the large screen. It can be understood that the identification of the auxiliary device can be displayed in any possible form on the large screen, such as a list, picture or number.

[0511] The user can use a remote control or other device to select "mobile phone B" on the large screen, and then the large screen can interact with mobile phone B to use mobile phone B to assist the large screen input.

[0512] In a possible implementation, the large screen may also automatically determine a device for auxiliary input.

[0513] For example, if the large screen finds that there is a mobile phone in the distributed network, the large screen can automatically select the auxiliary input device as the mobile phone, and does not display the following information: Fig.29 Optionally, if the large screen finds that other mobile phones other than the mobile phone are connected to the distributed network, the large screen can display the following Fig.29 The user interface shown.

[0514] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among the multiple mobile phones, there is a default auxiliary input mobile phone set by the user, then the large screen can automatically select the default auxiliary input mobile phone as the auxiliary input device, and does not display the following information: Fig.29 The user interface shown.

[0515] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among the multiple mobile phones, there is an auxiliary input mobile phone selected by the user when performing auxiliary input last time, then the large screen can automatically select the auxiliary input mobile phone selected by the user when performing auxiliary input last time as the auxiliary input device, and does not display the following information: Fig.29 The user interface shown.

[0516] For example, if the large screen finds that there are multiple mobile phones in the distributed network, the large screen obtains the mobile phone most frequently selected by the user as the auxiliary input device among the multiple mobile phones, then the large screen can automatically select the mobile phone most frequently selected by the user as the auxiliary input device as the auxiliary input device, and does not display the following information: Fig.29 The user interface shown.

[0517] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among the multiple mobile phones, there is a mobile phone with the same user account as the one logged in by the large screen, then the large screen can automatically select the mobile phone with the same user account as the one logged in by the large screen as the auxiliary input device, and does not display the following information: Fig.29 The user interface shown.

[0518] That is to say, Fig.29 The large screen user interface shown is not necessary and may not be displayed. Fig.29 The user interface shown in the embodiment of the present application Fig.29 The specific form of the user interface shown, as well as the trigger display Fig.29 The manner of the user interface shown is not limiting.

[0519] For example, if a user selects "mobile phone B" as an auxiliary input device on the large screen using a remote control or other device, after the user selects mobile phone B on the large screen, a notification may pop up on mobile phone B, prompting the user to request auxiliary input on the large screen.

[0520] For example, Fig.30 In the user interface shown in the leftmost figure, a notification may pop up in mobile phone B to prompt the large screen to request auxiliary input. The user may trigger the notification in mobile phone B to confirm the auxiliary large screen input. Further, as shown in FIG. Fig.30 In the user interface shown in the middle figure, an edit box for assisting large screen input can pop up in mobile phone B. Further, the user can trigger the edit box by clicking, etc. Fig.30 The edit box shown in the middle picture can be displayed on mobile phone B as follows Fig.30 The user interface shown in the rightmost figure can display the virtual keyboard (or soft keyboard) of the mobile phone. The user can then use the virtual keyboard of mobile phone B to assist in large-screen input.

[0521] In another possible implementation, after the user selects mobile phone B on the large screen, mobile phone B may not receive a notification, but instead a pop-up message may appear. Fig.31 The left figure shows an edit box for assisting large screen input. Further, the user can trigger the edit box by clicking, etc. Fig.31 The edit box shown in the left figure can be displayed by mobile phone B as follows Fig.31 The user interface shown in the right figure can display the virtual keyboard (or soft keyboard) of the mobile phone. The user can then use the virtual keyboard of mobile phone B to assist in large-screen input.

[0522] It is understandable that the user did not select "mobile phone A" on the large screen, so the large screen may not interact with mobile phone A and will not disturb the user of mobile phone A.

[0523] It should be noted that if the embodiment of the present application adopts Fig.28 The corresponding method triggers the auxiliary large screen input, then the following is omitted: Figure 29-31 As shown in the user interface diagram, during auxiliary input, except for the mobile phone that triggers the auxiliary large-screen input, other mobile phones can be unaware and will not cause interference to other mobile phone users.

[0524] For example, Fig.32FIG. 1 shows a user interface diagram of assisting large screen input in the edit box of mobile phone B. For example, Fig.32 The left figure shows the user interface of mobile phone B. The user can enter "lion" in the edit box of mobile phone B, and the cursor can be displayed after "lion" in the edit box of mobile phone B, such as Fig.32 The user interface diagram of the large screen shown in the right picture can be synchronized to the "lion" and cursor in the editing box of the large screen.

[0525] Fig.33 FIG. 1 shows a user interface schematic diagram in which a user can move a cursor in an edit box of mobile phone B. For example, Fig.33 In the user interface diagram of mobile phone B shown on the left, the user can move the cursor to the front of "lion" in the edit box of mobile phone B and add "old" in front of the cursor, such as Fig.33 The user interface diagram of the large screen shown in the right picture can be synchronized to the cursor before the "lion" and the "old" before the cursor in the editing box of the large screen.

[0526] Fig.34 FIG. 1 shows a user interface diagram in which a user can highlight a target word in an edit box of mobile phone B. For example, Fig.34 The left figure shows the user interface of mobile phone B. The user can highlight "Old" in the edit box of mobile phone B. Fig.34 The user interface diagram of the large screen shown in the right picture can be synchronized to the highlighted “old” in the edit box of the large screen.

[0527] It can be understood that if the user selects mobile phone A on the large screen, when the user implements auxiliary large-screen input on mobile phone A, the user interface of mobile phone A can be similar to the user interface of mobile phone B, which will not be repeated here.

[0528] It should be noted that the above-mentioned user interface diagrams when the mobile phone assists in large-screen input are all exemplary illustrations. In possible implementation methods, the interface when the mobile phone assists in large-screen input can also synchronize part or all of the content on the large screen, so that the mobile phone user can understand the status of the large screen based on the mobile phone interface.

[0529] For example, Fig.35 FIG. 1 shows a user interface of a mobile phone. Fig.35 As shown, when a user uses a mobile phone (such as mobile phone A or mobile phone B mentioned above) to assist in large-screen input, all or part of the content of the large screen can be projected onto the mobile phone. For example, the content related to the edit box of the large screen is displayed on the mobile phone, and the edit box of the mobile phone is displayed on the upper layer of the large-screen content. In this way, when the user inputs in the edit box of the mobile phone, the status of the edit box on the large screen can be synchronously seen in the user interface of the mobile phone. The user does not need to look up at the input status on the large screen when assisting in input.

[0530] It should be noted that in the above embodiments, the example of user-assisted large-screen input of Chinese characters is used for illustration. In possible implementations, the user can assist the large screen in inputting English phrases or other forms of text input. The embodiments of the present application do not limit the specific content of the assisted input.

[0531] In the case of dividing each functional module into corresponding functional modules, such as Fig.36 As shown, a possible structural diagram of a first device, a second device or a third device provided in an embodiment of the present application is shown, and the first device, the second device or the third device includes: a display screen 3601 and a processing unit 3602.

[0532] The display screen 3601 is used to support the first device, the second device or the third device to perform the display steps in the above embodiment, or other processes of the technology described in the embodiment of the present application. The display screen 3601 can be a touch screen or other hardware or a combination of hardware and software.

[0533] The processing unit 3602 is used to support the first device, the second device or the third device to execute the processing steps in the above method embodiments, or other processes of the technology described in the embodiments of the present application.

[0534] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here.

[0535] Of course, the electronic device includes but is not limited to the unit modules listed above. Moreover, the specific functions that can be realized by the above functional units also include but are not limited to the functions corresponding to the method steps described in the above examples. The detailed description of other units of the electronic device can refer to the detailed description of the corresponding method steps, and the embodiments of this application are not repeated here.

[0536] In the case of adopting an integrated unit, the first device, the second device or the third device involved in the above embodiment may include: a processing module, a storage module and a display screen. The processing module is used to control and manage the actions of the first device, the second device or the third device. The display screen is used to display content according to the instructions of the processing module. The storage module is used to save the program code and data of the first device, the second device or the third device. Further, the first device, the second device or the third device may also include an input module and a communication module, and the communication module is used to support the communication between the first device, the second device or the third device and other network entities, so as to realize the functions of the first device, the second device or the third device, such as calls, data interaction, and Internet access.

[0537] The processing module may be a processor or a controller. The communication module may be a transceiver, an RF circuit or a communication interface, etc. The storage module may be a memory. The display module may be a screen or a display. The input module may be a touch screen, a voice input device, or a fingerprint sensor, etc.

[0538] The communication module may include an RF circuit, and may also include a wireless fidelity (Wi-Fi) module, a near field communication (NFC) module, and a Bluetooth module. Communication modules such as the RF circuit, the NFC module, the WI-FI module, and the Bluetooth module may be collectively referred to as a communication interface. The processor, the RF circuit, the display screen, and the memory may be coupled together via a bus.

[0539] like Fig.37 As shown, another possible structural diagram of the first device, the second device or the third device provided in an embodiment of the present application is shown, including: one or more processors 3701, a memory 3702, a camera 3704 and a display screen 3703; the above-mentioned devices can communicate through one or more communication buses 3706.

[0540] Among them, one or more computer programs are stored in the memory 3702 by 3705 and are configured to be executed by one or more processors 3701; one or more computer programs 3705 include instructions, and the instructions are used to execute the display method of any of the above steps. Of course, the electronic device includes but is not limited to the devices listed above. For example, the above electronic device may also include a radio frequency circuit, a positioning device, a sensor, etc.

[0541] The present application also provides the following embodiments. It should be noted that the numbering of the following embodiments does not necessarily need to follow the numbering sequence of the previous embodiments.

[0542] Embodiment 31. A device communication method, applied to a system including a first device and a second device, the method comprising:

[0543] The first device displays a first interface including a first edit box;

[0544] The first device sends an indication message to the second device;

[0545] The second device displays a second interface according to the instruction message, where the second interface includes a second edit box;

[0546] When there is a keyword in the second edit box, the first device synchronizes the keyword to the first edit box;

[0547] The first device determines a candidate word corresponding to the keyword;

[0548] The second device obtains the candidate word and displays a third interface, where the third interface includes the candidate word.

[0549] Embodiment 32. According to the method of embodiment 31, the second device includes an interface service, and the interface service is used for synchronization of the editing status between the first device and the second device.

[0550] Embodiment 33. According to the method described in Embodiment 32, the editing state includes one or more of the following: a highlight mark of text content, cursor or text content.

[0551] Embodiment 34. According to the method of any one of Embodiments 31-33, the second device displays a second interface according to the indication message, including:

[0552] The second device displays a notification interface in response to the indication message; the notification interface includes an option for confirming the auxiliary input;

[0553] In response to a triggering operation on the option, the second device displays the second interface.

[0554] Embodiment 35. According to the method described in any one of embodiments 31-34, the second interface also includes: all or part of the content of the first interface.

[0555] Embodiment 36. According to the method described in Embodiment 35, the second edit box is displayed in layers with all or part of the content of the first interface, and the second edit box is displayed on an upper layer of all or part of the content of the first interface.

[0556] Embodiment 37. According to the method of any one of Embodiments 31-36, after the second device displays the second interface according to the indication message, the method further includes:

[0557] In response to triggering the second edit box, the second device displays a virtual keyboard;

[0558] The second device displays the editing status in the second editing box according to the input operation received in the virtual keyboard and / or the second editing box.

[0559] Embodiment 38. According to the method described in any one of Embodiments 31-37, the first device includes any one of the following: a television, a large screen or a wearable device; the second device includes any one of the following: a mobile phone, a tablet or a wearable device.

[0560] Embodiment 39. According to the method described in any one of Embodiments 31-38, the third interface further includes local candidate words associated with the keyword by the second device, and the display mode of the candidate words and the local candidate words in the third interface includes any one of the following:

[0561] The candidate words and the local candidate words are displayed in columns in the third interface;

[0562] The candidate word is displayed in front of the local candidate word in the third interface;

[0563] The candidate word is displayed after the local candidate word in the third interface;

[0564] The candidate words and the local candidate words are mixedly displayed in the third interface;

[0565] The candidate words and the local candidate words are distinguished by different identifiers in the third interface.

[0566] Embodiment 310. According to the method described in any one of Embodiments 31-39, the ranking of the candidate words is related to the historical user behavior in the first device.

[0567] Embodiment 311. The method according to any one of embodiments 31-39 and 310, further comprising:

[0568] The second device displays any one of the candidate words in the second edit box in response to a user triggering any one of the candidate words.

[0569] Embodiment 312. A device communication method, applied to a system including a first device and a second device, the method comprising:

[0570] The second device displays a fourth interface including options of the first device;

[0571] In response to a selection operation on an option of the first device, the second device sends an indication message to the first device;

[0572] The first device displays a first interface including a first edit box;

[0573] The second device displays a second interface, where the second interface includes a second edit box;

[0574] When there is a keyword in the second edit box, the first device synchronizes the keyword to the first edit box;

[0575] The first device determines a candidate word corresponding to the keyword;

[0576] The second device obtains the candidate word and displays a third interface, where the third interface includes the candidate word.

[0577] Embodiment 313. A device communication method, applied to a first device, the method comprising:

[0578] The first device displays a first interface including a first edit box;

[0579] The first device sends an instruction message to the second device; the instruction message is used to instruct the second device to display a second interface, where the second interface includes a second edit box;

[0580] When there is a keyword in the second edit box, the first device synchronizes the keyword to the first edit box;

[0581] The first device determines a candidate word corresponding to the keyword;

[0582] The first device synchronizes the candidate words to the second device.

[0583] Embodiment 314. A device communication method, applied to a second device, the method comprising:

[0584] The second device receives an indication message from the first device; a first interface including a first edit box is displayed in the first device;

[0585] The second device displays a second interface according to the instruction message, where the second interface includes a second edit box;

[0586] When there is a keyword in the second edit box, the second device synchronizes the keyword to the first edit box so that the first device determines a candidate word corresponding to the keyword;

[0587] The second device obtains the candidate word and displays a third interface, where the third interface includes the candidate word.

[0588] Embodiment 315. A device communication method, applied to a second device, the method comprising:

[0589] The second device displays a fourth interface including options of the first device;

[0590] In response to a selection operation on an option of the first device, the second device sends an instruction message to the first device; the instruction message is used to instruct the first device to display a first interface including a first edit box;

[0591] The second device displays a second interface, and the third interface includes a second edit box;

[0592] When there is a keyword in the second edit box, the second device synchronizes the keyword to the first edit box so that the first device determines a candidate word corresponding to the keyword;

[0593] The second device obtains the candidate word and displays a third interface, where the third interface includes the candidate word.

[0594] Embodiment 316. A device communication system comprises a first device and a second device, wherein the first device is used to execute the steps of the first device as described in any one of Embodiments 31-39, 310-315, and the second device is used to execute the steps of the second device as described in any one of Embodiments 31-39, 310-315.

[0595] Embodiment 317. A first device comprising: at least one memory and at least one processor;

[0596] The memory is used to store program instructions;

[0597] The processor is used to call the program instructions in the memory so that the first device executes the steps performed by the first device described in any one of Examples 31-39, 310-315.

[0598] Embodiment 318. A second device comprising: at least one memory and at least one processor;

[0599] The memory is used to store program instructions;

[0600] The processor is used to call the program instructions in the memory so that the second device executes the steps performed by the second device described in any one of embodiments 31-39, 310-315.

[0601] Embodiment 319. A computer-readable storage medium having a computer program stored thereon, so that when the computer program is executed by a processor of a first device, the steps performed by the first device as described in any one of embodiments 31-39, 310-315 are implemented; or, when the computer program is executed by a processor of a second device, the steps performed by the second device as described in any one of embodiments 31-39, 310-315 are implemented.

[0602] The specific implementation of the above-mentioned embodiments 31-39 and 310-319 can refer to the following Figure 38-53 Description.

[0603] When using a mobile phone to assist in large-screen input, after entering keywords or key words in the mobile phone, the text content in the mobile phone editing box can be synchronized to the large-screen side in real time to achieve quick input, thereby achieving the purpose of improving user input efficiency.

[0604] However, in a common implementation, the text content in the mobile phone edit box can be synchronized to the large screen, but the content in the large screen cannot be synchronized to the mobile phone. For example, when a user enters a keyword (such as part of a movie name, part of a music name, or part of a contact, etc.) in the mobile phone edit box, the keyword can be synchronized in the large screen edit box, and the large screen can use the keyword to obtain the target entry (such as the complete movie name, complete music name, or complete contact, etc.). At this time, since the target entry of the large screen cannot be synchronized to the mobile phone, and the candidate word library of the mobile phone itself is usually not related to the program content in the large screen, when the candidate word library of the mobile phone is used to associate the keyword, it is often impossible to associate the content related to the large screen program. Or, for the same keyword, the candidate words that the user usually selects in the mobile phone are different from the candidate words that the user usually selects in the large screen. For example, for the keyword "West", the candidate words that are usually selected in the large screen may be film and television nouns related to the West, and the candidate words that are usually selected in the mobile phone may be general words such as "West". Therefore, the user needs to completely input the target term in the mobile phone, or the user needs to use other hardware devices (such as a remote control, etc.) to manually select on the large screen to search for the target term, which results in low input efficiency.

[0605] For example, Fig.38 FIG. 1 shows a schematic diagram of a user interface for mobile phone-assisted large-screen input. Fig.38 The left figure shows the interface diagram of the mobile phone. When the user wants to search for the TV series "I Love This Land" on the big screen, the user enters the keyword "I Love" in the edit box of the mobile phone. Fig.38 In the editing box of the large screen shown in the right picture, the keyword "I love" in the editing box of the mobile phone can be displayed synchronously. The large screen associates the candidate word "I love this land" based on the keyword "I love", but the mobile phone cannot synchronize the candidate word "I love this land". The user still needs to enter the complete text "I love this land" in the mobile phone and click Finish, or the user uses the remote control to select the candidate word "I love this land" on the big screen before searching for "I love this land". The input efficiency is low.

[0606] Therefore, in the process of mobile phone-assisted large-screen input, synchronizing the mobile phone to the matching candidate words on the large screen is a feasible way to improve user input efficiency.

[0607] Based on this, an embodiment of the present application provides a device communication method. When a user uses a mobile phone to assist in large-screen input, when the user enters text in an input edit box of the mobile phone (such as a search edit box, a drop-down box or a combo box, etc.), the large screen can synchronize the text and associate the candidate words corresponding to the text according to the specific input scenario combined with the user habits counted by the large screen, the candidate word library or dictionary of the large screen, etc., and synchronize the candidate words associated with the text on the large screen to the mobile phone, so that the user can select the candidate words associated by the large screen in the mobile phone to achieve convenient input.

[0608] For example, Fig.39 A specific system architecture diagram of a device communication method provided in an embodiment of the present application is shown.

[0609] like Fig.39 As shown, the embodiment of the present application takes a large screen (or large screen device) and a mobile phone (or auxiliary device) in a distributed network as an example to illustrate the process of mobile phone assisting large screen input. The large screen can have a local or cloud word library, set an edit box and input method framework. The auxiliary device (mobile phone) can be set with auxiliary AA, notification manager, window manager and input method framework.

[0610] Among them, the edit box in the large screen can be used to trigger auxiliary input, receive text input from a remote control, or receive auxiliary input from a mobile phone, etc. The local or cloud word library of the large screen can store candidate words, and the candidate words can include, for example, program names and / or application names in the large screen, etc. The input method framework in the large screen, the auxiliary AA in the mobile phone, the notification in the mobile phone, the window in the mobile phone, and the input method framework in the mobile phone can refer to the above records, and will not be repeated here.

[0611] like Fig.39 As shown, after the large screen and the mobile phone are connected to the same distributed network, the user can use a remote control or other device to select the edit box of the large screen, the large screen can request the input method framework to connect to the auxiliary AA in the mobile phone, the auxiliary AA in the mobile phone can instruct the notification manager to pop up a notification, and when the mobile phone receives the user's click on the notification to confirm the auxiliary input, the edit box can be further popped up in the window of the mobile phone to pull up the input method framework of the mobile phone. The user can enter data in the edit box provided by the input method framework of the mobile phone. For example, the user can enter the word "I love" in the mobile phone, and the word "I love" can be synchronized to the input method framework of the large screen, and the edit box in the large screen will synchronously display the word "I love".

[0612] The big screen monitors the text changes in the big screen edit box, and can obtain the word "I love" in the edit box, match relevant entries in the big screen vocabulary according to "I love", and fill the relevant entries into the candidate word list of the search box. For example, the relevant entries may include "I love this land". Among them, the matching rules can be determined according to the actual application scenario. For example, the matching rules include but are not limited to string regular matching, synonym matching, synonym matching, exact matching or fuzzy matching, etc.

[0613] Furthermore, the large screen can synchronize the contents of the candidate word list of the large screen to the input method framework of the mobile phone, and the input method framework of the mobile phone can display the contents of the candidate word list of the large screen in the interface of the mobile phone. For example, the mobile phone can display "I love this land" as a candidate word in the mobile phone interface, and the user can click on the candidate word "I love this land" on the mobile phone interface to fill "I love this land" into the edit box of the mobile phone, and the "I love this land" can be synchronized to the edit box of the large screen, thereby realizing convenient and efficient input.

[0614] To explain the above steps more clearly, Fig.40 A flow chart of interactive synchronous matching of candidate words between a large screen and a mobile phone is shown.

[0615] like Fig.40 As shown, the user can enter a keyword or key word in an edit box of an auxiliary device (such as a mobile phone) for assisting large-screen input. The keyword or key word can be synchronized to the large-screen device. The large-screen device obtains candidate words matching the keyword or key word based on the keyword or key word, and synchronizes the candidate words to the mobile phone.

[0616] In a possible implementation, the candidate words synchronized from the large screen to the mobile phone include the target entry that the user wants to select. The user can select the target entry by clicking, and the mobile phone synchronizes the target entry to the large screen to complete the auxiliary input.

[0617] In a possible implementation, if the target term that the user wants to select is not among the candidate words synchronized from the large screen to the mobile phone, the user can continue to enter keywords or key words in the mobile phone and repeat the above steps until the target term that the user wants to select is among the candidate words synchronized from the large screen. The user can select the target term by clicking, etc., and the mobile phone synchronizes the target term to the large screen to complete the auxiliary input.

[0618] It should be noted that Fig.39 or Fig.40 This is a possible implementation of the embodiment of the present application. In other possible implementations, the user may select a virtual keyboard under an edit box provided by an application on the large screen through a remote control to trigger a subsequent auxiliary large-screen input process, or the user may trigger the auxiliary large-screen input process on a mobile phone, which is not specifically limited in the embodiment of the present application.

[0619] In combination with the above description, the user interface for the interaction between the large screen and the mobile phone is exemplified below.

[0620] For example, Figure 41-42 A schematic diagram of a user interface for user-triggered auxiliary input is shown.

[0621] Fig.41 A user interface diagram of a large screen is shown. Fig.41 As shown, the user can use the remote control 4101 to select the edit box 4102 in the large screen, which can trigger the subsequent process of the mobile phone-assisted large screen input in the embodiment of the present application. Alternatively, the user can use the remote control 4101 to select any content 4103 in the virtual keyboard in the large screen, which can trigger the subsequent process of the mobile phone-assisted large screen input in the embodiment of the present application. The specific method of mobile phone-assisted large screen input will be described in the subsequent embodiments and will not be repeated here.

[0622] It should be noted that Fig.41 A schematic diagram of setting an edit box in the user interface diagram of the large screen is shown. In a possible implementation, the user interface of the large screen may include multiple edit boxes, and the user triggering any edit box may trigger the subsequent mobile phone-assisted large screen input process of the embodiment of the present application, and the embodiment of the present application does not specifically limit this.

[0623] Fig.42 A user interface diagram of a mobile phone is shown. For example, a user can display the following information by pulling down the main screen of the mobile phone. Fig.42 The user interface shown in Figure a is as follows. Fig.42 The user interface shown in FIG. a may include one or more of the following functions of the mobile phone: WLAN, Bluetooth, flashlight, mute, flight mode, mobile data, wireless screen projection, screenshot or auxiliary input 4201. The auxiliary input 4201 may be a function of assisting large-screen input of the mobile phone in the embodiment of the present application.

[0624] In a possible implementation, after the user clicks on the auxiliary input 4201, the mobile phone can search for a large screen and other devices in the same distributed network, obtain the search box in the large screen, establish a communication connection with the large screen, and further display the following information in the mobile phone: Fig.42 The user interface shown in Figure c is as follows. Fig.42 In the user interface shown in Figure c, an edit box for assisting large-screen input may be displayed, and the user may assist the large-screen input based on the edit box.

[0625] In a possible implementation, if the mobile phone finds that there are multiple large screen devices in the same distributed network, the mobile phone can also display the following information: Fig.42 The user interface shown in Figure b is as follows. Fig.42 The user interface shown in Figure b can display multiple large screen logos, and the logo of the large screen can be the device number, user name or nickname of the large screen. Fig.42 In the user interface shown in Figure b, select the large screen you want to assist in input (for example, click large screen A or large screen B), and enter the following Fig.42 The user interface shown in Figure c is not specifically limited in the present application embodiment. After the user triggers the large-screen input through any of the above methods, the large-screen can search for auxiliary devices (such as mobile phones) with auxiliary input capabilities in the distributed network, and automatically determine the mobile phone used for auxiliary input, or send notifications to all mobile phones found in the distributed network.

[0626] For example, if the large screen finds that there is a mobile phone in the distributed network, the large screen can automatically select the mobile phone as the auxiliary input device.

[0627] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among the multiple mobile phones, there is a default auxiliary input mobile phone set by the user, the large screen can automatically select the default auxiliary input mobile phone as the auxiliary input device.

[0628] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among the multiple mobile phones, there is an auxiliary input mobile phone selected by the user when performing auxiliary input last time, the large screen can automatically select the auxiliary input mobile phone selected by the user when performing auxiliary input last time as the auxiliary input device.

[0629] For example, if the big screen finds that there are multiple mobile phones in the distributed network, the big screen obtains the mobile phone most frequently selected by users as auxiliary input among the multiple mobile phones, and the big screen can automatically select the mobile phone most frequently selected by users as auxiliary input as the auxiliary input device.

[0630] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among the multiple mobile phones, there is a mobile phone with the same user account as the one logged in by the large screen, the large screen can automatically select the mobile phone with the same user account as the one logged in by the large screen as the auxiliary input device.

[0631] For example, take the example of a large screen sending a notification to a mobile phone in a distributed network. Figure 43-49 It shows the process of a mobile phone using candidate words synchronized from the large screen to assist large-screen input.

[0632] For example, Fig.43 FIG. 1 shows a schematic diagram of a user interface for a mobile phone to determine auxiliary large screen input. Fig.43As shown in the leftmost figure of the user interface diagram, when the mobile phone receives a notification from the large-screen device, a notification may pop up in the mobile phone, prompting the large screen to request auxiliary input, and the user may trigger the notification in the mobile phone to confirm the auxiliary large-screen input. Further, as Fig.43 The user interface shown in the middle figure shows that an edit box can pop up in the mobile phone to assist in large-screen input. Furthermore, the user can trigger the input by clicking, etc. Fig.43 The edit box shown in the middle picture can be displayed on the phone as follows Fig.43 The user interface shown in the rightmost picture can display the mobile phone's virtual keyboard (or soft keyboard), and the user can subsequently use the mobile phone's virtual keyboard to assist in large-screen input.

[0633] For example, if the user wants to change the settings of the auxiliary application in the large screen, but there are many options for the application in the settings page of the large screen and it is difficult to find, the user can go to Fig.43 Enter the keyword "auxiliary" in the edit box of the mobile phone shown in the rightmost picture.

[0634] like Fig.44 In the large-screen user interface shown, the keyword "auxiliary" in the mobile phone edit box can be synchronized to the large-screen side edit box. The large screen searches for candidate words matching "auxiliary" based on the local or cloud vocabulary of the large screen, and displays them in the candidate word list. For example, the candidate word list of the large screen can include content related to "auxiliary" in multiple categories, such as the application category can include "auxiliary applications and voice input, as well as auxiliary applications", etc., and the auxiliary function category can include "accessibility and accessibility", etc.

[0635] It should be noted that when the large screen matches the candidate words for the keywords in the large screen edit box, it can be related to the function to be implemented by the large screen (or the scene in which it is located). Alternatively, it can be understood that the keywords entered by the user in the edit box are the same, but because the interfaces of the edit boxes are different and the functions implemented are different, the candidate words associated with the keywords in the edit boxes by the large screen can be the same or different.

[0636] For example, if the big screen currently uses a mobile phone to assist in searching for movies, the big screen can match relevant movie titles as keywords in conjunction with the movie library.

[0637] For example, if the big screen currently uses a mobile phone to assist in searching for TV series, the big screen can match relevant TV series titles as keywords in conjunction with the TV series library.

[0638] For example, if the big screen currently uses a mobile phone to assist in searching for music, the big screen can match relevant music titles as keywords in combination with the music library.

[0639] For example, if the large screen currently uses the mobile phone to assist in searching for functions in the large screen, the large screen can match related function names for keywords in conjunction with the function library.

[0640] In possible implementations, the sorting of candidate words displayed on the large screen is related to the user's historical behavior. Or it can be understood that when the keywords entered by the user in the edit box are the same, but the user's previous selections of candidate words corresponding to the keywords are different, the sorting of candidate words for the keyword on the large screen can change.

[0641] For example, for a certain keyword, if the candidate word selected by the user using this keyword on the large screen last time is candidate word A, then candidate word A can be displayed in a position with a higher ranking on the large screen.

[0642] For example, for a certain keyword, if the candidate word with the highest or relatively high frequency of being selected by the user using this keyword on the large screen is candidate word B, then candidate word B can be displayed in a position with a higher ranking on the large screen. The candidate words in the candidate word list on the large screen can be further synchronized to the input interface of the mobile phone. The display method of the candidate words in the candidate word list on the large screen on the mobile phone can be set according to the actual application scenario. For example, the sorting of the candidate words on the large screen can also be synchronized to the display interface of the mobile phone to recommend candidate words that conform to the user's habits on the large screen to the user on the mobile phone. The embodiments of the present application do not make specific limitations on this.

[0643] It should be noted that the candidate words of the mobile phone local input method based on keyword association can be the same as or different from the candidate words of the large screen based on keyword association. In possible implementations, the candidate words of the mobile phone local input method based on keyword association are the same as the candidate words of the large screen based on keyword association, but the sorting of the candidate words of the mobile phone local input method based on keyword association can be the same as the sorting of the candidate words of the large screen based on keyword association.

[0644] Exemplarily, Figures 45-48 The schematic diagrams of the mobile phone interface when synchronizing the candidate words in the candidate word list on the large screen to the mobile phone are shown.

[0645] As Fig.45 shown in the mobile phone display interface, when the user enters "assistant" in the edit box of the mobile phone, the candidate words obtained by the mobile phone from the large screen synchronization can be displayed similar to the candidate words of the mobile phone local input method. For example, the candidate words obtained by the large screen synchronization can be displayed in the form of a list in the input interface of the mobile phone. In a possible way of understanding, as Fig.45 shown in the mobile phone display interface, the user may not perceive whether the candidate words provided by the mobile phone are specifically from the mobile phone local or synchronized from the large screen. However, because the candidate words obtained by the large screen synchronization are provided among the candidate words provided by the mobile phone in the embodiments of the present application, the candidate words provided for the user in the mobile phone are closer to the content of the large screen, which is more conducive to assisting the user to achieve fast input.

[0646] As Fig.46In the mobile phone user interface shown, the candidate words in the candidate word list on the large screen can be displayed in a separate column from the candidate words of the mobile phone's native input method. For example, as Fig.46 shown, when the user enters "assistant" in the editing box of the mobile phone, in the user interface of the mobile phone, the candidate words matching "assistant" synchronized from the large screen can be displayed in one column (for example, the large screen candidate search word column), and the candidate words associated by the mobile phone's native input method using "assistant" can be displayed in one column (for example, the mobile phone candidate word column).

[0647] In a possible implementation, as Fig.47 shown, the candidate words in the candidate word list on the large screen and the candidate words of the mobile phone's native input method are displayed in separate columns. Although the candidate words in the candidate word list on the large screen are the same as the candidate words of the mobile phone's native input method, the sorting of the candidate words in the candidate word list on the large screen and the candidate words of the mobile phone's native input method can be different.

[0648] As Fig.48 shown in the mobile phone user interface, the candidate words in the candidate word list on the large screen can be arranged in front of the candidate words of the mobile phone's native input method, and a horizontal line or other identifier can be used to divide the candidate words in the candidate word list on the large screen from the candidate words of the mobile phone's native input method. Alternatively, the candidate words in the candidate word list on the large screen can be arranged behind the candidate words of the mobile phone's native input method, and a horizontal line or other identifier can be used to divide the candidate words in the candidate word list on the large screen from the candidate words of the mobile phone's native input method ( Fig.48 not shown).

[0649] As Fig.49 shown in the mobile phone user interface, the candidate words in the candidate word list on the large screen can be distinguished from the candidate words of the mobile phone's native input method by an identifier. Among them, the identifier of the candidate words in the candidate word list on the large screen is different from that of the candidate words of the mobile phone's native input method. The specific form of the identifier can include: color, text, and / or image, etc., which are not limited in the embodiments of the present application.

[0650] For example, as Fig.49 shown, when the user enters "assistant" in the editing box of the mobile phone, in the user interface of the mobile phone, an arrow pointing to the lower right can be added as an identifier to the candidate words matching "assistant" synchronized from the large screen, and an arrow pointing to the upper left can be added as an identifier to the candidate words associated by the mobile phone's native input method using "assistant", so that the user can know the source of the candidate words based on the identifiers of each candidate word.

[0651] The embodiment of the present application does not limit the specific display order of the candidate words in the candidate word list of the large screen and the candidate words of the local input method of the mobile phone. In a possible implementation, the candidate words in the candidate word list of the large screen and the candidate words of the local input method of the mobile phone can be sorted in order of historical usage from high to low in combination with the user's historical search situation. In a possible implementation, the popularity of the candidate words in the candidate word list of the large screen and the candidate words of the local input method of the mobile phone can be combined and sorted in order from high to low in popularity. In a possible implementation, the candidate words in the candidate word list of the large screen can be placed in front of the candidate words of the local input method of the mobile phone. In a possible implementation, the candidate words in the candidate word list of the large screen and the candidate words of the local input method of the mobile phone can be cross-sorted. In a possible implementation, the candidate words in the candidate word list of the large screen and the candidate words of the local input method of the mobile phone can be randomly sorted.

[0652] In this way, Figure 45-49 In any of the mobile phone user interfaces shown, the user can click on the desired target candidate word to fill the target candidate word in the edit box of the mobile phone, and then implement a search on the large screen based on the target candidate word.

[0653] In a possible implementation, the technical implementation of synchronizing the candidate words in the candidate word list of the large screen to the mobile phone may include: reading the candidate words in the candidate word list of the large screen based on the input method framework of the large screen, and sending the candidate words in the candidate word list of the large screen to the input method framework of the mobile phone through distributed networking. The embodiment of the present application does not limit the technical implementation of synchronizing the candidate words in the candidate word list of the large screen to the mobile phone.

[0654] It should be noted that the above-mentioned user interface diagrams when the mobile phone assists in large-screen input are all exemplary illustrations. In possible implementation methods, the interface when the mobile phone assists in large-screen input can also synchronize part or all of the content on the large screen, so that the mobile phone user can understand the status of the large screen based on the mobile phone interface.

[0655] For example, Fig.50 FIG. 1 shows a user interface of a mobile phone. Fig.50 As shown, when the user uses the mobile phone to assist in large-screen input, the user can project all or part of the content of the large screen to the mobile phone. For example, the content related to the edit box of the large screen is displayed on the mobile phone, and the edit box of the mobile phone is displayed on the upper layer of the large-screen content. In this way, when the user inputs in the edit box of the mobile phone, the status of the edit box on the large screen can be synchronously seen in the user interface of the mobile phone. The user does not need to look up at the input status on the large screen when assisting input.

[0656] It should be noted that in the above embodiments, the example of user-assisted large-screen input of Chinese characters is used for illustration. In possible implementations, the user can assist the large screen in inputting English phrases or other forms of text input. The embodiments of the present application do not limit the specific content of the assisted input.

[0657] For example, Fig.51 A schematic diagram of a specific process of using a mobile phone to assist a large screen in input is shown.

[0658] like Fig.51 As shown, mobile phone-assisted large-screen input may include: near-field device discovery, identity authentication and remote data channel establishment, and synchronization of large-screen candidate entries to the mobile phone.

[0659] Exemplarily, during the near-field device discovery process, the large-screen remote input service is turned on and started, and the large-screen can enable the near-field auxiliary device discovery function. When the focus is obtained in the search box of the large screen (for example, the search box selected by the user with the remote control), the large screen can send a broadcast to query distributed auxiliary input devices with auxiliary input capabilities (such as mobile phones). After the distributed auxiliary input device receives the broadcast from the large screen, a notification can pop up on the distributed auxiliary input device, which is used to prompt the large screen that auxiliary input is needed.

[0660] In a possible implementation, during the near-field device discovery process, the large screen can use Bluetooth or LAN broadcasting to query the near-field device, and all distributed auxiliary input devices with auxiliary input capabilities will receive notifications.

[0661] During the process of identity authentication and establishment of a remote data channel, after the distributed auxiliary input device receives the notification, the user can click on the notification message in the distributed auxiliary input device to trigger the large screen and the distributed auxiliary input device (hereinafter, the distributed auxiliary input device is taken as a mobile phone as an example for illustration) to perform identity authentication, such as verifying the legitimacy of the identities of both parties. After the authentication is completed, a remote data channel can be established between the large screen and the mobile phone, and data transmission between the large screen and the mobile phone can be realized based on the remote data channel. For example, after the mobile phone receives the remote data channel, it can load and display the auxiliary input mark box (or edit box), and the user can enter keywords in the input mark box.

[0662] It can be understood that the steps of identity authentication can be adapted and selected according to the actual application scenario. For example, in some scenarios (such as scenarios with low security requirements, etc.), identity authentication may not be performed between the large screen and the mobile phone. After the user on the mobile phone side triggers a notification, a remote data channel can be established between the large screen side and the mobile phone side.

[0663] In the process of synchronizing the candidate word list on the large screen side to the mobile phone, the mobile phone can synchronize the input keywords or key words to the large screen side through the remote data channel, and the large screen side submits the keywords or key words to the edit box through the local data channel. The large screen side can display the keywords or key words entered on the mobile phone side, and the search box on the large screen side finds matching candidate words according to the keywords or key words, and the matching candidate words are filled into the candidate word list of the large screen search box. The large screen synchronizes the candidate word list to the mobile phone side through the remote data channel. After the mobile phone receives the candidate word list, the mobile phone displays the candidate word list on the candidate word list interface of the mobile phone through the local data channel. If the candidate word list does not contain the target word the user wants, the user can continue to enter the keyword or key words in the mobile phone; if the candidate word list contains the target word the user wants, the user clicks the target word, and the mobile phone synchronizes the target word to the input box on the large screen side through the remote data channel to realize auxiliary input.

[0664] It should be noted that the above-mentioned user interface diagrams when the mobile phone assists in large-screen input are all exemplary illustrations. In possible implementation methods, the interface when the mobile phone assists in large-screen input can also synchronize part or all of the content on the large screen, so that the mobile phone user can understand the status of the large screen based on the mobile phone interface.

[0665] In the case of dividing each functional module into corresponding functional modules, such as Fig.52 As shown, a possible structural diagram of a first device or a second device provided in an embodiment of the present application is shown, and the first device or the second device includes: a display screen 5201 and a processing unit 5202.

[0666] The display screen 5201 is used to support the first device or the second device to perform the display steps in the above embodiment, or other processes of the technology described in the embodiment of the present application. The display screen 5201 can be a touch screen or other hardware or a combination of hardware and software.

[0667] The processing unit 5202 is used to support the first device or the second device to execute the processing steps in the above method embodiments, or other processes of the technology described in the embodiments of the present application.

[0668] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here.

[0669] Of course, the electronic device includes but is not limited to the unit modules listed above. Moreover, the specific functions that can be realized by the above functional units also include but are not limited to the functions corresponding to the method steps described in the above examples. The detailed description of other units of the electronic device can refer to the detailed description of the corresponding method steps, and the embodiments of this application are not repeated here.

[0670] In the case of adopting an integrated unit, the first device or the second device involved in the above embodiment may include: a processing module, a storage module and a display screen. The processing module is used to control and manage the actions of the first device or the second device. The display screen is used to display content according to the instructions of the processing module. The storage module is used to save the program code and data of the first device or the second device. Furthermore, the first device or the second device may also include an input module and a communication module, and the communication module is used to support the communication between the first device or the second device and other network entities to realize the functions of the first device or the second device, such as calling, data interaction, Internet access, etc.

[0671] The processing module may be a processor or a controller. The communication module may be a transceiver, an RF circuit or a communication interface, etc. The storage module may be a memory. The display module may be a screen or a display. The input module may be a touch screen, a voice input device, or a fingerprint sensor, etc.

[0672] The communication module may include an RF circuit, and may also include a wireless fidelity (Wi-Fi) module, a near field communication (NFC) module, and a Bluetooth module. Communication modules such as the RF circuit, the NFC module, the WI-FI module, and the Bluetooth module may be collectively referred to as a communication interface. The processor, the RF circuit, the display screen, and the memory may be coupled together via a bus.

[0673] like Fig.53 As shown, another possible structural diagram of the first device or the second device provided in an embodiment of the present application is shown, including: one or more processors 5301, a memory 5302, a camera 5304 and a display screen 5303; the above-mentioned devices can communicate through one or more communication buses 5306.

[0674] Among them, one or more computer programs are stored in the memory 5302 by 5305 and are configured to be executed by one or more processors 5301; one or more computer programs 5305 include instructions, and the instructions are used to execute the display method of any of the above steps. Of course, the electronic device includes but is not limited to the devices listed above. For example, the above electronic device may also include a radio frequency circuit, a positioning device, a sensor, etc.

[0675] The present application also provides the following embodiments. It should be noted that the numbering of the following embodiments does not necessarily need to follow the numbering sequence of the previous embodiments.

[0676] Embodiment 41. A device communication method, applied to a system including a first device, a second device, and a third device, the method comprising:

[0677] The first device, the second device and the third device are connected to a distributed network;

[0678] The second device acquires a target candidate word, the target candidate word does not belong to the candidate word library of the first device, and the target candidate word does not belong to the candidate word library of the third device;

[0679] The first device receives a keyword related to the target candidate word input by a user, and the first device displays the target candidate word;

[0680] And / or, the third device receives a keyword related to the target candidate word input by a user, and the third device displays the target candidate word.

[0681] Embodiment 42. The method according to embodiment 41, further comprising:

[0682] The first device, the second device and the third device synchronize their respective candidate word libraries with each other.

[0683] Embodiment 43. The method according to embodiment 41 or 42, further comprising:

[0684] When the first device, the second device or the third device exits the distributed networking, a prompt interface for whether to delete the synchronized candidate word library is displayed in the first device, the second device or the third device; the prompt interface includes an option for indicating deletion and an option for indicating non-deletion;

[0685] In response to a trigger operation on the option indicating deletion, the first device, the second device, or the third device deletes the candidate word library synchronized from other devices respectively;

[0686] Alternatively, in response to a trigger operation on the option indicating not to delete, the first device, the second device or the third device retains the candidate word library synchronized from the distributed network.

[0687] Embodiment 44. The method according to embodiment 41 or 42, further comprising:

[0688] The first device, the second device or the third device respectively determines their respective access types;

[0689] When the first device, the second device or the third device exits the distributed network, the first device, the second device or the third device determines whether to delete the candidate word library synchronized from the distributed network according to their respective access types.

[0690] Embodiment 45. The method according to any one of embodiments 41-44, further comprising:

[0691] The first device displays a first interface including a first edit box;

[0692] The first device sends an indication message to the second device;

[0693] The second device displays a second interface according to the instruction message, where the second interface includes a second edit box;

[0694] When an editing state exists in the second editing box, the editing state is synchronized to the first editing box.

[0695] Embodiment 46. According to the method of embodiment 45, the second device includes an interface service, and the interface service is used for synchronization of the editing status between the first device and the second device.

[0696] Embodiment 47. According to the method described in Embodiment 45 or 46, the editing state includes one or more of the following: a highlight mark of text content, cursor or text content.

[0697] Embodiment 48. According to the method of any one of Embodiments 45-47, the second device displays a second interface according to the indication message, including:

[0698] The second device displays a notification interface in response to the indication message; the notification interface includes a third option for confirming the auxiliary input;

[0699] In response to a triggering operation on the third option, the second device displays the second interface.

[0700] Embodiment 49. According to the method described in any one of Embodiments 45-48, the second interface also includes: all or part of the content of the first interface.

[0701] Embodiment 410. According to the method described in Embodiment 49, the second edit box is displayed in layers with all or part of the content of the first interface, and the second edit box is displayed on an upper layer of all or part of the content of the first interface.

[0702] Embodiment 411. According to the method of any one of Embodiments 45-49 and 410, after the second device displays the second interface according to the indication message, the method further includes:

[0703] In response to triggering the second edit box, the second device displays a virtual keyboard;

[0704] The second device displays the editing status in the second editing box according to the input operation received in the virtual keyboard and / or the second editing box.

[0705] Embodiment 412. According to the method described in any one of Embodiments 41-49, 410-411, the first device includes any one of the following: a television, a large screen or a wearable device; the second device or the third device includes any one of the following: a mobile phone, a tablet or a wearable device.

[0706] Embodiment 413. The method according to any one of embodiments 41-49, 410-412, further comprising:

[0707] The second device displays a fourth interface including options of the first device;

[0708] In response to a selection operation on an option of the first device, the second device sends an indication message to the first device;

[0709] The first device displays a first interface including a first edit box;

[0710] The second device displays a second interface, where the second interface includes a second edit box;

[0711] When an editing state exists in the second editing box, the editing state is synchronized to the first editing box.

[0712] Embodiment 414. A device communication method, applied to a system including a first device, a second device, and a third device, the method comprising:

[0713] The first device, the second device and the third device are connected to a distributed network;

[0714] The first device, the second device and the third device synchronize their respective candidate word libraries with each other to obtain a candidate word library set;

[0715] When the first device, the second device or the third device is editing text, the first device, the second device or the third device displays candidate words according to the candidate word library set.

[0716] Embodiment 415. A device communication method, applied to a first device, comprising:

[0717] The first device is connected to a distributed network; other devices are also connected to the distributed network;

[0718] The first device synchronizes the candidate word libraries of the other devices based on the distributed networking to obtain a candidate word library set;

[0719] When the first device is editing text, the first device displays candidate words according to the candidate word library set.

[0720] Embodiment 416. A device communication system comprises a first device, a second device and a third device, wherein the first device is used to execute the steps of the first device as described in any one of Embodiments 41-415, the second device is used to execute the steps of the second device as described in any one of Embodiments 41-49, 410-415, and the third device is used to execute the steps of the third device as described in any one of Embodiments 41-49, 410-415.

[0721] Embodiment 417. A first device comprising: at least one memory and at least one processor;

[0722] The memory is used to store program instructions;

[0723] The processor is used to call the program instructions in the memory so that the first device executes the steps performed by the first device described in any one of Examples 41-49, 410-415.

[0724] Embodiment 418. A second device comprising: at least one memory and at least one processor;

[0725] The memory is used to store program instructions;

[0726] The processor is used to call the program instructions in the memory so that the second device executes the steps performed by the second device described in any one of embodiments 41-49, 410-415.

[0727] Embodiment 419. A computer-readable storage medium having a computer program stored thereon, so that when the computer program is executed by a processor of a first device, the steps performed by the first device as described in any one of Embodiments 41-49, 410-415 are implemented; or, when the computer program is executed by a processor of a second device, the steps performed by the second device as described in any one of Embodiments 41-49, 410-415 are implemented; or, when the computer program is executed by a processor of a third device, the steps performed by the third device as described in any one of Embodiments 41-49, 410-415 are implemented.

[0728] The specific implementation of the above-mentioned embodiments 41 to 49 and embodiments 410 to 419 can refer to the following Figure 54-67 Description.

[0729] In the possible implementation of using a mobile phone to assist in large-screen input, after entering a keyword in the mobile phone, the keyword can be associated with the content of the mobile phone's own candidate word library (or it can be understood as the input method candidate word library corresponding to the input method used by the user), and recommended candidate words can be displayed. Users can click on the candidate words to achieve quick input, thereby achieving the purpose of improving user input efficiency.

[0730] However, the candidate word library of the mobile phone itself is usually not related to the program content on the large screen. When using the candidate word library of the mobile phone to associate keywords, it is often impossible to associate with the content related to the large-screen program, resulting in the user still having to select word by word, and the input efficiency is low.

[0731] Therefore, allowing the mobile phone to obtain a candidate word library with rich content is a feasible way to improve user input efficiency.

[0732] In possible implementations, some products may use user accounts to synchronize candidate word libraries between multiple devices of the user (such as mobile phones and large screens). For example, after a user registers a user account for an input method, no matter which device the user logs in to the user account on, specific candidate words generated during the user's input using the input method (such as words selected word by word by the user) can be saved in the candidate word library corresponding to the user account. If the user subsequently logs in to the user account on the large screen, the candidate word library of the large screen may also include the candidate word library of the mobile phone. If the user logs in to the user account on the mobile phone, the candidate word library of the mobile phone may also include the candidate word library of the large screen.

[0733] However, in this implementation, the synchronization of the candidate word library is completely dependent on the user account of the input method. If the user has not logged in to the user account in a certain device, the synchronization of the candidate word library cannot be achieved. Or, because the user account is usually for a certain company's input method, if a certain device does not support the company's input method, or the user changes the type of input method, the synchronization of the candidate word library cannot be achieved. Moreover, if the user changes the device, etc., it is necessary to switch or log in to the user account, which is cumbersome. Moreover, in actual use, there are not many users who register input method accounts, and it is even rarer to log in to the user account when using the input method to input, resulting in that this implementation method cannot be fully utilized.

[0734] Based on this, an embodiment of the present application provides a device communication method, which can synchronize the candidate vocabulary in the distributed network to the device after the device joins the distributed network, thereby eliminating the need to rely on the user account of the input method, and allowing multiple devices to conveniently share candidate vocabulary, thereby providing better input services for users.

[0735] For example, Fig.54 A schematic diagram of a specific application scenario of an embodiment of the present application is shown.

[0736] like Fig.54 As shown, a large screen, a tablet, a mobile phone A and a mobile phone B are connected to the distributed network. The large screen, the tablet, the mobile phone A and the mobile phone B can respectively synchronize the candidate word libraries of other devices based on the distributed network, so that the large screen, the tablet, the mobile phone A and the mobile phone B can all obtain a candidate word library set, which can be understood as the union of the candidate word library of the large screen, the candidate word library of the tablet, the candidate word library of the mobile phone A and the candidate word library of the mobile phone B. Then, the large screen, the tablet, the mobile phone A and the mobile phone B can all use the candidate word library set to achieve convenient candidate word recommendation and improve user input efficiency.

[0737] Exemplarily, the large screen, tablet, mobile phone A and mobile phone B can be connected to the same WIFI to realize the establishment of a distributed network. Among them, the large screen, tablet, mobile phone A and mobile phone B can be added to the distributed network in any possible form, and the embodiment of the present application does not specifically limit this.

[0738] It can be understood that the specific types and quantities of devices connected in the distributed network can be determined according to the actual application scenario, and the embodiments of the present application do not specifically limit the devices connected in the distributed network.

[0739] When each device joins the distributed network, each device can push the content in its own candidate word library to the candidate word library path of other devices in the distributed network based on the distributed database synchronization capability provided by the FWK layer of each device, so as to achieve synchronization of the candidate word libraries of each device. It can be understood that if each device in the distributed network performs the input step and generates a new candidate word after joining the distributed network, it can also adapt to synchronize the new candidate word to the candidate word library of each device.

[0740] In a possible implementation, the candidate vocabulary path of each device in a distributed network can be the same. For example, the candidate vocabulary path of each device can be set to the distributed candidate vocabulary system path "data / inputmethod / candicateWords". Then each device in the distributed network can conveniently push its own candidate vocabulary based on the same path.

[0741] In a possible implementation, when each device in a distributed network synchronizes its candidate word library with other devices, it can attach its own device information to the candidate words in its candidate word library, so that the candidate words can be flexibly managed based on the device information attached to the candidate words. For example, when a certain device exits the distributed network, the candidate words with the device information of the certain device can be deleted from the candidate word library of other devices in the distributed network, etc.

[0742] In a possible implementation, when a device first joins the distributed network, the user can set the access type of the device (or can be understood as permission), or each device can automatically determine the access type of the device, and then perform adaptation steps according to the access type of the device. When the device joins the distributed network again (or it can be understood that the device is not joining the distributed network for the first time), the access type previously set by the device can be automatically identified, and then the adaptation steps are performed according to the access type of the device. Exemplarily, the access type of the device may include commonly used devices, temporary visitors, or blacklisted devices.

[0743] For example, a commonly used device can indicate that the security level of the device is high. Then, when the commonly used device joins a distributed network, the commonly used device can be allowed to synchronize the candidate word library of other devices in the distributed network, and synchronize the candidate word library of the commonly used device itself to other devices in the distributed network. When a commonly used device exits a distributed network, the candidate word library synchronized to the commonly used device from the distributed network can be retained, so that the commonly used device can continue to use the candidate word library synchronized to the distributed network to achieve rich candidate word recommendations after exiting the distributed network. When a commonly used device exits a distributed network, the candidate word library of the commonly used device itself synchronized to the distributed network can also be retained in the distributed network, so that other devices in the distributed network can continue to use the candidate word library of the commonly used device to achieve rich candidate word recommendations. It can be understood that the specific permissions of the commonly used device can also be set according to the actual application scenario, and the embodiments of the present application do not specifically limit this.

[0744] For example, a temporary visitor may indicate that the security level of the device is average. Then, when the temporary visitor joins the distributed network, the temporary visitor may be allowed to synchronize the candidate word library of other devices in the distributed network, and synchronize the candidate word library of the temporary visitor itself to other devices in the distributed network. When the temporary visitor exits the distributed network, the candidate word library synchronized to the temporary visitor from the distributed network may be deleted, and the candidate word library synchronized to the distributed network by the temporary visitor itself may also be deleted in the distributed network. It can be understood that the specific permissions of the temporary visitor can also be set according to the actual application scenario, and the embodiments of the present application do not specifically limit this.

[0745] For example, a blacklist device can indicate that the security level of the device is low. When the blacklist device joins a distributed network, the blacklist device can be prohibited from synchronizing the candidate word library of other devices in the distributed network, and the blacklist device can be prohibited from synchronizing its own candidate word library to other devices in the distributed network. It can be understood that the specific permissions of the blacklist device can also be set according to the actual application scenario, and the embodiments of the present application do not specifically limit this.

[0746] In this way, by distinguishing the access types of devices, it is convenient for users to input and at the same time can play a role in data protection.

[0747] Exemplarily, one possible implementation of setting the access type of a device is: an administrator device is set in a distributed network (for example, one or more devices with administrator functions are added to the distributed network), and the FWK layer of the administrator device can monitor the status of the distributed network, and obtain information about the distributed network and the devices in the distributed network. When the administrator device monitors that a certain access device (for example, a large screen, a tablet, mobile phone A or mobile phone B) has joined the distributed network, the administrator device can set the access type of the access device.

[0748] It is understandable that the access type of each device in the distributed network can be modified by the administrator device as needed later. For example, a modification interface for modifying the device access type can be provided in the administrator device, and the administrator can adapt to modify the access type of each device in the distributed network in the modification interface. Or, for example, each device can send a request for modifying the access type to the administrator device, and the administrator device can modify the access type of the device based on the request, etc. The embodiment of the present application does not limit the specific method of modifying the access type of the device.

[0749] Exemplarily, one possible implementation of setting the access type of a device is as follows: any device connected to a distributed network provides a function for setting the access type of the device when connected to the distributed network, and the user can set the access type of the device as needed.

[0750] In a possible implementation, if a new device (such as mobile phone C) is subsequently connected to the distributed network, mobile phone C can also synchronize the candidate vocabulary with the large screen, tablet, mobile phone A and mobile phone B, similar to the description of synchronizing the candidate vocabulary with the large screen, tablet, mobile phone A and mobile phone B above, which will not be repeated here.

[0751] In a possible implementation, if a device that has joined the distributed network (such as a large screen, a tablet, mobile phone A, mobile phone B or mobile phone C) exits the distributed network, the candidate words synchronized to the distributed network by the exiting device can be deleted from the candidate word library of the exiting device according to the access type of the exiting device, or the candidate words synchronized to the distributed network by the exiting device can be retained in the candidate word library of the exiting device. The embodiments of the present application do not make specific limitations on this.

[0752] For example, Fig.55 A schematic diagram of a specific system architecture of a device communication method according to an embodiment of the present application is shown.

[0753] like Fig.55As shown in the figure, the embodiments of the present application take a large screen, mobile phone A, and mobile phone C in a distributed network as examples to schematically illustrate the process of the large screen, mobile phone A, and mobile phone C accessing the distributed network, synchronizing the candidate word libraries of the large screen, mobile phone A, and mobile phone C, mobile phone A using the synchronized candidate word library to assist the large screen in input, and the process of the large screen, mobile phone A, or mobile phone C leaving the distributed network.

[0754] Among them, the large screen and mobile phone A are common devices, and mobile phone C is a temporary visitor. The large screen, mobile phone A, and mobile phone C can all set up a distributed network framework, a distributed database (which may also become a database), and an input method framework (which may also be called a remote input method framework service).

[0755] During the process of the large screen, mobile phone A, and mobile phone C accessing the distributed network, taking the distributed network framework of mobile phone C detecting that mobile phone C has accessed the distributed network as an example, mobile phone C can use operations such as a display interface and voice prompts to ask the user of this mobile phone C to select the access type (which can also be called the device type). After the user selects the appropriate access type, mobile phone C can be triggered to synchronize the candidate word libraries of other devices in the distributed network. The steps for the large screen and mobile phone A to access the distributed network and synchronize the candidate word libraries are similar to those of mobile phone C and will not be elaborated here. Exemplarily, if there is a candidate word "pozhimie" in the candidate word library of mobile phone C, both the large screen and mobile phone A can synchronize this candidate word "pozhimie".

[0756] During the process of mobile phone A assisting the large screen B in input, the user can click on the input method editing box on the large screen, and the large screen can pull up the input method of mobile phone A. For example, an input box pops up on mobile phone A, and the user can input content in the input box on mobile phone A to achieve the effect of assisting the large screen in input. Exemplarily, if the user inputs "pozhimie" or "PZM" etc. in the input box, based on the candidate word library including the candidate word "pozhimie" synchronized by mobile phone A from mobile phone C, the candidate word "pozhimie" can be displayed on the interface of mobile phone A. The user can trigger the candidate word "pozhimie" by clicking or other means and display "pozhimie" in the input box on the large screen. In the embodiments of the present application, the user of mobile phone A, because they have synchronized the candidate word "pozhimie" from mobile phone C, does not need to select the desired characters one by one when the user inputs "pozhimie" or "PZM" etc., thus improving the input efficiency.

[0757] During the process of the large screen, mobile phone A, and mobile phone C exiting (or disconnecting) from the distributed network, taking the example that the distributed network framework of mobile phone C monitors the disconnection of mobile phone C from the distributed network, since mobile phone C is a temporary visitor, the candidate words synchronized from the large screen and mobile phone A to the candidate word library of mobile phone C can be deleted. Similarly, the candidate words obtained by mobile phone A from mobile phone C (or the candidate words obtained by mobile phone A from mobile phone C and not used) can also be deleted. For mobile phone A and the large screen, since they are frequently used devices, if mobile phone A or the large screen disconnects from the distributed network, the candidate words synchronized from other devices in the distributed network to mobile phone A or the large screen can be retained, or the candidate words synchronized from mobile phone A or the large screen can be retained in other devices in the distributed network.

[0758] Exemplarily, taking the example that the large screen, mobile phone A, and mobile phone C all disconnect from the distributed network, after disconnecting from the distributed network, mobile phone C can restore to the candidate word library before accessing the distributed network. The candidate word library of mobile phone A can include the candidate word library before mobile phone A accessed the distributed network and the candidate word library before the large screen accessed the distributed network. The candidate word library of the large screen can include the candidate word library before mobile phone A accessed the distributed network and the candidate word library before the large screen accessed the distributed network.

[0759] It can be understood that if new candidate words are generated due to input behaviors of the large screen, mobile phone A, or mobile phone C during the process of the large screen, mobile phone A, and mobile phone C being connected to the distributed network, the processing method of the new candidate words can also be adaptively adjusted according to the access types of the large screen, mobile phone A, and mobile phone C. For example, if the new candidate word is generated due to the input behavior of mobile phone C, it can be deleted from the candidate word libraries of mobile phone A and the large screen as mobile phone C disconnects from the distributed network. If the new candidate word is generated due to the input behavior of mobile phone A or the large screen, the new candidate word can be retained in the candidate word libraries of mobile phone A and the large screen after mobile phone A or the large screen disconnects from the distributed network.

[0760] In a possible implementation, if the candidate words in the candidate word library of mobile phone C are used during the process of the large screen, mobile phone A, and mobile phone C being connected to the distributed network. For example, when mobile phone A assists the large screen in inputting, the candidate word "pō zhǐ miē" in mobile phone C is used. After mobile phone C disconnects from the distributed network, the used candidate word "pō zhǐ miē" can be retained in the candidate word libraries of mobile phone A and the large screen.

[0761] It should be noted that the above embodiments of the present application are all described by taking the synchronization of candidate word libraries as an example. In possible implementations, the methods of the embodiments of the present application are also applicable to any data sharing scenario. For example, a method similar to the above-mentioned synchronization of candidate word libraries can be adopted to utilize distributed networking to achieve synchronization of files, music, videos and / or pictures between multiple devices. It can be understood that since candidate word libraries are usually text and usually occupy a relatively small space, in the implementation of the synchronization of candidate word libraries, it is not necessary to pay attention to the selection of storage controls. If the synchronized data is large, in actual applications, it is also possible to select an appropriate storage space for the data to be synchronized based on the size of the control occupied by the data to be synchronized.

[0762] Corresponds to Fig.55 The process described below provides examples of synchronizing candidate word libraries among a large screen, mobile phone A, and mobile phone C, mobile phone A using the synchronized candidate word library to assist the large screen in input, and the user interface of the large screen, mobile phone A, or mobile phone C leaving the distributed network.

[0763] For example, Fig.56 A schematic diagram of a user interface for selecting a device type is shown. Taking the distributed networking framework of mobile phone C monitoring that mobile phone C is connected to the distributed network as an example, mobile phone C can display the following Fig.56 The user interface shown.

[0764] like Fig.56 As shown, the user interface may include a common device control 5601 and a temporary visitor control 5602 for setting the access type of mobile phone C. The user can set mobile phone C as a temporary visitor by clicking the temporary visitor control 5602 button. In a similar way, the user can set mobile phone A and a large screen as common devices, which will not be repeated here.

[0765] In a possible implementation, if the large screen, mobile phone A or mobile phone C has previously set an access type in the distributed network, when the large screen, mobile phone A or mobile phone C joins the distributed network again, the previously set access type can be retained without prompting Fig.56 The user interface shown.

[0766] In a possible implementation, the large screen, mobile phone A or mobile phone C can also determine their respective access types according to the frequency, duration and / or number of times they join the distributed network.

[0767] For example, for any one of the large screen, mobile phone A, or mobile phone C: If the frequency of joining the distributed network is higher than a certain threshold, it can be determined as a frequently used device; or, if the frequency of joining the distributed network is lower than a certain threshold, it can be determined as a temporary visitor; or, if the duration of joining the distributed network is higher than a certain threshold, it can be determined as a frequently used device; or, if the duration of joining the distributed network is lower than a certain threshold, it can be determined as a temporary visitor; or, if the number of times of joining the distributed network is higher than a certain threshold, it can be determined as a frequently used device; or, if the number of times of joining the distributed network is lower than a certain threshold, it can be determined as a temporary visitor; or, if the number of times of joining the distributed network is higher than a certain threshold and the duration is higher than a certain threshold, it can be determined as a frequently used device; or, if the number of times of joining the distributed network is lower than a certain threshold and the duration is lower than a certain threshold, it can be determined as a temporary visitor; etc., and the embodiments of the present application do not make specific limitations thereon. In this manner, it may also not prompt a user interface as shown in Fig.56 shown.

[0768] In a possible implementation manner, if the user has previously set the access type of the device, the access type of the device set by the user last time can be automatically used as the access type of the device, and a user interface as shown in Fig.56 is not displayed.

[0769] In a possible implementation manner, if there are multiple devices among multiple devices that are the same as the logged-in user account, the multiple devices with the same logged-in user account can be automatically determined as frequently used devices, and a user interface as shown in Fig.56 is not displayed.

[0770] In a possible implementation manner, the access type of the large screen, mobile phone A, or mobile phone C may also not be set, and the large screen, mobile phone A, or mobile phone C has common permissions, and the embodiments of the present application do not make specific limitations thereon. In this manner, it may also not prompt a user interface as shown in Fig.56 shown.

[0771] It can be understood that if the large screen, mobile phone A, or mobile phone C sets an access type, corresponding steps of adding or deleting candidate word libraries can be performed based on the access type subsequently. If the large screen, mobile phone A, or mobile phone C does not set an access type, steps of adding or deleting a selected word library corresponding to any one of the above access types can be performed subsequently, and the embodiments of the present application do not make limitations thereon.

[0772] Fig.57 shows a schematic diagram of an interface for generating candidate words in mobile phone C. As shown in Fig.57 shown, after the user enters "pozhimie" in the input box, the user can select candidate characters one by one to obtain "坡止咩", and this "坡止咩" can be stored as a candidate word in the candidate word library of mobile phone C.

[0773] Alternatively, the user can also input English phrases "apple", "banana", and "meat" in the edit box of mobile phone C, and select each of the above phrases one by one to obtain the candidate English phrase "apple banana meat", which can be stored as a candidate word in the candidate word library of mobile phone C.

[0774] After that, mobile phone C is connected to the distributed network, and the large screen and mobile phone A can synchronize the candidate words such as "pō zhǐ miē". It can be understood that the process of synchronizing the candidate word library can be without a user interface, and the user can be unaware of the process of synchronizing the candidate word library. When mobile phone A assists the large screen in input later, fast input can be achieved based on the candidate words of "pō zhǐ miē". When the large screen inputs by itself, fast input can be achieved based on the candidate words of "pō zhǐ miē". When the mobile phone inputs by itself, fast input can be achieved based on the candidate words of "pō zhǐ miē".

[0775] Exemplarily, Figures 58-60 shows the process of mobile phone A using the candidate words of "pō zhǐ miē" to assist the large screen in input.

[0776] Fig.58 shows a schematic diagram of a user interface of the large screen. As Fig.58 shown, the user can select the input method edit box on the large screen through a device such as a remote control. The input method edit box control of the large screen can request to start the local input method from the input method framework (IMF) of the large screen and transmit the data channel to the IMF. The IMF queries the server with distributed capabilities through the distributed network. For example, the server can include mobile phone A. Then the large screen can connect to the auxiliary AA of mobile phone A and request auxiliary input from mobile phone A or pop up an input box in mobile phone A, etc.

[0777] Fig.59 shows a schematic diagram of a user interface for mobile phone A to determine to assist the large screen in input. As Fig.59 shown in the user interface of the leftmost figure, a notification for prompting the large screen to request auxiliary input can pop up in mobile phone B, and the user can trigger the notification in mobile phone B to confirm assisting the large screen in input. Further, as Fig.59 shown in the user interface of the middle figure, an edit box for assisting the large screen in input can pop up in mobile phone A. Further, the user can trigger the edit box shown in the Fig.59 middle figure by clicking or the like, and mobile phone A can display the user interface shown in the Fig.59 rightmost figure. The virtual keyboard (or called soft keyboard) of the mobile phone can be displayed in this user interface, and the user can subsequently use the virtual keyboard of mobile phone A to assist the large screen in input.

[0778] Fig.60Shows a schematic diagram of the user interface of mobile phone A using the "Pozhimie" candidate words synchronized from mobile phone C to assist large-screen input. As Fig.60 As shown in the left figure of the user interface diagram of mobile phone A in , after the user enters "pozhimie" in the input box of mobile phone A, the input method of mobile phone A can display the "Pozhimie" candidate words based on the synchronized candidate word library. When the user clicks on the "Pozhimie" candidate word, the input box of mobile phone A can display "Pozhimie". After the user clicks to complete, it can enter Fig.60 The user interface diagram of the large screen shown in the right figure of . In the editing box of the large screen, "Pozhimie" in the input box of mobile phone A can be synchronously displayed.

[0779] In a possible implementation, when the user enters in the input box of mobile phone A as shown in the left figure of Fig.60 , the content in the input box can be synchronously displayed in the editing box of the large screen as shown in the right figure of Fig.60 . For example, when the user performs operations such as deletion, highlighting selection, or cursor movement in the input box of mobile phone A as shown in the left figure of Fig.60 , the editing box of the large screen as shown in the right figure of Fig.60 can synchronously display the states such as deletion, highlighting selection, or cursor movement in the input box of mobile phone ...

Claims

1. A device communication method, characterized in that: Applied to a system including a first device, a second device, and a third device, the method includes: The first device displays a first interface including a first edit box; The first device sends an indication message to the second device and the third device; The second device displays a second interface according to the instruction message, where the second interface includes a second edit box; When there is an editing state in the second editing box, the first device synchronizes the editing state to the first editing box; The third device sends a preemption message to the first device; The third device displays a third interface including a third editing box; the third editing box is synchronized with the editing status of the first editing box.

2. The method according to claim 1, characterized in that: The second device includes an interface service, and the interface service is used for synchronization of editing status between the first device and the second device.

3. The method according to claim 1 or 2, characterized in that: The editing state includes one or more of the following: text content, a highlight mark of a cursor or text content.

4. The method according to claim 1 or 2, characterized in that: The second device displays a second interface according to the instruction message, including: The second device displays a first notification interface in response to the indication message; the first notification interface includes an option to confirm the auxiliary input; In response to a triggering operation on the option, the second device displays the second interface.

5. The method according to claim 1 or 2, characterized in that: The second interface also includes: all or part of the content of the first interface.

6. The method according to claim 1, characterized in that The second edit box is displayed in layers with all or part of the content of the first interface, and the second edit box is displayed on an upper layer of all or part of the content of the first interface.

7. The method according to claim 1, characterized in that After the second device displays the second interface according to the instruction message, the method further includes: In response to triggering the second edit box, the second device displays a virtual keyboard; The second device displays the editing status in the second editing box according to the input operation received in the virtual keyboard and / or the second editing box.

8. The method according to claim 1 or 2, characterized in that: The first device includes any one of the following: a television, a large screen or a wearable device; the second device or the third device includes any one of the following: a mobile phone, a tablet or a wearable device.

9. The method according to claim 1, characterized in that: Also includes: When input content is received in the third edit box, the first device synchronizes the input content to the first edit box.

10. The method according to claim 1, characterized in that The third device sending a preemption message to the first device includes: The third device receives a preemption request from the second device; The third device sends the preemption message to the first device based on the preemption request.

11. The method according to claim 1, characterized in that: The third device sending a preemption message to the first device includes: The third device displays a second notification interface according to the user operation; the second notification interface includes an option to confirm the preemption; In response to a triggering operation on the option of confirming the preemption, the third device sends a preemption message to the first device.

12. A device communication method, characterized in that: Applied to a system including a first device, a second device, and a third device, the method includes: The second device displays a fourth interface including options of the first device; In response to a selection operation on an option of the first device, the second device sends an indication message to the first device; The first device displays a first interface including a first edit box; The second device displays a second interface, where the second interface includes a second edit box; When there is an editing state in the second editing box, the first device synchronizes the editing state to the first editing box; The third device sends a preemption message to the first device; The third device displays a third interface including a third editing box; the third editing box is synchronized with the editing status of the first editing box.

13. A device communication method, characterized in that: Applied to a first device, the method includes: The first device displays a first interface including a first edit box; The first device sends an instruction message to the second device and the third device; the instruction message is used to instruct the second device to display a second interface, where the second interface includes a second edit box; When there is an editing state in the second editing box, the first device synchronizes the editing state to the first editing box; The first device receives a preemption message from the third device; In a case where input content is received in the edit box of the third device, the first device synchronizes the input content of the edit box of the third device to the first edit box.

14. A device communication system, characterized in that: The method comprises a first device, a second device and a third device, wherein the first device is used to execute the steps of the first device as described in any one of claims 1 to 11, the second device is used to execute the steps of the second device as described in any one of claims 1 to 11, and the third device is used to execute the steps of the third device as described in any one of claims 1 to 11.

15. A third device, characterized in that: include: at least one memory and at least one processor; The memory is used to store program instructions; The processor is used to call the program instructions in the memory so that the third device executes the steps performed by the third device according to any one of claims 1-11.

16. A computer-readable storage medium having a computer program stored thereon, characterized in that When the computer program is executed by a processor of the third device, the steps performed by the third device as described in any one of claims 1 to 11 are implemented.

Images