Equipment communication method, system and device

Abstract

The embodiment of the invention provides an equipment communication method, system and device, and is applied to the technical field of communication. In the embodiment of the invention, in the process that a user uses the mobile phone to assist large-screen input, other auxiliary devices located in the same distributed network with the large screen and the mobile phone can preempt the auxiliary input of the mobile phone, and further, the large-screen input can be continuously assisted on the basis of the input content of the mobile phone, so that the user experience is improved. The user does not need to select the editing box of the large screen again by using equipment such as a remote controller, so that convenient and efficient large-screen input assistance is realized.

Description

[0001] This application is a divisional application. The application number of the original application is 202110267000.8, and the filing date of the original application is March 11, 2021. The entire content of the original application is incorporated herein by reference. Technical Field

[0002] This application relates to the field of communication technologies, and in particular, to a device communication method, system, and apparatus. Background Art

[0003] With the continuous development of intelligent terminal technologies, more and more electronic devices have been developed. However, different electronic devices often have different advantages and disadvantages, and each electronic device often cannot provide good services for users.

[0004] Taking a TV and a mobile phone as examples, a TV can provide a better video picture based on a large screen. However, when searching for programs on the TV, it is necessary to use a remote control to select pinyin letters one by one for text input, with low efficiency and inconvenient input operations. A mobile phone can achieve convenient and efficient text input based on an input method framework, etc. However, the screen of a mobile phone is usually small, which is not conducive to users watching videos or images. Summary of the Invention

[0005] Embodiments of this application provide a device communication method, system, and apparatus, enabling different electronic devices to work together, leveraging their respective advantages, and providing convenient and comfortable services for users.

[0006] In a first aspect of an embodiment of this application, a device communication method is provided, which is applied to a system including a first device, a second device, and a third device. The method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to the second device and the third device; the second device displays a second interface according to the indication message, and the second interface includes a second edit box; in the case where there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box; the third device sends a preemption message to the first device; the third device displays a third interface including a third edit box; the editing state in the first edit box is synchronized in the third edit box.

[0007] In this way, during the process of the second device assisting the first device in input, the third device can perform preemption, making the way of assisting the first device in input more flexible.

[0008] In a possible implementation, the second device includes an interface service, which is used for synchronizing the editing state between the first device and the second device. In this way, based on the interface service, any editing state of the second device can be synchronized to the first device.

[0009] In a possible implementation, the editing state includes one or more of the following: text content, cursor, or highlight mark of the text content.

[0010] In a possible implementation, the second device displays a second interface according to an indication message, including: the second device displays a first notification interface in response to the indication message; the first notification interface includes an option to confirm auxiliary input; in response to a trigger operation on the option, the second device displays the second interface.

[0011] In a possible implementation, the second interface further includes: all or part of the content of the first interface. In this way, the user can see the situation in the first device on the second device, which is convenient for the user to understand the dynamics of assisting the first device.

[0012] In a possible implementation, the second edit box is displayed in a layered manner with all or part of the content of the first interface, and the second edit box is displayed above all or part of the content of the first interface.

[0013] In a possible implementation, after the second device displays the second interface according to the indication message, the method further includes: in response to a trigger on the second edit box, the second device displays a virtual keyboard; the second device displays the editing state in the second edit box according to the input operation received in the virtual keyboard and / or the second edit box.

[0014] In a possible implementation, the first device includes any one of the following: a television, a large screen, or a wearable device; the second device or the third device includes any one of the following: a mobile phone, a tablet, or a wearable device.

[0015] In a possible implementation, it further includes: when input content is received in the third edit box, the first device synchronizes the input content to the first edit box.

[0016] In a possible implementation, the third device sends a preemption message to the first device, including: the third device receives a preemption request from the second device; the third device sends a preemption message to the first device based on the preemption request.

[0017] In a possible implementation, the third device sends a preemption message to the first device, including: the third device displays a second notification interface according to a user operation; the second notification interface includes an option to confirm preemption; in response to a trigger operation on the option to confirm preemption, the third device sends a preemption message to the first device.

[0018] The first and second aspects of the embodiments of the present application provide a device communication method, which is applied to a system including a first device, a second device, and a third device. The method includes: the second device displays a fourth interface including an option of the first device; in response to a selection operation on the option of the first device, the second device sends an indication message to the first device; the first device displays a first interface including a first edit box; the second device displays a second interface, and the second interface includes a second edit box; when there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box; the third device sends a preemption message to the first device; the third device displays a third interface including a third edit box; the editing state in the first edit box is synchronized in the third edit box.

[0019] It should be noted that, in any possible implementation manner of the first aspect, in the case of not conflicting with the method provided in the first and second aspects, it can be used to limit the method provided in the first and second aspects, and will not be elaborated here.

[0020] The first and third aspects of the embodiments of the present application provide a device communication method, which is applied to the first device. The method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to the second device and the third device; the indication message is used to instruct the second device to display a second interface, and the second interface includes a second edit box; when there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box; the first device receives a preemption message from the third device.

[0021] It should be noted that, in any possible implementation manner of the first aspect, in the case of not conflicting with the method provided in the first and third aspects, it can be used to limit the method provided in the first and third aspects, and will not be elaborated here.

[0022] The first and fourth aspects of the embodiments of the present application provide a device communication method, which is applied to the second device. The method includes: the second device displays a fourth interface including an option of the first device; in response to a selection operation on the option of the first device, the second device sends an indication message to the first device; the first device displays a first interface including a first edit box; the second device displays a second interface, and the second interface includes a second edit box; when there is an editing state in the second edit box, the second device synchronizes the editing state to the first edit box; the second device receives a preemption message from the third device.

[0023] It should be noted that, in any possible implementation manner of the first aspect, in the case of not conflicting with the method provided in the first and fourth aspects, it can be used to limit the method provided in the first and fourth aspects, and will not be elaborated here.

[0024] The first to fifth aspects of the embodiments of the present application provide a device communication system, including a first device, a second device, and a third device. The first device is configured to perform the steps of the first device in any of the first to fourteenth aspects. The second device is configured to perform the steps of the second device in any of the first to fourteenth aspects. The third device is configured to perform the steps of the third device in any of the first to fourteenth aspects.

[0025] The sixteenth aspect of the embodiments of the present application provides a first device, including: at least one memory and at least one processor; the memory is configured to store program instructions; the processor is configured to call the program instructions in the memory so that the first device performs the steps performed by the first device in any of the first to fourteenth aspects.

[0026] The seventeenth aspect of the embodiments of the present application provides a second device, including: at least one memory and at least one processor; the memory is configured to store program instructions; the processor is configured to call the program instructions in the memory so that the second device performs the steps performed by the second device in any of the first to fourteenth aspects.

[0027] The eighteenth aspect of the embodiments of the present application provides a third device, including: at least one memory and at least one processor; the memory is configured to store program instructions; the processor is configured to call the program instructions in the memory so that the third device performs the steps performed by the third device in any of the first to fourteenth aspects.

[0028] The nineteenth aspect of the embodiments of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by the processor of the first device, it implements the steps performed by the first device in any of the first to fourteenth aspects; or when the computer program is executed by the processor of the second device, it implements the steps performed by the second device in any of the first to fourteenth aspects; or when the computer program is executed by the processor of the third device, it implements the steps performed by the third device in any of the first to fourteenth aspects.

[0029] It should be noted that in the embodiments of the present application, taking the interaction between the first device, the second device, and the third device as an example to illustrate the specific device communication method. When one of the first device, the second device, or the third device is used as the execution subject, the steps it performs can be selected from any of the above embodiments to obtain the unilateral implementation manners of the first device, the second device, or the third device, which will not be elaborated here. The functions of the second device and the third device are similar. Any steps performed by the second device can be applied to the third device as long as they do not conflict with the steps of the third device.

[0030] It should be noted that in the above embodiments, the display screen of each device can be used to implement the display step. The first interface, the second interface, the third interface, the fourth interface, etc. described in the above embodiments are used to distinguish different display interfaces of each device. In the subsequent specific embodiments, the first interface, the second interface, the third interface, or the fourth interface can be corresponded to the specific interfaces provided in the specific embodiments through text according to the specific content of the embodiments, which will not be elaborated here.

[0031] It should be understood that the technical solutions of the first to nineteenth aspects of the embodiments of the present application correspond to those of the eleventh aspect of the embodiments of the present application. The beneficial effects obtained by each aspect and the corresponding feasible implementation manners are similar and will not be elaborated.

[0032] The second aspect of the embodiments of the present application provides a device communication method, which is applied to a system including a first device, a second device, and a third device. The method includes: the first device displays a first interface including a first edit box; in response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network; the first device displays a second interface, and the second interface includes a first option corresponding to the second device and a second option corresponding to the third device; in response to a trigger operation on the first option, the first device sends an indication message to the second device; the second device displays a third interface according to the indication message, and the third interface includes a second edit box; when there is an editing state in the second edit box, the editing state is synchronized to the first edit box.

[0033] In the embodiments of the present application, the first device can provide a selection interface for selecting the second device or the third device. When receiving the selection of the second device, an indication message can be sent to the second device to instruct the second device to assist the first device. In this way, the indication message does not need to be sent to the third device, avoiding disturbing the third device.

[0034] In a possible implementation manner, the second device includes an interface service, and the interface service is used for synchronizing the editing state between the first device and the second device. In this way, based on the interface service, any editing state of the second device can be synchronized to the first device.

[0035] In a possible implementation manner, the editing state includes one or more of the following: text content, cursor, or a highlight mark of the text content.

[0036] In a possible implementation manner, the second device displays the third interface according to the indication message, including: the second device displays a notification interface in response to the indication message; the notification interface includes a third option for confirming auxiliary input; in response to a trigger operation on the third option, the second device displays the third interface.

[0037] In a possible implementation, the third interface further includes all or part of the content of the first interface. In this way, the user can view the situation in the first device on the second device, which is convenient for the user to understand the dynamics of assisting the first device.

[0038] In a possible implementation, the second edit box is displayed in a layered manner with all or part of the content of the first interface, and the second edit box is displayed above all or part of the content of the first interface.

[0039] In a possible implementation, after the second device displays the third interface according to the indication message, the method further includes: in response to a trigger on the second edit box, the second device displays a virtual keyboard; the second device displays an editing state in the second edit box according to the input operations received in the virtual keyboard and / or the second edit box.

[0040] In a possible implementation, the first device includes any one of the following: a television, a large screen, or a wearable device; the second device or the third device includes any one of the following: a mobile phone, a tablet, or a wearable device.

[0041] A second aspect of the embodiments of the present application provides a device communication method, which is applied to a system including a first device, a second device, and a third device. The method includes: the first device displays a first interface including a first edit box; in response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network; the first device determines that the second device is an auxiliary input device; the first device sends an indication message to the second device; the second device displays a third interface according to the indication message, and the third interface includes a second edit box; when there is an editing state in the second edit box, synchronize the editing state to the first edit box.

[0042] It should be noted that in any possible implementation of the second aspect, in the case of not conflicting with the method provided in the second aspect, it can be used to limit the method provided in the second aspect, and details are not described herein again.

[0043] A third aspect of the embodiments of the present application provides a device communication method, which is applied to a system including a first device, a second device, and a third device. The method includes: the second device displays a fourth interface including an option of the first device; in response to a selection operation on the option of the first device, the second device sends an indication message to the first device; the first device displays a first interface including a first edit box; the second device displays a third interface, and the third interface includes a second edit box; when there is an editing state in the second edit box, synchronize the editing state to the first edit box.

[0044] It should be noted that in any possible implementation of the second aspect, in the case of not conflicting with the method provided in the third aspect, it can be used to limit the method provided in the third aspect, and details are not described herein again.

[0045] In the second and fourth aspects of the embodiments of the present application, a device communication method is provided, which is applied to a first device. The method includes: the first device displays a first interface including a first edit box; in response to a selection operation on the first edit box, the first device determines that a second device and a third device join a distributed network; the first device displays a second interface, and the second interface includes a first option corresponding to the second device and a second option corresponding to the third device; in response to a trigger operation on the first option, the first device sends an indication message to the second device; the indication message is used to instruct the second device to display a third interface, and the third interface includes a second edit box; in the case where there is an editing state in the second edit box, synchronize the editing state to the first edit box.

[0046] It should be noted that in any possible implementation manner in the second and first aspects, in the case of not conflicting with the method provided in the second and fourth aspects, it can be used to limit the method provided in the second and fourth aspects, and will not be elaborated here.

[0047] In the second and fifth aspects of the embodiments of the present application, a device communication method is provided, which is applied to a second device. The method includes: the second device displays a fourth interface including an option of the first device; in response to a selection operation on the option of the first device, the second device sends an indication message to the first device; the indication message is used to instruct the first device to display a first interface including a first edit box; the second device displays a third interface, and the third interface includes a second edit box; in the case where there is an editing state in the second edit box, synchronize the editing state to the first edit box.

[0048] It should be noted that in any possible implementation manner in the second and first aspects, in the case of not conflicting with the method provided in the second and fifth aspects, it can be used to limit the method provided in the second and fifth aspects, and will not be elaborated here.

[0049] In the second and sixth aspects of the embodiments of the present application, a device communication system is provided, which includes a first device, a second device, and a third device. The first device is used to execute the steps of any first device in the second and first aspects to the second and fifth aspects, the second device is used to execute the steps of any second device in the second and first aspects to the second and fifth aspects, and the third device is used to execute the steps of any third device in the second and first aspects to the second and fifth aspects.

[0050] In the second and seventh aspects of the embodiments of the present application, a first device is provided, which includes: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the first device executes the steps executed by any first device in the second and first aspects to the second and fifth aspects.

[0051] The second aspect of the embodiments of the present application provides a second device, including: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory to enable the second device to execute the steps performed by any of the second devices in the second first aspect to the second fifth aspect.

[0052] The second ninth aspect of the embodiments of the present application provides a computer-readable storage medium, on which a computer program is stored, so that when the computer program is executed by the processor of the first device, it implements the steps performed by any of the first devices in the second first aspect to the second fifth aspect; or, when the computer program is executed by the processor of the second device, it implements the steps performed by any of the second devices in the second first aspect to the second fifth aspect; or, when the computer program is executed by the processor of the third device, it implements the steps performed by any of the third devices in the second first aspect to the second fifth aspect.

[0053] It should be noted that in the embodiments of the present application, taking the interaction of the first device, the second device, and the third device as an example to illustrate the specific device communication method. When one of the first device, the second device, or the third device is used as the execution subject, the steps it executes can be selected from any of the above embodiments to obtain the unilateral implementation methods of the first device, the second device, or the third device, which will not be elaborated here. The functions of the second device and the third device are similar. Any step executed in the second device can be applied to the third device as long as it does not conflict with the steps of the third device.

[0054] It should be noted that in the above embodiments, the display screen of each device can be used to implement the display steps. The first interface, the second interface, the third interface, or the fourth interface described in the above embodiments is a differentiated description of the different display interfaces of each device. In the subsequent specific embodiments, in combination with the specific content of the embodiments, the first interface, the second interface, the third interface, or the fourth interface can be corresponded to the specific interfaces provided by the specific embodiments through text, which will not be elaborated here.

[0055] It should be understood that the second second aspect to the second ninth aspect of the embodiments of the present application correspond to the technical solutions of the second first aspect of the embodiments of the present application. The beneficial effects obtained by each aspect and the corresponding feasible implementation manners are similar and will not be elaborated.

[0056] A third aspect of an embodiment of the present application provides a device communication method, which is applied to a system including a first device and a second device. The method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to the second device; the second device displays a second interface according to the indication message, and the second interface includes a second edit box; when there is a keyword in the second edit box, the first device synchronizes the keyword to the first edit box; the first device determines candidate words corresponding to the keyword; the second device obtains the candidate words and displays a third interface, and the third interface includes the candidate words.

[0057] In an embodiment of the present application, the keyword input in the second device can be synchronized to the first device, and the candidate words associated by the first device based on the keyword can be synchronized to the second device, so that the second device can realize convenient and efficient auxiliary input for the first device based on the operation of selecting the candidate words of the first device.

[0058] In a possible implementation, the second device includes an interface service, and the interface service is used for synchronizing the editing states between the first device and the second device. In this way, based on the interface service, any editing state of the first device can be synchronized to the second device.

[0059] In a possible implementation, the editing state includes one or more of the following: text content, cursor, or highlight mark of text content.

[0060] In a possible implementation, the second device displays the second interface according to the indication message, including: the second device displays a notification interface in response to the indication message; the notification interface includes an option to confirm auxiliary input; in response to the trigger operation on the option, the second device displays the second interface.

[0061] In a possible implementation, the third interface further includes: all or part of the content of the first interface. In this way, the user can see the situation in the first device on the second device, which is convenient for the user to understand the dynamics of assisting the first device.

[0062] In a possible implementation, the second edit box and all or part of the content of the first interface are displayed in layers, and the second edit box is displayed on top of all or part of the content of the first interface.

[0063] In a possible implementation, after the second device displays the second interface according to the indication message, the method further includes: in response to the trigger on the second edit box, the second device displays a virtual keyboard; the second device displays an editing state in the second edit box according to the input operation received by the virtual keyboard and / or the second edit box.

[0064] In a possible implementation, the first device includes any one of the following: a television, a large screen, or a wearable device; the second device includes any one of the following: a mobile phone, a tablet, or a wearable device.

[0065] In a possible implementation, the third interface further includes local candidate words associated by the second device based on keywords. The display methods of the candidate words and the local candidate words on the third interface include any of the following: the candidate words and the local candidate words are displayed in columns on the third interface; the candidate words are displayed in front of the local candidate words on the third interface; the candidate words are displayed behind the local candidate words on the third interface; the candidate words and the local candidate words are mixedly displayed on the third interface; the candidate words and the local candidate words are distinguished by different identifiers on the third interface.

[0066] In a possible implementation, the sorting of the candidate words is related to the historical user behavior in the first device.

[0067] In a possible implementation, it further includes: in response to the user's triggering of any one of the candidate words, the second device displays any one of the candidate words in the second edit box.

[0068] The third second aspect of the embodiments of the present application provides a device communication method, which is applied to a system including a first device and a second device. The method includes: the second device displays a fourth interface including an option of the first device; in response to a selection operation on the option of the first device, the second device sends an indication message to the first device; the first device displays a first interface including a first edit box; the second device displays a second interface, and the second interface includes a second edit box; when there is a keyword in the second edit box, the first device synchronizes the keyword to the first edit box; the first device determines candidate words corresponding to the keyword; the second device obtains the candidate words and displays a third interface, and the third interface includes the candidate words.

[0069] It should be noted that in any possible implementation of the third first aspect, in the case of not conflicting with the method provided in the third second aspect, it can be used to limit the method provided in the third second aspect, and details are not described herein again.

[0070] The third third aspect of the embodiments of the present application provides a device communication method, which is applied to the first device. The method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to the second device; the indication message is used to instruct the second device to display a second interface, and the second interface includes a second edit box; when there is a keyword in the second edit box, the first device synchronizes the keyword to the first edit box; the first device determines candidate words corresponding to the keyword; the first device synchronizes the candidate words to the second device.

[0071] It should be noted that in any possible implementation of the third first aspect, in the case of not conflicting with the method provided in the third third aspect, it can be used to limit the method provided in the third third aspect, and details are not described herein again.

[0072] The third and fourth aspects of the embodiments of the present application provide a device communication method, and the method includes: a second device receives an indication message from a first device; a first interface including a first edit box is displayed on the first device; the second device displays a second interface according to the indication message, and the second interface includes a second edit box; when there is a keyword in the second edit box, the second device synchronizes the keyword to the first edit box for the first device to determine candidate words corresponding to the keyword; the second device obtains the candidate words and displays a third interface, and the third interface includes the candidate words.

[0073] It should be noted that, in any possible implementation manner of the third aspect, in the case of not conflicting with the method provided in the third and fourth aspects, it can be used to limit the method provided in the third and fourth aspects, and will not be elaborated here.

[0074] The third and fifth aspects of the embodiments of the present application provide a device communication method, which is applied to a second device, and the method includes: the second device displays a fourth interface including an option of the first device; in response to a selection operation on the option of the first device, the second device sends an indication message to the first device; the indication message is used to instruct the first device to display a first interface including a first edit box; the second device displays a second interface, and the third interface includes a second edit box; when there is a keyword in the second edit box, the second device synchronizes the keyword to the first edit box for the first device to determine candidate words corresponding to the keyword; the second device obtains the candidate words and displays a third interface, and the third interface includes the candidate words.

[0075] It should be noted that, in any possible implementation manner of the third aspect, in the case of not conflicting with the method provided in the third and fifth aspects, it can be used to limit the method provided in the third and fifth aspects, and will not be elaborated here.

[0076] The third and sixth aspects of the embodiments of the present application provide a device communication system, including a first device and a second device. The first device is used to execute the steps of the first device in any of the third aspect to the third and fifth aspects, and the second device is used to execute the steps of the second device in any of the third aspect to the third and fifth aspects.

[0077] The third and seventh aspects of the embodiments of the present application provide a first device, including: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory to enable the first device to execute the steps executed by the first device in any of the third aspect to the third and fifth aspects.

[0078] The third and eighth aspects of the embodiments of the present application provide a second device, including: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory to enable the second device to execute the steps executed by the second device in any of the third aspect to the third and fifth aspects.

[0079] In the third aspect to the ninth aspect of the embodiments of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor of a first device, it implements the steps executed by the first device in any of the thirty-first aspect to the thirty-fifth aspect; or, when the computer program is executed by a processor of a second device, it implements the steps executed by the second device in any of the thirty-first aspect to the thirty-fifth aspect; or, when the computer program is executed by a processor of a third device, it implements the steps executed by the third device in any of the thirty-first aspect to the thirty-fifth aspect.

[0080] It should be noted that in the embodiments of the present application, taking the interaction between the first device and the second device as an example to illustrate the specific device communication method. When one of the first device or the second device is used as the execution subject, the steps executed by each can be selected from any of the above embodiments to obtain the unilateral implementation manners of the first device or the second device, which will not be elaborated herein.

[0081] It should be noted that in the above embodiments, the display screen of each device can be used to implement the display steps. The first interface, the second interface, the third interface, the fourth interface, etc. described in the above embodiments are for distinguishing different display interfaces of each device. In the subsequent specific embodiments, in combination with the specific content of the embodiments, the first interface, the second interface, the third interface, or the fourth interface can be corresponded to the specific interfaces provided by the specific embodiments through text, which will not be elaborated herein.

[0082] It should be understood that the thirty-second aspect to the thirty-ninth aspect of the embodiments of the present application correspond to the technical solutions of the thirty-first aspect of the embodiments of the present application. The beneficial effects obtained by each aspect and the corresponding feasible implementation manners are similar and will not be elaborated.

[0083] The forty-first aspect of the embodiments of the present application provides a device communication method, which is applied to a system including a first device, a second device, and a third device. The method includes: the first device, the second device, and the third device access a distributed network; the second device obtains a target candidate word, the target candidate word does not belong to the candidate word library of the first device, and the target candidate word does not belong to the candidate word library of the third device; the first device receives a keyword related to the target candidate word input by a user, and the first device displays the target candidate word; and / or, the third device receives a keyword related to the target candidate word input by a user, and the third device displays the target candidate word.

[0084] In the embodiments of the present application, the first device, the second device, and the third device can access a distributed network and synchronize their respective candidate word libraries with each other, so as to achieve efficient and convenient input based on the synchronized candidate word libraries.

[0085] In a possible implementation manner, it further includes: the first device, the second device, and the third device synchronize their respective candidate word libraries with each other.

[0086] In a possible implementation, it further includes: when the first device, the second device, or the third device exits the distributed networking, a prompt interface for displaying whether to delete the synchronized candidate word library is shown in the first device, the second device, or the third device; the prompt interface includes an option for indicating deletion and an option for indicating non-deletion; in response to a trigger operation on the option for indicating deletion, the first device, the second device, or the third device deletes the candidate word library synchronized from other devices by itself; or, in response to a trigger operation on the option for indicating non-deletion, the first device, the second device, or the third device retains the candidate word library synchronized from the distributed networking.

[0087] In a possible implementation, it further includes: the first device, the second device, or the third device respectively determines its own access type; when the first device, the second device, or the third device exits the distributed networking, the first device, the second device, or the third device determines whether to delete the candidate word library synchronized from the distributed networking according to its own access type.

[0088] In a possible implementation, it further includes: the first device displays a first interface including a first edit box; the first device sends an instruction message to the second device; the second device displays a second interface according to the instruction message, and the second interface includes a second edit box; when there is an editing state in the second edit box, the editing state is synchronized to the first edit box.

[0089] In a possible implementation, the second device includes an interface service for synchronizing the editing state between the first device and the second device. In this way, based on the interface service, any editing state of the second device can be synchronized to the first device.

[0090] In a possible implementation, the editing state includes one or more of the following: text content, cursor, or highlight mark of the text content.

[0091] In a possible implementation, the second device displays the second interface according to the instruction message, including: the second device displays a notification interface in response to the instruction message; the notification interface includes a third option for confirming auxiliary input; in response to a trigger operation on the third option, the second device displays the second interface.

[0092] In a possible implementation, the second interface further includes all or part of the content of the first interface.

[0093] In a possible implementation, the second edit box and all or part of the content of the first interface are displayed in layers, and the second edit box is displayed on top of all or part of the content of the first interface.

[0094] In a possible implementation, after the second device displays the second interface according to the indication message, the method further includes: in response to a trigger on the second edit box, the second device displays a virtual keyboard; the second device displays an editing state in the second edit box according to the input operations received in the virtual keyboard and / or the second edit box.

[0095] In a possible implementation, the first device includes any one of the following: a television, a large screen, or a wearable device; the second device or the third device includes any one of the following: a mobile phone, a tablet, or a wearable device.

[0096] In a possible implementation, it further includes: the second device displays a fourth interface including an option of the first device; in response to a selection operation on the option of the first device, the second device sends an indication message to the first device; the first device displays a first interface including a first edit box; the second device displays a second interface, and the second interface includes a second edit box; in the case where there is an editing state in the second edit box, the editing state is synchronized to the first edit box.

[0097] The fourth aspect of the embodiments of the present application provides a device communication method, which is applied to a system including a first device, a second device, and a third device. The method includes: the first device, the second device, and the third device access a distributed network; the first device, the second device, and the third device synchronize their respective candidate word libraries with each other to obtain a candidate word library set; when text editing is performed on the first device, the second device, or the third device, the first device, the second device, or the third device displays candidate words according to the candidate word library set.

[0098] It should be noted that in any possible implementation in the fourth aspect, in the case of not conflicting with the method provided in the fourth aspect, it can be used to limit the method provided in the fourth aspect, and details are not described herein again.

[0099] The fourth aspect of the embodiments of the present application provides a device communication method, which is applied to the first device and includes: the first device accesses a distributed network; other devices are also connected to the distributed network; the first device synchronizes the candidate word libraries of other devices based on the distributed network to obtain a candidate word library set; when text editing is performed on the first device, the first device displays candidate words according to the candidate word library set.

[0100] It should be noted that in any possible implementation in the fourth aspect, in the case of not conflicting with the method provided in the fourth aspect, it can be used to limit the method provided in the fourth aspect, and details are not described herein again.

[0101] The fourth aspect of the embodiments of the present application provides a device communication system, including a first device, a second device, and a third device. The first device is configured to execute the steps of the first device in any one of the forty-first aspect to the forty-third aspect. The second device is configured to execute the steps of the second device in any one of the forty-first aspect to the forty-third aspect. The third device is configured to execute the steps of the third device in any one of the forty-first aspect to the forty-third aspect.

[0102] The forty-fifth aspect of the embodiments of the present application provides a first device, including: at least one memory and at least one processor; the memory is configured to store program instructions; the processor is configured to call the program instructions in the memory so that the first device executes the steps executed by the first device in any one of the forty-first aspect to the forty-third aspect.

[0103] The forty-sixth aspect of the embodiments of the present application provides a second device, including: at least one memory and at least one processor; the memory is configured to store program instructions; the processor is configured to call the program instructions in the memory so that the second device executes the steps executed by the second device in any one of the forty-first aspect to the forty-third aspect.

[0104] The forty-seventh aspect of the embodiments of the present application provides a computer-readable storage medium, on which a computer program is stored, so that when the computer program is executed by the processor of the first device, it implements the steps executed by the first device in any one of the forty-first aspect to the forty-third aspect; or, when the computer program is executed by the processor of the second device, it implements the steps executed by the second device in any one of the forty-first aspect to the forty-third aspect; or, when the computer program is executed by the processor of the third device, it implements the steps executed by the third device in any one of the forty-first aspect to the forty-third aspect.

[0105] It should be noted that in the embodiments of the present application, taking the interaction between the first device, the second device, and the third device as an example to illustrate the specific device communication method. When one of the first device, the second device, or the third device is used as the execution subject, the steps executed by each of them can be selected from any of the above embodiments to obtain the unilateral implementation manners of the first device, the second device, or the third device, which will not be elaborated here. The functions of the second device and the third device are similar. Any step executed by the second device can be applied to the third device as long as it does not conflict with the steps of the third device.

[0106] It should be noted that in the above embodiments, the display screen of each device can be used to implement the display steps. The first interface, the second interface, the third interface, or the fourth interface described in the above embodiments is a descriptive distinction of different display interfaces of each device. In the subsequent specific embodiments, in combination with the specific content of the embodiments, the first interface, the second interface, the third interface, or the fourth interface can be corresponded to the specific interfaces provided by the specific embodiments through text, which will not be elaborated here.

[0107] It should be understood that the technical solutions of the fourth to seventh aspects of the embodiments of the present application correspond to those of the fourth aspect of the embodiments of the present application, and the beneficial effects obtained by each aspect and the corresponding feasible implementation manners are similar and will not be elaborated herein.

[0108] An embodiment of the fifth aspect of the present application provides a device communication method, which is applied to a system including a first device, a second device, and a third device. The method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to the second device and the third device; the second device displays a second interface according to the indication message, and the second interface includes a second edit box; the third device displays a third interface according to the indication message, and the third interface includes a third edit box; when there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box, and the third device synchronizes the editing state to the third edit box; or, when there is an editing state in the third edit box, the first device synchronizes the editing state to the first edit box, and the second device synchronizes the editing state to the second edit box; or, when there is an editing state in the first edit box, the second device synchronizes the editing state to the second edit box, and the third device synchronizes the editing state to the third edit box.

[0109] In the embodiment of the present application, the second device and the third device can jointly assist the first device in input, so as to achieve convenient and efficient input.

[0110] In a possible implementation manner, the second device includes an interface service, and the interface service is used for synchronizing the editing state between the first device and the second device. In this way, based on the interface service, any editing state of the second device can be synchronized to the first device.

[0111] In a possible implementation manner, the editing state includes one or more of the following: text content, cursor, or highlight mark of text content.

[0112] In a possible implementation manner, the second device displays the second interface according to the indication message, including: the second device displays a notification interface in response to the indication message; the notification interface includes an option to confirm auxiliary input; in response to the triggering operation on the option, the second device displays the second interface.

[0113] In a possible implementation manner, the second interface further includes: all or part of the content of the first interface. In this way, the user can see the situation in the first device on the second device, which is convenient for the user to understand the dynamics of assisting the first device.

[0114] In a possible implementation manner, the second edit box and all or part of the content of the first interface are displayed in layers, and the second edit box is displayed on the upper layer of all or part of the content of the first interface.

[0115] In a possible implementation, after the second device displays the second interface according to the indication message, the method further includes: in response to a trigger on the second edit box, the second device displays a virtual keyboard; the second device displays an editing state in the second edit box according to the input operations received in the virtual keyboard and / or the second edit box.

[0116] In a possible implementation, the first device includes any one of the following: a television, a large screen, or a wearable device; the second device or the third device includes any one of the following: a mobile phone, a tablet, or a wearable device.

[0117] In a possible implementation, the editing state in the first edit box includes the identifier of the first device, and / or the editing state in the second edit box includes the identifier of the second device, and / or the editing state in the third edit box includes the identifier of the first device.

[0118] In a possible implementation, when input contents are received in the second edit box and the third edit box at the same time, the first device determines the input content of the second edit box and the display manner of the third edit box.

[0119] The fifth second aspect of the embodiments of the present application provides a device communication method, which is applied to a system including a first device, a second device, and a third device. The method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to the second device; the second device displays a second interface according to the indication message, and the second interface includes a second edit box; the second device sends an auxiliary input request to the third device; the third device displays a third interface according to the auxiliary input request, and the third interface includes a third edit box; when there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box, and the third device synchronizes the editing state to the third edit box; or when there is an editing state in the third edit box, the first device synchronizes the editing state to the first edit box, and the second device synchronizes the editing state to the second edit box; or when there is an editing state in the first edit box, the second device synchronizes the editing state to the second edit box, and the third device synchronizes the editing state to the third edit box.

[0120] It should be noted that in any possible implementation of the fifth first aspect, in the case of not conflicting with the method provided in the fifth second aspect, it can be used to limit the method provided in the fifth second aspect, and details are not described herein again.

[0121] A fifth aspect of an embodiment of the present application provides a device communication method, which is applied to a system including a first device, a second device, and a third device. The method includes: the second device displays a fourth interface including an option of the first device; in response to a selection operation on the option of the first device, the second device sends an indication message to the first device; the first device displays a first interface including a first edit box; the second device displays a second interface, and the second interface includes a second edit box; the second device sends an auxiliary input request to the third device; the third device displays a third interface according to the auxiliary input request, and the third interface includes a third edit box; when there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box, and the third device synchronizes the editing state to the third edit box; or, when there is an editing state in the third edit box, the first device synchronizes the editing state to the first edit box, and the second device synchronizes the editing state to the second edit box; or, when there is an editing state in the first edit box, the second device synchronizes the editing state to the second edit box, and the third device synchronizes the editing state to the third edit box.

[0122] It should be noted that, in any possible implementation manner of the fifth aspect, in the case of not conflicting with the method provided in the fifth aspect, it can be used to limit the method provided in the fifth aspect, and details are not described herein again.

[0123] A fifth aspect of an embodiment of the present application provides a device communication method, which is applied to the first device. The method includes: the first device displays a first interface including a first edit box; the first device sends an indication message to the second device and the third device; for the second device to display a second interface according to the indication message, the second interface includes a second edit box, and for the third device to display a third interface according to the indication message, the third interface includes a third edit box; when there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box; or, when there is an editing state in the third edit box, the first device synchronizes the editing state to the first edit box.

[0124] It should be noted that, in any possible implementation manner of the fifth aspect, in the case of not conflicting with the method provided in the fifth aspect, it can be used to limit the method provided in the fifth aspect, and details are not described herein again.

[0125] A fifth aspect of an embodiment of the present application provides a device communication method, which is applied to a second device. The method includes: the second device displays a fourth interface including an option of a first device; in response to a selection operation on the option of the first device, the second device sends an indication message to the first device; for the first device to display a first interface including a first edit box; the second device displays a second interface, and the second interface includes a second edit box; the second device sends an auxiliary input request to a third device; for the third device to display a third interface according to the auxiliary input request, and the third interface includes a third edit box; when there is an editing state in the third edit box, the second device synchronizes the editing state to the second edit box; or, when there is an editing state in the first edit box, the second device synchronizes the editing state to the second edit box.

[0126] It should be noted that in any possible implementation manner of the fifth aspect, without conflict with the method provided in the fifth aspect, it can be used to define the method provided in the fifth aspect, and details are not described herein again.

[0127] A fifth aspect of an embodiment of the present application provides a device communication system, including a first device, a second device, and a third device. The first device is configured to execute the steps of the first device in any of the fifth aspect to the fifth aspect; the second device is configured to execute the steps of the second device in any of the fifth aspect to the fifth aspect; the third device is configured to execute the steps of the third device in any of the fifth aspect to the fifth aspect.

[0128] A fifth aspect of an embodiment of the present application provides a first device, including: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory to cause the first device to execute the steps executed by the first device in any of the fifth aspect to the fifth aspect.

[0129] A fifth aspect of an embodiment of the present application provides a second device, including: at least one memory and at least one processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory to cause the second device to execute the steps executed by the second device in any of the fifth aspect to the fifth aspect.

[0130] A fifth aspect of an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by the processor of the first device, it realizes the steps executed by the first device in any of the fifth aspect to the fifth aspect; or, when the computer program is executed by the processor of the second device, it realizes the steps executed by the second device in any of the fifth aspect to the fifth aspect; or, when the computer program is executed by the processor of the third device, it realizes the steps executed by the third device in any of the fifth aspect to the fifth aspect.

[0131] It should be noted that in the embodiments of the present application, taking the interaction among the first device, the second device, and the third device as an example to illustrate the specific device communication method. When one of the first device, the second device, or the third device serves as the execution subject, the steps it executes can be selected from any of the above embodiments to obtain the unilateral implementation manners of the first device, the second device, or the third device, which will not be elaborated here. The functions of the second device and the third device are similar. Any step executed in the second device can be applied to the third device as long as it does not conflict with the steps of the third device.

[0132] It should be noted that in the above embodiments, the display screen of each device can be used to implement the display steps. The first interface, the second interface, the third interface, or the fourth interface described in the above embodiments are used to distinguish different display interfaces of each device. In the subsequent specific embodiments, in combination with the specific content of the embodiments, the first interface, the second interface, the third interface, or the fourth interface can be corresponded to the specific interfaces provided by the specific embodiments through text, which will not be elaborated here.

[0133] It should be understood that the technical solutions of the fifty-second aspect to the fifty-ninth aspect of the embodiments of the present application correspond to those of the fifty-first aspect of the embodiments of the present application. The beneficial effects obtained by each aspect and the corresponding feasible implementation manners are similar and will not be elaborated. BRIEF DESCRIPTION OF THE DRAWINGS

[0134] Figure 1 FIG. shows the schematic architecture diagram of a communication system provided by an embodiment of the present application;

[0135] Figure 2 FIG. shows the schematic architecture diagram of another communication system provided by an embodiment of the present application;

[0136] Figure 3 FIG. shows the schematic architecture diagram of yet another communication system provided by an embodiment of the present application;

[0137] Figure 4 FIG. shows the functional block diagram of a first device provided by an embodiment of the present application;

[0138] Figure 5 FIG. shows the functional block diagram of a second device provided by an embodiment of the present application;

[0139] Figure 6 FIG. shows the software architecture diagram of a first device and a second device provided by an embodiment of the present application;

[0140] Figure 7 FIG. shows the schematic architecture diagram of a system for a device communication method provided by an embodiment of the present application;

[0141] Figure 8Shows a schematic diagram of the specific system architecture of a device communication method provided by an embodiment of the present application;

[0142] Figure 9 Shows a schematic diagram of a large screen user interface provided by an embodiment of the present application;

[0143] Figure 10 Shows a schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0144] Figure 11 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0145] Figure 12 Shows a schematic diagram of a user interface provided by an embodiment of the present application;

[0146] Figure 13 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0147] Figure 14 Shows another schematic diagram of a large screen user interface provided by an embodiment of the present application;

[0148] Figure 15 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0149] Figure 16 Shows another schematic diagram of a large screen user interface provided by an embodiment of the present application;

[0150] Figure 17 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0151] Figure 18 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0152] Figure 19 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0153] Figure 20 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0154] Figure 21 Shows another schematic diagram of a user interface provided by an embodiment of the present application;

[0155] Figure 22 Shows yet another schematic diagram of a user interface provided by an embodiment of the present application;

[0156] Figure 23 Shows a schematic diagram of the specific process of mobile phone and large screen communication provided by an embodiment of the present application;

[0157] Figure 24 Schematic structural diagram of a device provided by an embodiment of the present application;

[0158] Figure 25 Schematic structural diagram of another device provided by an embodiment of the present application;

[0159] Figure 26 Schematic diagram of the system architecture of another device communication method provided by an embodiment of the present application;

[0160] Figure 27 Schematic diagram of the user interface of a large screen provided by an embodiment of the present application;

[0161] Figure 28 Schematic diagram of the user interface of a mobile phone provided by an embodiment of the present application;

[0162] Figure 29 Schematic diagram of the user interface of a large screen provided by an embodiment of the present application;

[0163] Figure 30 Schematic diagram of the user interface of another mobile phone provided by an embodiment of the present application;

[0164] Figure 31 Schematic diagram of the user interface of another mobile phone provided by an embodiment of the present application;

[0165] Figure 32 Schematic diagram of the input interface of a mobile phone assisted large screen provided by an embodiment of the present application;

[0166] Figure 33 Schematic diagram of another input interface of a mobile phone assisted large screen provided by an embodiment of the present application;

[0167] Figure 34 Schematic diagram of the input interface of a mobile phone assisted large screen provided by an embodiment of the present application;

[0168] Figure 35 Schematic diagram of the user interface of a mobile phone provided by an embodiment of the present application;

[0169] Figure 36 Schematic structural diagram of a device provided by an embodiment of the present application;

[0170] Figure 37 Schematic structural diagram of another device provided by an embodiment of the present application;

[0171] Figure 38 Schematic diagram of the user interface of a mobile phone communicating with a large screen provided by an embodiment of the present application;

[0172] Figure 39Shows a specific system architecture diagram of a device communication method provided by an embodiment of the present application;

[0173] Figure 40 Shows a schematic flowchart of communication between a mobile phone and a large screen provided by an embodiment of the present application;

[0174] Figure 41 Shows a schematic diagram of a large screen user interface provided by an embodiment of the present application;

[0175] Figure 42 Shows a schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0176] Figure 43 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0177] Figure 44 Shows another schematic diagram of a large screen user interface provided by an embodiment of the present application;

[0178] Figure 45 Shows a schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0179] Figure 46 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0180] Figure 47 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0181] Figure 48 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0182] Figure 49 Shows yet another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0183] Figure 50 Shows yet another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0184] Figure 51 Shows a specific flowchart of communication between a mobile phone and a large screen provided by an embodiment of the present application;

[0185] Figure 52 Is a schematic diagram of the structure of a device provided by an embodiment of the present application;

[0186] Figure 53 Is another schematic diagram of the structure of a device provided by an embodiment of the present application;

[0187] Figure 54 Shows a schematic diagram of a specific application scenario of an embodiment of the present application;

[0188] Figure 55 Shows a schematic diagram of the specific system architecture of a device communication method provided by an embodiment of the present application;

[0189] Figure 56 Shows a schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0190] Figure 57 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0191] Figure 58 Shows a schematic diagram of a large screen user interface provided by an embodiment of the present application;

[0192] Figure 59 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0193] Figure 60 Shows a schematic diagram of a user interface for communication between a mobile phone and a large screen provided by an embodiment of the present application;

[0194] Figure 61 Shows another schematic diagram of a large screen user interface provided by an embodiment of the present application;

[0195] Figure 62 Shows a schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0196] Figure 63 Shows a schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0197] Figure 64 Shows another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0198] Figure 65 Shows yet another schematic diagram of a mobile phone user interface provided by an embodiment of the present application;

[0199] Figure 66 Is a schematic diagram of the structure of a device provided by an embodiment of the present application;

[0200] Figure 67 Is a schematic diagram of the structure of another device provided by an embodiment of the present application;

[0201] Figure 68 Shows a schematic diagram of the system architecture of another device communication method provided by an embodiment of the present application;

[0202] Figure 69 Shows a schematic diagram of a large screen interface provided by an embodiment of the present application;

[0203] Figure 70Shows a schematic diagram of a mobile phone interface provided by an embodiment of the present application;

[0204] Figure 71 Shows another schematic diagram of a mobile phone interface provided by an embodiment of the present application;

[0205] Figure 72 Shows a schematic diagram of a mobile phone interface provided by an embodiment of the present application;

[0206] Figure 73 Shows another schematic diagram of a mobile phone interface provided by an embodiment of the present application;

[0207] Figure 74 Shows another schematic diagram of a mobile phone interface provided by an embodiment of the present application;

[0208] Figure 75 Shows a schematic diagram of the system architecture of another device communication method provided by an embodiment of the present application;

[0209] Figure 76 Shows a schematic diagram of a mobile phone assisted large screen input interface provided by an embodiment of the present application;

[0210] Figure 77 Shows another schematic diagram of a mobile phone assisted large screen input interface provided by an embodiment of the present application;

[0211] Figure 78 Shows a schematic diagram of a mobile phone assisted large screen input interface provided by an embodiment of the present application;

[0212] Figure 79 Shows a schematic diagram of a mobile phone assisted large screen input interface provided by an embodiment of the present application;

[0213] Figure 80 Shows a schematic diagram of a mobile phone assisted large screen input interface provided by an embodiment of the present application;

[0214] Figure 81 Shows a schematic diagram of the system architecture of another device communication method provided by an embodiment of the present application;

[0215] Figure 82 Shows a schematic diagram of a mobile phone assisted large screen input interface provided by an embodiment of the present application;

[0216] Figure 83 Shows a schematic diagram of the generation of a cyclic chain provided by an embodiment of the present application;

[0217] Figure 84 Shows a schematic diagram of the system architecture of another device communication method provided by an embodiment of the present application;

[0218] Figure 85Shows a schematic diagram of a mobile phone interface provided by an embodiment of the present application;

[0219] Figure 86 Is a schematic structural diagram of a device provided by an embodiment of the present application;

[0220] Figure 87 Is a schematic structural diagram of another device provided by an embodiment of the present application. Detailed implementation manners

[0221] For the convenience of clearly describing the technical solutions of the embodiments of the present application, in the embodiments of the present application, terms such as "first" and "second" are used to distinguish identical or similar items with basically the same functions and roles. For example, the first device and the second device are only used to distinguish different devices, and do not limit their sequence. Those skilled in the art can understand that terms such as "first" and "second" do not limit the quantity and execution order, and "first" and "second" do not necessarily mean different.

[0222] It should be noted that in the present application, words such as "exemplary" or "for example" are used to represent examples, illustrations or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the present application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present relevant concepts in a specific manner.

[0223] In the present application, "at least one" means one or more, and "a plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone, where A and B may be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after. "At least one (item)" or its similar expression refers to any combination of these items, including any combination of single item (item) or plural items (items). For example, at least one (item) of a, b, or c may represent: a, b, c, a - b, a - c, b - c, or a - b - c, where a, b, and c may be single or multiple.

[0224] Figure 1 Shows a schematic diagram of the architecture of a communication system provided by an embodiment of the present application. As Figure 1 shown, the communication system may include: a first device 101 and a second device 102.

[0225] Among them, the first device 101 can be a device that is inconvenient for a user to edit content such as text, or can be understood as an assisted device with weak input capabilities. For example, it can include a television, a smart screen (or a large screen), a smart watch, etc. In a possible implementation, the first device 101 can also include a camera (not shown in the figure), etc. The embodiments of the present application do not specifically limit the first device 101. Generally, when inputting content such as text in the first device 101, the user needs to use the remote control 103 to sequentially select pinyin and press the confirmation key, and the input is rather cumbersome and inefficient.

[0226] The second device 102 can be a device that is convenient for a user to edit content such as text, or can be understood as an auxiliary device with strong input capabilities. For example, it can include a mobile phone, a tablet, a computer, etc. The embodiments of the present application do not specifically limit the specific types of the first device 101 and the second device 102. For the convenience of description, the embodiments of the present application take the first device 101 as a large screen and the second device 102 as a mobile phone for illustration.

[0227] In a possible implementation, the mobile phone and the large screen can be connected by wire or wirelessly. For example, the wireless connection can include: wireless fidelity (Wi-Fi) connection, Bluetooth connection, or ZigBee connection, etc. The embodiments of the present application do not limit this. Furthermore, based on the method of the subsequent embodiments of the present application, the user can assist the large screen in inputting on the mobile phone.

[0228] For example, when the user moves an option on the large screen through the remote control and selects the edit box of the large screen, a dialog box for auxiliary input can pop up on the mobile phone communicating with the large screen. The user uses the input method soft keyboard of the mobile phone to input content such as text in the edit box of the mobile phone dialog box, and this content can be displayed on the large screen. After the user confirms that the input is completed on the mobile phone, functions such as searching for programs on the large screen can be implemented according to the content input by the user on the mobile phone.

[0229] In some embodiments, the number of mobile phones can be multiple. Exemplarily, Figure 2 shows a schematic structural diagram of another communication system provided by the embodiments of the present application. As Figure 2 shown, the communication system can include: a large screen 201, a first mobile phone 202, and a second mobile phone 203.

[0230] In a possible embodiment, the large screen 201, the first mobile phone 202, and the second mobile phone 203 are in a distributed network. The distributed network can support communication connections among the large screen 201, the first mobile phone 202, and the second mobile phone 203. Within the same distributed network, a client can connect to multiple servers simultaneously for distributed input, and a server can also be connected by multiple clients simultaneously. For example, in the same distributed network, the large screen 201 with weak input ability can be used as a client for distributed input, and the mobile phones 101 and 102 with strong input ability can be used as servers for distributed input.

[0231] Based on the architecture of the distributed network, the large screen 201, the first mobile phone 202, and the second mobile phone 203 can mutually implement one or more functions such as device discovery, device connection, or data transmission.

[0232] Exemplarily, after the large screen 201, the first mobile phone 202, and the second mobile phone 203 join the distributed network, they can implement mutual device discovery and device connection. Furthermore, the first mobile phone 202 and the second mobile phone 203 can simultaneously assist the large screen 201 in inputting content such as text. Or the first mobile phone 202 and the second mobile phone 203 can respectively assist the large screen 201 in inputting content such as text. Or when one of the first mobile phone 202 or the second mobile phone 203 assists the large screen 201 in inputting, the other mobile phone can perform preemptive input. Or the large screen 201 can select the first mobile phone 202 or the second mobile phone 203 to assist it in inputting, etc. The specific process of assisting input or preemptive input, etc. will be described in detail in subsequent embodiments and will not be elaborated here.

[0233] In some embodiments, the number of mobile phones can be multiple, and the number of large screens can also be multiple. Exemplarily, Figure 3 shows a schematic diagram of the architecture of another communication system provided by an embodiment of the present application. As Figure 3 shown, the communication system may include: a first large screen 301, a second large screen 302, a first mobile phone 303, and a second mobile phone 304.

[0234] In a possible embodiment, the first large screen 301, the second large screen 302, the first mobile phone 303, and the second mobile phone 304 are in a distributed network. Based on the architecture of the distributed network, the first large screen 301, the second large screen 302, the first mobile phone 303, and the second mobile phone 304 can mutually implement functions such as device discovery, device connection, or data transmission.

[0235] Exemplarily, after the first large screen 301, the second large screen 302, the first mobile phone 303, and the second mobile phone 304 join the distributed network, device discovery and device connection with each other can be achieved. Furthermore, the first mobile phone 303 and the second mobile phone 304 can simultaneously assist the first large screen 301 and / or the second large screen 302 in inputting content such as text. Or the first mobile phone 303 and the second mobile phone 304 can respectively assist the first large screen 301 and / or the second large screen 302 in inputting content such as text. Or when one of the first mobile phone 303 or the second mobile phone 304 assists the first large screen 301 and / or the second large screen 302 in inputting, the other can perform preemptive input. Or the first large screen 301 and / or the second large screen 302 can select the first mobile phone 303 or the second mobile phone 304 to assist in inputting for it, etc. The specific processes of assisting input or preemptive input, etc. will be described in detail in the subsequent embodiments and will not be elaborated here.

[0236] Figure 4 The functional block diagram of a first device provided by an embodiment of the present application is shown. In a possible implementation manner, as Figure 4 shown, the first device 400 may include: a processor 401, a memory 402, a communication interface 403, a speaker 404, a display 405, etc. These components can communicate through one or more communication buses or signal lines (not shown in the figure).

[0237] Next, in combination with Figure 4 each component of the first device 400 will be specifically introduced:

[0238] The processor 401 is the control center of the first device 400, connecting various parts of the first device 400 through various interfaces and lines. By running or executing the application programs stored in the memory 402, and by calling the data stored in the memory 402, it executes various functions of the first device 400 and processes data.

[0239] In some embodiments, the processor 401 may include one or more processing units. For example, the processor 401 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors. Among them, the controller may be the nerve center and command center of the first device 400. The controller may generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions. In some other embodiments, a memory may also be provided in the processor 401 for storing instructions and data. In some embodiments, the memory in the processor 401 is a cache memory. This memory may save the instructions or data that the processor 401 has just used or recycled. If the processor 401 needs to use this instruction or data again, it can be directly called from the memory, avoiding repeated accesses, reducing the waiting time of the processor 401, and thus improving the efficiency of the system. The processor 401 may run the software code / modules of the device communication method provided in some embodiments of the present application to implement the function of controlling the first device 400.

[0240] The memory 402 is used to store application programs and data. The processor 401 executes various functions and data processing of the first device 400 by running the application programs and data stored in the memory 402. The memory 402 mainly includes a program storage area and a data storage area. Among them, the program storage area may store an operating system (OS) and application programs required for at least one function (such as device discovery function, video search function, video playback function, etc.); the data storage area may store data created when using the first device (such as audio and video data, etc.). In addition, the memory 402 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as a disk storage device, a flash memory device, or other non-volatile solid-state storage devices, etc. In some embodiments, the memory 402 may store various operating systems. The above-mentioned memory 402 may be independent and connected to the processor 401 through the above-mentioned communication bus; the memory 402 may also be integrated with the processor 401.

[0241] The communication interface 403 can be a wired interface (such as an Ethernet interface) or a wireless interface (such as a cellular network interface or a wireless local area network interface). For example, the communication interface 403 can be specifically used for communicating with one or more second devices, etc.

[0242] The speaker 404, also known as a "loudspeaker", is used to convert an audio electrical signal into a sound signal. The first device 400 can play the sound signal through the speaker 404.

[0243] The display 405 (or referred to as a display screen, screen, etc.) can be used to display the display interface of an application, such as an interface for searching for videos or the current video playback screen, etc. The display 405 can include a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, a touch sensor can be provided in the display 405 to form a touch screen, which is not limited in this application. The touch sensor is used to detect a touch operation acting thereon or nearby. The touch sensor can transmit the detected touch operation to the processor 401 to determine the type of touch event. The processor 401 can provide a visual output related to the touch operation through the display 405.

[0244] In addition, the first device 400 can further include a power supply device 406 (such as a battery and a power management chip) for powering each component. The battery can be logically connected to the processor 401 through the power management chip, so as to implement functions such as management of charging, discharging, and power consumption management through the power supply device 406.

[0245] In addition, the first device 400 can further include a sensor module (not shown in the figure). The sensor module can include a barometric pressure sensor, a temperature sensor, etc. In practical applications, the first device 400 can further include more or fewer sensors, or use other sensors with the same or similar functions to replace the sensors listed above, etc., which is not limited in this application.

[0246] It can be understood that Figure 4The device structure shown does not constitute a specific limitation on the first device. In some other embodiments, the first device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0247] Figure 5 The functional block diagram of a second device 500 provided by an embodiment of the present application is shown. As Figure 5 shown, the second device 500 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0248] It can be understood that the structure schematically shown in the embodiment of the present application does not constitute a specific limitation on the second device 500. In some other embodiments of the present application, the second device 500 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0249] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0250] The controller may generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

[0251] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0252] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0253] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be respectively coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, and implementing the touch function of the second device 500.

[0254] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple groups of I2S buses. The processor 110 may be coupled to the audio module 170 through the I2S bus to implement communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface to implement the function of answering a call through a Bluetooth headset.

[0255] The PCM interface can also be used for audio communication to sample, quantize, and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through the PCM bus interface. In some embodiments, the audio module 170 may also transmit an audio signal to the wireless communication module 160 through the PCM interface to implement the function of answering a call through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0256] The UART interface is a general-purpose serial data bus for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0257] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to implement the shooting function of the second device 500. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the second device 500.

[0258] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0259] The USB interface 130 is an interface that complies with the USB standard specification, and can specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the second device 500, and can also be used to transfer data between the second device 500 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. This interface can also be used to connect other electronic devices, such as AR devices, etc.

[0260] It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is for illustrative purposes only and does not constitute a structural limitation on the second device 500. In other embodiments of the present application, the second device 500 can also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0261] The charging management module 140 is used to receive a charging input from a charger. Among them, the charger can be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 can receive the charging input from a wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 can receive the wireless charging input through the wireless charging coil of the second device 500. While charging the battery 142, the charging management module 140 can also supply power to the terminal device through the power management module 141.

[0262] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives inputs from the battery 142 and / or the charging management module 140 and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, the wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as the battery capacity, the number of battery cycles, and the battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be provided in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 can also be provided in the same device.

[0263] The wireless communication function of the second device 500 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc.

[0264] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. The antennas in the second device 500 can be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0265] The mobile communication module 150 can provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the second device 500. The mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, filter and amplify the received electromagnetic waves, and then transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modulation and demodulation processor and convert them into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least some functional modules of the mobile communication module 150 can be provided in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 can be provided in the same device.

[0266] The modulation and demodulation processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modulation and demodulation processor may be an independent device. In other embodiments, the modulation and demodulation processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.

[0267] The wireless communication module 160 may provide solutions for wireless communications applied to the second device 500, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive the signal to be transmitted from the processor 110, perform frequency modulation on it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

[0268] In some embodiments, antenna 1 of the second device 500 is coupled to the mobile communication module 150, and antenna 2 is coupled to the wireless communication module 160, such that the second device 500 can communicate with the network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0269] The second device 500 implements the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change the display information.

[0270] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the second device 500 may include one or N display screens 194, where N is a positive integer greater than 1.

[0271] The second device 500 can implement the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor, etc.

[0272] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera sensor. The light signal is converted into an electrical signal, and the camera sensor transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0273] The camera 193 is used to capture static images or videos. An object generates an optical image through the lens and projects it onto the sensor. The sensor can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The sensor converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard RGB, YUV, etc. formats. In some embodiments, the second device 500 may include one or N cameras 193, where N is a positive integer greater than 1.

[0274] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the second device 500 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0275] The video codec is used to compress or decompress digital videos. The second device 500 can support one or more video codecs. In this way, the second device 500 can play or record videos in multiple coding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0276] The NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between human brain neurons, it can quickly process input information and can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the second device 500 can be realized, such as: image recognition, face recognition, speech recognition, text understanding, etc.

[0277] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the second device 500. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, files such as music and videos are saved in the external memory card.

[0278] The internal memory 121 can be used to store computer-executable program code, and the executable program code includes instructions. The internal memory 121 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, the image playback function, etc.). The data storage area can store the data created during the use of the second device 500 (such as audio data, phone book, etc.). In addition, the internal memory 121 can include high-speed random access memory and can also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the second device 500 by running the instructions stored in the internal memory 121 and / or the instructions stored in the memory provided in the processor.

[0279] The second device 500 can implement audio functions through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and the application processor, etc. For example, music playback, recording, etc.

[0280] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some functional modules of the audio module 170 can be disposed in the processor 110.

[0281] The speaker 170A, also known as the "loudspeaker", is used to convert an audio electrical signal into a sound signal. The second device 500 can listen to music or a hands-free call through the speaker 170A.

[0282] The receiver 170B, also known as the "earpiece", is used to convert an audio electrical signal into a sound signal. When the second device 500 answers a call or a voice message, the voice can be listened to by placing the receiver 170B close to the human ear.

[0283] The microphone 170C, also known as the "microphone" or "transmitter", is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak by bringing the mouth close to the microphone 170C to input the sound signal into the microphone 170C. The second device 500 can be provided with at least one microphone 170C. In some other embodiments, the second device 500 can be provided with two microphones 170C, which can not only collect sound signals but also implement a noise reduction function. In some other embodiments, the second device 500 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, and implement functions such as directional recording.

[0284] The headphone jack 170D is used to connect a wired headphone. The headphone jack 170D can be a USB interface 130, or a 3.5 mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0285] The pressure sensor 180A is used to sense pressure signals and can convert pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor may include at least two parallel plates having conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The second device 500 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the second device 500 detects the intensity of the touch operation according to the pressure sensor 180A. The second device 500 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions.

[0286] The gyroscope sensor 180B can be used to determine the motion posture of the second device 500. In some embodiments, the angular velocity of the second device 500 around three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake during shooting. Exemplarily, when the shutter is pressed, the gyroscope sensor 180B detects the angle of shake of the second device 500, calculates the distance that the lens module needs to compensate according to the angle, and enables the lens to cancel the shake of the second device 500 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenarios.

[0287] The barometric pressure sensor 180C is used to measure barometric pressure. In some embodiments, the second device 500 calculates the altitude according to the barometric pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0288] The magnetic sensor 180D includes a Hall sensor. The second device 500 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the second device 500 is a flip phone, the second device 500 can detect the opening and closing of the flip according to the magnetic sensor 180D. Furthermore, according to the detected opening and closing state of the leather case or the flip, features such as automatic flip unlocking are set.

[0289] The acceleration sensor 180E can detect the magnitude of the acceleration of the second device 500 in various directions (generally three axes). When the second device 500 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the terminal device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0290] A distance sensor 180F is used to measure distance. The second device 500 can measure distance by infrared or laser. In some embodiments, when shooting a scene, the second device 500 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0291] The proximity light sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The light-emitting diode may be an infrared light-emitting diode. The second device 500 emits infrared light outward through the light-emitting diode. The second device 500 uses the photodiode to detect the infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the second device 500. When insufficient reflected light is detected, the second device 500 can determine that there is no object near the second device 500. The second device 500 can use the proximity light sensor 180G to detect that the user holds the second device 500 close to the ear for a call, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used for the holster mode and automatic unlocking and locking of the pocket mode.

[0292] The ambient light sensor 180L is used to sense the ambient light brightness. The second device 500 can adaptively adjust the brightness of the display screen 194 according to the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the second device 500 is in the pocket to prevent accidental touch.

[0293] The fingerprint sensor 180H is used to collect fingerprints. The second device 500 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc.

[0294] The temperature sensor 180J is used to detect temperature. In some embodiments, the second device 500 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the second device 500 reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the second device 500 heats the battery 142 to avoid abnormal shutdown of the second device 500 caused by low temperature. In some other embodiments, when the temperature is lower than yet another threshold, the second device 500 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0295] The touch sensor 180K, also known as the "touch control device". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as the "touch control screen". The touch sensor 180K is used to detect a touch operation acting thereon or nearby. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In some other embodiments, the touch sensor 180K can also be disposed on the surface of the second device 500, at a different position from where the display screen 194 is located.

[0296] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals of the vibrating bone mass of the human vocal part. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure pulsation signals. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone to form a bone conduction earphone. The audio module 170 can parse out voice signals based on the vibration signals of the vibrating bone mass of the human vocal part acquired by the bone conduction sensor 180M to implement the voice function. The application processor can parse out heart rate information based on the blood pressure pulsation signals acquired by the bone conduction sensor 180M to implement the heart rate detection function.

[0297] The button 190 includes a power-on button, a volume button, etc. The button 190 can be a mechanical button. It can also be a touch button. The second device 500 can receive button inputs and generate key signal inputs related to the user settings and function control of the second device 500.

[0298] The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration prompts and can also be used for touch vibration feedback. For example, touch operations acting on different application programs (such as taking pictures, audio playing, etc.) can correspond to different vibration feedback effects. Touch operations acting on different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects. Different application scenarios (such as: time reminder, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0299] The indicator 192 can be an indicator light and can be used to indicate the charging state, power change, and can also be used to indicate messages, missed calls, notifications, etc.

[0300] The SIM card interface 195 is used to connect to a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation from the second device 500. The second device 500 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The types of multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The second device 500 interacts with the network through the SIM card to implement functions such as calls and data communication. In some embodiments, the second device 500 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the second device 500 and cannot be separated from the second device 500.

[0301] The software systems of the first device 400 and the second device 500 can both adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture, etc. In the embodiments of this application, the Android system with a layered architecture is taken as an example to exemplarily illustrate the software structures of the first device 400 and the second device 500.

[0302] Figure 6 The left figure shows a software architecture block diagram of a first device provided by the embodiments of this application. The software system of the first device can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture, etc. In the embodiments of this application, the operating system of the first device is taken as the Android system as an example for exemplary illustration. As Figure 6 shown, the Android system is divided into four layers, from top to bottom are the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0303] The application layer can include a series of application packages.

[0304] As Figure 6 shown, the application layer can include one or more applications such as a gallery, a calendar, music, video, on-demand, smart home, or device control.

[0305] Among them, an input box can be provided in any of the above applications, enabling the user to enter keywords in the input box to perform operations such as searching in the application.

[0306] Smart home applications can be used to control or manage home devices with networking capabilities. For example, home devices can include electric lights, air conditioners, anti-theft door locks, speakers, floor cleaning robots, sockets, body fat scales, table lamps, air purifiers, refrigerators, washing machines, water heaters, microwave ovens, rice cookers, curtains, fans, TVs, set-top boxes, doors and windows, etc.

[0307] The device control application is used to control or manage a single device (such as the first device).

[0308] In addition, the application layer can also include system applications such as a control center and / or a notification center.

[0309] Among them, the control center is the pull-down message notification bar of the first device, such as the user interface displayed by the first device when the user performs a downward operation on the first device. The notification center is the pull-up message notification bar of the first device, that is, the user interface displayed by the first device when the user performs an upward operation on the first device.

[0310] The application framework layer (framework) provides application programming interfaces (application programming interface, API) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions.

[0311] Such as Figure 6 As shown, the application framework layer can include one or more of a window manager, a content provider, a resource manager, a view system, a notification manager, a distributed networking framework, a remote input service, or an input method framework, etc.

[0312] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, touch the screen, drag the screen, capture the screen, etc.

[0313] The content provider is used to store and obtain data, and make this data accessible to applications. The data can include videos, images, audio, browsing history, bookmarks, etc.

[0314] The view system includes visible controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon can include a view for displaying text and a view for displaying pictures.

[0315] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, and so on.

[0316] The notification manager enables an application to display notification information in the status bar. It can be used to convey messages of the notification type, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that a download is completed, a message reminder, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or a scroll bar text, such as a notification of a background-running application, or a notification that appears on the screen in the form of a dialogue window. For example, it prompts text information in the status bar, emits a prompt tone, and the indicator light flashes, etc.

[0317] The distributed networking framework enables the first device to discover other devices in the same distributed network, and then establish a communication connection with other devices.

[0318] The remote input service (which may also be called the remote input atomic ability (AA)) enables the first device to receive remote input from other devices.

[0319] The input method framework can support the first device to input content in the input box.

[0320] Android runtime includes core libraries and a virtual machine. Android runtime is responsible for the scheduling and management of the Android system.

[0321] The core libraries contain two parts: one part is the functional functions that the Java language needs to call, and the other part is the core libraries of Android.

[0322] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as the management of object life cycles, stack management, thread management, security and exception management, and garbage collection.

[0323] The system libraries can include multiple functional modules. For example: surface manager, Media Libraries, 3D graphics processing libraries (such as: OpenGL ES), 2D graphics engines (such as: SGL), etc.

[0324] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

[0325] The media libraries support the playback and recording of multiple common audio and video formats, as well as static image files, etc. The media libraries can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0326] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0327] The 2D graphics engine is a drawing engine for 2D drawing.

[0328] The kernel layer is the layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.

[0329] Figure 6 The right figure shows a software architecture block diagram of a second device provided by an embodiment of the present application. Exemplarily, as Figure 6 shown, the Android system is divided into four layers, from top to bottom are the application layer, the application framework layer, the Android runtime, and the system libraries, and the kernel layer.

[0330] The application layer may include a series of application packages.

[0331] As Figure 6 shown, the application packages may include applications such as a camera, a calendar, a phone, a map, a phone, music, settings, an email, a video, and social applications.

[0332] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions.

[0333] As Figure 6 shown, the application framework layer may include one or more of a window manager, a content provider, a resource manager, a view system, a notification manager, a distributed networking framework, an input method framework, or an interface service, etc.

[0334] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, touch the screen, drag the screen, capture the screen, etc.

[0335] The content provider is used to store and obtain data, and make this data accessible to applications. The data may include videos, images, audio, dialed and received calls, browsing history and bookmarks, a phone book, etc.

[0336] The view system includes visible controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

[0337] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, and so on.

[0338] The notification manager enables applications to display notification information in the status bar. It can be used to convey informative messages that can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that a download is complete, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of background running applications, or a notification that appears in the form of a dialogue window on the screen. For example, it can prompt text information in the status bar, emit a prompt sound, vibrate the terminal device, blink the indicator light, etc.

[0339] The distributed networking framework enables the second device to discover other devices in the same distributed network, and then establish communication connections with other devices.

[0340] The input method framework can support the second device to input content in the input box.

[0341] The interface service can define the interface between the second device and other devices, enabling the second device and other devices to implement data transmission based on the interface defined by the interface service. In a possible implementation, the interface service can include: auxiliary AA, where the atomic ability (AA) is developed by developers and is a program entity that implements a single function and can have no user interface (UI).

[0342] Android runtime includes a core library and a virtual machine. Android runtime is responsible for the scheduling and management of the Android system.

[0343] The core library consists of two parts: one part is the functional functions that need to be called by the Java language, and the other part is the core library of Android.

[0344] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0345] The system library can include multiple functional modules. For example: surface manager, Media Libraries, 3D graphics processing library (e.g., OpenGL ES), 2D graphics engine (e.g., SGL), etc.

[0346] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

[0347] The media library supports the playback and recording of multiple common audio and video formats, as well as static image files, etc. The media library can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0348] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0349] The 2D graphics engine is the drawing engine for 2D drawing.

[0350] The kernel layer is the layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.

[0351] Based on Figure 6 According to the software architectures of the first device and the second device shown, in the embodiments of the present application, the first device and the second device can use their respective distributed networking frameworks to implement communication services such as accessing a distributed network, device discovery, or data sending. For example, after the first device and the second device access the distributed network, the first device can pull up the interface service of the second device based on the remote input service, and then use the interface service of the second device to call the input method framework of the second device to implement using the input method framework of the second device to assist the first device in input. The remote input service of the first device can also send the content input based on the input method framework of the first device to the second device through the interface service of the second device, etc.

[0352] In a possible understanding manner, Figure 6 The corresponding embodiment is to set an interface service (such as assisting AA) in the framework layer of the second device. Through the interface service, it is similar to building a bridge between the input method frameworks of the first device and the second device, so that the first device can pull up the input method framework of the second device, and the content input using the input method framework of the second device can be equivalently displayed in the input box of the first device (for example, the cursor, highlighted display, etc. in the input box of the second device can all be displayed in the input box of the first device), realizing using the second device to assist the first device in input.

[0353] It should be understood that in possible implementations, the interface service (such as the auxiliary AA) can also be implemented in the form of an application. For example, an application (APP) for implementing the interface service of the embodiments of the present application can be developed, and then the application can be loaded in the mobile phone to implement the functions of the above-mentioned interface service of the embodiments of the present application based on the application. In possible implementation manners, the application may have an application icon displayed in the user interface (or it can be understood that the user can perceive the application), or the application may not have an application icon displayed in the user interface (or it can be understood that the user does not perceive the application). The embodiments of the present application do not limit the specific implementation of the interface service. For the convenience of description, the interface service is hereinafter exemplified by the auxiliary AA.

[0354] Next, Figure 7 an example will be given of the specific implementation process of mobile phone-assisted large screen input.

[0355] Figure 7 FIG. shows the system architecture diagram of a device communication method provided by an embodiment of the present application. As Figure 7 shown, an application editing box (or referred to as a search box), a database, and a remote input method framework service (or referred to as a remote input service) can be set in the client (large screen). An auxiliary AA, a notification manager (or simply referred to as a notification), a window manager (or simply referred to as a window), a database, and an input method framework can be set in the server (mobile phone).

[0356] The application editing box in the large screen can be provided by the input method framework of the large screen. The application editing box of the large screen can receive inputs from a remote control, etc. When the remote control selects the application editing box, subsequent auxiliary input implementation can be triggered. Or, when the remote control selects the application editing box and selects content in the soft keyboard (or referred to as a virtual keyboard) corresponding to the application editing box, subsequent auxiliary input implementation can be triggered.

[0357] The database in the large screen can store the association relationship between keywords and programs, etc. For example, after the large screen obtains a keyword in the application editing box, it can search for programs based on the association relationship between the keyword and the program in the database.

[0358] The remote input method framework service in the large screen enables the large screen to receive remote input. Exemplarily, the remote input method framework may include the local input method framework of the large screen and the remote input service AA. Based on the remote input service AA, an interface between the large screen and an external device can be defined, enabling the large screen to receive remote input from the external device through the interface. For example, the remote input service AA (or can be called the remote input service AA interface) on the large screen may include one or more of the following interfaces: an interface for the external to set text on the large screen, an interface for the external to apply for focus switching on the large screen, a callback registered by the external to the large screen, or an interface provided for the use of the keypad, etc.

[0359] The auxiliary AA in the mobile phone can define an interface between the mobile phone and other devices, enabling the mobile phone and other devices to implement data transmission based on the interface defined by the interface service. For example, it is possible to establish mutual calls between the local input method framework of the mobile phone and the remote input method framework of the large screen based on the auxiliary AA, so as to realize the synchronous display of any content input in the local input method framework of the mobile phone in the edit box of the large screen.

[0360] In a possible implementation, the realization of establishing mutual calls between the local input method framework of the mobile phone and the remote input method framework of the large screen based on the auxiliary AA includes: the remote input method framework of the large screen and the auxiliary AA hold each other's remote procedure call (RPC) objects. Then, when the large screen and the mobile phone perform data interaction subsequently, they can call the device processes of each other according to the RPC objects of each other, and notify the device processes of each other to call the local interfaces of each other to perform adaptation operations.

[0361] The notification manager in the mobile phone can display notification content in the mobile phone interface based on the operation of the large screen to obtain the focus of the edit box, prompting the mobile phone user to perform auxiliary input on the large screen.

[0362] The window manager in the mobile phone can display the user interface, such as displaying the notification interface, the auxiliary input interface, etc.

[0363] The database in the mobile phone can store the association relationship between keywords and candidate content. For example, after obtaining keywords in the input method edit box of the mobile phone, the candidate content can be displayed based on the association relationship between the keywords and the candidate content in the database.

[0364] The input method framework in the mobile phone can provide a convenient input method implementation.

[0365] Among them, both the large screen and the mobile phone can join the distributed network, and realize device discovery, communication connection establishment, data transmission, etc. in the distributed network. Since joining the distributed network is a relatively common technology, it will not be elaborated here.

[0366] In such as Figure 7In the system architecture diagram of the device communication method shown, when the large screen and the mobile phone join the distributed network, the databases of the large screen (such as the candidate word library) and the mobile phone (such as the candidate word library) can be synchronized, so that the large screen and the mobile phone can share each other's databases, and thus the user can select candidate words more conveniently based on the candidate word libraries in the large screen and the mobile phone.

[0367] For example, after the user selects the edit box of the large screen using a device such as a remote control, the large screen can start the local input method channel through the remote input method framework and pass it to the remote input method framework. The remote input method framework (IMF) queries the distributed network framework for the auxiliary AA within the current distributed network (it should be understood that here the auxiliary AA is taken as an example, and in fact it can be any application process in the mobile phone that can carry relevant capabilities). The mobile phone returns the RPC object of the auxiliary AA to the large screen, and then the mobile phone calls the interface to pass the RPC object of the input channel of the large screen to the mobile phone. Subsequently, the mobile phone can synchronize the editing status information to the large screen through the RPC object of the input channel of the large screen, and the large screen can also synchronize the editing status information to the mobile phone through the RPC object of the input channel of the mobile phone.

[0368] The auxiliary AA in the mobile phone can further instruct the notification manager to pop up a notification. When the mobile phone receives the user's click to confirm the notification, an input box can be popped up in the window of the mobile phone, and the local input method in the local input method framework of the mobile phone can be pulled up. Furthermore, the content input by the mobile phone user using the local input method can be synchronized to the remote input method framework service of the large screen, so that the content in the input box of the mobile phone is synchronously displayed in the edit box of the large screen.

[0369] In a possible implementation of using the mobile phone to assist the large screen in input, after the user enters a keyword in the edit box of the mobile phone, information such as the keyword in the edit box of the mobile phone can be synchronized to the edit box of the large screen, thereby improving the input efficiency on the large screen.

[0370] In a common implementation, in the scenario where the mobile phone A is used to assist the large screen in input, if the mobile phone A is interrupted during the process of assisting the large screen in input, for example, the mobile phone A receives an incoming call during the process of assisting the large screen in input, the auxiliary input of the mobile phone A may be interrupted, and the mobile phone A cannot continue to assist the large screen in input. Or, the user using the mobile phone A does not want to continue using the mobile phone A to assist the large screen in input. The user may hope to switch to other auxiliary devices to assist the large screen in input, such as switching to the mobile phone B to assist the large screen in input. Then the user needs to use the large screen remote control again, click the large screen edit box again, and re-trigger the connection between the large screen and the mobile phone B, and the process is rather cumbersome.

[0371] Based on this, an embodiment of the present application provides a device communication method. During the process of a user using a mobile phone to assist in large-screen input, other auxiliary devices in the same distributed network as the large screen and the mobile phone can preempt the auxiliary input of the mobile phone. Further, based on the input content of the mobile phone, it can continue to assist in large-screen input. During this period, the user does not need to use a remote control or other devices to select the editing box of the large screen again, realizing convenient and efficient auxiliary large-screen input.

[0372] Exemplarily, Figure 8 FIG. shows a schematic diagram of the specific system architecture of the device communication method for multiple devices to preempt input in an embodiment of the present application.

[0373] As Figure 8 shown, in an embodiment of the present application, taking a distributed network including a large screen, mobile phone A, and mobile phone B as an example, the process of mobile phone B preempting the auxiliary input when mobile phone A is assisting in input is exemplarily described. It can be understood that the large screen in the embodiment of the present application can have the ability to request remote input, and both mobile phone A and mobile phone B can have distributed input method assistance AA.

[0374] As Figure 8 shown, the device communication method in the embodiment of the present application can include a pulling-up process and a preemption process. In the pulling-up process, the large screen can establish connections with mobile phone A and mobile phone B, and mobile phone A confirms to assist in large-screen input. In the preemption process, mobile phone B can preempt mobile phone A to realize using mobile phone B to assist in large-screen input.

[0375] Exemplarily, in the pulling-up process, the user can click on the editing box of the large screen through the large-screen remote control. The editing box of the large screen requests a remote input method from the input method framework of the large screen. The large screen locates mobile phone A and mobile phone B in the distributed network. The large screen can establish connections with the auxiliary AA of mobile phone A and the auxiliary AA of mobile phone B respectively, and transfer the data channel interfaces of the large screen to the auxiliary AA of mobile phone A and the auxiliary AA of mobile phone B respectively. Notifications can pop up on both mobile phone A and mobile phone B, and this notification can be used to indicate that the large screen requests auxiliary input. The user can confirm to use mobile phone A to assist in large-screen input in the notification of mobile phone A and notify the large screen that the currently preempted device is mobile phone A. An editing box for assisting in large-screen input can pop up on mobile phone A, and the user can pull up the local input method of the mobile phone in the editing box of mobile phone A to assist in large-screen input. Exemplarily, the user can input "Hello," in the editing box of mobile phone A, and "Hello," can be synchronously displayed on the large screen.

[0376] Exemplarily, during the preemption process, the user can confirm in the notification of mobile phone B to use mobile phone B to assist large-screen input, and notify the large screen that the currently preempted device is mobile phone B. The large screen can broadcast to mobile phone A and mobile phone B in the distributed network that the currently preempted device is mobile phone B. If mobile phone A does not execute the preemption step again, the edit box for assisting input in mobile phone A can be hidden, and an edit box for assisting large-screen input can pop up in mobile phone B. The user can pull up the local input method of the mobile phone in the edit box of mobile phone B to assist large-screen input. In a possible implementation, after mobile phone B achieves preemption, in the edit box of mobile phone B, the content synchronized from mobile phone A by the large screen can be displayed synchronously. For example, if the content "Hello," has been synchronized from the edit box of mobile phone A to the edit box of the large screen, then in the edit box popped up by mobile phone B, the "Hello," can be synchronized.

[0377] In a possible implementation manner, during the above-mentioned pulling-up process, the notification on mobile phone B can be hidden first. During the preemption process, the user can trigger the display of the hidden notification on mobile phone B and implement preemption in the notification. For example, after the user clicks the notification on mobile phone A to make a selection and confirmation, the notification on mobile phone B can be hidden in the notification bar. When the user wants to use mobile phone B for preemptive input, the user can pull down the notification bar of mobile phone B to display the notification in mobile phone B, and click the notification of mobile phone B to achieve the preemption of mobile phone B.

[0378] It can be understood that during the process of mobile phone B successfully preempting and assisting large-screen input, mobile phone A can, based on a process similar to that of mobile phone B above, preempt to assist large-screen input again, which will not be elaborated here.

[0379] It should be noted that in the implementation of mobile phone B preempting the auxiliary input of mobile phone A, mobile phone A can be in a state where it cannot assist large-screen input, such as during a call, or mobile phone A can also be in a state where it can assist large-screen input. Or it can be understood that mobile phone B can initiate preemption at any time, and the embodiments of the present application do not limit the timing of preemption.

[0380] In a possible implementation manner, mobile phone A can also request mobile phone B to preempt. For example, in a home scenario, an elderly person holds mobile phone A to assist large-screen input, but the elderly person may have a slow input speed and hopes to request a young person holding mobile phone B to assist large-screen input. Then mobile phone A can send a request to mobile phone B, requesting mobile phone B to preempt the auxiliary input, and mobile phone B can achieve preemption based on the request of mobile phone A.

[0381] In a possible implementation, during the process of mobile phone A assisting the large screen for input, the large screen can also initiate preemption. For example, during the process of mobile phone A assisting the large screen for input, when the user clicks an edit box on the large screen using a remote control, the large screen can broadcast the current preemption device ID, which is the large screen ID, to all auxiliary devices within the distributed network. After receiving the broadcast of the current preemption device ID, the devices within the distributed network will judge the preemption device ID: for the large screen, if it is judged as the current preemption device, the local input method of the large screen will be pulled up, and the user can continue to input in the edit box on the large screen using the remote control; for other auxiliary devices, if it is judged as not the current preemption device, the input methods of other auxiliary devices can be hidden.

[0382] It should be noted that Figure 8 The corresponding embodiment is a possible implementation of the embodiments of the present application. In other possible implementations, it may be that the user triggers the subsequent process of assisting the large screen for input by selecting the virtual keyboard under the edit box provided by a certain application on the large screen using a remote control, or it may be that the user triggers the process of assisting the large screen for input on the mobile phone. The embodiments of the present application do not make specific limitations in this regard.

[0383] Combined with the above description, the user interface for the interaction between the large screen and the mobile phone will be exemplarily described below.

[0384] Exemplarily, Figure 9 - 10 A schematic diagram of the user interface for the user to trigger assisted input is shown.

[0385] Figure 9 A user interface diagram of the large screen is shown. As Figure 9 shown, the user can use the remote control 901 to select the edit box 902 on the large screen, and then the subsequent process of the mobile phone assisting the large screen for input in the embodiments of the present application can be triggered. Or, the user can use the remote control 901 to select any content 902 in the virtual keyboard on the large screen, and then the subsequent process of the mobile phone assisting the large screen for input in the embodiments of the present application can be triggered. The specific method of the mobile phone assisting the large screen for input will be described in the subsequent embodiments and will not be elaborated here.

[0386] It should be noted that Figure 9 A schematic diagram of setting an edit box in the user interface diagram of the large screen is shown. In a possible implementation, the user interface of the large screen may include multiple edit boxes, and triggering any edit box by the user can trigger the subsequent process of the mobile phone assisting the large screen for input in the embodiments of the present application. The embodiments of the present application do not make specific limitations in this regard.

[0387] Figure 10 A user interface diagram of the mobile phone is shown. For example, the user can display the user interface as shown in Figure 10 Figure a in, for example, by pulling down the main screen of the mobile phone, etc. As shown in Figure 10In the user interface shown in Figure a, one or more of the following functions of the mobile phone may be included: WLAN, Bluetooth, flashlight, mute, flight mode, mobile data, wireless screen mirroring, screenshot, or auxiliary input 1001. Among them, the auxiliary input 1001 may be the function of the mobile phone for auxiliary large-screen input in the embodiments of the present application.

[0388] In a possible implementation manner, after the user clicks on the auxiliary input 1001, the mobile phone may search for devices such as large screens in the same distributed network, obtain the search box in the large screen, establish a communication connection with the large screen, and may further display in the mobile phone as Figure 10 the user interface shown in Figure c, in such as Figure 10 In the user interface shown in Figure c, an edit box for assisting large-screen input may be displayed, and the user may assist the large screen in input based on this edit box.

[0389] In a possible implementation manner, if the number of devices such as large screens found by the mobile phone in the same distributed network is multiple, the mobile phone may also display in the user interface as Figure 10 shown in Figure b, in such as Figure 10 In the user interface shown in Figure b, the identifiers of multiple large screens may be displayed. The identifier of the large screen may be the device number, username, or nickname of the large screen, etc. The user may select the large screen for which they wish to assist in input (for example, click on large screen A or large screen B) in the user interface shown in Figure 10 Figure b, and enter the user interface shown in Figure 10 Figure c. The embodiments of the present application do not make specific limitations on this.

[0390] After the user triggers large-screen input through any of the above methods, for example, the large screen may search for auxiliary devices (such as mobile phones) with auxiliary input capabilities in the distributed network, and automatically determine the mobile phone for auxiliary input, or send a notification to all mobile phones found in the distributed network.

[0391] For example, if the large screen finds that there is one mobile phone in the distributed network, the large screen may automatically select the mobile phone as the device for auxiliary input.

[0392] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among these multiple mobile phones, there is a mobile phone set as the default auxiliary input by the user, the large screen may automatically select this default auxiliary input mobile phone as the device for auxiliary input.

[0393] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among these multiple mobile phones, there is a mobile phone that the user selected for auxiliary input the last time they performed auxiliary input, the large screen may automatically select the mobile phone that the user selected for auxiliary input the last time as the device for auxiliary input.

[0394] For example, if the large screen finds that there are multiple mobile phones in the distributed network, and among the multiple mobile phones, the mobile phone with the highest frequency of being selected by the user as the auxiliary input is obtained, then the large screen can automatically select the mobile phone with the highest frequency of being selected by the user as the auxiliary input device for auxiliary input.

[0395] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among the multiple mobile phones, there is a mobile phone with the same user account as the one logged in on the large screen, then the large screen can automatically select the mobile phone with the same user account as the one logged in on the large screen as the auxiliary input device.

[0396] Exemplarily, taking the large screen sending a notification to the mobile phones in the distributed network as an example, the user interfaces for the large screen and the mobile phones to preempt input will be described exemplarily below.

[0397] One or more mobile phones can be connected to the distributed network. In the case where one mobile phone is connected to the distributed network, this one mobile phone can assist the large screen in input. Subsequently, if other mobile phones are also connected to the distributed network, then the distributed network can include multiple mobile phones, and the multiple mobile phones can implement the preemption process as described in the embodiments of the present application. In the case where multiple mobile phones are connected to the distributed network, the multiple mobile phones can implement the preemption process as described in the embodiments of the present application.

[0398] Exemplarily, Figure 11 - 23 shows the process of the preemption device assisting the large screen in input. Taking the example of having a large screen, mobile phone A, and mobile phone B in the distributed network for illustration.

[0399] Figure 11 shows a schematic diagram of a user interface of the large screen. The large screen can connect to the auxiliary AA of mobile phone A and the auxiliary AA of mobile phone B, and request auxiliary input from mobile phone A and mobile phone B. Notifications can pop up on both mobile phone A and mobile phone B, and the notification is used to prompt the large screen to request auxiliary input. Exemplarily, Figure 11 shows the user interface diagram of mobile phone A or mobile phone B when receiving the notification.

[0400] Figure 12 shows the schematic diagram of the interface where mobile phone A determines to assist the large screen in input. As shown in the left user interface diagram of the mobile phone in Figure 12 , the user selects mobile phone A for auxiliary input, and the user can click the OK button in the notification of mobile phone A. In a possible implementation, as shown in the right user interface diagram of the large screen in Figure 12 , the large screen can prompt that the currently preempted device is mobile phone A. If no other device preempts for a period of time, it can be confirmed that mobile phone A assists the large screen in input. It can be understood that in another possible implementation, during the process of mobile phone A confirming auxiliary input, the large screen may not prompt that mobile phone A preempts, and the user watching the large screen may be unaware of the preemption process of mobile phone B.

[0401] In a possible implementation, such as Figure 10 in the embodiment shown, if the user initiates the process of assisting the large screen input from mobile phone A, then Figure 11 and Figure 12 the corresponding user interface may not be displayed, and the large screen can confirm the large screen input assisted by mobile phone A.

[0402] Figure 13 shows a schematic diagram of the interface for using mobile phone A to assist the large screen input. Such as Figure 13 in the user interface diagram of mobile phone A shown in the left figure of, an editing box for assisting input pops up in mobile phone A, and then the user can assist the large screen input in this editing box. For example, such as Figure 13 in the user interface diagram shown in the right figure of, the user can enter "Hello," in the editing box of mobile phone A. Correspondingly, such as Figure 14 shown, in the editing box of the large screen, "Hello," in the editing box of mobile phone A can be synchronously displayed.

[0403] In a possible implementation, when the user is inputting in the editing box of mobile phone A as shown in the right figure of Figure 13 , if the user performs operations such as deletion, highlighting selection, or cursor movement in the editing box of mobile phone A as shown in the right figure of Figure 13 , then, as shown in Figure 14 , the states such as deletion, highlighting selection, or cursor movement performed in the editing box of mobile phone A can be synchronously displayed in the editing box of the large screen.

[0404] When the user uses mobile phone A to assist the large screen in inputting, the assisted input of mobile phone A may be interrupted due to certain reasons. For example, mobile phone A receives a phone call during the assisted input process, or mobile phone A receives a video or voice call during the assisted input process. Or, when the user wants to switch devices to input to the large screen during the assisted input process, it involves the process of preempting input. The preempting device can be mobile phone B, or the large screen itself.

[0405] Exemplarily,[[]] Figure 15 - 17 shows a schematic diagram of the interface for mobile phone B to preempt input to the large screen.

[0406] In a possible implementation, the user of mobile phone B can preempt by triggering the notification bar. Exemplarily,[[]] Figure 15 shows a schematic diagram of the interface for mobile phone B to pull down the notification bar to preempt. Such as Figure 15As shown, when the mobile phone B performs preemptive input, the user can pull down the notification bar of the mobile phone B. The notification bar can display the notifications for requesting auxiliary input that the mobile phone B received from the large screen before. The user initiates preemption by clicking on the notification that previously popped up on the mobile phone B to prompt the large screen to request auxiliary input. For example, when the user clicks on the control for confirming auxiliary large screen input in this notification, the mobile phone B can connect to the large screen to perform preemptive input.

[0407] In a possible implementation, Figure 16 shows a schematic diagram of a user interface of the large screen, as Figure 16 shown. After the user confirms preemption on the mobile phone B, the auxiliary device AA of the mobile phone B notifies the large screen of the ID of the preemptive device, which is the mobile phone B. The large screen user interface can pop up a notification with the ID of the preemptive device, which is mobile phone B00.

[0408] Optionally, the large screen can broadcast the ID of the current preemptive device, which is the mobile phone B, to the mobile phone A and the mobile phone B. As Figure 17 shown, a notification with the ID of the current preemptive device, which is mobile phone B00, can be displayed in the user interface of the mobile phone A. When the mobile phone B determines that the current preemptive device is itself, the mobile phone B can pull up the local input method keyboard. When the mobile phone A determines that the current preemptive device is not itself, the mobile phone A can hide the local input method keyboard. When the large screen determines that the current preemptive device is not itself, the large screen hides the local input method keyboard.

[0409] In a possible implementation, after the user confirms preemption on the mobile phone B, the large screen does not need to pop up a notification with the ID of the preemptive device, which is mobile phone B00, in the user interface. Instead, the large screen broadcasts the ID of the current preemptive device, which is the mobile phone B, to the mobile phone A and the mobile phone B. When the mobile phone B determines that the current preemptive device is itself, the mobile phone B pulls up the local input method keyboard. When the mobile phone A determines that the current preemptive device is not itself, the mobile phone A hides the local input method keyboard. When the large screen determines that the current preemptive device is not itself, the large screen hides the local input method keyboard. Or it can be understood that during the process of the mobile phone B initiating preemption, the large screen does not need to prompt the preemption of the mobile phone B, and the users watching the large screen can be unaware of the preemption process of the mobile phone B.

[0410] In another possible implementation, the user of the mobile phone B can perform preemption through a request from the mobile phone A. Exemplarily, as Figure 18 shown, Figure 18 in the mobile phone A, an interface for requesting the mobile phone B to provide auxiliary input can be displayed. The user can click on the confirmation option in the mobile phone A to request the mobile phone B to provide auxiliary large screen input. Figure 18 In the mobile phone B, it can notify the mobile phone A of the request for auxiliary large screen input. The user can accept the request from the mobile phone A in the mobile phone B to achieve preemption of the auxiliary large screen input.

[0411] In another possible implementation, initially, the large screen and mobile phone A are connected to the distributed network. Mobile phone A assists the large screen in input. Subsequently, mobile phone B is connected to the distributed network, and a user interface for prompting the user whether to preempt the assisted input can be displayed on mobile phone B. Exemplarily, as Figure 19 shown, a user interface for prompting the user whether to preempt the assisted input is displayed on mobile phone B. The user can click the OK option on mobile phone B to achieve preemption of the assisted large screen input.

[0412] It can be understood that the method for mobile phone B to achieve preemption can also be set according to the actual application scenario, and the embodiments of the present application do not make specific limitations in this regard.

[0413] Exemplarily, Figure 20 a schematic diagram of a user interface of mobile phone B is shown. As shown in the left figure of Figure 20 , after mobile phone B successfully preempts, the content "Hello," in the edit box of the large screen can be synchronized to the edit box of mobile phone B. The user can continue to input in the edit box of mobile phone B. For example, the user continues to input "friend" in the edit box of mobile phone B. As shown in the right figure of Figure 20 , the edit box of mobile phone B can display "Hello, friend". Accordingly, the content "Hello, friend" in the edit box of mobile phone B can be synchronized and displayed in the edit box of the large screen.

[0414] It can be understood that during the process of mobile phone B assisting the large screen in input, mobile phone A can preempt again. The preemption process is similar to the above-mentioned preemption process of mobile phone B and will not be elaborated here.

[0415] In a possible implementation, during the process of mobile phone A or mobile phone B assisting the large screen in input, the large screen can also preempt.

[0416] Exemplarily, mobile phone A is assisting the large screen in input, and "Hello," has been input in the edit box of mobile phone A and the edit box of the large screen. The user hopes to use the large screen for input.

[0417] As shown in the large screen user interface diagram of the left figure of Figure 21 , the user can select the edit box on the large screen using a remote control or the like. The large screen can broadcast to the large screen, mobile phone A, and mobile phone B in the distributed network that the ID of the current preempting device is the large screen ID. After receiving this broadcast, mobile phone A and mobile phone B can pop up a user interface as shown in the right figure of Figure 18 . In the user interface shown in the right figure of Figure 21 , it can be displayed to prompt that the current preempting device is the large screen. In a possible implementation, mobile phone A and mobile phone B may not display a notification for prompting that the current clearing device is the large screen, and the embodiments of the present application do not make specific limitations in this regard.

[0418] Further, the large screen, mobile phone A, and mobile phone B can judge the preempted device ID. Mobile phone A and mobile phone B determine that the current preempted device is not their own device, and mobile phone A and mobile phone B hide the local input method keyboard. The large screen determines that the current preempted device is its own device, and the large screen pulls up the local input method keyboard. The user can continue to input in the edit box of the large screen using the remote control.

[0419] It should be noted that the above user interface diagrams during mobile phone-assisted large screen input are all exemplary illustrations. In possible implementation manners, in the interface during mobile phone-assisted large screen input, some or all of the content on the large screen can also be synchronized, so that mobile phone users can understand the status of the large screen based on the mobile phone interface.

[0420] Exemplarily, Figure 22 shows a user interface of a mobile phone. As Figure 22 shown, when the user uses the mobile phone to assist the large screen in input, all or part of the content of the large screen can be projected onto the mobile phone. For example, the content related to the edit box of the large screen is displayed on the mobile phone, and the edit box of the mobile phone is displayed on top of the large screen content. In this way, when the user inputs using the edit box of the mobile phone, the status in the edit box of the large screen can be synchronously seen in the user interface of the mobile phone, and the user does not need to look up at the input status on the large screen when assisting in input.

[0421] It should be noted that in the above embodiments, the example of the user assisting the large screen in inputting Chinese characters is used for illustration. In possible implementation manners, the user can assist the large screen in inputting English phrases or other forms of text input. The embodiments of the present application do not limit the specific content of the assisted input.

[0422] Corresponding to the above framework and user interface examples, exemplarily, Figure 23 shows a schematic flowchart of a specific process for a mobile phone to assist a large screen in input according to an embodiment of the present application.

[0423] As Figure 23 shown, mobile phone-assisted large screen input can include: a remote input method pulling-up process and a remote input method preemption process.

[0424] Exemplarily, during the remote input method pulling-up process, a distributed network can be formed. A large screen, two mobile phones (such as mobile phone A and mobile phone B), and a tablet can be connected to the distributed network, etc.

[0425] The user can use a device such as a remote control to click on the edit box of the large screen, so that the edit box of the large screen obtains focus.

[0426] The large screen can query all auxiliary devices with auxiliary AA in the distributed network. When an auxiliary device is found, the large screen connects to the auxiliary AA of each auxiliary device and simultaneously transmits the data channel interface to each auxiliary AA. A notification will pop up on the auxiliary AA of each auxiliary device, which is used to prompt the large screen that auxiliary input is required. Taking the auxiliary devices found by the large screen including mobile phone A and mobile phone B as an example, a notification can pop up on mobile phone A and mobile phone B waiting for the user to select and confirm.

[0427] When the user clicks the notification on mobile phone A to confirm using mobile phone A to assist the large screen in input, a text box can pop up on mobile phone A, and at the same time, the input method keyboard is pulled up. The user can input in the text box on mobile phone A.

[0428] During the input process on mobile phone A, for some reason, the user wants to switch to other auxiliary devices for input, such as mobile phone B, and enters the remote input method preemption process.

[0429] During the remote input method preemption process, when the user clicks the notification (or text box) on mobile phone B, the auxiliary AA of mobile phone B will notify the large screen that the current preemption device ID is the ID of mobile phone B. At the same time, the large screen will broadcast the current preemption device ID, and all auxiliary devices (such as mobile phone A and mobile phone B) in the distributed network will determine whether this device is the current preemption device based on the preemption device ID broadcast by the large screen.

[0430] For example, if mobile phone B determines that the current preemption device is this device, mobile phone B will pull up the local input method keyboard and simultaneously synchronize the content of the large screen text box to the text box on mobile phone B through the data channel interface. The user can input in the text box on mobile phone B. If mobile phone A determines that the current preemption device is not this device, mobile phone A can determine whether the input method keyboard has been pulled up. If the input method keyboard has been pulled up on mobile phone A, mobile phone A can hide the local input method keyboard.

[0431] In this way, based on the above method of the embodiment of the present application, any auxiliary device in the distributed network can initiate convenient preemption at any time. After successful preemption, it can assist the large screen in input.

[0432] In the case of dividing each function into corresponding function modules, as Figure 24 shown, a possible structural schematic diagram of a first device, a second device, or a third device provided by the embodiment of the present application is shown. The first device, the second device, or the third device includes: a display screen 2401 and a processing unit 2402.

[0433] Among them, the display screen 2401 is used to support the first device, the second device, or the third device to execute the display step in the above embodiment, or other processes of the technology described in the embodiment of the present application. The display screen 2401 can be a touch screen or other hardware or a combination of hardware and software.

[0434] A processing unit 2402 is configured to support the first device, the second device, or the third device to execute the processing steps in the above method embodiments, or other processes of the technology described in the embodiments of the present application.

[0435] Wherein, all relevant contents of each step involved in the above method embodiments can be cited in the function descriptions of the corresponding functional modules, and will not be elaborated herein.

[0436] Of course, the electronic device includes, but is not limited to, the unit modules listed above. Moreover, the functions that the above functional units can specifically implement also include, but are not limited to, the functions corresponding to the method steps described in the above examples. For a detailed description of other units of the electronic device, reference can be made to the detailed description of the corresponding method steps, which will not be elaborated in the embodiments of the present application.

[0437] In the case of adopting an integrated unit, the first device, the second device, or the third device involved in the above embodiments may include: a processing module, a storage module, and a display screen. The processing module is configured to control and manage the actions of the first device, the second device, or the third device. The display screen is configured to display content according to the instructions of the processing module. The storage module is used to store the program codes and data of the first device, the second device, or the third device. Further, the first device, the second device, or the third device may further include an input module and a communication module. The communication module is configured to support the communication between the first device, the second device, or the third device and other network entities to implement functions such as calls, data interaction, and Internet access of the first device, the second device, or the third device.

[0438] Wherein, the processing module may be a processor or a controller. The communication module may be a transceiver, an RF circuit, or a communication interface, etc. The storage module may be a memory. The display module may be a screen or a display. The input module may be a touch screen, a voice input device, or a fingerprint sensor, etc.

[0439] Wherein, the above communication module may include an RF circuit, and may further include a wireless fidelity (Wi-Fi) module, a near field communication (NFC) module, and a Bluetooth module. Communication modules such as the RF circuit, the NFC module, the Wi-Fi module, and the Bluetooth module may be collectively referred to as a communication interface. Wherein, the above processor, RF circuit, display screen, and memory may be coupled together through a bus.

[0440] Such as Figure 25As shown, another possible structural schematic diagram of the first device, second device, or third device provided by an embodiment of the present application is shown, including: one or more processors 2501, a memory 2502, a camera 2504, and a display screen 2503; the above-mentioned devices can communicate through one or more communication buses 2506.

[0441] Among them, one or more computer programs are stored in the memory 2502 and are configured to be executed by one or more processors 2501; one or more computer programs 2505 include instructions for executing the display method of any of the above steps. Of course, the electronic device includes but is not limited to the devices listed above. For example, the above electronic device may further include a radio frequency circuit, a positioning device, a sensor, and so on.

[0442] The present application also provides the following embodiments. It should be noted that the numbers of the following embodiments do not necessarily need to follow the numbering order of the previous embodiments.

[0443] Embodiment 21. A device communication method applied to a system including a first device, a second device, and a third device, the method including:

[0444] The first device displays a first interface including a first edit box;

[0445] In response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network;

[0446] The first device displays a second interface, the second interface including a first option corresponding to the second device and a second option corresponding to the third device;

[0447] In response to a trigger operation on the first option, the first device sends an indication message to the second device;

[0448] The second device displays a third interface according to the indication message, the third interface including a second edit box;

[0449] In the case where there is an editing state in the second edit box, synchronize the editing state to the first edit box.

[0450] Embodiment 22. According to the method of Embodiment 21, the second device includes an interface service for synchronizing the editing state between the first device and the second device.

[0451] Embodiment 23. According to the method of Embodiment 21 or 22, the editing state includes one or more of the following: text content, cursor, or highlighted mark of text content.

[0452] Example 24. The method according to any one of Examples 21-23, wherein the second device displays a third interface according to the indication message, including:

[0453] The second device displays a notification interface in response to the indication message; the notification interface includes a third option for confirming auxiliary input;

[0454] In response to a trigger operation on the third option, the second device displays the third interface.

[0455] Example 25. The method according to any one of Examples 21-24, wherein the third interface further includes: all or part of the content of the first interface.

[0456] Example 26. The method according to Example 25, wherein the second edit box is displayed in a layered manner with all or part of the content of the first interface, and the second edit box is displayed above all or part of the content of the first interface.

[0457] Example 27. The method according to any one of Examples 21-26, after the second device displays the third interface according to the indication message, the method further includes:

[0458] In response to a trigger on the second edit box, the second device displays a virtual keyboard;

[0459] The second device displays the editing state in the second edit box according to the input operation received in the virtual keyboard and / or the second edit box.

[0460] Example 28. The method according to any one of Examples 21-27, wherein the first device includes any one of the following: a television, a large screen, or a wearable device; the second device or the third device includes any one of the following: a mobile phone, a tablet, or a wearable device.

[0461] Example 29. A device communication method applied to a system including a first device, a second device, and a third device, the method including:

[0462] The first device displays a first interface including a first edit box;

[0463] In response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network;

[0464] The first device determines that the second device is an auxiliary input device;

[0465] The first device sends an indication message to the second device;

[0466] The second device displays a third interface according to the indication message, and the third interface includes a second edit box;

[0467] When there is an editing state in the second edit box, synchronize the editing state to the first edit box.

[0468] Embodiment 210. A device communication method is applied to a system including a first device, a second device, and a third device. The method includes:

[0469] The second device displays a fourth interface including an option of the first device;

[0470] In response to a selection operation on the option of the first device, the second device sends an indication message to the first device;

[0471] The first device displays a first interface including a first edit box;

[0472] The second device displays a third interface, and the third interface includes a second edit box;

[0473] When there is an editing state in the second edit box, synchronize the editing state to the first edit box.

[0474] Embodiment 211. A device communication method is applied to a first device. The method includes:

[0475] The first device displays a first interface including a first edit box;

[0476] In response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network;

[0477] The first device displays a second interface, and the second interface includes a first option corresponding to the second device and a second option corresponding to the third device;

[0478] In response to a triggering operation on the first option, the first device sends an indication message to the second device; the indication message is used to instruct the second device to display a third interface, and the third interface includes a second edit box;

[0479] When there is an editing state in the second edit box, synchronize the editing state to the first edit box.

[0480] Embodiment 212. A device communication method is applied to a second device. The method includes:

[0481] The second device displays a fourth interface including an option of the first device;

[0482] In response to a selection operation of an option of the first device, the second device sends an indication message to the first device; the indication message is used to instruct the first device to display a first interface including a first edit box.

[0483] The second device displays a third interface, and the third interface includes a second edit box.

[0484] When there is an editing state in the second edit box, synchronize the editing state to the first edit box.

[0485] Embodiment 213. A device communication system includes a first device, a second device, and a third device. The first device is configured to perform the steps of the first device according to any one of Embodiments 21-29 and 210-212. The second device is configured to perform the steps of the second device according to any one of Embodiments 21-29 and 210-212. The third device is configured to perform the steps of the third device according to any one of Embodiments 21-29 and 210-212.

[0486] Embodiment 214. A first device includes: at least one memory and at least one processor.

[0487] The memory is used to store program instructions.

[0488] The processor is configured to call the program instructions in the memory to cause the first device to perform the steps performed by the first device according to any one of Embodiments 21-29 and 210-212.

[0489] Embodiment 215. A second device includes: at least one memory and at least one processor.

[0490] The memory is used to store program instructions.

[0491] The processor is configured to call the program instructions in the memory to cause the second device to perform the steps performed by the second device according to any one of Embodiments 21-29 and 210-212.

[0492] Embodiment 216. A computer-readable storage medium stores a computer program, such that when the computer program is executed by a processor of a first device, it implements the steps performed by the first device according to any one of Embodiments 21-29 and 210-212; or when the computer program is executed by a processor of a second device, it implements the steps performed by the second device according to any one of Embodiments 21-29 and 210-212; or when the computer program is executed by a processor of a third device, it implements the steps performed by the third device according to any one of Embodiments 21-29 and 210-212.

[0493] For the specific implementation of the above Embodiments 21-29 and Embodiments 210-216, reference may be made to Figure 26 - 37 for description.

[0494] In a possible implementation of using a mobile phone to assist in large-screen input, when the large screen locates an auxiliary device with an auxiliary input function in the distributed network, the large screen can send a broadcast to all auxiliary devices with an auxiliary input function in the distributed network to notify all such auxiliary devices that the large screen needs auxiliary input.

[0495] However, perhaps only one or some of the auxiliary devices participate in assisting the large screen input, and the large screen sending a broadcast to all auxiliary devices in the distributed network will cause certain interference to other auxiliary devices in the distributed network that do not participate in assisting the large screen input.

[0496] Based on this, the embodiments of the present application provide a device communication method. The user can select a target auxiliary device on the large screen, and then can send a notification to the target auxiliary device without sending a notification to other auxiliary devices, which can avoid interfering with other devices. Or, the user can select a target auxiliary device on the large screen, establish a communication connection with the target auxiliary device, and a editing box for assisting large-screen input can pop up on the target auxiliary device. During this period, a notification interface may not be displayed on the target auxiliary device, nor does the user need to trigger a notification.

[0497] Exemplarily, Figure 26 shows a schematic diagram of the specific system architecture of the device communication method according to the embodiments of the present application.

[0498] The user clicks on an editing box provided by a certain application on the large screen through a remote control. The large screen can locate a device with an auxiliary input capability (such as a mobile phone with auxiliary AA set) in the distributed network. After the large screen locates a device with an auxiliary input capability, an interface including the identifier of the device with an auxiliary input capability can pop up on the large screen. Among them, the identifier of the device with an auxiliary input capability can be the device number, username, or nickname of the device with an auxiliary input capability, etc.

[0499] If the user selects a target device in a device with auxiliary input capabilities, taking the target device as a mobile phone for example, the large screen can transfer the input data interface to the Input Method Management Framework (IMF) of the large screen. The Input Method Management Framework of the large screen can establish a connection with the auxiliary AA of the mobile phone. The auxiliary AA of the mobile phone can simulate a click event to launch the local input method of the mobile phone. In the input window of the mobile phone that contains an edit box, subsequently, the user can input content in the edit box using the local input method of the mobile phone. The auxiliary AA of the mobile phone can return a cross-process interface to the Input Method Management Framework of the large screen. The Input Method Management Framework of the large screen can, through this cross-process interface, package the input data interface of the large screen across processes and transfer it to the auxiliary AA of the mobile phone. Subsequently, the auxiliary AA of the mobile phone can synchronize the content in the edit box of the mobile phone to the large screen based on the input data interface of the large screen.

[0500] For example, when the user performs operations such as text input, text deletion, highlighting and selecting text, or moving the cursor in the edit box of the mobile phone, the auxiliary AA of the mobile phone can call the input data interface of the large screen to synchronize the content in the edit box of the mobile phone to the edit box of the large screen.

[0501] It can be understood that if the large screen does not have the ability of remote input, or the large screen does not find an auxiliary device in the distributed network, the large screen can use the local input method of the large screen for input.

[0502] It should be noted that Figure 26 This is a possible implementation manner of the embodiments of the present application. In other possible implementation manners, it can be that the user triggers the subsequent process of assisting the large screen input by selecting the virtual keyboard under the edit box provided by a certain application on the large screen through a remote control, or it can be that the user triggers the process of assisting the large screen input in the mobile phone. The embodiments of the present application do not make specific limitations on this.

[0503] Combined with the above description, the user interface for the interaction between the large screen and the mobile phone is exemplarily described below.

[0504] Exemplarily, Figure 27 - 28 A schematic diagram of the user interface for the user to trigger auxiliary input is shown.

[0505] Figure 27 A user interface diagram of the large screen is shown. As Figure 27 shown, the user can use the remote control 2701 to select the edit box 2702 in the large screen, then the subsequent process of the mobile phone assisting the large screen input in the embodiments of the present application can be triggered. Or, the user can use the remote control 2701 to select any content 2702 in the virtual keyboard of the large screen, then the subsequent process of the mobile phone assisting the large screen input in the embodiments of the present application can be triggered. The specific manner of the mobile phone assisting the large screen input will be described in the subsequent embodiments and will not be elaborated here.

[0506] It should be noted thatFigure 27 A schematic diagram of setting an edit box in the user interface diagram of the large screen is shown. In a possible implementation, the user interface of the large screen may include multiple edit boxes, and the user triggering any edit box may trigger the subsequent mobile phone-assisted large screen input process of the embodiment of the present application, and the embodiment of the present application does not specifically limit this.

[0507] Figure 28 A user interface diagram of a mobile phone is shown. For example, a user can display the following information by pulling down the main screen of the mobile phone. Figure 28 The user interface shown in Figure a is as follows. Figure 28 The user interface shown in FIG. a may include one or more of the following functions of the mobile phone: WLAN, Bluetooth, flashlight, mute, flight mode, mobile data, wireless screen projection, screenshot or auxiliary input 2801. The auxiliary input 2801 may be a function of assisting large-screen input of the mobile phone in the embodiment of the present application.

[0508] In a possible implementation, after the user clicks on the auxiliary input 2801, the mobile phone can search for a large screen and other devices in the same distributed network, obtain the search box in the large screen, establish a communication connection with the large screen, and further display the following information in the mobile phone: Figure 28 The user interface shown in Figure c is as follows. Figure 28 In the user interface shown in Figure c, an edit box for assisting large-screen input may be displayed, and the user may assist the large-screen input based on the edit box.

[0509] In a possible implementation, if the mobile phone finds that there are multiple large screen devices in the same distributed network, the mobile phone can also display the following information: Figure 28 The user interface shown in Figure b is as follows. Figure 28 The user interface shown in Figure b can display multiple large screen logos, and the logo of the large screen can be the device number, user name or nickname of the large screen. Figure 28 In the user interface shown in Figure b, select the large screen you want to assist in input (for example, click large screen A or large screen B), and enter the following Figure 28 The user interface shown in Figure c is not specifically limited in the present application embodiment. After the user triggers the large screen input through any of the above methods, for example, Figure 29 -34 shows a schematic diagram of the user interface for mobile phone-assisted large-screen input.

[0510] Figure 29 A user interface diagram of a large screen is shown. Figure 29 As shown, users can use Figure 27Trigger the scenario of entering the auxiliary input in a corresponding manner. The large screen can search for auxiliary devices with auxiliary input capabilities within the distributed network and display the found auxiliary devices "Mobile Phone A" and "Mobile Phone B" on the large screen. It can be understood that any possible form can be adopted on the large screen to display the identifiers of the auxiliary devices, such as in a list, picture, or number, etc.

[0511] The user can use a device such as a remote control to select "Mobile Phone B" on the large screen, and then the large screen can interact with Mobile Phone B to utilize Mobile Phone B to assist in the input of the large screen.

[0512] In a possible implementation manner, the large screen can also automatically determine the device for auxiliary input.

[0513] For example, if the large screen finds that there is a mobile phone in the distributed network, the large screen can automatically select the mobile phone as the device for auxiliary input and does not display the user interface as Figure 29 shown. Optionally, if the large screen later discovers that other mobile phones except this mobile phone are connected to the distributed network, the large screen can display the user interface as Figure 29 shown.

[0514] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among these multiple mobile phones, there is a mobile phone set as the default auxiliary input by the user, the large screen can automatically select this default auxiliary input mobile phone as the device for auxiliary input and does not display the user interface as Figure 29 shown.

[0515] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among these multiple mobile phones, there is a mobile phone that was selected as the auxiliary input when the user last performed auxiliary input, the large screen can automatically select the mobile phone that was selected as the auxiliary input when the user last performed auxiliary input as the device for auxiliary input and does not display the user interface as Figure 29 shown.

[0516] For example, if the large screen finds that there are multiple mobile phones in the distributed network, the large screen obtains the mobile phone among these multiple mobile phones that has been selected as the auxiliary input with the highest frequency by the user, then the large screen can automatically select the mobile phone that has been selected as the auxiliary input with the highest frequency by the user as the device for auxiliary input and does not display the user interface as Figure 29 shown.

[0517] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among these multiple mobile phones, there is a mobile phone with the same user account as the one logged in on the large screen, the large screen can automatically select the mobile phone with the same user account as the one logged in on the large screen as the device for auxiliary input and does not display the user interface as Figure 29 shown.

[0518] That is to say,Figure 29 The user interface of the large screen shown is not necessary and may not be displayed, such as Figure 29 the user interface shown. The embodiments of the present application Figure 29 do not limit the specific form of the user interface shown, nor the way to trigger the display of Figure 29 the user interface shown.

[0519] Taking the example that the user uses a device such as a remote control to select "Mobile Phone B" as an auxiliary input device on the large screen. After the user selects Mobile Phone B on the large screen, a notification can pop up on Mobile Phone B to prompt the user that the large screen requests auxiliary input.

[0520] Exemplarily, such as Figure 30 the user interface shown in the leftmost figure, a notification for prompting the large screen to request auxiliary input can pop up on Mobile Phone B, and the user can trigger the notification in Mobile Phone B to confirm auxiliary input to the large screen. Further, such as Figure 30 the user interface shown in the middle figure, an edit box for assisting large screen input can pop up on Mobile Phone B. Further, the user can trigger, such as by clicking, the edit box shown in Figure 30 the middle figure, and Mobile Phone B can display the user interface shown in Figure 30 the rightmost figure. A virtual keyboard (or soft keyboard) of the mobile phone can be displayed in this user interface, and the user can subsequently use the virtual keyboard of Mobile Phone B to assist large screen input.

[0521] In another possible implementation, after the user selects Mobile Phone B on the large screen, Mobile Phone B may not receive a notification, but instead pop up an edit box for assisting large screen input as shown in Figure 31 the left figure. Further, the user can trigger, such as by clicking, the edit box shown in Figure 31 the left figure, and Mobile Phone B can display the user interface shown in Figure 31 the right figure. A virtual keyboard (or soft keyboard) of the mobile phone can be displayed in this user interface, and the user can subsequently use the virtual keyboard of Mobile Phone B to assist large screen input.

[0522] It can be understood that the user does not select "Mobile Phone A" on the large screen, so the large screen may not interact with Mobile Phone A, and it will not cause interference to the users of Mobile Phone A.

[0523] It should be noted that if the embodiments of the present application adopt the corresponding method to trigger auxiliary large screen input, the user interface diagram shown in Figure 28 will be omitted, and during auxiliary input, except for the mobile phone that triggers to enter auxiliary large screen input, other mobile phones can be unaware and will not cause interference to other mobile phone users. Figure 29 - 31 the user interface shown in

[0524] Exemplarily, Figure 32Shows a schematic diagram of a user interface for a user to assist in large-screen input in the edit box of mobile phone B. Exemplarily, as Figure 32 shown in the left figure of the user interface diagram of mobile phone B, the user can enter "lion" in the edit box of mobile phone B, and a cursor can also be displayed behind "lion" in the edit box of mobile phone B, as Figure 32 shown in the right figure of the user interface diagram of the large screen, the "lion" and the cursor can be synchronized to the edit box of the large screen.

[0525] Figure 33 Shows a schematic diagram of a user interface for a user to move the cursor in the edit box of mobile phone B. Exemplarily, as Figure 33 shown in the left figure of the user interface diagram of mobile phone B, the user can move the cursor in the edit box of mobile phone B to before "lion" and add "old" before the cursor, as Figure 33 shown in the right figure of the user interface diagram of the large screen, the cursor before "lion" and "old" before the cursor can be synchronized to the edit box of the large screen.

[0526] Figure 34 Shows a schematic diagram of a user interface for a user to highlight and select a target word in the edit box of mobile phone B. Exemplarily, as Figure 34 shown in the left figure of the user interface diagram of mobile phone B, the user can highlight and select "old" in the edit box of mobile phone B, as Figure 34 shown in the right figure of the user interface diagram of the large screen, the highlighted "old" can be synchronized to the edit box of the large screen.

[0527] It can be understood that if the user selects mobile phone A on the large screen, in the implementation of the user assisting in large-screen input on mobile phone A, the user interface of mobile phone A can be similar to that of mobile phone B, which will not be elaborated here.

[0528] It should be noted that the above user interface diagrams for mobile phone-assisted large-screen input are all exemplary illustrations. In possible implementation methods, in the interface for mobile phone-assisted large-screen input, some or all of the content on the large screen can also be synchronized, so that mobile phone users can understand the status of the large screen based on the mobile phone interface.

[0529] Exemplarily, Figure 35 shows a user interface of a mobile phone. As Figure 35 shown, when the user uses a mobile phone (such as the above-mentioned mobile phone A or mobile phone B) to assist in large-screen input, all or part of the content of the large screen can be projected onto the mobile phone. For example, the content related to the edit box of the large screen is displayed on the mobile phone, and the edit box of the mobile phone is displayed on the upper layer of the large-screen content. In this way, when the user enters text in the edit box of the mobile phone, the status of the edit box on the large screen can be synchronized and seen in the user interface of the mobile phone. When the user assists in input, there is no need to look up at the input status on the large screen.

[0530] It should be noted that in the above embodiments, taking the example of a user assisting in inputting Chinese characters on a large screen, in possible implementation manners, the user can assist the large screen in inputting English phrases or other forms of text input. The embodiments of the present application do not limit the specific content of the assisted input.

[0531] In the case of dividing each function into corresponding function modules, as Figure 36 shown, a possible structural schematic diagram of a first device, a second device, or a third device provided by an embodiment of the present application is shown. The first device, the second device, or the third device includes: a display screen 3601 and a processing unit 3602.

[0532] Among them, the display screen 3601 is used to support the first device, the second device, or the third device to execute the display steps in the above embodiments, or other processes of the technologies described in the embodiments of the present application. The display screen 3601 can be a touch screen or other hardware or a combination of hardware and software.

[0533] The processing unit 3602 is used to support the first device, the second device, or the third device to execute the processing steps in the above method embodiments, or other processes of the technologies described in the embodiments of the present application.

[0534] Among them, all relevant contents of each step involved in the above method embodiments can be cited in the function descriptions of the corresponding function modules, and will not be elaborated here.

[0535] Of course, the electronic device includes but is not limited to the unit modules listed above. Moreover, the specific functions that the above function units can implement also include but are not limited to the functions corresponding to the method steps described in the above examples. For a detailed description of other units of the electronic device, reference can be made to the detailed description of the corresponding method steps, which will not be elaborated in the embodiments of the present application here.

[0536] In the case of adopting an integrated unit, the first device, the second device, or the third device involved in the above embodiments may include: a processing module, a storage module, and a display screen. The processing module is used to control and manage the actions of the first device, the second device, or the third device. The display screen is used to display content according to the instructions of the processing module. The storage module is used to save the program codes and data of the first device, the second device, or the third device. Further, the first device, the second device, or the third device may further include an input module and a communication module. The communication module is used to support the communication between the first device, the second device, or the third device and other network entities to implement functions such as calls, data interaction, and Internet access of the first device, the second device, or the third device.

[0537] Among them, the processing module may be a processor or a controller. The communication module may be a transceiver, an RF circuit, a communication interface, etc. The storage module may be a memory. The display module may be a screen or a display. The input module may be a touch screen, a voice input device, a fingerprint sensor, etc.

[0538] Among them, the above communication module may include an RF circuit, and may further include a wireless fidelity (Wi-Fi) module, a near field communication (NFC) module, and a Bluetooth module. Communication modules such as the RF circuit, the NFC module, the Wi-Fi module, and the Bluetooth module may be collectively referred to as a communication interface. Among them, the above processor, RF circuit, display screen, and memory may be coupled together through a bus.

[0539] Such as Figure 37 As shown, it shows another possible structural schematic diagram of the first device, the second device, or the third device provided by the embodiment of the present application, including: one or more processors 3701, a memory 3702, a camera 3704, and a display screen 3703; the above-mentioned devices may communicate through one or more communication buses 3706.

[0540] Among them, one or more computer programs are stored in the memory 3702 and are configured to be executed by one or more processors 3701; one or more computer programs 3705 include instructions for executing the display method of any of the above steps. Of course, the electronic device includes but is not limited to the above-listed devices. For example, the above electronic device may further include an RF circuit, a positioning device, a sensor, and so on.

[0541] The present application also provides the following embodiments. It should be noted that the numbers of the following embodiments do not necessarily need to follow the numbering order of the previous embodiments.

[0542] Embodiment 31. A device communication method applied to a system including a first device and a second device, the method including:

[0543] The first device displays a first interface including a first edit box;

[0544] The first device sends an indication message to the second device;

[0545] The second device displays a second interface according to the indication message, and the second interface includes a second edit box;

[0546] In the case where there is a keyword in the second edit box, the first device synchronizes the keyword to the first edit box;

[0547] The first device determines candidate words corresponding to the keyword;

[0548] The second device obtains the candidate words and displays a third interface, where the third interface includes the candidate words.

[0549] Embodiment 32. The method according to Embodiment 31, where the second device includes an interface service for synchronizing the editing states between the first device and the second device.

[0550] Embodiment 33. The method according to Embodiment 32, where the editing state includes one or more of the following: text content, cursor, or highlighted mark of text content.

[0551] Embodiment 34. The method according to any one of Embodiments 31-33, where the second device displays a second interface according to the indication message, including:

[0552] The second device displays a notification interface in response to the indication message; the notification interface includes an option for confirming auxiliary input;

[0553] In response to a trigger operation on the option, the second device displays the second interface.

[0554] Embodiment 35. The method according to any one of Embodiments 31-34, where the second interface further includes all or part of the content of the first interface.

[0555] Embodiment 36. The method according to Embodiment 35, where the second edit box and all or part of the content of the first interface are displayed in layers, and the second edit box is displayed on top of all or part of the content of the first interface.

[0556] Embodiment 37. The method according to any one of Embodiments 31-36, after the second device displays the second interface according to the indication message, the method further includes:

[0557] In response to a trigger on the second edit box, the second device displays a virtual keyboard;

[0558] The second device displays the editing state in the second edit box according to the input operation received in the virtual keyboard and / or the second edit box.

[0559] Embodiment 38. The method according to any one of Embodiments 31-37, where the first device includes any one of the following: a television, a large screen, or a wearable device; the second device includes any one of the following: a mobile phone, a tablet, or a wearable device.

[0560] Example 39. In the method according to any one of Examples 31-38, the third interface further includes local candidate words associated by the second device based on the keyword, and the display modes of the candidate words and the local candidate words in the third interface include any of the following:

[0561] The candidate words and the local candidate words are displayed in columns in the third interface;

[0562] The candidate words are displayed in front of the local candidate words in the third interface;

[0563] The candidate words are displayed behind the local candidate words in the third interface;

[0564] The candidate words and the local candidate words are displayed in a mixed manner in the third interface;

[0565] The candidate words and the local candidate words are distinguished by different identifiers in the third interface.

[0566] Example 310. In the method according to any one of Examples 31-39, the sorting of the candidate words is related to the historical user behavior in the first device.

[0567] Example 311. The method according to any one of Examples 31-39 and 310 further includes:

[0568] In response to the user triggering any one of the candidate words, the second device displays the candidate word in the second edit box.

[0569] Example 312. A device communication method applied to a system including a first device and a second device, the method including:

[0570] The second device displays a fourth interface including an option of the first device;

[0571] In response to a selection operation on the option of the first device, the second device sends an indication message to the first device;

[0572] The first device displays a first interface including a first edit box;

[0573] The second device displays a second interface, and the second interface includes a second edit box;

[0574] When there is a keyword in the second edit box, the first device synchronizes the keyword to the first edit box;

[0575] The first device determines candidate words corresponding to the keyword;

[0576] The second device obtains the candidate words and displays a third interface, and the third interface includes the candidate words.

[0577] Embodiment 313. A device communication method, applied to a first device, the method comprising:

[0578] The first device displays a first interface including a first edit box;

[0579] The first device sends an indication message to the second device; the indication message is used to instruct the second device to display a second interface, and the second interface includes a second edit box;

[0580] When there is a keyword in the second edit box, the first device synchronizes the keyword to the first edit box;

[0581] The first device determines candidate words corresponding to the keyword;

[0582] The first device synchronizes the candidate words to the second device.

[0583] Embodiment 314. A device communication method, applied to a second device, the method comprising:

[0584] The second device receives an indication message from the first device; a first interface including a first edit box is displayed in the first device;

[0585] The second device displays a second interface according to the indication message, and the second interface includes a second edit box;

[0586] When there is a keyword in the second edit box, the second device synchronizes the keyword to the first edit box for the first device to determine candidate words corresponding to the keyword;

[0587] The second device obtains the candidate words and displays a third interface, and the third interface includes the candidate words.

[0588] Embodiment 315. A device communication method, applied to a second device, the method comprising:

[0589] The second device displays a fourth interface including options of the first device;

[0590] In response to a selection operation on the option of the first device, the second device sends an indication message to the first device; the indication message is used to instruct the first device to display a first interface including a first edit box;

[0591] The second device displays a second interface, and the third interface includes a second edit box;

[0592] When there is a keyword in the second editing box, the second device synchronizes the keyword to the first editing box for the first device to determine candidate words corresponding to the keyword.

[0593] The second device obtains the candidate words and displays a third interface, which includes the candidate words.

[0594] Embodiment 316. A device communication system includes a first device and a second device. The first device is configured to perform the steps of the first device as described in any one of Embodiments 31 - 39, 310 - 315, and the second device is configured to perform the steps of the second device as described in any one of Embodiments 31 - 39, 310 - 315.

[0595] Embodiment 317. A first device includes: at least one memory and at least one processor;

[0596] The memory is used to store program instructions;

[0597] The processor is configured to call the program instructions in the memory to cause the first device to perform the steps performed by the first device as described in any one of Embodiments 31 - 39, 310 - 315.

[0598] Embodiment 318. A second device includes: at least one memory and at least one processor;

[0599] The memory is used to store program instructions;

[0600] The processor is configured to call the program instructions in the memory to cause the second device to perform the steps performed by the second device as described in any one of Embodiments 31 - 39, 310 - 315.

[0601] Embodiment 319. A computer - readable storage medium stores a computer program, such that when the computer program is executed by a processor of the first device, it implements the steps performed by the first device as described in any one of Embodiments 31 - 39, 310 - 315; or when the computer program is executed by a processor of the second device, it implements the steps performed by the second device as described in any one of Embodiments 31 - 39, 310 - 315.

[0602] For the specific implementation of the above Embodiments 31 - Embodiment 39, Embodiments 310 - Embodiment 319, reference can be made to the description as Figure 38 - 53 follows.

[0603] During the process of using a mobile phone to assist in large-screen input, after entering keywords or key phrases in the mobile phone, the text content in the mobile phone's edit box can be synchronized to the large-screen side in real time to achieve fast input, thereby achieving the purpose of improving the user's input efficiency.

[0604] However, in the usual implementation, the text content in the mobile phone's edit box can be synchronized to the large screen, but the content on the large screen cannot be synchronized to the mobile phone. For example, when the user enters a keyword (such as part of a movie name, part of a music name, or part of a contact, etc.) in the edit box of the mobile phone, the keyword can be synchronized in the large-screen edit box, and the large screen can obtain the target entry (such as the complete movie name, the complete music name, or the complete contact, etc.) using the keyword. At this time, since the target entry on the large screen cannot be synchronized to the mobile phone, and the candidate word library of the mobile phone itself is usually not related to the program content on the large screen, when using the candidate word library of the mobile phone to associate with the keyword, it is often impossible to associate with content related to the large-screen program. Or, for the same keyword, the candidate words usually selected by the user on the mobile phone are different from the candidate words usually selected by the user on the large screen. For example, for the keyword "west", the candidate words usually selected on the large screen may be movie-related nouns related to the west, and the candidate words usually selected on the mobile phone may be general words such as "the West". Therefore, the user needs to enter the target entry completely on the mobile phone, or the user needs to manually select on the large screen using other hardware devices (such as a remote control, etc.) to search for the target entry, resulting in low input efficiency.

[0605] Exemplarily, Figure 38 shows a schematic diagram of the user interface for mobile phone-assisted large-screen input. As Figure 38 shown in the left diagram of the mobile phone interface, when the user wants to search for the TV drama "I Love This Land" on the large screen, the user enters the keyword "I Love" in the edit box of the mobile phone. As Figure 38 shown in the right diagram of the large-screen edit box, the keyword "I Love" in the mobile phone's edit box can be synchronously displayed. The large screen associates the candidate word "I Love This Land" based on the keyword "I Love", but the mobile phone cannot synchronize this candidate word "I Love This Land". The user still needs to enter the complete text "I Love This Land" on the mobile phone and click to complete, or the user uses the remote control to select the candidate word "I Love This Land" on the large screen to search for "I Love This Land", resulting in low input efficiency.

[0606] Therefore, during the process of mobile phone-assisted large-screen input, enabling the mobile phone to synchronize the matching candidate words to the large screen is a feasible way to improve the user's input efficiency.

[0607] Based on this, the embodiments of the present application provide a device communication method. When a user uses a mobile phone to assist in large screen input, when the user inputs text in an input and editable box of the mobile phone (such as a search edit box, a drop-down box, or a combo box, etc.), the large screen can synchronize the text, and associate candidate words corresponding to the text based on the user habits statistically analyzed by the large screen, the candidate word library or dictionary of the large screen, etc. according to the specific input scenario, and synchronize the candidate words associated by the large screen based on the text to the mobile phone, so that the user can select the candidate words associated by the large screen on the mobile phone to achieve convenient input.

[0608] Exemplarily, Figure 39 FIG. shows a schematic diagram of the specific system architecture of a device communication method provided by the embodiments of the present application.

[0609] As Figure 39 shown, the embodiments of the present application take a distributed network including a large screen (or referred to as a large screen device) and a mobile phone (or referred to as an auxiliary device) as an example to illustrate the process of mobile phone assisting large screen input. The large screen can have a local or cloud word library, a set edit box, and an input method framework. The auxiliary device (mobile phone) can be provided with an auxiliary AA, a notification manager, a window manager, and an input method framework.

[0610] Among them, the edit box in the large screen can be used to trigger auxiliary input, receive remote control text input, or receive mobile phone auxiliary input, etc. The local or cloud word library in the large screen can store candidate words, and the candidate words can include, for example, program names and / or application names in the large screen, etc. The input method framework in the large screen, the auxiliary AA in the mobile phone, the notifications in the mobile phone, the windows in the mobile phone, and the input method framework in the mobile phone can refer to the above records and will not be elaborated here.

[0611] As Figure 39 shown, after the large screen and the mobile phone are connected to the same distributed network, the user can use a device such as a remote control to select the edit box of the large screen. The large screen can request the input method framework to connect to the auxiliary AA in the mobile phone. The auxiliary AA in the mobile phone can instruct the notification manager to pop up a notification. When the mobile phone receives the user's click on the notification to confirm auxiliary input, an edit box can be further popped up in the window of the mobile phone, and the input method framework of the mobile phone can be pulled up. The user can input data in the edit box provided by the input method framework of the mobile phone. For example, the user can input the word "I love" in the mobile phone, and the word "I love" can be synchronized to the input method framework of the large screen and displayed synchronously in the edit box of the large screen.

[0612] When the large screen monitors the text change in the large-screen editing box, it can obtain the word "I love" in the editing box, match relevant entries in the large-screen word library according to "I love", and fill the relevant entries into the candidate word list of the search box. For example, the relevant entries may include "I love this land". Among them, the matching rule can be determined according to the actual application scenario. For example, the matching rule includes but is not limited to string regular matching, synonym matching, synonym matching, exact matching or fuzzy matching, etc.

[0613] Furthermore, the large screen can synchronize the content in the candidate word list of the large screen to the input method framework of the mobile phone. The input method framework of the mobile phone can display the content in the candidate word list of the large screen on the mobile phone interface. For example, the mobile phone can display "I love this land" as a candidate word on the mobile phone interface. The user can click on the candidate word "I love this land" on the mobile phone interface to fill "I love this land" into the editing box of the mobile phone, and this "I love this land" can be synchronized to the editing box of the large screen, thus realizing convenient and efficient input.

[0614] To illustrate the above steps more clearly, Figure 40 The flowchart showing the interaction and synchronous matching of candidate words between the large screen and the mobile phone is shown.

[0615] As Figure 40 shown, the user can enter keywords or key phrases in the editing box for assisting large-screen input on the auxiliary device (such as a mobile phone), and the keywords or key phrases can be synchronized to the large-screen device. The large-screen device obtains candidate words matching the keywords or key phrases according to the keywords or key phrases, and synchronizes the candidate words to the mobile phone.

[0616] In a possible implementation, among the candidate words synchronized from the large screen to the mobile phone, there are target entries that the user wants to select. The user can select the target entry by clicking or the like, and the mobile phone synchronizes the target entry to the large screen to complete the auxiliary input.

[0617] In a possible implementation, among the candidate words synchronized from the large screen to the mobile phone, there is no target entry that the user wants to select. The user can continue to enter keywords or key phrases in the mobile phone and repeat the above steps until there is a target entry that the user wants to select among the candidate words synchronized from the large screen. The user can select the target entry by clicking or the like, and the mobile phone synchronizes the target entry to the large screen to complete the auxiliary input.

[0618] It should be noted that Figure 39 or Figure 40 is a possible implementation manner of the embodiments of the present application. In other possible implementation manners, it may be that the user triggers the subsequent process of assisting large-screen input by selecting the virtual keyboard under the editing box provided by a certain application on the large screen through the remote control, or it may be that the user triggers the process of assisting large-screen input in the mobile phone. The embodiments of the present application do not make specific limitations on this.

[0619] Combined with the above description, the user interface for the interaction between the large screen and the mobile phone will be exemplarily described below.

[0620] Exemplarily, Figure 41 - 42 It shows a schematic diagram of the user interface where the user triggers auxiliary input.

[0621] Figure 41 It shows a user interface diagram of the large screen. As Figure 41 shown, the user can use the remote control 4101 to select the edit box 4102 on the large screen, and then trigger the subsequent process of mobile phone-assisted large screen input in the embodiments of the present application. Or, the user can use the remote control 4101 to select any content 4102 in the virtual keyboard on the large screen, and then trigger the subsequent process of mobile phone-assisted large screen input in the embodiments of the present application. The specific method of mobile phone-assisted large screen input will be described in the subsequent embodiments and will not be elaborated here.

[0622] It should be noted that Figure 41 It shows a schematic diagram of setting an edit box in the user interface diagram of the large screen. In possible implementation manners, the user interface of the large screen may include multiple edit boxes, and triggering any one of the edit boxes by the user can trigger the subsequent process of mobile phone-assisted large screen input in the embodiments of the present application. The embodiments of the present application do not make specific limitations on this.

[0623] Figure 42 It shows a user interface diagram of the mobile phone. For example, the user can display the user interface as shown in Figure 42 Figure a by pulling down the main screen of the mobile phone, etc. In the user interface as shown in Figure 42 Figure a, it may include one or more of the following functions of the mobile phone: WLAN, Bluetooth, flashlight, mute, flight mode, mobile data, wireless screen mirroring, screenshot, or auxiliary input 4201. Among them, the auxiliary input 4201 can be the function of mobile phone-assisted large screen input in the embodiments of the present application.

[0624] In possible implementation manners, after the user clicks the auxiliary input 4201, the mobile phone can search for devices such as the large screen in the same distributed network, obtain the search box on the large screen, establish a communication connection with the large screen, and further display the user interface as shown in Figure 42 Figure c in the mobile phone. In the user interface as shown in Figure 42 Figure c, an edit box for assisting large screen input can be displayed, and the user can assist the large screen in input based on this edit box.

[0625] In possible implementation manners, if the number of devices such as the large screen found by the mobile phone in the same distributed network is multiple, the mobile phone can also display the user interface as shown in Figure 42 Figure b, in the user interface as shown inFigure 42 The user interface shown in Figure b can display the identifiers of multiple large screens. The identifier of a large screen can be the device number, username, nickname, etc. of the large screen. The user can select the large screen for which they hope to assist in input in the user interface shown in Figure b (for example, click on Large Screen A or Large Screen B) and enter the user interface shown in Figure c, which is not specifically limited in the embodiments of the present application. After the user triggers large screen input in any of the above ways, exemplarily, the large screen can search for auxiliary devices (such as mobile phones) with the ability to assist in input in the distributed network and automatically determine the mobile phone for assisting in input, or send a notification to all the mobile phones found in the distributed network. Figure 42 The user interface shown in Figure b can display the identifiers of multiple large screens. The identifier of a large screen can be the device number, username, nickname, etc. of the large screen. The user can select the large screen for which they hope to assist in input in the user interface shown in Figure b (for example, click on Large Screen A or Large Screen B) and enter the user interface shown in Figure c, which is not specifically limited in the embodiments of the present application. After the user triggers large screen input in any of the above ways, exemplarily, the large screen can search for auxiliary devices (such as mobile phones) with the ability to assist in input in the distributed network and automatically determine the mobile phone for assisting in input, or send a notification to all the mobile phones found in the distributed network. Figure 42 The user interface shown in Figure b can display the identifiers of multiple large screens. The identifier of a large screen can be the device number, username, nickname, etc. of the large screen. The user can select the large screen for which they hope to assist in input in the user interface shown in Figure b (for example, click on Large Screen A or Large Screen B) and enter the user interface shown in Figure c, which is not specifically limited in the embodiments of the present application. After the user triggers large screen input in any of the above ways, exemplarily, the large screen can search for auxiliary devices (such as mobile phones) with the ability to assist in input in the distributed network and automatically determine the mobile phone for assisting in input, or send a notification to all the mobile phones found in the distributed network.

[0626] For example, if the large screen finds that there is one mobile phone in the distributed network, the large screen can automatically select the mobile phone as the auxiliary input device.

[0627] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among these multiple mobile phones, there is a mobile phone set as the default auxiliary input by the user, the large screen can automatically select this default auxiliary input mobile phone as the auxiliary input device.

[0628] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among these multiple mobile phones, there is a mobile phone that the user selected as the auxiliary input device during the last auxiliary input, the large screen can automatically select the mobile phone that the user selected as the auxiliary input device during the last auxiliary input as the auxiliary input device.

[0629] For example, if the large screen finds that there are multiple mobile phones in the distributed network, the large screen obtains the mobile phone among these multiple mobile phones that has been selected as the auxiliary input by the user with the highest frequency, and the large screen can automatically select the mobile phone that has been selected as the auxiliary input by the user with the highest frequency as the auxiliary input device.

[0630] For example, if the large screen finds that there are multiple mobile phones in the distributed network, but among these multiple mobile phones, there is a mobile phone with the same user account as the user logged in to the large screen, the large screen can automatically select the mobile phone with the same user account as the user logged in to the large screen as the auxiliary input device.

[0631] Exemplarily, taking the large screen sending a notification to the mobile phones in the distributed network as an example, Figure 43 - 49 It shows the process of the mobile phone using the candidate words synchronized from the large screen to assist the large screen in input.

[0632] Exemplarily, Figure 43 It shows a schematic diagram of the user interface for the mobile phone to determine to assist the large screen in input. As Figure 43As shown in the leftmost figure of the user interface, when the mobile phone receives a notification from the large-screen device, a notification can pop up on the mobile phone, prompting the large screen to request auxiliary input. The user can trigger the notification on the mobile phone to confirm the auxiliary large-screen input. Further, as Figure 43 shown in the middle figure of the user interface, an edit box for auxiliary large-screen input can pop up on the mobile phone. Further, the user can trigger, such as by clicking, as Figure 43 the edit box shown in the middle figure, and the mobile phone can display as Figure 43 the user interface shown in the rightmost figure. The virtual keyboard (or soft keyboard) of the mobile phone can be displayed in this user interface, and the user can subsequently use the virtual keyboard of the mobile phone to assist in large-screen input.

[0633] For example, if the user wants to change the settings of the auxiliary application on the large screen, but it is difficult to find due to the large number of application options in the settings page of the large screen, the user can input the keyword "auxiliary" in the edit box of the mobile phone as shown in Figure 43 the rightmost figure.

[0634] As Figure 44 shown in the large-screen user interface, the keyword "auxiliary" in the edit box of the mobile phone can be synchronized to the edit box on the large-screen side. The large screen searches the local or cloud dictionary of the large screen for candidate words that match "auxiliary" and displays them in the candidate word list. For example, the candidate word list on the large screen can include content related to "auxiliary" in multiple categories. For example, in the application category, it can include "auxiliary application and voice input, and auxiliary application", etc., and in the auxiliary function category, it can include "auxiliary function and accessibility", etc.

[0635] It should be noted that when the large screen matches candidate words for the keyword in the large-screen edit box, it can be related to the function (or the scenario) that the large screen is to achieve. Or it can be understood that although the keywords input by the user in the edit box are the same, because the interfaces where each edit box is located are different and the functions implemented are different, the candidate words associated by the large screen based on the keywords in each edit box can be the same or different.

[0636] For example, if the large screen is currently using the mobile phone to assist in searching for movies, the large screen can match relevant movie names for the keyword in combination with the movie library.

[0637] For example, if the large screen is currently using the mobile phone to assist in searching for TV dramas, the large screen can match relevant TV drama names for the keyword in combination with the TV drama library.

[0638] For example, if the large screen is currently using the mobile phone to assist in searching for music, the large screen can match relevant music names for the keyword in combination with the music library.

[0639] For example, if the large screen is currently using the mobile phone to assist in searching for functions on the large screen, the large screen can match relevant function names for the keyword in combination with the function library.

[0640] In a possible implementation, the sorting of candidate words displayed on the large screen is related to the user's historical behavior. Or it can be understood that although the keywords entered by the user in the edit box are the same, the user's previous selections of candidate words corresponding to the keywords are different, and the sorting of candidate words for the keyword on the large screen can change.

[0641] For example, for a certain keyword, if the candidate word selected by the user using this keyword on the large screen last time is candidate word A, then candidate word A can be displayed in a position with a higher ranking on the large screen.

[0642] For example, for a certain keyword, if the candidate word with the highest or relatively high frequency of being selected by the user using this keyword on the large screen is candidate word B, then candidate word B can be displayed in a position with a higher ranking on the large screen. The candidate words in the candidate word list on the large screen can be further synchronized to the input interface of the mobile phone, and the display method of the candidate words in the candidate word list on the large screen on the mobile phone can be set according to the actual application scenario. For example, the sorting of the candidate words on the large screen can also be synchronized to the display interface of the mobile phone to recommend candidate words that conform to the user's habits on the large screen to the user on the mobile phone. The embodiments of the present application do not make specific limitations on this.

[0643] It should be noted that the candidate words on the mobile phone based on keyword association by the local input method of the mobile phone can be the same as or different from the candidate words on the large screen based on keyword association. In a possible implementation, the candidate words on the mobile phone based on keyword association by the local input method of the mobile phone are the same as the candidate words on the large screen based on keyword association, but the sorting of the candidate words on the mobile phone based on keyword association by the local input method of the mobile phone can be the same as the sorting of the candidate words on the large screen based on keyword association.

[0644] Exemplarily, Figure 45 - 48 Schematic diagrams of the interfaces of the mobile phone when synchronizing the candidate words in the candidate word list on the large screen to the mobile phone are shown.

[0645] As Figure 45 shown in the mobile phone display interface, when the user enters "assistant" in the edit box of the mobile phone, the candidate words obtained by the mobile phone from the large screen synchronization can be displayed similar to the candidate words of the local input method of the mobile phone. For example, the candidate words obtained by the mobile phone from the large screen synchronization can be displayed in the form of a list in the input interface of the mobile phone. In a possible understanding, as Figure 45 shown in the mobile phone display interface, the user may not perceive whether the candidate words provided by the mobile phone are specifically local to the mobile phone or synchronized from the large screen. However, since the candidate words obtained by the mobile phone from the large screen synchronization are provided among the candidate words provided by the mobile phone in the embodiments of the present application, the candidate words provided to the user on the mobile phone are closer to the content on the large screen, which is more conducive to assisting the user to achieve fast input.

[0646] As Figure 46In the mobile phone user interface shown in FIG. 1 , the candidate words in the candidate word list on the large screen can be displayed in separate columns from the candidate words in the local input method of the mobile phone. Figure 46 As shown, when the user enters "辅" in the edit box of the mobile phone, in the user interface of the mobile phone, the candidate words matching "辅" synchronized from the large screen can be displayed in a column (such as the large screen candidate search term column), and the candidate words obtained by the mobile phone's local input method using "辅" can be displayed in a column (such as the mobile phone candidate term column).

[0647] Possible implementations include Figure 47 As shown, the candidate words in the candidate word list of the large screen and the candidate words of the local input method of the mobile phone are displayed in separate columns. Although the candidate words in the candidate word list of the large screen are the same as the candidate words of the local input method of the mobile phone, the order of the candidate words in the candidate word list of the large screen and the candidate words of the local input method of the mobile phone may be different.

[0648] like Figure 48 In the mobile phone user interface shown, the candidate words in the candidate word list of the large screen can be arranged in front of the candidate words of the mobile phone local input method, and a horizontal line or other mark is used to separate the candidate words in the candidate word list of the large screen from the candidate words of the mobile phone local input method. Alternatively, the candidate words in the candidate word list of the large screen can be arranged after the candidate words of the mobile phone local input method, and a horizontal line or other mark is used to separate the candidate words in the candidate word list of the large screen from the candidate words of the mobile phone local input method ( Figure 48 not shown).

[0649] like Figure 49 In the mobile phone user interface shown, the candidate words in the candidate word list of the large screen can be distinguished from the candidate words of the local input method of the mobile phone by using an identifier. Among them, the identifier of the candidate words in the candidate word list of the large screen is different from the candidate words of the local input method of the mobile phone. The specific form of the identifier can include: color, text and / or image, etc., which is not limited in the embodiment of the present application.

[0650] For example, Figure 49 As shown, when the user enters "辅" in the edit box of the mobile phone, in the user interface of the mobile phone, the candidate words matching "辅" obtained by synchronization from the large screen can be added with an arrow pointing to the lower right as a mark, and the candidate words obtained by the mobile phone's local input method using "辅" to associate can be added with an arrow pointing to the upper left as a mark, so that the user can know the source of the candidate words based on the marks of each candidate word.

[0651] The embodiments of the present application do not limit the specific display order of the candidate words in the candidate word list of the large screen and the candidate words of the mobile phone local input method. In possible implementation manners, the candidate words in the candidate word list of the large screen and the candidate words of the mobile phone local input method may be sorted in descending order of historical usage times in combination with the user's historical search situation. In possible implementation manners, the candidate words in the candidate word list of the large screen and the candidate words of the mobile phone local input method may be sorted in descending order of popularity in combination with the popularity of the candidate words. In possible implementation manners, the candidate words in the candidate word list of the large screen may be arranged in front of the candidate words of the mobile phone local input method. In possible implementation manners, the candidate words in the candidate word list of the large screen and the candidate words of the mobile phone local input method may be cross-sorted. In possible implementation manners, the candidate words in the candidate word list of the large screen and the candidate words of the mobile phone local input method may be randomly sorted.

[0652] In this way, in Figure 45 - 49 any of the shown mobile phone user interfaces, the user can click on the target candidate word needed, fill the target candidate word in the edit box of the mobile phone, and then perform a search on the large screen based on the target candidate word.

[0653] In possible implementation manners, the above-mentioned technology implementation of synchronizing the candidate words in the candidate word list of the large screen to the mobile phone may include: reading the candidate words in the candidate word list of the large screen based on the input method framework of the large screen, and sending the candidate words in the candidate word list of the large screen to the input method framework of the mobile phone through distributed networking. The embodiments of the present application do not limit the technology implementation of synchronizing the candidate words in the candidate word list of the large screen to the mobile phone.

[0654] It should be noted that the above user interface diagrams during mobile phone-assisted large screen input are all exemplary illustrations. In possible implementation manners, in the interface during mobile phone-assisted large screen input, some or all of the content on the large screen may also be synchronized, so that the mobile phone user can understand the status of the large screen based on the mobile phone interface.

[0655] Exemplarily, Figure 50 a user interface of a mobile phone is shown. As Figure 50 shown, when the user uses the mobile phone to assist in large screen input, all or part of the content of the large screen can be projected onto the mobile phone. For example, the content related to the edit box of the large screen is displayed on the mobile phone, and the edit box of the mobile phone is displayed on the upper layer of the large screen content. In this way, when the user inputs in the edit box of the mobile phone, the status in the edit box of the large screen can be synchronously seen in the user interface of the mobile phone, and when the user is assisting in input, there is no need to look up at the input status on the large screen.

[0656] It should be noted that in the above embodiments, taking the example of a user assisting the large screen to input Chinese characters, in possible implementation manners, the user can assist the large screen to input English phrases or other forms of text input. The embodiments of the present application do not limit the specific content of the assisted input.

[0657] Exemplarily, Figure 51 shows a schematic flowchart of a specific process of a mobile phone assisting a large screen in input.

[0658] As Figure 51 shown, the mobile phone assisting the large screen in input may include: near-field device discovery, identity authentication and remote data channel establishment, and synchronization of large-screen candidate entries to the mobile phone.

[0659] Exemplarily, during the process of near-field device discovery, the large-screen remote input service starts up. The large screen can enable the function of near-field auxiliary device discovery. When the search box on the large screen obtains the focus (for example, the search box selected by the user with the remote control), the large screen can send a broadcast to query for distributed auxiliary input devices with auxiliary input capabilities (such as mobile phones). After the distributed auxiliary input device receives the broadcast from the large screen, a notification can pop up on the distributed auxiliary input device, and this notification is used to prompt that the large screen needs auxiliary input.

[0660] In possible implementation manners, during the process of near-field device discovery, the large screen can use Bluetooth or local area network broadcast, etc. to query for near-field devices, and all distributed auxiliary input devices with auxiliary input capabilities will receive the notification.

[0661] During the process of identity authentication and remote data channel establishment, after the distributed auxiliary input device receives the notification, the user can click on the notification message in the distributed auxiliary input device to trigger both the large screen and the distributed auxiliary input device (subsequently taking the distributed auxiliary input device as a mobile phone for example for illustration) to perform identity authentication, such as verifying the legality of both parties' identities, etc. After the authentication is completed, a remote data channel can be established between the large screen side and the mobile phone side. Subsequently, data transmission between the large screen and the mobile phone can be realized according to the remote data channel. For example, after the mobile phone side receives the remote data channel, it can load and display an auxiliary input markup box (or called an edit box), and the user can enter keywords in the input markup box.

[0662] It can be understood that the steps of identity authentication can be adaptively selected according to the actual application scenario. For example, in some scenarios (such as scenarios with low security requirements, etc.), identity authentication may not be performed between the large screen and the mobile phone. After the user on the mobile phone side triggers the notification, a remote data channel can be established between the large screen side and the mobile phone side.

[0663] In the process of synchronizing the candidate word list on the large screen side to the mobile phone, the mobile phone can synchronize the input keyword or keywords to the large screen side through the remote data channel. The large screen side submits the keyword or keywords to the edit box through the local data channel. The large screen side can display the keyword or keywords input on the mobile phone side. The search box on the large screen side finds the matching candidate words according to the keyword or keywords, and the matching candidate words are filled into the candidate word list of the large screen search box. The large screen synchronizes the candidate word list to the mobile phone side through the remote data channel. After receiving the candidate word list, the mobile phone displays the candidate word list on the candidate word list interface of the mobile phone through the local data channel. If the target word desired by the user does not exist in the candidate word list, the user can continue to input the keyword or keywords on the mobile phone; if the target word desired by the user exists in the candidate word list, the user clicks on the target word, and the mobile phone synchronizes the target word to the input box on the large screen side through the remote data channel to achieve assisted input.

[0664] It should be noted that the user interface diagrams during the above mobile phone assisted large screen input are all exemplary illustrations. In possible implementation manners, in the interface during mobile phone assisted large screen input, some or all of the content on the large screen can also be synchronized, so that mobile phone users can understand the status of the large screen based on the mobile phone interface.

[0665] In the case of dividing each functional module according to the corresponding functions, as Figure 52 shown, a possible structural schematic diagram of a first device or a second device provided by an embodiment of the present application is shown. The first device or the second device includes: a display screen 5201 and a processing unit 5202.

[0666] Among them, the display screen 5201 is used to support the first device or the second device to execute the display steps in the above embodiments, or other processes of the technologies described in the embodiments of the present application. The display screen 5201 can be a touch screen or other hardware or a combination of hardware and software.

[0667] The processing unit 5202 is used to support the first device or the second device to execute the processing steps in the above method embodiments, or other processes of the technologies described in the embodiments of the present application.

[0668] Among them, all relevant contents of each step involved in the above method embodiments can be cited in the function descriptions of the corresponding functional modules, and will not be elaborated here.

[0669] Of course, the electronic device includes but is not limited to the unit modules listed above. And the specific functions that the above functional units can achieve also include but are not limited to the functions corresponding to the method steps described in the above examples. The detailed descriptions of other units of the electronic device can refer to the detailed descriptions of the corresponding method steps, and will not be elaborated here in the embodiments of the present application.

[0670] In the case of adopting integrated units, the first device or the second device involved in the above embodiments may include: a processing module, a storage module, and a display screen. The processing module is used to control and manage the operations of the first device or the second device. The display screen is used to display content according to the instructions of the processing module. The storage module is used to store the program codes and data of the first device or the second device. Further, the first device or the second device may further include an input module and a communication module. The communication module is used to support the communication between the first device or the second device and other network entities, so as to implement functions such as calls, data interaction, and Internet access of the first device or the second device.

[0671] Among them, the processing module may be a processor or a controller. The communication module may be a transceiver, an RF circuit, or a communication interface, etc. The storage module may be a memory. The display module may be a screen or a display. The input module may be a touch screen, a voice input device, or a fingerprint sensor, etc.

[0672] Among them, the above communication module may include an RF circuit, and may further include a wireless fidelity (Wi-Fi) module, a near field communication (NFC) module, and a Bluetooth module. Communication modules such as the RF circuit, the NFC module, the Wi-Fi module, and the Bluetooth module may be collectively referred to as a communication interface. Among them, the above processor, RF circuit, display screen, and memory may be coupled together through a bus.

[0673] As Figure 53 shown, there is shown another possible structural schematic diagram of the first device or the second device provided by the embodiments of the present application, including: one or more processors 5301, a memory 5302, a camera 5304, and a display screen 5303; the above-mentioned devices may communicate through one or more communication buses 5306.

[0674] Among them, one or more computer programs are stored in the memory 5302 and are configured to be executed by one or more processors 5301; one or more computer programs 5305 include instructions for performing the display method of any of the above steps. Of course, the electronic device includes but is not limited to the above-listed devices. For example, the above electronic device may further include an RF circuit, a positioning device, a sensor, and so on.

[0675] The present application also provides the following embodiments. It should be noted that the numbers of the following embodiments do not necessarily need to follow the numbering order of the previous embodiments.

[0676] Embodiment 41. A device communication method is applied to a system including a first device, a second device, and a third device. The method includes:

[0677] The first device, the second device, and the third device access a distributed network;

[0678] The second device obtains a target candidate word, where the target candidate word does not belong to the candidate word library of the first device and does not belong to the candidate word library of the third device;

[0679] The first device receives a keyword related to the target candidate word input by a user, and the first device displays the target candidate word;

[0680] And / or, the third device receives a keyword related to the target candidate word input by a user, and the third device displays the target candidate word.

[0681] Embodiment 42. The method according to Embodiment 41 further includes:

[0682] The first device, the second device, and the third device synchronize their respective candidate word libraries with each other.

[0683] Embodiment 43. The method according to Embodiment 41 or 42 further includes:

[0684] When the first device, the second device, or the third device exits the distributed network, a prompt interface for indicating whether to delete the synchronized candidate word library is displayed on the first device, the second device, or the third device; the prompt interface includes an option for indicating deletion and an option for indicating non - deletion;

[0685] In response to a trigger operation on the option for indicating deletion, the first device, the second device, or the third device deletes the candidate word library synchronized from other devices;

[0686] Or, in response to a trigger operation on the option for indicating non - deletion, the first device, the second device, or the third device retains the candidate word library synchronized from the distributed network.

[0687] Embodiment 44. The method according to Embodiment 41 or 42 further includes:

[0688] The first device, the second device, or the third device respectively determines its own access type;

[0689] When the first device, the second device, or the third device exits the distributed network, the first device, the second device, or the third device determines whether to delete the candidate word library synchronized from the distributed network according to their respective access types.

[0690] Embodiment 45. The method according to any one of Embodiments 41-44 further includes:

[0691] The first device displays a first interface including a first edit box;

[0692] The first device sends an indication message to the second device;

[0693] The second device displays a second interface according to the indication message, and the second interface includes a second edit box;

[0694] When there is an editing state in the second edit box, synchronize the editing state to the first edit box.

[0695] Embodiment 46. In the method according to Embodiment 45, the second device includes an interface service for synchronizing the editing state between the first device and the second device.

[0696] Embodiment 47. In the method according to Embodiment 45 or 46, the editing state includes one or more of the following: text content, cursor, or highlighted mark of text content.

[0697] Embodiment 48. In the method according to any one of Embodiments 45-47, the second device displays the second interface according to the indication message, including:

[0698] The second device displays a notification interface in response to the indication message; the notification interface includes a third option for confirming auxiliary input;

[0699] In response to a trigger operation on the third option, the second device displays the second interface.

[0700] Embodiment 49. In the method according to any one of Embodiments 45-48, the second interface further includes: all or part of the content of the first interface.

[0701] Embodiment 410. In the method according to Embodiment 49, the second edit box and all or part of the content of the first interface are displayed in layers, and the second edit box is displayed on top of all or part of the content of the first interface.

[0702] Embodiment 411. After the second device displays the second interface according to the indication message in the method according to any one of Embodiments 45-49, 410, the method further includes:

[0703] In response to the triggering of the second edit box, the second device displays a virtual keyboard;

[0704] The second device displays the editing state in the second edit box according to the input operations received in the virtual keyboard and / or the second edit box.

[0705] Example 412. According to the method described in any one of Examples 41-49, 410-411, the first device includes any one of the following: a television, a large screen, or a wearable device; the second device or the third device includes any one of the following: a mobile phone, a tablet, or a wearable device.

[0706] Example 413. According to the method described in any one of Examples 41-49, 410-412, the method further includes:

[0707] The second device displays a fourth interface including an option of the first device;

[0708] In response to a selection operation on the option of the first device, the second device sends an indication message to the first device;

[0709] The first device displays a first interface including a first edit box;

[0710] The second device displays a second interface, and the second interface includes a second edit box;

[0711] When there is an editing state in the second edit box, synchronize the editing state to the first edit box.

[0712] Example 414. A device communication method applied to a system including a first device, a second device, and a third device, the method includes:

[0713] The first device, the second device, and the third device access a distributed network;

[0714] The first device, the second device, and the third device mutually synchronize their respective candidate word libraries to obtain a candidate word library set;

[0715] When text editing is performed on the first device, the second device, or the third device, the first device, the second device, or the third device displays candidate words according to the candidate word library set.

[0716] Example 415. A device communication method applied to a first device, including:

[0717] The first device accesses a distributed network; other devices are also connected to the distributed network;

[0718] The first device synchronizes the candidate word libraries of the other devices based on the distributed network to obtain a set of candidate word libraries.

[0719] When the first device performs text editing, the first device displays candidate words according to the set of candidate word libraries.

[0720] Embodiment 416. A device communication system includes a first device, a second device, and a third device. The first device is configured to perform the steps of the first device as described in any one of Embodiments 41-415. The second device is configured to perform the steps of the second device as described in any one of Embodiments 41-49, 410-415. The third device is configured to perform the steps of the third device as described in any one of Embodiments 41-49, 410-415.

[0721] Embodiment 417. A first device includes: at least one memory and at least one processor;

[0722] The memory is used to store program instructions;

[0723] The processor is configured to call the program instructions in the memory to cause the first device to perform the steps performed by the first device as described in any one of Embodiments 41-49, 410-415.

[0724] Embodiment 418. A second device includes: at least one memory and at least one processor;

[0725] The memory is used to store program instructions;

[0726] The processor is configured to call the program instructions in the memory to cause the second device to perform the steps performed by the second device as described in any one of Embodiments 41-49, 410-415.

[0727] Embodiment 419. A computer-readable storage medium stores a computer program, such that when the computer program is executed by a processor of a first device, it implements the steps performed by the first device as described in any one of Embodiments 41-49, 410-415; or when the computer program is executed by a processor of a second device, it implements the steps performed by the second device as described in any one of Embodiments 41-49, 410-415; or when the computer program is executed by a processor of a third device, it implements the steps performed by the third device as described in any one of Embodiments 41-49, 410-415.

[0728] The specific implementation of the above Embodiments 41-Embodiment 49, Embodiments 410-Embodiment 419 can be referred to as Figure 54 - 67 described.

[0729] In a possible implementation of using a mobile phone to assist in large-screen input, after entering a keyword in the mobile phone, the keyword can be associated based on the content of the candidate word library of the mobile phone itself (or it can be understood as the candidate word library corresponding to the input method used by the user), and the recommended candidate words are displayed. The user can achieve fast input by clicking on the candidate words, thereby achieving the purpose of improving the user's input efficiency.

[0730] However, the candidate word library of the mobile phone itself is usually not relevant to the program content on the large screen. When associating keywords using the candidate word library of the mobile phone, it is often impossible to associate content related to the large-screen program, resulting in the user still needing to select word by word, and the input efficiency is low.

[0731] Therefore, enabling the mobile phone to obtain a candidate word library with rich content is a feasible way to improve the user's input efficiency.

[0732] In a possible implementation method, some products may use the user account method to achieve the synchronization of the candidate word library between multiple devices of the user (such as a mobile phone and a large screen). For example, after the user registers the user account of the input method, no matter which device the user logs in the user account on, during the input process using the input method, specific candidate words generated (such as words selected by the user word by word) can be saved to the candidate word library corresponding to the user account. Subsequently, if the user logs in the user account on the large screen, the candidate word library on the large screen can also include the candidate word library of the mobile phone. If the user logs in the user account on the mobile phone, the candidate word library on the mobile phone can also include the candidate word library of the large screen.

[0733] However, in this implementation method, the synchronization of the candidate word library completely depends on the user account of the input method. If the user does not log in the user account on a certain device, the synchronization of the candidate word library cannot be achieved. Or, because the user account is usually for the input method of a certain company, if a certain device does not support the input method of this company, or the user changes the type of the input method, the synchronization of the candidate word library cannot be achieved. Moreover, if the user changes devices, etc., the user needs to switch or log in the user account, and the operation is relatively cumbersome. Also, in actual use, there are not many users who register the input method account, and the situation of logging in the user account during input using the input method is even rarer, resulting in this implementation method not being able to fully play its role.

[0734] Based on this, the embodiment of the present application provides a device communication method, which can synchronize the candidate word library in the distributed network to the device after the device joins the distributed network, so that it is possible to conveniently share the candidate word library between multiple devices without relying on the user account of the input method, and can better provide input services for users.

[0735] Exemplarily, Figure 54 Fig. shows a schematic diagram of a specific application scenario of the embodiment of the present application.

[0736] As shown Figure 54 in the figure, a large screen, a tablet, mobile phone A, and mobile phone B are connected in a distributed network. The large screen, the tablet, mobile phone A, and mobile phone B can respectively synchronize the candidate word libraries of other devices based on the distributed network, so that the large screen, the tablet, mobile phone A, and mobile phone B can all obtain a candidate word library set, which can be understood as the union of the candidate word library of the large screen, the candidate word library of the tablet, the candidate word library of mobile phone A, and the candidate word library of mobile phone B. Then, subsequently, the large screen, the tablet, mobile phone A, and mobile phone B can all utilize this candidate word library set to achieve convenient candidate word recommendation and improve user input efficiency.

[0737] Exemplarily, the large screen, the tablet, mobile phone A, and mobile phone B can be connected to the same WIFI to form a distributed network. Among them, the large screen, the tablet, mobile phone A, and mobile phone B can join the distributed network in any possible form, and the embodiments of the present application do not make specific limitations on this.

[0738] It can be understood that the specific types and quantities of devices connected in the distributed network can be determined according to the actual application scenario, and the embodiments of the present application do not make specific limitations on the devices connected in the distributed network.

[0739] When each device joins the distributed network, each device can, based on the distributed database synchronization ability provided by the FWK layer of each device, push the content in its own candidate word library to the candidate word library path of other devices in the distributed network to achieve synchronization of the candidate word libraries of each device. It can be understood that if each device in the distributed network performs an input step and generates new candidate words after joining the distributed network, it can also adapt to synchronize the new candidate words to the candidate word libraries of each device.

[0740] In a possible implementation manner, the candidate word library paths of each device in the distributed network can be the same. For example, the candidate word library paths of each device can all be set to the distributed candidate word library system path "data / inputmethod / candicateWords", so that each device in the distributed network can conveniently push its own candidate word library based on this same path.

[0741] In a possible implementation manner, when each device in the distributed network synchronizes its own candidate word library to other devices, it can attach its own device information to the candidate words in its own candidate word library, so that subsequent flexible management of the candidate words can be achieved based on the device information attached to the candidate words. For example, when a certain device exits the distributed network, the candidate words with the device information of the certain device can be deleted from the candidate word libraries of other devices in the distributed network, etc.

[0742] In a possible implementation, when a device initially joins the distributed network, the user can set the access type of the device (or it can be understood as the permission), or each device can automatically determine the access type of the device, and then execute corresponding steps according to the access type of the device. When the device joins the distributed network again (or it can be understood that the device is not joining the distributed network for the first time), it can automatically identify the access type set by the device before, and then execute corresponding steps according to the access type of the device. Exemplarily, the access type of the device can include common devices, temporary visitors, blacklist devices, etc.

[0743] For example, a common device can indicate that the security level of the device is relatively high. When a common device joins the distributed network, the common device can be allowed to synchronize the candidate word libraries of other devices in the distributed network, and synchronize its own candidate word library to other devices in the distributed network. When a common device exits the distributed network, the candidate word library synchronized by the common device from the distributed network can be retained, so that the common device can continue to use the candidate word library synchronized in the distributed network to implement rich candidate word recommendations after exiting the distributed network. When a common device exits the distributed network, its own candidate word library synchronized to the distributed network by the common device can also be retained in the distributed network, so that other devices in the distributed network can continue to use the candidate word library of the common device to implement rich candidate word recommendations. It can be understood that the specific permissions of the common device can also be set according to the actual application scenario, and the embodiments of the present application do not make specific limitations on this.

[0744] For example, a temporary visitor can indicate that the security level of the device is average. When a temporary visitor joins the distributed network, the temporary visitor can be allowed to synchronize the candidate word libraries of other devices in the distributed network, and synchronize its own candidate word library to other devices in the distributed network. When a temporary visitor exits the distributed network, the candidate word library synchronized by the temporary visitor from the distributed network can be deleted, and the candidate word library of the temporary visitor synchronized to the distributed network can also be deleted in the distributed network. It can be understood that the specific permissions of the temporary visitor can also be set according to the actual application scenario, and the embodiments of the present application do not make specific limitations on this.

[0745] For example, a blacklist device can indicate that the security level of the device is relatively low. When a blacklist device joins the distributed network, the blacklist device can be prohibited from synchronizing the candidate word libraries of other devices in the distributed network, and prohibited from synchronizing its own candidate word library to other devices in the distributed network. It can be understood that the specific permissions of the blacklist device can also be set according to the actual application scenario, and the embodiments of the present application do not make specific limitations on this.

[0746] In this way, by differentiating the access types of devices, while facilitating user input, data protection can be achieved.

[0747] Exemplarily, one possible implementation of setting the access type of a device is as follows: In a distributed network, an administrator device is set (for example, one or more devices with administrator functions joined to the distributed network). The FWK layer of the administrator device can monitor the status of the distributed network, and obtain information about the distributed network and devices within the distributed network. When the administrator device monitors that a certain access device (such as a large screen, a tablet, mobile phone A, or mobile phone B) joins the distributed network, the administrator device can set the access type of the access device.

[0748] It can be understood that subsequently, according to needs, the administrator device can also modify the access types of devices in the distributed network. For example, a modification interface for modifying the access type of a device can be provided in the administrator device, and the administrator can adaptively modify the access types of devices in the distributed network in the modification interface. Or, for example, each device can send a request for modifying the access type to the administrator device, and the administrator device can modify the access type of the device based on this request, etc. The embodiments of the present application do not limit the specific manner of modifying the access type of a device.

[0749] Exemplarily, one possible implementation of setting the access type of a device is as follows: For any device accessing the distributed network, when accessing the distributed network, a function for setting the access type of the device is provided, and the user can set the access type of the device according to requirements.

[0750] In possible implementation manners, if a new device (such as mobile phone C) subsequently accesses the distributed network, then mobile phone C can also synchronize the candidate word library with the large screen, the tablet, mobile phone A, and mobile phone B, similar to the description of the large screen, the tablet, mobile phone A, and mobile phone B synchronizing the candidate word library, which will not be elaborated here.

[0751] In possible implementation manners, if a device that has joined the distributed network (such as a large screen, a tablet, mobile phone A, mobile phone B, or mobile phone C) exits the distributed network, according to the access type of the exiting device, the candidates synchronized by the exiting device in the distributed network can be deleted from the candidate word library of the exiting device, or the candidates synchronized by the exiting device in the distributed network can be retained in the candidate word library of the exiting device. The embodiments of the present application do not make specific limitations on this.

[0752] Exemplarily, Figure 55 The specific system architecture diagram of the device communication method according to the embodiments of the present application is shown.

[0753] As Figure 55As shown in the figure, in the embodiments of the present application, taking a large screen, mobile phone A, and mobile phone C included in a distributed network as an example, it schematically illustrates the process of the large screen, mobile phone A, and mobile phone C accessing the distributed network, the large screen, mobile phone A, and mobile phone C synchronizing the candidate word libraries, mobile phone A using the synchronized candidate word library to assist the large screen in input, and the process of the large screen, mobile phone A, or mobile phone C leaving the distributed network.

[0754] Among them, the large screen and mobile phone A are common devices, and mobile phone C is a temporary visitor. The large screen, mobile phone A, and mobile phone C can all set up a distributed network framework, a distributed database (which may also become a database), and an input method framework (which may also be called a remote input method framework service).

[0755] During the process of the large screen, mobile phone A, and mobile phone C accessing the distributed network, taking the distributed network framework of mobile phone C detecting that mobile phone C has accessed the distributed network as an example, mobile phone C can use operations such as a display interface and voice prompts to ask the user of this mobile phone C to select the access type (which can also be called the device type). After the user selects the appropriate access type, it can trigger mobile phone C to synchronize the candidate word libraries of other devices in the distributed network. The steps for the large screen and mobile phone A to access the distributed network and synchronize the candidate word libraries are similar to those of mobile phone C and will not be elaborated here. Exemplarily, if there is a candidate word "pozhimie" in the candidate word library of mobile phone C, both the large screen and mobile phone A can synchronize this candidate word "pozhimie".

[0756] During the process of mobile phone A assisting the large screen B in input, the user can click on the input method editing box on the large screen, and the large screen can pull up the input method of mobile phone A. For example, an input box pops up on mobile phone A, and then the user can input content in the input box of mobile phone A to achieve the effect of assisting the large screen in input. Exemplarily, if the user inputs "pozhimie" or "PZM" etc. in the input box, based on the candidate word library including the candidate word "pozhimie" synchronized by mobile phone A from mobile phone C, the candidate word "pozhimie" can be displayed on the interface of mobile phone A. The user can trigger the candidate word "pozhimie" by clicking or other means and display "pozhimie" in the input box of the large screen. In the embodiments of the present application, the user of mobile phone A, because they have synchronized the candidate word "pozhimie" from mobile phone C, does not need to select the desired input characters one by one when the user inputs "pozhimie" or "PZM" etc., thus improving the input efficiency.

[0757] During the process of the large screen, mobile phone A, and mobile phone C exiting (or disconnecting) from the distributed network, taking the case where the distributed network framework of mobile phone C monitors the disconnection of mobile phone C from the distributed network as an example, since mobile phone C is a temporary visitor, the candidate words synchronized from the large screen and mobile phone A to the candidate word library of mobile phone C can be deleted. Similarly, the candidate words obtained by mobile phone A from mobile phone C (or the candidate words obtained by mobile phone A from mobile phone C and not used) can also be deleted. For mobile phone A and the large screen, since they are frequently used devices, if mobile phone A or the large screen disconnects from the distributed network, the candidate words synchronized from other devices in the distributed network to mobile phone A or the large screen can be retained, or the candidate words synchronized from mobile phone A or the large screen to other devices in the distributed network can be retained.

[0758] Exemplarily, taking the case where the large screen, mobile phone A, and mobile phone C all disconnect from the distributed network as an example, after disconnecting from the distributed network, mobile phone C can restore to the candidate word library before accessing the distributed network. The candidate word library of mobile phone A can include the candidate word library before mobile phone A accessed the distributed network and the candidate word library before the large screen accessed the distributed network. The candidate word library of the large screen can include the candidate word library before mobile phone A accessed the distributed network and the candidate word library before the large screen accessed the distributed network.

[0759] It can be understood that if new candidate words are generated due to input behaviors such as the large screen, mobile phone A, or mobile phone C during the process of the large screen, mobile phone A, and mobile phone C being connected to the distributed network, the processing method of the new candidate words can also be adaptively adjusted according to the access types of the large screen, mobile phone A, and mobile phone C. For example, if the new candidate word is generated due to the input behavior of mobile phone C, it can be deleted from the candidate word libraries of mobile phone A and the large screen as mobile phone C disconnects from the distributed network. If the new candidate word is generated due to the input behavior of mobile phone A or the large screen, the new candidate word can be retained in the candidate word libraries of mobile phone A and the large screen after mobile phone A or the large screen disconnects from the distributed network.

[0760] In a possible implementation, if the candidate words in the candidate word library of mobile phone C are used during the process of the large screen, mobile phone A, and mobile phone C being connected to the distributed network. For example, when mobile phone A assists the large screen in input and uses the candidate word "pō zhǐ miē" in mobile phone C, after mobile phone C disconnects from the distributed network, the used candidate word "pō zhǐ miē" can be retained in the candidate word libraries of mobile phone A and the large screen.

[0761] It should be noted that in the above embodiments of the present application, the synchronous candidate word library is taken as an example for illustration. In possible implementations, the method of the embodiments of the present application is also applicable to any scenario of data sharing. For example, in a manner similar to the synchronous candidate word library described above, distributed networking can be used to achieve the synchronization of files, music, videos, and / or pictures, etc. between multiple devices. It can be understood that since the candidate word library usually consists of text and generally occupies a relatively small space, in the implementation of synchronizing the candidate word library, the selection of storage controls may not be concerned. If the data to be synchronized is large, in practical applications, the storage space suitable for the data to be synchronized can also be selected in combination with the occupied size of the controls of the data to be synchronized.

[0762] Corresponding to Figure 55 For the described process, the following is an example illustration of the synchronous candidate word library for the large screen, mobile phone A, and mobile phone C, mobile phone A using the synchronized candidate word library to assist the large screen in input, and the user interfaces of the large screen, mobile phone A, or mobile phone C leaving the distributed networking.

[0763] Exemplarily, Figure 56 A schematic diagram of a user interface for selecting a device type is shown. Taking the example that the distributed networking framework of mobile phone C monitors the access of mobile phone C to the distributed networking, mobile phone C can display a user interface as Figure 56 shown.

[0764] As Figure 56 shown, the user interface may include a common device control 5601 for setting the access type of mobile phone C and a temporary visitor control 5602. The user can set mobile phone C as a temporary visitor by clicking the temporary visitor control 5602 button. By a similar method, the user can set mobile phone A and the large screen as common devices, which will not be elaborated here.

[0765] In possible implementation manners, if the access type has been set for the large screen, mobile phone A, or mobile phone C in the distributed networking before, when the large screen, mobile phone A, or mobile phone C joins the distributed networking again, the previously set access type can be retained, and the user interface as Figure 56 shown is not prompted.

[0766] In possible implementation manners, the large screen, mobile phone A, or mobile phone C can also determine their respective access types according to their own frequencies, durations, and / or numbers of joining the distributed networking, etc.

[0767] For example, for any one of the large screen, mobile phone A or mobile phone C: if the frequency of joining the distributed network is higher than a certain threshold, it can be determined as a common device; or, if the frequency of joining the distributed network is lower than a certain threshold, it can be determined as a temporary visitor; or, if the duration of joining the distributed network is higher than a certain threshold, it can be determined as a common device; or, if the duration of joining the distributed network is lower than a certain threshold, it can be determined as a temporary visitor; or, if the number of times joining the distributed network is higher than a certain threshold, it can be determined as a common device; or, if the number of times joining the distributed network is lower than a certain threshold, it can be determined as a temporary visitor; or, if the number of times joining the distributed network is higher than a certain threshold and the duration is higher than a certain threshold, it can be determined as a common device; or, if the number of times joining the distributed network is lower than a certain threshold and the duration is lower than a certain threshold, it can be determined as a temporary visitor; etc., the embodiments of the present application do not make specific limitations on this. This method may also not prompt such as Figure 56 The user interface shown.

[0768] In a possible implementation, if the user has set the access type of the device last time, the access type of the device set by the user last time can be automatically used as the access type of the device, and the access type of the device is not displayed. ​ The user interface shown.

[0769] In a possible implementation, if there are multiple devices with the same user account as the logged-in user account, the multiple devices with the same logged-in user account can be automatically determined as common devices, and the devices are not displayed. ​ The user interface shown.

[0770] In a possible implementation, the access type of the large screen, mobile phone A or mobile phone C may not be set. The large screen, mobile phone A or mobile phone C share common permissions, which is not specifically limited in this embodiment of the present application. ​ The user interface shown.

[0771] It is understood that if the large screen, mobile phone A or mobile phone C sets the access type, the corresponding candidate word library addition or deletion steps can be performed based on the access type. If the large screen, mobile phone A or mobile phone C does not set the access type, the selection word library addition or deletion steps corresponding to any of the above access types can be performed subsequently, and the embodiments of the present application are not limited to this.

[0772] ​ FIG. 4 shows a schematic diagram of an interface for generating candidate words in mobile phone C. ​ As shown, the user can enter "pozhimie" in the input box and select candidate characters one by one to obtain "坡止咩", which can be stored as a candidate word in the candidate word library of mobile phone C.

[0773] Alternatively, the user can also enter the English phrases "apple", "banana", and "meat" in the e...

Claims

1. A device communication method, characterized in that, Applied to a system including a first device, a second device, and a third device, the method includes: The first device displays a first interface including a first edit box; In response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network; The first device displays a second interface, which includes a first option corresponding to the second device and a second option corresponding to the third device; In response to a triggering operation on the first option, the first device sends an indication message to the second device; The second device displays a third interface according to the indication message, and the third interface includes a second edit box; When there is an editing state in the second edit box, synchronize the editing state to the first edit box.

2. The method according to claim 1, characterized in that, The second device includes an interface service for synchronizing the editing state between the first device and the second device.

3. The method according to claim 1 or 2, characterized in that, The editing state includes one or more of the following: text content, cursor, or a highlight mark of the text content.

4. The method according to any one of claims 1 - 3, characterized in that, The second device displays a third interface according to the indication message, including: The second device displays a notification interface in response to the indication message; the notification interface includes a third option for confirming auxiliary input; In response to a triggering operation on the third option, the second device displays the third interface; wherein, the third interface further includes all or part of the content of the first interface.

5. The method according to claim 4, characterized in that, The second edit box is displayed in a layered manner with all or part of the content of the first interface, and the second edit box is displayed above all or part of the content of the first interface.

6. The method according to any one of claims 1 - 5, characterized in that, After the second device displays a third interface according to the indication message, the method further includes: In response to a trigger on the second edit box, the second device displays a virtual keyboard; The second device displays the editing state in the second edit box according to the input operation received in the virtual keyboard and / or the second edit box.

7. A device communication method, characterized in that, Applied to a system including a first device, a second device, and a third device, the method includes: The first device displays a first interface including a first edit box; In response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network; The first device determines that the second device is an auxiliary input device; The first device sends an indication message to the second device; The second device displays a third interface according to the indication message, and the third interface includes a second edit box; When there is an editing state in the second edit box, synchronize the editing state to the first edit box.

8. A device communication method, characterized in that, Applied to a system including a first device, a second device, and a third device, the method includes: The second device displays a fourth interface including an option of the first device; In response to a selection operation on the option of the first device, the second device sends an indication message to the first device; The first device displays a first interface including a first edit box; The second device displays a third interface, and the third interface includes a second edit box; When there is an editing state in the second edit box, synchronize the editing state to the first edit box.

9. A device communication method, characterized in that, Applied to a first device, the method includes: The first device displays a first interface including a first edit box; In response to a selection operation on the first edit box, the first device determines that the second device and the third device join a distributed network; The first device displays a second interface, the second interface including a first option corresponding to the second device and a second option corresponding to the third device; In response to a trigger operation on the first option, the first device sends an indication message to the second device; the indication message is used to instruct the second device to display a third interface, the third interface including a second edit box; When there is an editing state in the second edit box, synchronize the editing state to the first edit box.

10. A device communication method, characterized in that, Applied to a second device, the method includes: The second device displays a fourth interface including an option of the first device; In response to a selection operation on the option of the first device, the second device sends an indication message to the first device; the indication message is used to instruct the first device to display a first interface including a first edit box; The second device displays a third interface, the third interface including a second edit box; When there is an editing state in the second edit box, synchronize the editing state to the first edit box.

11. A device communication method, characterized in that, Applied to a system including a first device, a second device and a third device, the method includes: The first device displays a first interface including a first edit box; The first device sends an indication message to the second device and the third device; The second device displays a second interface according to the indication message, the second interface including a second edit box; The third device displays a third interface according to the indication message, the third interface including a third edit box; When there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box, and the third device synchronizes the editing state to the third edit box.

12. The method according to claim 11, characterized in that, The second device includes an interface service for synchronizing the editing state between the first device and the second device.

13. The method according to claim 11 or 12, characterized in that, The editing state includes one or more of the following: text content, cursor, or highlight mark of text content.

14. The method according to any one of claims 11 - 13, characterized in that, The second device displays a second interface according to the indication message, including: The second device displays a notification interface in response to the indication message; the notification interface includes an option to confirm auxiliary input; In response to a trigger operation on the option, the second device displays the second interface.

15. The method according to any one of claims 11 - 14, characterized in that, The second interface further includes: all or part of the content of the first interface.

16. The method according to claim 15, characterized in that, The second edit box is displayed in layers with all or part of the content of the first interface, and the second edit box is displayed above all or part of the content of the first interface.

17. The method according to any one of claims 11 - 16, characterized in that, After the second device displays a second interface according to the indication message, the method further includes: In response to a trigger on the second edit box, the second device displays a virtual keyboard; The second device displays the editing state in the second edit box according to the input operations received in the virtual keyboard and / or the second edit box.

18. The method according to any one of claims 11 - 17, characterized in that, The editing state in the first edit box includes the identifier of the first device, and / or the editing state in the second edit box includes the identifier of the second device, and / or the editing state in the third edit box includes the identifier of the first device.

19. The method according to any one of claims 11 - 18, characterized in that, When input contents are received in the second edit box and the third edit box simultaneously, the first device determines the input contents of the second edit box and the display mode of the third edit box.

20. A device communication method, characterized in that, Applied to a system including a first device, a second device, and a third device, the method includes: The first device displays a first interface including a first edit box; The first device sends an indication message to the second device; The second device displays a second interface according to the indication message, and the second interface includes a second edit box; The second device sends an auxiliary input request to the third device; The third device displays a third interface according to the auxiliary input request, and the third interface includes a third edit box; When there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box, and the third device synchronizes the editing state to the third edit box.

21. A device communication method, characterized in that, Applied to a system including a first device, a second device, and a third device, the method includes: The second device displays a fourth interface including options of the first device; In response to a selection operation on the options of the first device, the second device sends an indication message to the first device; The first device displays a first interface including a first edit box; The second device displays a second interface, and the second interface includes a second edit box; The second device sends an auxiliary input request to the third device; The third device displays a third interface according to the auxiliary input request, and the third interface includes a third edit box; When there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box, and the third device synchronizes the editing state to the third edit box.

22. A device communication method, characterized in that, Applied to the first device, the method includes: The first device displays a first interface including a first edit box; The first device sends an indication message to the second device and the third device; for the second device to display a second interface according to the indication message, the second interface includes a second edit box, and for the third device to display a third interface according to the indication message, the third interface includes a third edit box; When there is an editing state in the second edit box, the first device synchronizes the editing state to the first edit box; Or, when there is an editing state in the third edit box, the first device synchronizes the editing state to the first edit box.

23. A device communication method, characterized in that, Applied to the second device, the method includes: The second device displays a fourth interface including options of the first device; In response to a selection operation of an option of the first device, the second device sends an indication message to the first device; for the first device to display a first interface including a first edit box; The second device displays a second interface, and the second interface includes a second edit box; The second device sends an auxiliary input request to the third device; for the third device to display a third interface according to the auxiliary input request, and the third interface includes a third edit box; When there is an editing state in the third edit box, the second device synchronizes the editing state to the second edit box; Alternatively, when there is an editing state in the first edit box, the second device synchronizes the editing state to the second edit box.

24. A device communication system, characterized in that, It includes a first device, a second device and a third device. The first device is configured to perform the steps of the first device according to any one of claims 1-9 or 11-22. The second device is configured to perform the steps of the second device according to any one of claims 1-9 or 11-21, 23. The third device is configured to perform the steps of the third device according to any one of claims 1-9 or 11-21.

25. A first device, characterized in that, It includes: At least one memory and at least one processor; The memory is used for storing program instructions; The processor is configured to call the program instructions in the memory to cause the first device to perform the steps performed by the first device according to any one of claims 1-9, or perform the steps performed by the first device according to any one of claims 11-22.

26. A second device, characterized in that, It includes: At least one memory and at least one processor; The memory is used for storing program instructions; The processor is configured to call the program instructions in the memory to cause the second device to perform the steps performed by the second device according to any one of claims 1-9, or perform the steps performed by the second device according to any one of claims 11-21, 23.

Images