Assistive input method, electronic device, and system

Abstract

The application provides an auxiliary input method, an electronic device and a system. In the method, a first auxiliary device can perform auxiliary input with an assisted device, and send first information displayed in a local input box to the assisted device. When the first auxiliary device cannot perform auxiliary input with the assisted device, the assisted device can send information displayed in a focus display box to a second auxiliary device which is idle in a device group, and then perform auxiliary input with the second auxiliary device. The technical solution provided by the application can better assist the assisted device to perform auxiliary input.

Description

Technical Field

[0001] This application relates to the field of terminal and communication technology, and in particular to auxiliary input methods, electronic devices and systems. Background Technology

[0002] With the development of internet technology, the functions of large-screen devices (such as smart screens) are constantly being improved and enhanced. More and more users are choosing large-screen devices to replace traditional televisions. The market offers a wide variety of brands and types of large-screen devices, and user demand for them is also increasing. Therefore, improving the interactive experience between large-screen devices and users is crucial. Users can interact with large-screen electronic devices through other electronic devices (such as remote controls). For example, users can use a remote control to input information into input boxes on the large-screen electronic device. However, when a large amount of information needs to be input into the large-screen device, using a remote control can lead to low input efficiency.

[0003] In existing technologies, users can use user-friendly electronic devices (such as mobile phones) as auxiliary devices to assist large-screen devices in completing input. Information is entered on the mobile phone and then displayed on the large-screen device, thus completing the information input for the large-screen device.

[0004] However, in this prior art, the large-screen device can only perform auxiliary input through an auxiliary device. The auxiliary device can send the information displayed in the input box to the screen display device. When the auxiliary device starts other processes and cannot perform auxiliary input, the large-screen device still needs to use a remote control to input information. Summary of the Invention

[0005] This application provides an auxiliary input method, electronic device, and system. A first auxiliary device can perform auxiliary input with a device being assisted by sending the first information displayed in the input box of the device to the device being assisted. When the first auxiliary device cannot perform auxiliary input with the device being assisted, the device being assisted can send the information displayed in the focus display box to an idle second auxiliary device in the device group, and then perform auxiliary input with the second auxiliary device.

[0006] In a first aspect, this application provides an assistance method, comprising: a assisted device displaying first information sent by a first assisting device in a focus input box; when the assisted device determines that the device status of the first assisting device has switched to busy, the assisted device sending second information displayed in the focus input box to a second assisting device; the second information being the first information or information processed based on the first information; the second assisting device being the highest priority assisting device among assisting devices in a device group whose device status is idle; and the assisted device displaying third information sent by the second assisting device in the focus input box, the third information being the second information or information processed based on the second information.

[0007] In the above embodiments, the first auxiliary device has already assisted the input device and sent the information in its input box to the assisted device. When the first auxiliary device is busy and cannot assist the input device, the assisted device can assist the input device with the second auxiliary device. The second auxiliary device can then send the second information displayed in the current focus display box to the second auxiliary device. The second auxiliary device can display this second information in its input box, process it, and then send the processed information to the assisted device. In this way, as long as there is one idle auxiliary device in the device group, it can assist the assisted device with input.

[0008] In conjunction with the method of the first aspect, the second information is the first information or information obtained by processing the first information, specifically including: when the assisted electronic device does not process the first information, the first information is the same as the second information; when the assisted electronic device processes the first information, the first information is different from the second information.

[0009] In the above embodiments, after receiving the first information, the assisted device can process the first information, such as deleting, adding, etc., to change the content of the first information and obtain the second information.

[0010] In conjunction with the first aspect of the method, before the assisted device displays the first information sent by the first assisted device in the focus input box, the method further includes: the assisted device sending an assisted input request to the first assisted device.

[0011] In conjunction with the first aspect of the method, before the assisted device displays the first information sent by the first assisted device in the focus input box, the method further includes: when the assisted device receives information that the device status of the first assisted device is busy, the assisted device updates the device status of the first assisted device to busy in the device status information.

[0012] In the above embodiments, the assisted device uses the device status information to record the device status of the assisted device in the device group, which makes it easy to find the status of the assisted device.

[0013] In conjunction with the first aspect of the method, before the assisted device sends the second information displayed in the focus input box to the second assisted device, the method further includes: in the assisted device updating the device status information, the device status of the second assisted device is idle.

[0014] In the above embodiments, the assisted device uses device status information to record the device status of the assisted device in the device group, which can conveniently update the status of the assisted device.

[0015] In conjunction with the method of the first aspect, the assisted device displays the first information sent by the first assisting device in the focus input box, specifically including: the assisted device determining the focus input box, the focus input box being used to display information; the assisted device receiving the first information sent by the first assisting device, the first information being all the information displayed in the input box of the assisted device; and the assisted device displaying the first information in the focus input box.

[0016] In the above embodiments, the auxiliary device can send the information displayed in the input box to the assisted device in real time, and the auxiliary device can send all the information displayed in the input box to the assisted device. The auxiliary device can then display this information in the focus display box.

[0017] In conjunction with the method of the first aspect, the assisted device sends the second information displayed in the focus input box to the second auxiliary device, specifically including: the assisted device sends the second information displayed in the focus input box to the second auxiliary device, wherein the second information is all the information displayed in the focus input box.

[0018] In the above embodiments, the assisted device can send all the information in the focus display box to the second auxiliary device, so that the second auxiliary device can obtain the information in the focus display box of the assisted device, process the information, and continue to provide assisted input with the assisted device.

[0019] In conjunction with the method of the first aspect, after the assisted device sends the second information displayed in the focus input box to the second auxiliary device, the method further includes: when the assisted device receives information that the device status of the first auxiliary device is idle, the assisted device updates the device status of the first auxiliary device to idle in the device status information; the assisted device sends an auxiliary input switching request to the second auxiliary device; the auxiliary input switching request is used to inquire with the second auxiliary device whether to switch to the first auxiliary device for auxiliary input; at this time, the first auxiliary device is the auxiliary device with the highest device priority among the auxiliary devices whose current device status is idle; the assisted device continues to perform auxiliary input with the second auxiliary device or selects the first auxiliary device for auxiliary input.

[0020] In the above embodiments, when the electronic device with the highest device priority in the device group is in an idle state, the assisted device can send an assisted input switching request to the assisted device that is currently providing assisted input with it, hoping to switch to the assisted device with the highest device priority for assisted input, so as to maximize the efficiency of assisted input.

[0021] In conjunction with the method of the first aspect, the assisted device continues to perform auxiliary input with the second auxiliary device or with the first auxiliary device, specifically including: when the assisted device receives information from the second auxiliary device indicating a switch to the first auxiliary device for auxiliary input, the assisted device selects the first auxiliary device for auxiliary input; when the assisted device receives information from the second auxiliary device indicating no switch to the first auxiliary device for auxiliary input, the assisted device continues to perform auxiliary input with the second auxiliary device.

[0022] In conjunction with the method of the first aspect, after the assisted device selects the first assisting device for assisting input, the method further includes: when the first assisting device refuses to provide assisting input to the assisted device, the assisted device continues to provide assisting input to the second assisting device.

[0023] In the above embodiments, the auxiliary device can refuse to provide auxiliary input to the assisted device, thereby ensuring the safety of the auxiliary device.

[0024] In conjunction with the method of the first aspect, when the first auxiliary device refuses to provide auxiliary input to the assisted device, the assisted device continues to provide auxiliary input to the second auxiliary device. Specifically, when the first auxiliary device does not respond within a certain period of time after receiving the assistance request from the assisted device, the assisted device continues to provide auxiliary input to the second auxiliary device.

[0025] In the above embodiments, if the auxiliary device fails to respond to the auxiliary input request of the assisted device within a timeout period, the assisted device can select other auxiliary devices to assist, making the auxiliary input more intelligent and efficient.

[0026] Secondly, this application provides an assisted device, the assisted device comprising: a memory and one or more processors; the memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors calling the computer instructions to cause the assisted device to perform: displaying first information sent by a first auxiliary device in a focus input box; when determining that the device status of the first auxiliary device has switched to busy, sending second information displayed in the focus input box to a second auxiliary device; the second information being the first information or information processed based on the first information; the second auxiliary device being the highest priority auxiliary device among auxiliary devices in a device group whose device status is idle; and displaying third information sent by the second auxiliary device in the focus input box, the third information being the second information or information processed based on the second information.

[0027] In the above embodiments, the first auxiliary device has already assisted the input device and sent the information in its input box to the assisted device. When the first auxiliary device is busy and cannot assist the input device, the assisted device can assist the input device with the second auxiliary device. The second auxiliary device can then send the second information displayed in the current focus display box to the second auxiliary device. The second auxiliary device can display this second information in its input box, process it, and then send the processed information to the assisted device. In this way, as long as there is one idle auxiliary device in the device group, it can assist the assisted device with input.

[0028] In conjunction with the auxiliary device of the second aspect, the one or more processors are specifically configured to invoke the computer instructions to cause the assisted device to execute: when the first information is not processed, the first information is the same as the second information; when the first information is processed, the first information is different from the second information.

[0029] In conjunction with the second aspect of the auxiliary device, before displaying the first information sent by the first auxiliary device in the focus input box, the one or more processors are further configured to invoke the computer instructions to cause the assisted device to perform: sending an auxiliary input request to the first auxiliary device.

[0030] In conjunction with the second aspect of the auxiliary device, before displaying the first information sent by the first auxiliary device in the focus input box, the one or more processors are further configured to invoke the computer instructions to cause the assisted device to perform: when receiving information that the device status of the first auxiliary device is busy, update the device status of the first auxiliary device to busy in the device status information.

[0031] In conjunction with the second auxiliary device, before sending the second information displayed in the focus input box to the second auxiliary device, the one or more processors are further configured to invoke the computer instructions to cause the assisted device to execute: in updating the device status information, the device status of the second auxiliary device is idle.

[0032] In conjunction with the auxiliary device of the second aspect, the one or more processors are specifically configured to invoke the computer instructions to cause the assisted device to perform: determining a focus input box for displaying information; receiving first information sent by the first auxiliary device, the first information being all the information displayed in the input box of the assisted device; and displaying the first information in the focus input box.

[0033] In conjunction with the auxiliary device of the second aspect, the one or more processors are specifically used to invoke the computer instructions to cause the assisted device to execute: sending the second information displayed in the focus input box to the second auxiliary device, wherein the second information is all the information displayed in the focus input box.

[0034] In conjunction with the second aspect of the auxiliary device, after sending the second information displayed in the focus input box to the second auxiliary device, the one or more processors are further configured to invoke the computer instructions to cause the assisted device to execute: when receiving information that the device status of the first auxiliary device is idle, update the device status of the first auxiliary device to idle in the device status information; send an auxiliary input switching request to the second auxiliary device; the auxiliary input switching request is used to inquire whether the second auxiliary device should switch to the first auxiliary device for auxiliary input; at this time, the first auxiliary device is the auxiliary device with the highest device priority among the auxiliary devices whose current device status is idle; continue to perform auxiliary input with the second auxiliary device or select the first auxiliary device for auxiliary input.

[0035] In conjunction with the auxiliary device of the second aspect, the one or more processors are specifically configured to invoke the computer instructions to cause the assisted device to perform: when receiving information from the second auxiliary device to switch to the first auxiliary device for assisted input, selecting the first auxiliary device for assisted input; when receiving information from the second auxiliary device not to switch to the first auxiliary device for assisted input, continuing to perform assisted input with the second auxiliary device.

[0036] In conjunction with the second aspect of the auxiliary device, after selecting the first auxiliary device for auxiliary input, the one or more processors are further configured to invoke the computer instructions to cause the assisted device to execute: when the first auxiliary device refuses to provide auxiliary input to the assisted device, then continue to provide auxiliary input to the second auxiliary device.

[0037] In conjunction with the auxiliary device of the second aspect, the one or more processors are specifically configured to invoke the computer instructions to cause the assisted device to perform: when the first auxiliary device does not respond within a period of time after receiving the assistance request from the assisted device, it continues to provide assistance input with the second auxiliary device.

[0038] Thirdly, embodiments of this application provide an auxiliary input method, comprising: a first auxiliary device sending first information to an assisted device; the first information being all information displayed in the input box of the first auxiliary device; the assisted device displaying the first information sent by the first auxiliary device in a focus input box; when the assisted device determines that the device status of the first auxiliary device has switched to busy, the assisted device sending second information displayed in the focus input box to a second auxiliary device; the second information being the first information or information processed based on the first information; the second auxiliary device being the highest priority auxiliary device among auxiliary devices in a device group whose device status is idle; the assisted device displaying third information sent by the second auxiliary device in the focus input box, the third information being the second information or information processed based on the second information.

[0039] In conjunction with the auxiliary input method provided in the third aspect, before the assisted device displays the first information sent by the first assisted device in the focus input box, the method further includes: the assisted device sending an auxiliary input request to the first assisted device. The first assisted device receives the auxiliary input request sent by the assisted device.

[0040] In conjunction with the auxiliary input method provided in the third aspect, before the assisted device displays the first information sent by the first auxiliary device in the focus input box, the method further includes: the first auxiliary device notifying the assisted device that its device status is busy; when the assisted device receives the information that the device status of the first auxiliary device is busy, the assisted device updates the device status of the first auxiliary device to busy in the device status information.

[0041] In conjunction with the auxiliary input method provided in the third aspect, before the assisted device sends the second information displayed in the focus input box to the second auxiliary device, the method further includes: the second auxiliary device notifying the assisted device that its device status is idle; and in the assisted device updating the device status information, the device status of the second auxiliary device is idle.

[0042] In conjunction with the auxiliary input method provided in the third aspect, the assisted device displays the first information sent by the first auxiliary device in the focus input box, specifically including: the assisted device determining the focus input box, the focus input box being used to display information; the first auxiliary device sending the first information to the assisted device; the assisted device receiving the first information sent by the first auxiliary device, the first information being all the information displayed in the input box of the assisted device; and the assisted device displaying the first information in the focus input box.

[0043] In conjunction with the auxiliary input method provided in the third aspect, the assisted device sends the second information displayed in the focus input box to the second auxiliary device, specifically including: the assisted device sending the second information displayed in the focus input box to the second auxiliary device, the second information being all the information displayed in the focus input box; the second auxiliary device receiving the second information; and the second auxiliary device displaying the second information in the input box.

[0044] In conjunction with the auxiliary input method provided in the third aspect, after the assisted device sends the second information displayed in the focus input box to the second auxiliary device, the method further includes: the first auxiliary device notifying the assisted device that its device status is idle; when the assisted device receives the information that the device status of the first auxiliary device is idle, the assisted device updates the device status of the first auxiliary device to idle in the device status information; the assisted device sends an auxiliary input switching request to the second auxiliary device; the auxiliary input switching request is used to inquire with the second auxiliary device whether to switch to the first auxiliary device for auxiliary input; the second auxiliary device receives the auxiliary device switching request; at this time, the first auxiliary device is the auxiliary device with the highest device priority among the auxiliary devices whose current device status is idle; the assisted device continues to perform auxiliary input with the second auxiliary device or selects the first auxiliary device for auxiliary input.

[0045] In conjunction with the auxiliary input method provided in the third aspect, the assisted device continues to perform auxiliary input with the second auxiliary device or with the first auxiliary device, specifically including: the second auxiliary device notifying the assisted device to switch to the first auxiliary device for auxiliary input; when the assisted device receives the information sent by the second auxiliary device indicating a switch to the first auxiliary device for auxiliary input, the assisted device selects the first auxiliary device for auxiliary input; the second auxiliary device notifying the assisted device not to switch to the first auxiliary device for auxiliary input; when the assisted device receives the information sent by the second auxiliary device indicating a decision not to switch to the first auxiliary device for auxiliary input, the assisted device continues to perform auxiliary input with the second auxiliary device.

[0046] Fourthly, this application provides a system comprising: a assisted device, a first auxiliary device, and a second auxiliary device; the assisted device, the first auxiliary device, and the second auxiliary device each include: a memory and one or more processors; the memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, and the one or more processors calling the computer instructions to cause the assisted device, the first auxiliary device, and the second auxiliary device to execute: the first auxiliary device sending first information to the assisted device; the first information being all information displayed in the input box of the first auxiliary device; the assisted device displaying the first information sent by the first auxiliary device in a focus input box; when the assisted device determines that the device status of the first auxiliary device has switched to busy, the assisted device sending second information displayed in the focus input box to the second auxiliary device; the second information being the first information or information processed based on the first information; the second auxiliary device being the highest priority auxiliary device among auxiliary devices in a device group whose device status is idle; the assisted device displaying third information sent by the second auxiliary device in the focus input box, the third information being the second information or information processed based on the second information.

[0047] Fifthly, this application provides a chip system applied to an electronic device, the chip system including one or more processors, the processors being configured to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1-11.

[0048] In a sixth aspect, this application provides a computer program product comprising instructions, characterized in that, when the computer program product is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 1-11.

[0049] In a seventh aspect, this application provides a computer-readable storage medium including instructions, characterized in that, when the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the method as described in any one of claims 1-11.

[0050] It is understood that the auxiliary device provided in the second aspect, the method provided in the third aspect, the system provided in the fourth aspect, the chip system provided in the fifth aspect, the computer program product provided in the sixth aspect, and the computer-readable storage medium provided in the seventh aspect are all used to execute the method provided in the embodiments of this application. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects in the corresponding methods, and will not be repeated here. Attached Figure Description

[0051] Figure 1 This is a schematic diagram of a device group provided in an embodiment of this application;

[0052] Figures 2a-2c This is a schematic diagram of the device status of the electronic device provided in the embodiments of this application;

[0053] Figures 3a-3c This is a schematic diagram of a scenario of an auxiliary input method provided in an embodiment of this application;

[0054] Figure 4a and Figure 4b This is a schematic diagram of a scenario of the auxiliary input method in the embodiments of this application;

[0055] Figures 5a-5k This is a set of exemplary user interfaces for the auxiliary methods provided in the embodiments of this application;

[0056] Figure 6 This is a schematic diagram of the structure of the communication system 100 provided in the embodiments of this application;

[0057] Figure 7 This is a schematic diagram of the hardware structure of the first electronic device provided in an embodiment of this application;

[0058] Figure 8 This is a schematic diagram of the hardware structure of the second electronic device provided in an embodiment of this application;

[0059] Figure 9 This is a signaling interaction diagram of application scenario 1 provided in the embodiments of this application;

[0060] Figure 10 This is a schematic diagram of an interactive information flow for application scenario 1 provided in this application embodiment;

[0061] Figure 11 This is a signaling interaction diagram of application scenario 2 provided in the embodiments of this application. Detailed Implementation

[0062] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to include the plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used in this application refers to and includes any or all possible combinations of one or more of the listed items.

[0063] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.

[0064] Since the embodiments of this application involve the application of file protection between distributed collaborative devices, for ease of understanding, the relevant terms and concepts involved in the embodiments of this application will be introduced below.

[0065] (1) Equipment Group:

[0066] In this embodiment, multiple electronic devices can first be connected via a network to form a distributed collaborative scenario. Then, after the multiple electronic devices complete input method collaboration, they can form a device group. Specifically, the assisted device can send an input method collaboration request to each assisting device. After receiving the request, the input method of the assisting device can collaborate with the input method of the assisted device to complete the same information input. This information may include text information, image information, etc., which are not limited in this embodiment.

[0067] In this context, auxiliary devices refer to electronic devices that can directly input information using the device itself, such as mobile phones and tablets. Assisted devices refer to electronic devices that are inefficient for inputting information directly using the device, but can be used to input information through auxiliary devices, such as smart screens.

[0068] The device group includes two or more auxiliary devices and one or more assisted devices. The auxiliary devices in the device group can assist the assisted device in inputting data using the auxiliary input method described in the embodiments of this application.

[0069] In this application embodiment, the device group can be composed in many ways:

[0070] In some embodiments, multiple electronic devices logged into the same network account can be configured to form a distributed collaborative scenario. After the multiple electronic devices complete input method collaboration, they can form a device group.

[0071] In some embodiments, multiple electronic devices in the same local area network can be configured to form a distributed collaborative scenario. After the multiple electronic devices complete the input method collaboration, they can form a device group.

[0072] In some embodiments, multiple electronic devices with the same specific identifier can be configured to form a distributed collaborative scenario. After the multiple electronic devices complete the input method collaboration, they can form a device group.

[0073] In other embodiments, the above-described methods for forming device groups can be combined to obtain a device group.

[0074] It is understood that there may be other ways to form a group of devices, and the embodiments in this application do not limit this.

[0075] Figure 1 This is a schematic diagram of a group of devices in an embodiment of this application.

[0076] like Figure 1 As shown, this device group includes multiple electronic devices such as smart screens, mobile phones, and tablets. Among them, the smart screen is the auxiliary device, while the mobile phones and tablets are auxiliary devices. The mobile phones and tablets can assist the smart screen in input.

[0077] (2) Equipment status:

[0078] In this embodiment of the application, when an electronic device is used as an auxiliary device, the device status of the electronic device includes: busy, idle, and inputting.

[0079] When an electronic device is in a busy state, auxiliary input is not possible. For example, when an electronic device is running other processes that cannot be performed simultaneously with auxiliary input, such as a call or chat process, the device is considered busy.

[0080] For example, Figure 2a This diagram illustrates an exemplary user interface when an electronic device is in a busy state.

[0081] like Figure 2a As shown, at this time, the electronic device is in the call process and cannot assist the assisted device in input.

[0082] Auxiliary input can be performed when the electronic device is in an idle state, but at this time the electronic device is not performing any auxiliary input. For example, when the electronic device has no processes running.

[0083] For example, Figure 2b This diagram illustrates an exemplary user interface when an electronic device is in an idle state.

[0084] like Figure 2b As shown, at this time, the electronic device displays the main screen (Home screen) and no other processes are running.

[0085] When the device status of an electronic device is "In Input", it means that the electronic device is performing auxiliary input.

[0086] For example, Figure 2c This diagram illustrates an exemplary user interface when the device status of an electronic device is "In Input".

[0087] like Figure 2c As shown, at this time, the input method of the electronic device is turned on, and assisted input is in progress.

[0088] (3) Equipment status information:

[0089] In this embodiment, device status information is used to represent the correspondence between the identifiers of auxiliary devices in a device group and their device statuses. This device status information can be stored in the memory of the assisted device.

[0090] The identifier of the auxiliary device is used to uniquely identify an auxiliary device within the group of devices.

[0091] Optionally, the identifier of the auxiliary device may be one or a combination of the device name, device physical address, mobile equipment identifier (MEID), and international mobile equipment identity (IMEI), etc., without limitation here.

[0092] For example, taking IMEI as the identifier of the auxiliary device, Table 1 below is an example of the device status information in an embodiment of this application:

[0093] Identification of electronic devices Equipment status IMEI of Device 1 Busy IMEI of Device 2 idle IMEI of Device 3 Inputting

[0094] Table 1

[0095] From the device status information shown in Table 1, we can determine that: device 1 is busy; device 2 is idle; and device 3 is in input.

[0096] In some embodiments, when the device status of any auxiliary device in the device group is updated from other statuses to busy, the auxiliary device may be triggered to delete the information of that auxiliary device from the device status information.

[0097] In some embodiments, when the device status of any auxiliary device in the device group is updated from other statuses to busy, the auxiliary device may be triggered to delete the information of all auxiliary devices whose device status is busy from the device status information.

[0098] In some embodiments, the assisted device may periodically obtain the device information and delete information about assisted devices whose device status is busy.

[0099] In other embodiments, when any auxiliary device leaves the device group, the auxiliary device's information may be deleted from the device status information.

[0100] It is understood that Table 1 is merely an exemplary illustration of device status information. In practical applications, device status information can be stored in many other different forms, such as arrays, matrices, databases, etc. This application embodiment does not limit this.

[0101] In some embodiments, the assisted device may set the initial device status of the assisted devices in the device group to busy-green.

[0102] (4) Equipment priority information:

[0103] In this embodiment, device priority information is used to represent the correspondence between the identifiers of electronic devices in a device group and their device priorities. This device priority information can be stored in the memory of the assisted device.

[0104] In this context, device priority refers to the order in which the assisted electronic device and the auxiliary electronic device perform auxiliary input. In this embodiment, the assisted device can only perform auxiliary input with one auxiliary device at a time. The auxiliary device that can perform auxiliary input with the assisted device first has the highest device priority, and so on.

[0105] The priority of the first device can be recorded as "1", the priority of the second device as "2", and so on. Other methods can also be used to represent device priorities, and this application does not limit this.

[0106] The identification of electronic devices has the same meaning as that of auxiliary devices, and is used to uniquely identify an electronic device within the group of devices.

[0107] For example, taking IMEI as the identifier of an auxiliary device, Table 2 below is an example of the device priority information in an embodiment of this application:

[0108] Identification of electronic devices Device priority IMEI of Device 1 1 IMEI of Device 2 2 IMEI of Device 3 3

[0109] Table 2

[0110] From the device priority information shown in Table 2, it can be determined that: device 1 has the highest device priority; device 2 has the second highest device priority; and device 3 has the lowest device priority.

[0111] In some embodiments, the device priority information stored in an assisted device may not include the local device priority information. In other embodiments, an assisted device may include the local device priority information. This application does not limit this approach.

[0112] It is understood that Table 2 is merely an exemplary illustration of device priority information. In practical applications, device priority information can be stored in many other different forms, such as arrays, matrices, databases, etc. This application embodiment does not limit this.

[0113] Figures 3a-3c An exemplary schematic diagram of an auxiliary input method in one scenario is shown.

[0114] In this system, the first electronic device is the device being assisted, and the second electronic device is the auxiliary device.

[0115] like Figure 3a As shown, user interface 30a is a search interface of the first electronic device, which can display an input box 301 for displaying information already acquired by the electronic device.

[0116] User interface 30b is an information input interface of the second electronic device, which can display the keyboard 302 of the input method, the input prompt box 303 and the input box 304.

[0117] Suppose the user wants to input the text "you". In response to the user's operation on keyboard 302 (such as a click), the input prompt box 303 can display the text information corresponding to the user's operation, such as "I want to have time for you". In response to the user's operation of selecting the text "you" in the input prompt box 303 (such as a click), the input box 304 can display the text information "you" 304a.

[0118] The second electronic device can send the text information 304a to the first electronic device, and then the text information 304a can be displayed in the input box 301 of the user interface 30a of the first electronic device.

[0119] Then, as Figure 3bAs shown in the user interface 31b, when the second electronic device assists the first electronic device in auxiliary input, the second electronic device accesses a call. In response to an operation (such as a click operation) by the user on the answer control 311a in the incoming call display box 311, the electronic device can initiate a call process and display a user interface 32b as shown in Figure 3c 所示的用户界面32b。

[0120] 如 Figure 3c 中的用户界面32b所示,此时,第二电子设备可以进行通话,不可以再协助第一电子设备进行输入。

[0121] It can be understood that in this solution, when the device state of the second electronic device is busy, it cannot assist the first electronic device in input. At this time, the first electronic device also cannot perform auxiliary input with other auxiliary devices. In this way, the first electronic device can only use the original input method for input, for example, input through a remote control. This results in low input efficiency of the first electronic device.

[0122] However, by using the auxiliary input method provided in the embodiments of the present application, as long as any auxiliary device in the devices constituting the distributed collaboration scenario has an idle device state, it can assist the assisted electronic device in input.

[0123] Figure 4a 和 Figure 4b Exemplarily shows a schematic diagram of a scenario of the auxiliary input method in the solution related to the embodiments of the present application.

[0124] In the embodiments of the present application, the first electronic device is the assisted device, the second electronic device is the auxiliary device with the highest device priority, and the third electronic device is the auxiliary device with the second device priority.

[0125] 假设开始是第二电子设备协助第一电子设备进行输入,然后,第二电子设备开始进行通话。如 Figure 4a 中的用户界面40b所示,第二电子设备因为进行通话而导致无法再协助第一电子设备进行输入。此时,第一电子设备可以将用户界面40a中显示的输入框401中的文字信息401a发送给第二设备优先级的第三电子设备。然后,第三电子设备的用户界面40c中的输入框402中,可以显示文字信息401a。

[0126] 当第二电子设备的设备状态为忙碌时,第三电子设备可以协助第一电子设备进行输入。响应于用户在 Figure 4a 中所示的用户界面40c中显示的输入提示框403中的选择文字“的”的操作(例如点击操作),第三电子设备可以显示如 Figure 4bThe user interface 41c shown can display an input box 402, which can display text information 411a. The third electronic device can send the text information 411a to the first electronic device, such as... Figure 4b As shown in the user interface 41a, the text information 411a can be displayed in the input box 401 of the first electronic device. At this time, the second electronic device... Figure 4b As shown in the user interface 41b, the device status is busy.

[0127] Thus, by using the auxiliary input method in this application embodiment, the assisted device can select an auxiliary device to assist it with input according to device priority. As long as any auxiliary device in the device group is in the input state or idle, it can assist the assisted device in input.

[0128] The auxiliary input method in this application embodiment will be described below using a set of exemplary user interfaces as examples:

[0129] Figures 5a-5k This is a set of exemplary user interfaces for the auxiliary input method in the embodiments of this application.

[0130] Assume that at this time, the first electronic device is the assisted electronic device, the second electronic device is the first device priority and the device status is idle, and the third electronic device is the second device priority and the device status is idle.

[0131] like Figures 5a-5e As shown, the first electronic device first performs auxiliary input with the second electronic device. When the device status of the second electronic device is busy, the first electronic device can perform auxiliary input with the third electronic device.

[0132] Figure 5a As shown, after the user selects an input box 501 in the user interface 50a, the first electronic device can gray out the input box 501. Then, in response to the user's operation on the confirmation button 502 in the remote control (e.g., pressing, clicking, etc.), the first electronic device can display as shown in the image. Figure 5b The user interface 51a shown in the figure has a prompt cursor 501a that can be displayed in the input box 501. The prompt cursor 501a is used to prompt the user that the input box 501 has been identified as the focus input box. When the first electronic device obtains information, it is displayed in the input box 501 and after the prompt cursor 501a.

[0133] At this time, the user interface 50b of the second electronic device can display a prompt box 503, which may include a prompt message 503a, an agree control 503b, and a refuse control 503c. The prompt message 503a prompts the user: "Do you agree to activate local input to assist the first electronic device in inputting data?" The agree control 503b allows the first electronic device to agree to activate local input to assist in inputting data. The refuse control 503c allows the first electronic device to refuse to activate local input to assist in inputting data.

[0134] In response to a user's action (such as a click) on the consent control 503b, the second electronic device may display, as follows: Figure 5b The user interface 51b shown may display an input box 511 and a keyboard 512 for the input method of the second electronic device. The keyboard 512 may be used to input text information into the second electronic device, and the input box 511 may be used by the second electronic device to display the text information input by the keyboard 512.

[0135] like Figure 5b As shown, in response to a user's operation on the keyboard 512 (such as a click operation), the second electronic device can display as follows: Figure 5c The user interface 52b shown can display text information corresponding to the user's operation in the input prompt box 521, such as "You, I want to have time". In response to the user's operation of selecting the text "you" in the input prompt box 521 (such as a click operation), the text information "you" 511a can be displayed in the input box 511.

[0136] The second electronic device can send the text information 511a to the first electronic device, and then the text information 511a can be displayed in the input box 501 of the user interface 52a of the first electronic device.

[0137] At this time, as Figure 5d As shown, when a phone call is received by the second electronic device, in response to the user's operation (e.g., a click) on the answer control 531a in the caller ID box 531 of the user interface 53b, the electronic device can start the call. At this time, the device status of the second electronic device is busy, and it can display as shown below. Figure 5e The user interface 54b is shown. At this time, the first electronic device may still display the user interface 52a.

[0138] It is understandable that, such as Figures 5a-5d As shown, when the first electronic device and the second electronic device are performing auxiliary input, the third electronic device can continuously display the user interface 50c, and the device status of the third electronic device can always be idle, and it cannot perform auxiliary input with the first electronic device.

[0139] like Figure 5e A user interface 54b is shown when the second electronic device is making a call. When the second electronic device initiates a call, the device status switches from input to busy, and the second electronic device can no longer assist the first electronic device with input.

[0140] At this point, the first electronic device can continue displaying the user interface 52a. Then, the first electronic device can provide auxiliary input to a third electronic device with a second device priority.

[0141] like Figure 5e As shown, the user interface 54c of the third electronic device can pop up a prompt box 541, which may include a prompt message 541a, an agree control 541b, and a refuse control 541c.

[0142] In response to a user's action on the consent control 541b (such as a click), the first electronic device can send the text information 511a displayed in the input box 501 to the third electronic device. The third electronic device can then display, for example... Figure 5f The user interface 55c shown may display an input box 551, which may display text information 511a, and a keyboard 552 for the input method of a third electronic device.

[0143] In this way, when the device status of the second electronic device switches to busy, the first electronic device can still select other auxiliary devices for auxiliary input and send the information displayed in the currently focused input box to the other auxiliary device, so that the other auxiliary device can continue to provide auxiliary input with the first electronic device based on the previous input.

[0144] like Figures 5f-5k As shown, when the first electronic device and the third electronic device are performing auxiliary input, and the device status of the second electronic device with the highest device priority is idle, the first electronic device can switch to the second electronic device for auxiliary input, or it can continue to perform auxiliary input with the third electronic device.

[0145] like Figure 5f As shown, in response to a user's operation on keyboard 552 (such as a click operation), the third electronic device can display, as shown in the image. Figure 5g The user interface 56c shown can display text information corresponding to the user's operation in the input prompt box 561, such as "the answer to our question". In response to the user's operation of selecting the text "of" in the input prompt box 561 (such as a click operation), the input box 511 can display the text information "your" 511b.

[0146] The third electronic device can send the text information 511b to the first electronic device, and then the text information 511b can be displayed in the input box 501 of the user interface 56a of the first electronic device.

[0147] It is understandable that, such as Figures 5e-5g As shown, when the first electronic device is providing auxiliary input to the third electronic device, the second electronic device can continuously display the user interface 54b, which indicates that the device status of the second electronic device is always busy and cannot provide auxiliary input to the first electronic device.

[0148] In response to Figure 5g The operation (such as a click) on the hang-up control 562 displayed in the user interface 54b shown in the diagram allows the second electronic device to end the call process and display something like... Figure 5h The user interface 57b shown is the main interface of the second electronic device.

[0149] At this point, the second electronic device switches its device status from busy to idle. Since the third electronic device has a lower device priority than the first electronic device, the first electronic device will send a request to the third electronic device to switch to the second electronic device for auxiliary input. The third electronic device can then display something like... Figure 5h The user interface 57c shown is shown.

[0150] like Figure 5h As shown, a pop-up dialog box 571 may appear in the user interface 57c. This dialog box 571 may include a prompt message 571a, a "No" control 571b, and a "Yes" control 572c. The prompt message 571a prompts the user: "Return to the second electronic device for input?" The "No" control 571b is used by the third electronic device to refuse the request to switch to the second electronic device for assisted input. The "Yes" control 571c is used by the third electronic device to agree to the request to switch to the second electronic device for assisted input.

[0151] If the third electronic device responds to a user action (such as a click) on the No control 571b, it can continue to provide auxiliary input to the first electronic device. This scenario can be referenced in the following example. Figure 5i The description is as follows. If, in response to a user action on control 571c (such as a click), the third electronic device can cease auxiliary input with the first electronic device, and then the second electronic device can continue auxiliary input with the first electronic device. This scenario can be referenced in the following... Figure 5j and Figure 5k The description.

[0152] When the third electronic device refuses the request to switch to the second electronic device for auxiliary input, such as Figure 5iAs shown, the third electronic device can display user interface 58c to continue acquiring text information and assist the first electronic device in input. The first electronic device can display user interface 56a. The second electronic device continues to display user interface 54b, but its device status remains idle and it cannot assist the first electronic device in input.

[0153] When the third electronic device agrees to the request to switch to the second electronic device for auxiliary input, such as Figure 5j As shown, the first electronic device can display user interface 56a. The third electronic device can display user interface 59c, which is the main interface of the third electronic device. At this time, the device status of the third electronic device switches from input to idle, and the third electronic device cannot assist the first electronic device in input. The second electronic device can display user interface 59b. A prompt box 503 can pop up in the user interface 59b, which prompts the user whether to agree to activate the local input method to assist the first electronic device in input. In response to the user's operation on the agree control in the prompt box 503 (such as a click operation), the first electronic device can send the text information 511b displayed in the input box 501 to the second electronic device. Then, the second electronic device can display as follows: Figure 5k The user interface shown is 510b.

[0154] like Figure 5k As shown, user interface 510b is a user interface used by the second electronic device to assist the first electronic device in input. This user interface 510b can display an input box 5101, which can display text information 511b sent by the first electronic device. The first electronic device can continue to display user interface 56a. The third electronic device can continue to display user interface 59c. At this time, the second electronic device can assist the first electronic device in auxiliary input.

[0155] In this way, the first electronic device can select the auxiliary device with the highest device priority for auxiliary input. This allows the first electronic device to choose a more suitable auxiliary device, improving the efficiency of auxiliary input.

[0156] The following first describes an exemplary communication system 100 obtained by implementing this application.

[0157] Figure 6 This is a schematic diagram of the structure of the communication system 100 provided in the embodiments of this application.

[0158] like Figure 6 As shown, the communication system 100 includes: multiple electronic devices, such as a first electronic device, a second electronic device, a third electronic device, a fourth electronic device, and a server.

[0159] The first electronic device in this application embodiment can be a terminal device running Android, Huawei HarmonyOS, iOS, Microsoft, or other operating systems, and this first electronic device requires other electronic devices to complete information input. For example, a smart screen. The first electronic device can serve as an auxiliary device involved in this application embodiment.

[0160] The second, third, and fourth electronic devices can be terminal devices running Android, Huawei HarmonyOS, iOS, Microsoft, or other operating systems, and can directly input information locally, such as mobile phones and tablets. The second, third, and fourth electronic devices can serve as auxiliary devices in the embodiments of this application.

[0161] All electronic devices in the communication system 100 are equipped with a first APP. The first APP is an input method application. The first APP provides information input functionality. This first APP could be, for example, Huawei's "Input Method". Users can log in to the first APP on their electronic devices using their own identity identifier, which could be, for example, an account (e.g., name, Huawei ID, mobile phone number, etc.) and password, facial image, voiceprint, fingerprint, etc. After logging in to the first APP, users can input information into the first electronic device through the first APP.

[0162] Servers are used to provide various services to electronic devices, such as connectivity services and communication services (data transmission, etc.).

[0163] Electronic devices can access servers by connecting to the Internet. Electronic devices can communicate with servers through cellular mobile communication technologies such as 3G, 4G, and 5G, wide area network (WAN) technology, local area network (LAN) technology, or wireless LAN (WLAN) technology.

[0164] The following describes an exemplary first electronic device provided in the embodiments of this application.

[0165] Figure 7 This is a schematic diagram of the hardware structure of the first electronic device provided in the embodiments of this application.

[0166] The following description uses a first electronic device as an example to illustrate the embodiments. It should be understood that the first electronic device may have more or fewer components than shown in the figures, may combine two or more components, or may have different component configurations. The various components shown in the figures can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0167] The first electronic device may include: a processor 122, a memory 123, a wireless communication processing module 124, a power switch 125, a wired LAN communication processing module 126, a USB communication processing module 127, and a display screen 128. Wherein:

[0168] Processor 122 can be used to read and execute computer-readable instructions. In a specific implementation, processor 122 mainly includes a controller, an arithmetic logic unit (ALU), and registers. The controller is primarily responsible for instruction decoding and issuing control signals for the operations corresponding to the instructions. The ALU is primarily responsible for performing fixed-point or floating-point arithmetic operations, shift operations, and logical operations, and can also perform address operations and translations. Registers are primarily responsible for storing register operands and intermediate operation results temporarily stored during instruction execution. In a specific implementation, the hardware architecture of processor 122 can be an application-specific integrated circuit (ASIC) architecture, a MIPS architecture, an ARM architecture, or an NP architecture, etc.

[0169] In some embodiments, the processor 122 can be used to parse signals received by the wireless communication processing module 124 and / or the wired LAN communication processing module 126, such as video call requests, image sequence acquisition requests, video stream processing requests (3D noise reduction, encoding / decoding, etc.), video stream transmission requests, and video stream playback requests sent by the first electronic device. The processor 122 can be used to perform corresponding processing operations based on the parsing results, such as driving the camera to acquire images according to the video call request, or driving the display screen 128 to display according to the display request or display instruction.

[0170] In some embodiments, the processor 122 can also be used to generate signals sent out by the wireless communication processing module 124 and / or the wired LAN communication processing module 126, such as a video call activation signal, a parameter negotiation signal, etc.

[0171] Memory 123 is coupled to processor 122 and is used to store various software programs and / or multiple sets of instructions. In specific implementations, memory 123 may include high-speed random access memory and may also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 123 may store an operating system, such as an embedded operating system like a real-time multi-tasking operating system (uCOS). Memory 123 may also store auxiliary input programs that can be used to provide auxiliary input to the assisted device.

[0172] The wireless communication processing module 124 may include one or more of a Bluetooth (BT) communication processing module 124A and a WLAN communication processing module 124B, for establishing a wireless communication connection with a server that provides instant messaging services.

[0173] The wireless communication processing module 124 can be used to send text information to other electronic devices. For example, the first electronic device can send text information to the second electronic device and the third electronic device through the wireless communication processing module.

[0174] The wireless communication processing module 124 is also used to receive text messages sent by other electronic devices. For example, the first electronic device can receive text messages sent by the second electronic device and the third electronic device.

[0175] The power switch 125 can be used to control the power supply to the first electronic device.

[0176] The wired LAN communication processing module 126 can be used to communicate with other electronic devices in the same LAN via a wired LAN, and can also be used to connect to a WAN via a wired LAN to communicate with devices in the WAN.

[0177] The USB communication processing module 127 can be used to communicate with other devices via a USB interface (not shown).

[0178] The display screen 128 can be used for text information, images, etc. The display screen 128 can be a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, an active-matrix organic light-emitting diode (AMOLED) display, a flexible light-emitting diode (FLED) display, a quantum dot light-emitting diode (QLED) display, etc.

[0179] In this embodiment of the application, the processor 122 can call computer instructions stored in the internal memory 123 to cause the first electronic device to execute the auxiliary input method in this embodiment of the application.

[0180] The following describes an exemplary second electronic device provided in the embodiments of this application.

[0181] Figure 8 This is a schematic diagram of the hardware structure of the second electronic device provided in the embodiments of this application.

[0182] The following description uses a second electronic device as an example to illustrate the embodiment. It should be understood that the second electronic device may have more or fewer components than shown in the figures, may combine two or more components, or may have different component configurations. The various components shown in the figures can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0183] It should be understood that auxiliary devices such as the third and fourth electronic devices can have the same structure as the second electronic device.

[0184] The second electronic device may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0185] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0186] The controller can serve as the nerve center and command center of the second electronic device. The controller can generate operation control signals based on the instruction opcode and timing signals to control the fetching and execution of instructions.

[0187] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0188] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0189] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the second electronic device can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0190] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to a second electronic device. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0191] The wireless communication module 160 can provide solutions for wireless communication applications in a second electronic device, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0192] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of the second electronic device by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, applications required for at least one function (such as facial recognition, fingerprint recognition, mobile payment, etc.), etc. The data storage area may store data created during the use of the second electronic device (such as facial information template data, fingerprint information templates, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0193] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. A second electronic device determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, the second electronic device detects the intensity of the touch operation based on pressure sensor 180A. The second electronic device can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0194] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of a second electronic device, in a different position than display screen 194.

[0195] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. The second electronic device can receive button input and generate key signal inputs related to user settings and function control of the second electronic device.

[0196] In this embodiment, the processor 110 can call computer instructions stored in the internal memory 121 to cause the second electronic device to execute the auxiliary input method in this embodiment.

[0197] The method in the embodiments of this application will be described in detail below with reference to the above-described hardware structure diagrams of the exemplary first electronic device and the second electronic device:

[0198] Application Scenario 1: Because the second electronic device is the highest priority auxiliary device in the device group and its status is idle, the first electronic device will first assist with input. Then, after the second electronic device starts the call process, when it can no longer assist the first electronic device with input, the first electronic device will send the text information in the input box to the third electronic device, which has the second device priority and its status is idle, and then assist with input with the third electronic device.

[0199] Figure 9 This is a signaling interaction diagram of application scenario 1 in the embodiments of this application.

[0200] Figure 10 A schematic diagram of an interactive information flow in application scenario 1 is shown.

[0201] like Figure 10 The diagram illustrates the information flow between the software modules of a first electronic device, a second electronic device, and a third electronic device. The software modules of the first electronic device may include: an input box management module 911, an input method framework service module 912, and a multi-device data transmission service module 913. The input method framework service module 912 includes an input management module 912a and a device group status management module 912b. The second electronic device may include an input box management module 921, an auxiliary input module 922, and a multi-device data transmission service module 923. The auxiliary input module 922 includes an input management module 922a and a status information management module 922b. The third electronic device may include an input box management module 931, an auxiliary input module 932, and a multi-device data transmission service module 933. The auxiliary input module 932 includes an input management module 932a and a status information management module 932b.

[0202] Understandable, Figure 10 The software modules shown are only a portion of those in the first, second, and third electronic devices, and should not be construed as limiting their software architecture.

[0203] The process of Scenario 1 is as follows Figure 9 As shown, the process includes steps S101-S1024, which will be discussed below. Figure 10 The interactive information flow diagram shown below provides a detailed description of steps S101-S1024:

[0204] S101. The first electronic device, the second electronic device, and the third electronic device form a device group;

[0205] Once the first electronic device, the second electronic device, and the third electronic device have completed the input method collaboration, a device group is established.

[0206] Specifically, firstly, the first, second, and third electronic devices form a distributed collaborative scenario through network connections. Then, the first and second electronic devices collaborate on input methods. Specifically, the input management module 912a in the input method framework service module 912 of the first electronic device can send an input method collaboration request to its local multi-device data transmission service module 913. The multi-device data transmission service module 913 can then forward this request to the multi-device data transmission service module 923 of the second electronic device. This request inquires whether the second electronic device should collaborate with the first electronic device's input method to input the same information. Then, the multi-device data transmission service module 923 of the second electronic device can forward this request to the input management module 922a in its local auxiliary input module 922. The input management module 922a of the second electronic device can then send a response indicating collaboration with the first electronic device to its local multi-device data transmission service module 923. The multi-device data transmission service module 923 can then forward this response to the multi-device data transmission service module 913 of the first electronic device, which in turn forwards the request to the input management module 912a of the first electronic device. In this way, the first electronic device and the second electronic device completed the input method collaboration.

[0207] It is understandable that the first electronic device can also work with the third electronic device to coordinate the input method. This process can be referred to the above description and will not be repeated here.

[0208] S102. The first electronic device sets the device priority for the second and third electronic devices;

[0209] Specifically, the input management module 912a of the first electronic device can set the device priority of the electronic devices in the device group. Then, the set device priority is sent to the device group status management module 912b in the input method framework module 912, which can set the priority of the electronic device in the device priority information to the corresponding device priority.

[0210] In some embodiments, a user can directly select the priority of electronic devices in a device group. For example, in response to a user setting a second electronic device to a first device priority, the first electronic device can set the device priority of the second electronic device to the first device priority.

[0211] In some embodiments, a first electronic device can set the device priority of other electronic devices in a device group based on the strength of their network signals. Then, the device priority of the first electronic device is set to the lowest priority; for example, the electronic device can set the electronic device with the strongest network signal as the first device priority.

[0212] In other embodiments, the first electronic device can set the priority of other electronic devices in the device group based on the strength of the network signal of the electronic devices in the device group, without setting the device priority of its own device.

[0213] It is understood that there are other ways to set device priority, and this application embodiment does not limit this.

[0214] For example, in one implementation, if MEID is used as the unique identifier of the electronic device in the device priority information, and the first device priority is recorded as "1", the second device priority as "2", and so on, then the device priority information can be represented as:

[0215] Identification of electronic devices Device priority IMEI of the second electronic device 1 IMEI of a third electronic device 2

[0216] Table 3

[0217] From the device priority information shown in Table 3, it can be determined that the first electronic device sets the device priority of the second electronic device to the first device priority, sets the device priority of the third electronic device to the second device priority, and does not set the device priority of its own device.

[0218] S103. The first electronic device determines the focus input box;

[0219] A focus input field is an input field used by the assistive device to display information. This information may include information sent by the assistive device and information entered locally.

[0220] In response to a user's selection of an input box on the first electronic device (such as a click operation), the input box management module 911 of the first electronic device can set the input box as the focus input box.

[0221] This process can be referenced. Figure 5a The description of the user interface 50a of the first electronic device and Figure 5b The description of the user interface 51a of the first electronic device is omitted here.

[0222] S104. The second electronic device notifies the first electronic device that its device status is idle;

[0223] When the second electronic device can provide auxiliary input to the first electronic device, but does not provide auxiliary input to the first electronic device, the second electronic device can set its own device status to idle and then send the device status to the first electronic device.

[0224] Specifically, the status information management module 922b of the second electronic device can set the device status to idle. Then, it sends the device status to the multi-device data transmission service module 923 of the local device.

[0225] The multi-device data transmission service module 923 of the second electronic device can send the device status of the local device to the multi-device data transmission service module 913 of the first electronic device.

[0226] S105. The device status of the second electronic device is set to idle in the device status information updated by the first electronic device;

[0227] Specifically, the multi-device data transmission service module 913 of the first electronic device can send the device status of the second electronic device to the device group status management module 912b of the local device. The device group status management module 912b can update the device status of the second electronic device from the initial device status of busy to idle in the device status information.

[0228] At this time, the device status of the second electronic device in the device group is idle, while the device status of the third electronic device can still be the initial device status, i.e., busy.

[0229] For example, in one implementation, if MEID is used as the unique identifier of the electronic device in the device priority information, then the device status information can be represented as:

[0230] Identification of electronic devices Device priority IMEI of the second electronic device idle IMEI of a third electronic device Busy

[0231] Table 4

[0232] S106. The first electronic device sends an auxiliary input request to the second electronic device;

[0233] When the first electronic device does not perform auxiliary input with any auxiliary device in the device group, the first electronic device can select the auxiliary device with the highest priority among the auxiliary devices in the device group whose device status is idle to perform auxiliary input. Therefore, here, the first electronic device selects the second electronic device to perform auxiliary input.

[0234] In response to a user's selection of an input field on a first electronic device (such as a click), the first electronic device may send an auxiliary input request to a second electronic device.

[0235] Specifically, the input management module 912a of the first electronic device can obtain device priority information and device status information through the device group status management module 912b to determine that the second electronic device is the highest priority auxiliary device among the auxiliary devices whose device status is idle. Then, the input management module 912a can send the identifier of the second electronic device and the auxiliary input request to the local multi-device data transmission service module 913.

[0236] The multi-device data transmission service module 913 of the first electronic device can send an auxiliary input request to the multi-device data transmission service module 923 of the second electronic device according to the identifier of the second electronic device.

[0237] In some embodiments, after receiving the auxiliary input request, the second electronic device may display, as shown below. Figure 5a The user interface 50b of the second electronic device is described in the preceding description and will not be repeated here.

[0238] S107. The second electronic device activates the input method;

[0239] Specifically, the multi-device data transmission service module 923 of the second electronic device can send the auxiliary input request to the local input management module 922a, which can activate the input method of the second electronic device.

[0240] In some embodiments, the second electronic device can invoke a user interface of the local input method with reference to the foregoing. Figure 5b The description of the user interface 51b of the second electronic device is omitted here.

[0241] S108. The second electronic device notifies the first electronic device that its device status is "in input".

[0242] Optionally, when the second electronic device can provide auxiliary input to the first electronic device, the second electronic device can set its own device status to "input in progress" and then send that device status to the first electronic device.

[0243] It is understood that the process involved in step S108 is similar to that in step S104 above. Please refer to the description of step S104 above, and it will not be repeated here.

[0244] S109. In the device status information update of the first electronic device, the device status of the second electronic device is "in input";

[0245] It is understood that the process involved in step S109 is similar to that in step S105 above. Please refer to the description of step S105 above, and it will not be repeated here.

[0246] For example, in one implementation, if MEID is used as the unique identifier of the electronic device in the device priority information, then the device status information can be represented as:

[0247] Identification of electronic devices Device priority IMEI of the second electronic device Inputting IMEI of a third electronic device Busy

[0248] Table 5

[0249] As shown in Table 5, at this time, the device status of the second electronic device in the device group is "in input", and the device status of the third electronic device can still be "initialization device status", i.e., "busy".

[0250] In some embodiments, step S108 may be omitted. When the first electronic device determines that it is performing auxiliary input with the second electronic device, the first electronic device may directly set the status information of the second electronic device in the device status information to "input in progress".

[0251] S1010. The second electronic device acquires the first information;

[0252] In some embodiments, the first information is all the information displayed in the input box of the second electronic device.

[0253] In response to a user inputting first information, which may be text, into the keyboard of a second electronic device, the second electronic device can acquire the first information and then display it in its input box.

[0254] Specifically, the input box management module 922a of the second electronic device can obtain the first information and then display the first information in the input box of the device.

[0255] In some embodiments, the process may refer to the foregoing. Figure 5b as well as Figure 5c The description of the user interface of the second electronic device is omitted here.

[0256] S1011. The second electronic device sends the first information to the first electronic device;

[0257] Specifically, the input box management module 922a of the second electronic device can send the first information to the input management module 922a of the local device, and then the input management module 922a can send the first information to the multi-device data transmission service module 923 of the local device. Then the multi-device data transmission service module 923 can send the first information to the multi-device data transmission service module 913 of the first electronic device.

[0258] S1012. The first electronic device displays the first information in the focus input box;

[0259] Specifically, the multi-device data transmission service module 913 of the first electronic device can send the first information to the input management module 912a of the local device. Then, the input management module 912a can send the information to the input box management module 911 of the local device, and the input box management module 911 can display the information in the focus input box.

[0260] In some embodiments, an exemplary user interface for this process may refer to the foregoing. Figure 5c The description of the user interface 52a of the first electronic device is omitted here.

[0261] S1013. The second electronic device initiates the call process;

[0262] In some embodiments, the process can be as described above. Figures 5d-5f The description of the user interface of the second electronic device is omitted here.

[0263] S1014. The second electronic device notifies the first electronic device that its device status is busy;

[0264] At this time, the second electronic device cannot provide auxiliary input to the first electronic device. The second electronic device can set its own device status to busy and then send the device status to the first electronic device.

[0265] It is understood that the process involved in step S1014 is similar to that in step S104 above. Please refer to the description of step S104 above, and it will not be repeated here.

[0266] S1015. The device status of the second electronic device is busy in the updated device status information of the first electronic device;

[0267] It is understood that the process involved in step S1015 is similar to that in step S105 above. Please refer to the description of step S105 above, and it will not be repeated here.

[0268] For example, in one implementation, if MEID is used as the unique identifier of the electronic device in the device priority information, then the device status information can be represented as:

[0269]

[0270]

[0271] Table 6

[0272] As shown in Table 6, at this time, the device status of the second electronic device in the device group is busy, while the device status of the third electronic device can still be the initialization device status, i.e., busy.

[0273] S1016. The first electronic device deletes the information of the second electronic device from the device status information;

[0274] Optionally, when the device status of the second electronic device is updated to busy from the input, the first electronic device can be triggered to delete the information of the second electronic device from the device status information.

[0275] Specifically, the device group status management module 912b of the first electronic device can delete the status information of the second electronic device from the device status information.

[0276] S1017. The third electronic device notifies the first electronic device that its device status is idle;

[0277] When the third electronic device can provide auxiliary input to the first electronic device, but does not provide auxiliary input to the first electronic device, the third electronic device can set its own device status to idle and then send the device status to the first electronic device.

[0278] Specifically, the status information management module 932b in the auxiliary input module 932 of the third electronic device can set the device status of the local device to idle. Then, it sends the device status to the local multi-device data transmission service module 933.

[0279] The multi-device data transmission service module 933 of the third electronic device can send the device status of the local device to the multi-device data transmission service module 913 of the first electronic device.

[0280] S1018. The device status of the third electronic device is set to idle in the device status information updated by the first electronic device;

[0281] It is understood that the process involved in step S1018 is similar to that in step S105 above. Please refer to the description of step S105 above, and it will not be repeated here.

[0282] If the first electronic device executes step S1016, then the device status information can be represented as follows:

[0283] Identification of electronic devices Device priority IMEI of a third electronic device idle

[0284] Table 7

[0285] As shown in Table 7, at this time, the information of the second electronic device in the device group has been deleted, and the device status of the third electronic device has been updated from busy to idle.

[0286] S1019. The first electronic device sends an auxiliary input request to the third electronic device;

[0287] Specifically, the input management module 912a of the first electronic device can obtain device priority information and device status information through the device group status management module 912b to determine that the third electronic device is the highest priority auxiliary device among the auxiliary devices whose device status is idle. Then, the input management module 912a can send the identifier of the third electronic device and the auxiliary input request to the multi-device data transmission service module 913 of the local machine.

[0288] The multi-device data transmission service module 913 of the first electronic device can send an auxiliary input request to the multi-device data transmission service module 933 of the third electronic device according to the identifier of the third electronic device.

[0289] In some embodiments, after receiving the auxiliary input request, the third electronic device may display, as shown below. Figure 5e The user interface 54c of the third electronic device in the text can be referred to in the corresponding description above, and will not be repeated here.

[0290] S1020. The first electronic device sends the second information to the third electronic device;

[0291] At this point, the second information is all the information displayed in the focus input box. The second information can be the first information or information obtained by processing the first information;

[0292] Specifically, the input management module 912 of the first electronic device can send the second information to the multi-device data transmission service module 913 of the local device, and the multi-device data transmission service module 913 of the first electronic device can then send the second information to the multi-device data transmission service module 933 of the third electronic device.

[0293] It is understood that in some embodiments, if it is assumed that after step S1012, all the information displayed in the focus input box of the first electronic device is still the first information, then the second information is the first information.

[0294] In other embodiments, it is assumed that after step S1012, all the information displayed in the focus input box of the first electronic device may no longer be the first information. Specifically, after the first electronic device processes the first information, such as deleting part of the content in the first information, the second information is a part of the first information. For example, if all the first information is deleted and then other information is newly entered, the second information is the newly entered other information. At this time, the first information and the second information are different.

[0295] S1021. The third electronic device activates the input method and displays the second information;

[0296] Specifically, in some embodiments, the multi-device data transmission service module 933 of the third electronic device can send an auxiliary input request to the local input management module 932a, which can activate the input method of the second electronic device.

[0297] Then, the multi-device data transmission service module 933 of the third electronic device can send the second information to the local input management module 932a, which can then send the second information to the local input box management module 931, which can then display the second information in the input box.

[0298] It is understandable that the process by which the multi-device data transmission service module 933 sends the auxiliary input request and the second information to the local input management module 932a is not sequential.

[0299] In some embodiments, a user interface for this process may refer to the foregoing. Figure 5f The description of the user interface 55c of the third electronic device is omitted here.

[0300] S1022. The third electronic device acquires third information;

[0301] The third information is all the information displayed in the input box of the third electronic device.

[0302] In response to a user's input of text information on the keyboard of a third electronic device, the second electronic device can perform operations such as adding or deleting text information to obtain third information, which is then displayed in its input box.

[0303] Specifically, the input box management module 932a of the third electronic device can obtain the third information and then display the third information in the input box of the local device.

[0304] In some embodiments, the process may refer to the foregoing. Figure 5f as well as Figure 5g The description of the user interface of the third electronic device will not be repeated here.

[0305] S1023. The third electronic device sends a third message to the first electronic device;

[0306] It is understood that the process involved in step S1023 is similar to that in step S1011 above. Please refer to the description of step S1011 above, and it will not be repeated here.

[0307] S1024. The first electronic device displays the third information in the focus input box;

[0308] It is understood that the process involved in step S1024 is similar to that in step S1012 mentioned above. Please refer to the description of step S1012 mentioned above, and it will not be repeated here.

[0309] In some embodiments, an exemplary user interface for this process may refer to the foregoing. Figure 5g The description of the user interface 56a of the first electronic device is omitted here.

[0310] Step S105 can occur after step S104, and step S104 can occur after step S101; step S1018 can occur after step S1017, and step S1017 can occur after step S101; step S109 can occur after step S108; step S1015 can occur after step S1014; step S1016 can be omitted, or if it is to be executed, it can occur after step S1015; there is no specific order between steps S1019 and S1020, and they can be executed simultaneously.

[0311] Application Scenario 2: Combining with Application Scenario 1, assuming that the second electronic device ends the call process at this time, the first electronic device can switch to the second electronic device with the first device priority for auxiliary input, or it can continue to use the third electronic device with the second device priority for auxiliary input.

[0312] Figure 11 This is a signaling interaction diagram for application scenario 2 in this application embodiment.

[0313] In this scenario, the information flow between electronic devices in the device group can be referenced Figure 10 .

[0314] The process of Scenario 2 is as follows Figure 10 As shown, the process includes steps S201-S2013, which will be discussed below. Figure 10 The interactive information flow diagram shown below provides a detailed description of steps S201-S2013:

[0315] S201. The second electronic system terminates the call process;

[0316] In some embodiments, the process can be as described above. Figures 5f-5g The description of the user interface of the second electronic device is omitted here.

[0317] S202. The second electronic device notifies the first electronic device that its device status is idle;

[0318] When the second electronic device can provide auxiliary input to the first electronic device, but does not provide auxiliary input to the first electronic device, the second electronic device can set its own device status to idle and then send the device status to the first electronic device.

[0319] It is understood that the process involved in step S202 is the same as that in step S104 above. Please refer to the description of step S104 above, and it will not be repeated here.

[0320] S203. In the device status information update of the first electronic device, the device status of the second electronic device is set to idle;

[0321] In some embodiments, in step S1016, if the first electronic device deletes the information of the second electronic device from the device status information when the device status of the second electronic device is updated to busy from the input, then the first electronic device needs to first re-add the device status of the second electronic device and initialize it to busy, and then update the device status of the second electronic device to idle.

[0322] In some other embodiments, if step S1016 is not performed, the first electronic device updates the device status of the second electronic device from busy to idle in the device status information.

[0323] It is understandable that the process involved in step S203 can be referred to the previous description, and will not be repeated here.

[0324] For example, in one implementation, if MEID is used as the unique identifier of the electronic device in the device priority information, then the device status information can be represented as:

[0325] Identification of electronic devices Device priority IMEI of the second electronic device idle IMEI of a third electronic device Inputting

[0326] Table 8

[0327] As shown in Table 8, at this time, the device status of the second electronic device in the device group is idle, and the device status of the third electronic device can still be inputting.

[0328] S204. The first electronic device sends an auxiliary input switching request to the third electronic device;

[0329] When there is an idle auxiliary device in the device group, and the device priority of this auxiliary device is higher than that of the auxiliary device currently performing auxiliary input, the first electronic device can send an auxiliary input switching request to the auxiliary device currently performing auxiliary input. This request is used to inquire whether the auxiliary device currently performing auxiliary input should switch to the auxiliary device with the highest device priority among the currently idle auxiliary devices for auxiliary input.

[0330] Since the second electronic device has a higher device priority than the third electronic device, when the device status of the second electronic device is idle, the first electronic device can send an auxiliary input switching request to the third electronic device. This request is used to ask the third electronic device whether to switch to the second electronic device for auxiliary input.

[0331] Specifically, the input management module 912a of the first electronic device can obtain device priority information and device status information through the device group status management module 912b, determine that the second electronic device is the highest priority auxiliary device among the auxiliary devices whose device status is idle, and that the device status of the third electronic device is inputting. Then, the input management module 912a can send the identifier of the third electronic device and the auxiliary input switching request to the local multi-device data transmission service module 913.

[0332] The multi-device data transmission service module 913 of the first electronic device can send an auxiliary input switching request to the multi-device data transmission service module 933 of the third electronic device according to the identifier of the third electronic device.

[0333] S205. The third electronic device determines whether to switch to the second electronic device;

[0334] Specifically, the multi-device data transmission service module 933 of the third electronic device can send the auxiliary input switching request to the local input management module 932a, which can determine whether the third electronic device has switched to the second electronic device.

[0335] In one scenario, in response to the user's consent to switch to a second electronic device, a third electronic device may determine to switch to the second electronic device for auxiliary input.

[0336] In another scenario, in response to the user's refusal to switch to the second electronic device, the third electronic device may determine not to switch to the second electronic device for auxiliary input. In some embodiments, a user interface for this process may refer to the foregoing description of the user interface 57c of the third electronic device in 5h, which will not be repeated here.

[0337] If the third electronic device determines to switch to the second electronic device for auxiliary input, then steps S206-S209 are executed; if the third electronic device determines not to switch to the second electronic device for auxiliary input, then steps S2010-S2013 are executed.

[0338] S206. The third electronic device notifies the first electronic device to switch to the second electronic device for auxiliary input;

[0339] Specifically, the input management module 932a of the third electronic device can send a response indicating that the third electronic device has decided to switch to the second electronic device for auxiliary input to the local multi-device data transmission service module 933. Then, the multi-device data transmission service module 933 can send this response to the multi-device data transmission service module 913 of the first electronic device.

[0340] S207. The first electronic device sends an auxiliary input command to the second electronic device;

[0341] The first electronic device selects to perform auxiliary input with the second electronic device and sends auxiliary input commands to the second electronic device.

[0342] Specifically, the multi-device data transmission service module 913 of the first electronic device can send a response from the third electronic device determining to switch to the second electronic device for auxiliary input to the local input management module 912a. Then, the input management module 912a can send the identifier of the second electronic device and the auxiliary input request to the local multi-device data transmission service module 913.

[0343] The multi-device data transmission service module 913 of the first electronic device can send an auxiliary input request to the multi-device data transmission service module 923 of the second electronic device according to the identifier of the second electronic device.

[0344] In some embodiments, after receiving the auxiliary input request, the second electronic device may display, as shown below. Figure 5j The user interface 59b of the second electronic device is described in the preceding description and will not be repeated here.

[0345] S208. The first electronic device sends a fourth message to the second electronic device;

[0346] The process involved in step S208 is similar to that in step S1020 above. Please refer to the description of step S1020 above, and it will not be repeated here.

[0347] S209. The second electronic device activates the input method and displays the fourth information;

[0348] The process involved in step S209 is similar to that in step S1021 above. Please refer to the description of step S1021 above, and it will not be repeated here.

[0349] In some embodiments, a user interface for this process may refer to the foregoing. Figure 5k The description of the user interface 510b of the second electronic device is omitted here.

[0350] It is understood that, in some embodiments, after step S207 above, after the second electronic device agrees to provide auxiliary input to the first electronic device, the first electronic device may update the device status information to change the device status of the second electronic device from idle to input, and update the device status of the third electronic device from input to idle.

[0351] It is understood that in some embodiments, after step S207 above, if the second electronic device refuses the request for auxiliary input with the first electronic device, the first electronic device may continue to provide auxiliary input with the third electronic device.

[0352] The second electronic device's refusal to provide auxiliary input to the first electronic device may include: timeout failure to respond, meaning that the second electronic device does not respond within a certain period after receiving the assistance request from the first electronic device. In this case, if the first electronic device does not receive a response from the second electronic device within a certain period after sending its own request for auxiliary input, it is considered that the second electronic device has refused to provide auxiliary input. Additionally, it may respond to a user's request to refuse auxiliary input from the electronic device.

[0353] S2010. The third electronic device notifies the first electronic device not to switch to the second electronic device for auxiliary input;

[0354] The first electronic device continues to provide auxiliary input to the third electronic device.

[0355] Specifically, the input management module 932a of the third electronic device can send a response indicating that the third electronic device has determined not to switch to the second electronic device for auxiliary input to the local multi-device data transmission service module 933. Then, the multi-device data transmission service module 933 can send this response to the multi-device data transmission service module 913 of the first electronic device.

[0356] The first electronic device continues to provide auxiliary input to the third electronic device.

[0357] S2011. The third electronic device acquires the fifth information;

[0358] The process involved in step S2011 is similar to that in step S1022 mentioned above. Please refer to the description of step S1022 mentioned above. It will not be repeated here.

[0359] S2012. The third electronic device sends a fifth message to the first electronic device;

[0360] The process involved in step S2012 is similar to that in step S1023 above. Please refer to the description of step S1023 above, and it will not be repeated here.

[0361] S2013. The first electronic device displays the fifth information in the focus input box.

[0362] The process involved in step S2013 is similar to that in step S1024 above. Please refer to the description of step S1024 above, and it will not be repeated here.

[0363] There is no specific order between steps S207 and S208 above, and they can be executed simultaneously.

[0364] It is understandable that in scenarios 1 and 2 above, the information sent by the first electronic device to other electronic devices in the device group is always all the information displayed in the focus input box, which may include the information obtained by the first electronic device when it inputs through its own device.

[0365] It is understood that, in the embodiments of this application, when an electronic device in a device group sends information to other electronic devices in the same device group, such as requests, text messages, or responses, it can carry its own unique identifier, such as the device name, device physical address, mobile equipment identifier (MEID), or international mobile equipment identity (IMEI), or a combination thereof. Alternatively, the device's unique identifier can be sent together with this information to other electronic devices. As long as other electronic devices can recognize that the information comes from the device itself, this application embodiment does not impose any limitations on this.

[0366] Thus, using the auxiliary input method in this embodiment, the assisted device and multiple auxiliary devices form a device group. The assisted device can select the auxiliary device with the highest priority among the idle auxiliary devices in the device group to perform auxiliary input. As long as any auxiliary device in the device group is in input or idle, it can assist the assisted device in input.

[0367] In this embodiment of the application, the second electronic device may also be referred to as the first auxiliary device, and the third electronic device may also be referred to as the second auxiliary device.

[0368] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0369] As used in the above embodiments, depending on the context, the term "when..." can be interpreted as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is interpreted as meaning "if determining...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)".

[0370] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.

[0371] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

Claims

1. An auxiliary input method, characterized in that, include: The assisted device displays the first information sent by the first assisted device in the focus input box; When the assisted device determines that the device status of the first auxiliary device has switched to busy and the device status of the second auxiliary device is idle, the assisted device sends the second information displayed in the focus input box to the second auxiliary device; the second information is the first information or information processed based on the first information; When the device status of the first auxiliary device is not idle, the second auxiliary device is the auxiliary device with the highest device priority among the auxiliary devices in the device group whose device status is idle; The first auxiliary device has a higher device priority than the second auxiliary device. The assisted device displays the third information sent by the second assisted device in the focus input box, wherein the third information is the second information or information obtained by processing the second information; When the device status of the first auxiliary device switches to idle, the assisted device continues to provide auxiliary input with the second auxiliary device or selects the first auxiliary device for auxiliary input.

2. The method according to claim 1, characterized in that, The second information is the first information or information obtained by processing the first information, specifically including: When the assisted electronic device does not process the first information, the first information is the same as the second information; When the first information is processed by the auxiliary electronic device, the first information is different from the second information.

3. The method according to claim 1, characterized in that, Before the assisted device displays the first information sent by the first assisted device in the focus input box, the method further includes: The auxiliary device sends an auxiliary input request to the first auxiliary device.

4. The method according to claim 1, characterized in that, Before the assisted device displays the first information sent by the first assisted device in the focus input box, the method further includes: When the assisted device receives information that the device status of the first auxiliary device is busy, the assisted device updates the device status of the first auxiliary device to busy in the device status information.

5. The method according to claim 1, characterized in that, Before the assisted device sends the second information displayed in the focus input box to the second assisted device, the method further includes: In the updated device status information of the assisted device, the device status of the second assisted device is idle.

6. The method according to claim 1, characterized in that, The assisted device displays the first information sent by the first assisted device in the focus input box, specifically including: The auxiliary device determines the focus input box, which is used to display information. The assisted device receives first information sent by the first auxiliary device, wherein the first information is all the information displayed in the input box of the first auxiliary device; The assisted device displays the first information in the focus input box.

7. The method according to claim 6, characterized in that, The assisted device sends the second information displayed in the focus input box to the second auxiliary device, specifically including: The assisted device sends the second information displayed in the focus input box to the second assisted device, whereby the second information is all the information displayed in the focus input box.

8. The method according to claim 7, characterized in that, After the assisted device sends the second information displayed in the focus input box to the second assisted device, the method further includes: When the assisted device receives information that the device status of the first auxiliary device is idle, the assisted device updates the device status of the first auxiliary device to idle in the device status information; The assisted device sends an auxiliary input switching request to the second auxiliary device; the auxiliary input switching request is used to ask the second auxiliary device whether to switch to the first auxiliary device for auxiliary input; when the device status of the first auxiliary device is idle, the first auxiliary device is the auxiliary device with the highest device priority among the auxiliary devices whose device status is currently idle.

9. The method according to claim 8, characterized in that, The assisted device continues to provide auxiliary input with the second auxiliary device or selects the first auxiliary device for auxiliary input, specifically including: When the assisted device receives information from the second assisted device to switch to the first assisted device for assisted input, it selects the first assisted device for assisted input. When the assisted device receives information from the second auxiliary device indicating that it will not switch to the first auxiliary device for assisted input, the assisted device continues to perform assisted input with the second auxiliary device.

10. The method according to claim 9, characterized in that, After the assisted device selects the first assisted device for assisted input, the method further includes: When the first auxiliary device refuses to provide auxiliary input to the assisted device, the assisted device continues to provide auxiliary input to the second auxiliary device.

11. The method according to claim 10, characterized in that, When the first auxiliary device refuses to provide auxiliary input to the assisted device, the assisted device continues to provide auxiliary input to the second auxiliary device, specifically including: If the first auxiliary device does not respond within a certain period of time after receiving the assistance request from the assisted device, the assisted device continues to provide assistance input with the second auxiliary device.

12. An auxiliary device, characterized in that, The assisted device includes: a memory and one or more processors; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the assisted device to execute: Display the first information sent by the first auxiliary device in the focus input box; When it is determined that the device status of the first auxiliary device has switched to busy and the device status of the second auxiliary device is idle, the second information displayed in the focus input box is sent to the second auxiliary device; the second information is the first information or information processed based on the first information; when the device status of the first auxiliary device is not idle, the second auxiliary device is the auxiliary device with the highest priority among the auxiliary devices with idle device status in the device group; the device priority of the first auxiliary device is higher than the device priority of the second auxiliary device; The third information sent by the second auxiliary device is displayed in the focus input box. The third information is the second information or information obtained by processing the second information. When the device status of the first auxiliary device is switched to idle, continue to perform auxiliary input with the second auxiliary device or select the first auxiliary device for auxiliary input.

13. The assisted device according to claim 12, characterized in that, The one or more processors are specifically used to invoke the computer instructions to cause the assisted device to execute: When the first information is not processed, the first information is the same as the second information; When processing the first information, the first information is different from the second information.

14. The assisted device according to claim 12, characterized in that, Before displaying the first information sent by the first assistive device in the focus input box, the one or more processors are further configured to invoke the computer instructions to cause the assisted device to execute: Send an auxiliary input request to the first auxiliary device.

15. The assisted device according to claim 12, characterized in that, Before displaying the first information sent by the first assistive device in the focus input box, the one or more processors are further configured to invoke the computer instructions to cause the assisted device to execute: When the device status of the first auxiliary device is received as busy, the device status of the first auxiliary device is updated to busy in the device status information.

16. The assisted device according to claim 12, characterized in that, Before sending the second information displayed in the focus input box to the second auxiliary device, the one or more processors are further configured to invoke the computer instructions to cause the assisted device to execute: In the updated device status information, the device status of the second auxiliary device is idle.

17. The assisted device of claim 12, wherein the one or more processors are specifically configured to invoke the computer instructions to cause the assisted device to perform: Determine the focus input box, which is used to display information; Receive first information sent by the first auxiliary device, wherein the first information is all the information displayed in the input box of the first auxiliary device; The first information is displayed in the focus input box.

18. The assisted device according to claim 17, characterized in that, The one or more processors are specifically used to invoke the computer instructions to cause the assisted device to execute: The second information displayed in the focus input box is sent to the second auxiliary device, and the second information is all the information displayed in the focus input box.

19. The assisted device according to any one of claims 12-18, characterized in that, After sending the second information displayed in the focus input box to the second auxiliary device, the one or more processors are further configured to invoke the computer instructions to cause the assisted device to execute: When receiving information that the device status of the first auxiliary device is idle, update the device status of the first auxiliary device to idle in the device status information; A switching request for auxiliary input is sent to the second auxiliary device; the switching request is used to ask the second auxiliary device whether to switch to the first auxiliary device for auxiliary input. When the device status of the first auxiliary device is idle, the first auxiliary device is the auxiliary device with the highest device priority among the auxiliary devices whose current device status is idle.

20. The assisted device of claim 19, wherein the one or more processors are specifically configured to invoke the computer instructions to cause the assisted device to perform: When receiving a message from the second auxiliary device to switch to the first auxiliary device for auxiliary input, select the first auxiliary device for auxiliary input; When the system receives a message from the second auxiliary device indicating that it will not switch to the first auxiliary device for auxiliary input, it continues to perform auxiliary input with the second auxiliary device.

21. The assisted device according to claim 20, characterized in that, After selecting the first assistive device for assistive input, the one or more processors are further configured to invoke the computer instructions to cause the assisted device to execute: When the first auxiliary device refuses to provide auxiliary input to the assisted device, it continues to provide auxiliary input to the second auxiliary device.

22. The assisted device according to claim 21, characterized in that, The one or more processors are specifically used to invoke the computer instructions to cause the assisted device to execute: If the first auxiliary device does not respond within a certain period of time after receiving the assistance request from the assisted device, it continues to provide assistance input with the second auxiliary device.

23. An auxiliary input method, characterized in that, include: The first auxiliary device sends the first information to the assisted device; The first information is all the information displayed in the input box of the first auxiliary device; The assisted device displays the first information sent by the first assisted device in the focus input box; When the assisted device determines that the device status of the first auxiliary device has switched to busy and the device status of the second auxiliary device is idle, the assisted device sends the second information displayed in the focus input box to the second auxiliary device; the second information is the first information or information processed based on the first information; When the device status of the first auxiliary device is not idle, the second auxiliary device is the auxiliary device with the highest device priority among the auxiliary devices in the device group whose device status is idle; The first auxiliary device has a higher device priority than the second auxiliary device. The assisted device displays the third information sent by the second assisted device in the focus input box, wherein the third information is the second information or information obtained by processing the second information; When the device status of the first auxiliary device switches to idle, the assisted device continues to provide auxiliary input with the second auxiliary device or selects the first auxiliary device for auxiliary input.

24. A system, characterized in that, The system includes: a assisted device, a first auxiliary device, and a second auxiliary device; the assisted device, the first auxiliary device, and the second auxiliary device each include: a memory and one or more processors; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors invoke the computer instructions to cause the assisted device, the first auxiliary device, and the second auxiliary device to execute: The first auxiliary device sends first information to the assisted device; the first information is all the information displayed in the input box of the first auxiliary device. The assisted device displays the first information sent by the first assisted device in the focus input box; When the assisted device determines that the device status of the first auxiliary device has switched to busy and the device status of the second auxiliary device is idle, the assisted device sends the second information displayed in the focus input box to the second auxiliary device; the second information is the first information or information processed based on the first information; when the device status of the first auxiliary device is not idle, the second auxiliary device is the auxiliary device with the highest device priority among the auxiliary devices with idle device status in the device group; the device priority of the first auxiliary device is higher than the device priority of the second auxiliary device; The assisted device displays the third information sent by the second assisted device in the focus input box, wherein the third information is the second information or information obtained by processing the second information; When the device status of the first auxiliary device switches to idle, the assisted device continues to provide auxiliary input with the second auxiliary device or selects the first auxiliary device for auxiliary input.

25. A chip system applied to an electronic device, the chip system comprising one or more processors, the processors being configured to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1-11.

26. A computer program product containing instructions, characterized in that, When the computer program product is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 1-11.

27. A computer-readable storage medium comprising instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the method as described in any one of claims 1-11.

Images