A cross-device input method, device and system

Abstract

The application discloses a cross-device input method, device and system, relates to the technical field of electronic, and can improve the convenience and efficiency when cross-device input. The scheme can initiate remote input to a target device (such as a large-screen device) based on a single device (such as a first device), without causing interference to other strong input capability devices. Further, for the case that the display interface of the target device includes multiple edit boxes, the method can realize arbitrary switching of the focus box through the single device, and the operation is simple and the user experience is good.

Description

Technical Field

[0001] This application relates to the field of electronic technology, and in particular to a cross-device input method, device, and system. Background Technology

[0002] More and more electronic devices can connect to the network and accept user input for searching or input. For example, a television can connect to a home network, receive program names entered by the user in the search box, search for the corresponding program through the home network, and play it. Usually, the program names received by the television are entered by the user in the search box using the remote control.

[0003] In some examples, such as Figure 1 As shown, TV 01 can receive input from the user via the directional keys (such as...) on remote control 02. Figure 1 As shown in A, B, C, or D), control the cursor on the TV 01 to move on the input keyboard (e.g., ...). Figure 1 The movement on E) as shown allows the program name to be entered into the search box F. In other examples, such as Figure 1 As shown, the television 01 can receive input from the user via the keyboard of the remote control 02 (e.g., ...). Figure 1 As shown in G), the program name is entered in the search box F. However, the method of entering the program name in the search box using the remote control is cumbersome and inconvenient. Summary of the Invention

[0004] This application provides a cross-device input method, device, and system that enables arbitrary switching of the focus box based on a single device during cross-device input, and is simple to operate.

[0005] To achieve the above objectives, the embodiments of this application adopt the following technical solutions:

[0006] In a first aspect, a cross-device input method is provided, comprising: in response to receiving an operation from a user to enable a remote input function, a first device determining a target device based on interface information of one or more second devices; the first device establishing a wireless connection with the target device for transmitting user input information sent by the first device to the target device; and the first device displaying a remote input interface including an input box and at least one option, the at least one option being used to adjust a focus box on the target device. The target device is one of the aforementioned one or more second devices, and the interface of the target device includes one or more edit boxes.

[0007] The solution provided in the first aspect above allows for remote input to a target device (such as a large-screen device) from a single device (such as the first device) without interfering with other devices with strong input capabilities. Furthermore, when the target device's display interface includes multiple editing boxes, this method allows for arbitrary switching of the focus box using a single device, resulting in simple operation and a superior user experience.

[0008] In one possible implementation, the first device determines the target device based on the interface information of one or more second devices, including: the first device displays device information based on the interface information of multiple second devices. Among the multiple second devices, multiple devices have edit boxes on their interfaces, and the device information includes identification information of one or more second devices whose interfaces have edit boxes. The first device determines the target device based on the user's selection operation on the identification information in the device information. As one implementation, the first device can display the identification information of multiple second devices to the user so that the user can select the target device. Through the above-mentioned user interface (UI) interaction, a more user-friendly service can be provided, improving the user experience.

[0009] In one possible implementation, if only one of the aforementioned one or more second devices has an edit box on its interface, then the first device determines that the device with the edit box is the target device. As one implementation, the first device can automatically determine the target device based on whether one or more second devices have an edit box on their interfaces. For example, if only one second device has an edit box, that device is directly determined to be the target device. This solution simplifies cross-device input operations, improves the efficiency of cross-device input, and enhances the user experience.

[0010] In one possible implementation, the method further includes: a first device receiving information entered by a user in the input box; the first device sending the information entered by the user in the input box to a target device, wherein the information entered by the user in the input box is used to fill the default focus box of the target device. Alternatively, the first device can directly enter corresponding information into the default focus box of the target device based on the information entered by the user in the input box used for cross-device input. This approach can improve the user experience during cross-device input.

[0011] In one possible implementation, the method further includes: a first device responding to receiving an operation from a user selecting any one of the at least one options; the first device determining the switched focus box; and the first device sending focus box switching information to the target device. The focus box switching information includes the identification information of the switched focus box. Alternatively, the first device may switch the focus box accordingly based on the user's operation to switch the focus box on the target device. This approach simplifies the focus box switching process and operation during cross-device input, improves the efficiency of cross-device input, and enhances the user experience.

[0012] In one possible implementation, the first device determines the focus box after switching, including: the first device determines the focus box based on edit box information; the edit box information includes the priority of multiple edit boxes. As one implementation, the focus box can be switched based on the priority of the edit boxes. This approach prioritizes cross-device input for edit boxes with higher importance, improving the user experience.

[0013] In one possible implementation, the target device's interface includes multiple edit boxes; the method further includes: a first device receiving position information of the multiple edit boxes from the target device; and the first device determining the priority of the multiple edit boxes based on their position information. As one implementation, the focus box can be switched based on its position information. This solution conforms to user habits, such as the user's habit of inputting text into edit boxes across devices in a top-to-bottom, left-to-right order, thus improving the user experience.

[0014] In one possible implementation, the method further includes: the first device receiving edit box information from the target device. As one implementation, the first device can obtain edit box information from the target device, such as the priority or position information of the edit box, to improve the accuracy of the information used for focus box switching.

[0015] In one possible implementation, the at least one of the above options includes at least one of an option for switching to the next edit box or an option for switching to the previous edit box. As one implementation, the first device can provide options for switching to the next and / or previous focus box, allowing the user to switch focus boxes as needed, thereby improving the user experience.

[0016] In one possible implementation, at least one of the above options includes an option for switching across editing boxes. As one implementation, the first device can provide an option for switching across editing boxes, allowing the user to switch focus boxes as needed, thereby improving the user experience.

[0017] In one possible implementation, the aforementioned wireless connection is a peer-to-peer (P2P) connection. As an alternative, the method provided in this application is applicable to P2P network architectures, which can improve the applicability and compatibility of the method with different network architectures.

[0018] In one possible implementation, the aforementioned wireless connection is based on the Remote Procedure Call (RPC) protocol. As a possibility, the method provided in this application is applicable to RPC-based wireless connections, which can improve the applicability and compatibility of the method with different communication protocols.

[0019] Secondly, a cross-device input method is provided, applied to a target device. The method includes: after establishing a wireless connection with a first device, the target device determines a default focus box. The wireless connection is used by the first device to send user-input information to the target device. The target device receives the information sent by the first device via the wireless connection and fills the default focus box with the information. It should be understood that the target device is one of one or more second devices.

[0020] The solution provided in the second aspect above allows the target device (such as a large-screen device) to establish a wireless connection with the first device for cross-device input. The target device then receives remote input from the first device through this established wireless connection. In this method, the establishment of the wireless connection does not interfere with other devices with strong input capabilities, making it simple to operate and providing a superior user experience.

[0021] In one possible implementation, the method further includes: the target device receiving focus frame switching information from the first device, the focus frame switching information including the focus frame's identification information; and the target device switching the focus frame to the edit box corresponding to the identification information. As one implementation, for example, if the target device's display interface includes multiple edit boxes, arbitrary switching of the focus frame can be achieved through a single device, resulting in simple operation and a good user experience.

[0022] In one possible implementation, the default focus box is the first edit box on the target device's interface; or, the default focus box is the edit box with the highest priority on the target device's interface. One implementation approach is to determine the default focus box based on the priority of the edit boxes. This approach prioritizes cross-device input for more important edit boxes, improving the user experience. Another implementation approach is to determine the default focus box based on the position information of the edit boxes. This approach aligns with user habits, such as accommodating users' habit of inputting edit boxes across devices from top to bottom and left to right, thus improving the user experience.

[0023] In one possible implementation, the interface of the target device includes multiple edit boxes; the method further includes: the target device sending position information of the multiple edit boxes to the first device; or, the target device sending the priority of the multiple edit boxes to the first device. As one implementation, the first device can obtain edit box information, such as the priority or position information of the edit boxes, from the target device to improve the accuracy of the information used for focus box switching.

[0024] In one possible implementation, the aforementioned wireless connection is a peer-to-peer (P2P) connection. As one possibility, the method provided in this application is applicable to P2P network architectures, which can improve the applicability and compatibility of the method with different network architectures.

[0025] In one possible implementation, the aforementioned wireless connection is based on the RPC protocol. As another possibility, the method provided in this application is applicable to RPC-based wireless connections, which can improve the applicability and compatibility of the method with different communication protocols.

[0026] Thirdly, a first device is provided, comprising: a processing unit configured to: in response to receiving an operation from a user to enable a remote input function, determine a target device based on interface information of one or more second devices; and establish a wireless connection with the target device for transmitting user input information sent by the first device to the target device; and a display unit configured to: display a remote input interface, the remote input interface including an input box and at least one option, the at least one option being used to adjust a focus box on the target device. The target device is one of the aforementioned one or more second devices, and the interface of the target device includes one or more edit boxes.

[0027] The solution provided in the third aspect above allows for remote input to a target device (such as a large-screen device) from a single device (such as the first device) without interfering with other devices with strong input capabilities. Furthermore, when the target device's display interface includes multiple editing boxes, this method allows for arbitrary switching of the focus box using a single device, resulting in simple operation and a superior user experience.

[0028] In one possible implementation, the processing unit is specifically used to: display device information based on the interface information of multiple second devices; and determine the target device based on the user's selection operation on the identification information in the device information. Here, multiple of the multiple second devices have edit boxes on their interfaces, and the device information includes the identification information of one or more second devices whose interfaces have edit boxes. As one implementation, the first device can display the identification information of multiple second devices to the user, allowing the user to select the target device. Through this UI interaction, a more user-friendly service can be provided, improving the user experience.

[0029] In one possible implementation, if only one of the one or more second devices has an edit box on its interface, the processing unit determines that the device with the edit box is the target device. Alternatively, the first device can automatically determine the target device based on whether one or more second devices have an edit box on their interfaces. For example, if only one second device has an edit box, that device is directly determined to be the target device. This approach simplifies cross-device input operations, improves the efficiency of cross-device input, and enhances the user experience.

[0030] In one possible implementation, the processing unit is further configured to: receive information entered by the user in the input box; and send the information entered by the user in the input box to the target device, wherein the information entered by the user in the input box is used to fill the default focus box of the target device. As another possibility, the first device can directly input corresponding information into the default focus box of the target device based on the information entered by the user in the input box used for cross-device input. This approach can improve the user experience during cross-device input.

[0031] In one possible implementation, the processing unit is further configured to: respond to receiving an operation from a user selecting any one of the at least one options; determine the switched focus box; and send focus box switching information to the target device. The focus box switching information includes the identification information of the switched focus box. As an alternative, the first device switches the focus box accordingly based on the user's operation to switch the focus box of the target device. This approach simplifies the focus box switching process and operation during cross-device input, improves the efficiency of cross-device input, and enhances the user experience.

[0032] In one possible implementation, the processing unit is specifically used to: determine the focus box after switching based on the edit box information; the edit box information includes the priority of multiple edit boxes. As one implementation, the focus box can be switched based on the priority of the edit boxes. This approach prioritizes cross-device input for edit boxes with higher importance, improving the user experience.

[0033] In one possible implementation, the interface of the target device includes multiple edit boxes; the processing unit is further configured to: receive position information of the multiple edit boxes from the target device; and determine the priority of the multiple edit boxes based on the position information. As one implementation, the focus box can be switched based on the position information of the edit boxes. This solution conforms to user habits, such as the user's habit of inputting text into edit boxes across devices in a top-to-bottom, left-to-right order, thus improving the user experience.

[0034] In one possible implementation, the first device further includes a transceiver unit for receiving edit box information from the target device. As one implementation, the first device can obtain edit box information from the target device, such as the priority or position information of the edit box, to improve the accuracy of the information used for focus box switching.

[0035] In one possible implementation, the at least one of the above options includes at least one of an option for switching to the next edit box or an option for switching to the previous edit box. As one implementation, the first device can provide options for switching to the next and / or previous focus box, allowing the user to switch focus boxes as needed, thereby improving the user experience.

[0036] In one possible implementation, at least one of the above options includes an option for switching across editing boxes. As one implementation, the first device can provide an option for switching across editing boxes, allowing the user to switch focus boxes as needed, thereby improving the user experience.

[0037] In one possible implementation, the aforementioned wireless connection is a peer-to-peer (P2P) connection. As one possibility, the method provided in this application is applicable to P2P network architectures, which can improve the applicability and compatibility of the method with different network architectures.

[0038] In one possible implementation, the aforementioned wireless connection is based on the RPC protocol. As another possibility, the method provided in this application is applicable to RPC-based wireless connections, which can improve the applicability and compatibility of the method with different communication protocols.

[0039] Fourthly, a target device is provided, comprising: a processing unit configured to establish a wireless connection with a first device and determine a default focus box. The wireless connection is used by the first device to send user-inputted information to the target device. A transceiver unit is configured to receive information sent by the first device via the wireless connection and fill the default focus box with the information. It should be understood that the target device is one of one or more second devices.

[0040] The solution provided in the fourth aspect above allows the target device (such as a large-screen device) to establish a wireless connection with the first device for cross-device input, and to receive remote input from the first device through this established wireless connection. In this method, the establishment of the wireless connection does not interfere with other devices with strong input capabilities, and the operation is simple, providing a superior user experience.

[0041] In one possible implementation, the transceiver unit is further configured to: receive focus frame switching information from the first device, the focus frame switching information including the identification information of the focus frame; the processing unit is further configured to: switch the focus frame to the edit box corresponding to the identification information. As one implementation, for example, when the target device's display interface includes multiple edit boxes, arbitrary switching of the focus frame can be achieved through a single device, resulting in simple operation and a good user experience.

[0042] In one possible implementation, the default focus box is the first edit box on the target device's interface; or, the default focus box is the edit box with the highest priority on the target device's interface. One implementation approach is to determine the default focus box based on the priority of the edit boxes. This approach prioritizes cross-device input for more important edit boxes, improving the user experience. Another implementation approach is to determine the default focus box based on the position information of the edit boxes. This approach aligns with user habits, such as accommodating users' habit of inputting edit boxes across devices from top to bottom and left to right, thus improving the user experience.

[0043] In one possible implementation, the interface of the target device includes multiple edit boxes; the transceiver unit is further configured to: send position information of the multiple edit boxes to the first device; or, send the priority of the multiple edit boxes to the first device. As one implementation, the first device can obtain edit box information, such as the priority or position information of the edit boxes, from the target device to improve the accuracy of the information used for focus box switching.

[0044] In one possible implementation, the aforementioned wireless connection is a peer-to-peer (P2P) connection. As one possibility, the method provided in this application is applicable to P2P network architectures, which can improve the applicability and compatibility of the method with different network architectures.

[0045] In one possible implementation, the aforementioned wireless connection is based on the RPC protocol. As another possibility, the method provided in this application is applicable to RPC-based wireless connections, which can improve the applicability and compatibility of the method with different communication protocols.

[0046] Fifthly, a first device is provided, the first device comprising: a display screen; one or more processors; one or more memories; the memories storing one or more programs, the one or more programs including instructions that, when executed by the one or more processors, cause the first device to perform the method as described in any one of the first aspects.

[0047] A sixth aspect provides a target device comprising: a display screen; one or more processors; one or more memories; the memories storing one or more programs, the one or more programs including instructions that, when executed by the one or more processors, cause the target device to perform the method as described in any one of the second and second aspects. It should be understood that the target device is one of one or more second devices.

[0048] A seventh aspect provides a cross-device input method, the method comprising: in response to receiving an operation from a user to enable a remote input function, a first device determining a target device based on interface information of one or more second devices, the target device being one of the one or more second devices, the target device having an interface including one or more edit boxes; the first device establishing a wireless connection with the target device, the wireless connection being used to transmit user input information sent by the first device to the target device; the target device determining a default focus box; and the first device displaying a remote input interface, the remote input interface including an input box and at least one option, the at least one option being used to adjust the focus box on the target device. It should be understood that the target device is one of the one or more second devices.

[0049] The solution provided in the seventh aspect above allows for remote input to a target device (such as a large-screen device) from a single device (such as the first device) without interfering with other devices with strong input capabilities. Furthermore, when the target device's display interface includes multiple editing boxes, this method allows for arbitrary switching of the focus box using a single device, resulting in simple operation and a superior user experience.

[0050] In one possible implementation, the method further includes: a first device receiving information entered by a user in an input box; the first device sending the information entered by the user in the input box to a target device, wherein the information entered by the user in the input box is used to fill the default focus box of the target device; and the target device filling the default focus box with the information. Alternatively, the first device can directly enter corresponding information into the default focus box of the target device based on the information entered by the user in an input box used for cross-device input. This approach can improve the user experience during cross-device input.

[0051] In one possible implementation, the method further includes: a first device responding to receiving an operation from a user selecting any one of the at least one options; the first device determining the switched focus box; the first device sending focus box switching information to a target device, the focus box switching information including identification information of the switched focus box; and the target device switching the focus box to the edit box corresponding to the identification information. As another possibility, the first device performs focus box switching based on the user's operation of switching the target device's focus box. This solution simplifies the focus box switching process and operation during cross-device input, improves the efficiency of cross-device input, and enhances the user experience.

[0052] In one possible implementation, the interface of the target device includes multiple edit boxes; the method further includes: the target device sending position information of the multiple edit boxes to the first device; or, the target device sending the priorities of the multiple edit boxes to the first device. As one implementation, the first device can obtain edit box information, such as the priority or position information of the edit boxes, from the target device to improve the accuracy of the information used for focus box switching.

[0053] Eighthly, a communication system is provided, comprising: a first device as described in any possible implementation of the third or fifth aspect, and a target device as described in any possible implementation of the fourth or sixth aspect. It should be understood that the target device is one of one or more second devices.

[0054] Ninth aspect, a computer-readable storage medium is provided that stores computer program code thereon, which, when executed by a processor, causes the processor to implement the method as in any possible implementation of the first or second aspect.

[0055] In a tenth aspect, a chip system is provided, comprising a processor and a memory, wherein computer program code is stored in the memory; when executed by the processor, the computer program code causes the processor to implement the methods as described in any possible implementation of the first or second aspect. The chip system may be composed of chips or may include chips and other discrete devices.

[0056] Eleventhly, a computer program product is provided, comprising computer instructions. When the computer instructions are executed on a computer, they cause the computer to implement the method as described in any possible implementation of the first or second aspect. Attached Figure Description

[0057] Figure 1 Here is an example diagram of a cross-device input method;

[0058] Figure 2This is a schematic diagram of the hardware structure of a large-screen device provided in an embodiment of this application;

[0059] Figure 3 A schematic diagram of the hardware structure of a mobile phone provided in an embodiment of this application;

[0060] Figure 4 An example diagram of a cross-device input method provided in an embodiment of this application;

[0061] Figure 5 An example diagram of a cross-device input scenario provided in this application embodiment;

[0062] Figure 6 A structural block diagram of a mobile phone and a large-screen device provided in an embodiment of this application;

[0063] Figure 7 A cross-device input method flow provided in this application embodiment Figure 1 ;

[0064] Figure 8 An example of cross-device input provided in this application embodiment Figure 1 ;

[0065] Figure 9 A cross-device input method flow provided in this application embodiment Figure 2 ;

[0066] Figure 10 A cross-device input method flow provided in this application embodiment Figure 3 ;

[0067] Figure 11 An example of cross-device input provided in this application embodiment Figure 2 ;

[0068] Figure 12 An example of cross-device input provided in this application embodiment Figure 3 ;

[0069] Figure 13 This is a structural block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0070] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0071] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this embodiment, unless otherwise stated, "a plurality of" means two or more.

[0072] This application provides a cross-device input method, which is applied to the process of receiving input from devices with weak input capabilities, such as large-screen devices, from devices with strong input capabilities, such as mobile phones.

[0073] In this embodiment, weak input capability and strong input capability are relative concepts. For example, a television is a device with weak input capability compared to a mobile phone; a mobile phone is a device with strong input capability compared to a smartwatch. The following embodiments of this application use large-screen devices as examples of devices with weak input capability and mobile phones as examples of devices with strong input capability to describe a cross-device input method provided by this application.

[0074] The weak input capability device in this application includes one or more displays. For example, the device may be a television, smart camera, handheld computer, personal digital assistant (PDA), portable multimedia player (PMP), augmented reality (AR) / virtual reality (VR) device, ultra-mobile personal computer (UMPC), smart bracelet, smartwatch, etc. Alternatively, the device may be other types or structures of electronic devices including one or more displays; this application is not limited to these categories.

[0075] Please refer to Figure 2 , Figure 2 Taking a television as an example, a schematic diagram of the hardware structure of a large-screen device is shown. Figure 2As shown, the large-screen device 200 may include: a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a power management module 240, an antenna, a wireless communication module 260, an audio module 270, a speaker 270A, a microphone 270C, a speaker interface 270B, a sensor module 280, buttons 290, an indicator 291, a camera 293, and a display screen 292, etc.

[0076] It is understood that the structure illustrated in this embodiment does not constitute a specific limitation on the large-screen device 200. In other embodiments, the large-screen device 200 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0077] Processor 210 may include one or more processing units, such as application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0078] In this embodiment of the application, the processor 210 may include an auxiliary module (such as... Figure 6 The auxiliary module 2 is shown in (b) of the diagram. This auxiliary module can be used to send interface information to a strong input device (such as a mobile phone), bind to a strong input device (such as a mobile phone), request remote input from a strong input device (such as a mobile phone), receive input from a strong input device (such as a mobile phone), and process focus box switching information from a strong input device (such as a mobile phone).

[0079] The controller can serve as the central nervous system and command center of the large-screen device 200. The controller can retrieve instructions, generate operation control signals, and then execute the commands. In this embodiment, the controller can generate operation control signals based on instructions included in control information from a powerful input device (such as a mobile phone) to complete input in an editing box (such as a search box) on the large-screen device's display screen.

[0080] The processor 210 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. This memory can store instructions or data that the processor 210 has just used or that are used repeatedly. If the processor 210 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 210, and thus improves the efficiency of the system. In some embodiments, the processor 210 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, and / or a USB interface, etc.

[0081] It is understood that the interface connection relationships between the modules illustrated in this embodiment are merely illustrative and do not constitute a structural limitation on the large-screen device 200. In other embodiments, the large-screen device 200 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0082] The power management module 240 is used to connect to a power source. The charging management module 240 can also be connected to the processor 210, internal memory 221, display screen 294, camera 293, and wireless communication module 260, etc. The power management module 241 receives power input and supplies power to the processor 210, internal memory 221, display screen 294, camera 293, and wireless communication module 260, etc. In some embodiments, the power management module 241 can also be located within the processor 210.

[0083] The wireless communication function of the large-screen device 200 can be implemented through an antenna and a wireless communication module 260. The wireless communication module 260 can provide solutions for wireless communication applications on the large-screen device 200, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. In this embodiment, the large-screen device 200 can receive input information from a strong input device (such as a mobile phone) through the antenna and the wireless communication module 260, and then complete the input in the editing box on the large-screen device display screen based on the received input information.

[0084] The wireless communication module 260 can be one or more devices integrating at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via an antenna, performs frequency modulation and filtering of the electromagnetic wave signal, and sends the processed signal to the processor 210. The wireless communication module 260 can also receive signals to be transmitted from the processor 210, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via the antenna. In some embodiments, the antenna of the large-screen device 200 is coupled to the wireless communication module 260, enabling the large-screen device 200 to communicate with networks and other devices via wireless communication technology.

[0085] The large-screen device 200 implements display functions through a GPU, a display screen 292, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 292 and the application processor. The GPU performs mathematical and geometric calculations for graphics rendering. The processor 210 may include one or more GPUs, which execute program instructions to generate or modify display information. The display screen 292 is used to display images, videos, etc., and includes a display panel.

[0086] A digital signal processor (DSP) is used to process digital signals, including digital image signals and other digital signals. For example, when the large-screen device 200 selects a frequency point, the DSP performs Fourier transforms on the frequency energy. A video codec is used to compress or decompress digital video. The large-screen device 200 can support one or more video codecs. Thus, the large-screen device 200 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG 2, MPEG 3, and MPEG 4.

[0087] The external storage interface 220 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the large-screen device 400. The external storage card communicates with the processor 210 through the external storage interface 220 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0088] Internal memory 221 can be used to store computer executable program code, which includes instructions. Processor 210 executes various functional applications and data processing of the large-screen device 200 by running the instructions stored in internal memory 221. For example, in this embodiment, processor 210 can execute instructions stored in internal memory 221, which may include a program storage area and a data storage area.

[0089] The program storage area can store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.). The data storage area can store data created during the use of the large-screen device 200 (such as audio data, phonebook, etc.). Furthermore, the internal memory 221 can include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0090] The large-screen device 200 can implement audio functions through an audio module 270, a speaker 270A, a microphone 270C, a speaker interface 270B, and an application processor. Examples include music playback and recording.

[0091] Understandable, Figure 2 The illustrated structure does not constitute a specific limitation on large-screen devices. It can have more than... Figure 2 The more or fewer components shown can be combined into two or more components, or they can have different component configurations. For example, the large-screen device may also include components such as speakers and remote controls. Figure 2The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing or application-specific integrated circuits.

[0092] For example, the strong input device in this application can be a smartphone, netbook, tablet computer, etc. Alternatively, the strong input device can also be other types or structures of electronic devices, which are not limited in this application.

[0093] Please refer to Figure 3 , Figure 3 Taking a smartphone (hereinafter referred to as a mobile phone) as an example, a schematic diagram of the hardware structure of a strong input device is shown. Figure 3 As shown, the mobile phone 300 may include a processor 310, memory (including an external memory interface 320 and an internal memory 321), a universal serial bus (USB) interface 330, a charging management module 340, a power management module 341, a battery 342, antenna 1, antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, a headphone jack 370D, a sensor module 380, buttons 390, a motor 391, an indicator 392, a camera 393, a display screen 394, and a subscriber identification module (SIM) card interface 395, etc. The sensor module 380 may include a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer, a proximity sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0094] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the mobile phone. In other embodiments of this application, the mobile phone may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0095] Processor 310 may include one or more processing units. For example, processor 310 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a flight controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0096] The processor 310 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. This memory can store instructions or data that the processor 310 has just used or that are used repeatedly. If the processor 310 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 310, and thus improves the efficiency of the system.

[0097] In this embodiment of the application, the processor 310 may include an auxiliary module (such as... Figure 6 The auxiliary module 1 shown in (a) is used to obtain interface information from the large screen device, select the target device, bind to the target device, receive input requests from the target device, control the display screen 394 to display the remote input interface, input to the target device according to the user's input on the remote input interface, and instruct the target device to switch according to the user's operation of changing the focus box on the remote input interface.

[0098] In some embodiments, the processor 310 may include one or more interfaces. Interfaces may include an integrated circuit I2C interface, an integrated circuit built-in audio I2S interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0099] The wireless communication function of a mobile phone can be achieved through antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, modem processor, and baseband processor.

[0100] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the mobile phone can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0101] The mobile communication module 350 can provide solutions for wireless communication applications in mobile phones, including 2G / 3G / 4G / 5G / 6G. The mobile communication module 350 may include at least one filter, switch, power amplifier, low-noise amplifier (LNA), etc. The mobile communication module 350 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 350 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 350 may be housed in the processor 310. In some embodiments, at least some functional modules of the mobile communication module 350 and at least some modules of the processor 310 may be housed in the same device.

[0102] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through audio devices (not limited to speaker 370A, receiver 370B, etc.) or displays images or videos through the display screen 394. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 310 and may be housed in the same device as the mobile communication module 350 or other functional modules.

[0103] The wireless communication module 360 ​​can provide solutions for wireless communication applications in mobile phones, including WLAN (such as Wi-Fi networks), Bluetooth BT, GNSS, FM, NFC, and IR. The wireless communication module 360 ​​can be one or more devices integrating at least one communication processing module. The wireless communication module 360 ​​receives electromagnetic waves via antenna 2, modulates and filters the electromagnetic wave signal, and sends the processed signal to processor 310. The wireless communication module 360 ​​can also receive signals to be transmitted from processor 310, modulate and amplify them, and then convert them into electromagnetic waves for radiation via antenna 2.

[0104] In some embodiments, the mobile phone's antenna 1 is coupled to the mobile communication module 350, and the antenna 2 is coupled to the wireless communication module 360, enabling the mobile phone to communicate with networks and other devices via wireless communication technology.

[0105] The mobile phone implements its display function through a GPU, a display screen 394, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor 310 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0106] The display screen 394 is used to display images, videos, etc. The display screen 394 includes a display panel. In some embodiments, the mobile phone may include one or N displays screens 394, where N is a positive integer greater than 1.

[0107] The mobile phone can achieve shooting functions through the ISP, camera component 393, video codec, GPU, display 394 and application processor.

[0108] The external storage interface 320 can be used to connect an external storage card, such as a Micro SD card, to expand the phone's storage capacity. The external storage card communicates with the processor 310 through the external storage interface 320 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0109] Internal memory 321 can be used to store computer executable program code, which includes instructions. Internal memory 321 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during mobile phone use (such as audio data, phonebook, etc.). Furthermore, internal memory 321 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 310 executes various mobile phone functions and data processing by running instructions stored in internal memory 321 and / or instructions stored in memory located in the processor.

[0110] Mobile phones can achieve audio functions through audio module 370, speaker 370A, receiver 370B, microphone 370C, and application processor. Examples include music playback and recording. For the specific working principles and functions of audio module 370, speaker 370A, receiver 370B, and microphone 370C, please refer to the introduction in general technical documentation.

[0111] Button 390 includes a power button, volume buttons, etc. Button 390 can be a mechanical button or a touch button. The mobile phone can receive button input and generate key signal inputs related to the phone's user settings and function control. For example, in this embodiment, the mobile phone can receive simultaneous pressing of the power button and volume buttons to instruct the target device to switch focus frames.

[0112] For details on the specific working principles and functions of the charging management module 340, power management module 341, motor 391, indicator 392, and SIM card interface 395, please refer to the descriptions in conventional technologies. The embodiments in this application will not be elaborated upon.

[0113] It should be noted that, Figure 3 The hardware modules included in the mobile phone shown are merely illustrative and do not limit the specific structure of the phone. For example, the mobile phone may also include other functional modules.

[0114] As an example, in this embodiment of the application, the large-screen device and the mobile phone can be connected to the same network, such as a home Wi-Fi network. The large-screen device can receive input information from the mobile phone via Wi-Fi, and then complete the input in the editing box (such as the search box) on the large-screen device's display screen based on the received input information.

[0115] For example, the large-screen device 01 can display something like... Figure 4 The search box F is shown. The large-screen device 01 can trigger remote input when it receives an operation from the user moving the input cursor to the search box F using a remote control. The large-screen device 01 sends a broadcast message to one or more devices with strong input capabilities, which then display a remote input confirmation interface so that the user can select the corresponding remote input device. In some examples, after receiving the broadcast message from the large-screen device 01, the device with strong input capabilities can display a pop-up remote input confirmation interface for the user to choose whether to use that device for remote input.

[0116] In some examples, based on, for example Figure 4 When performing cross-device input using the method shown, one or more devices with strong input capabilities that receive the broadcast information may include devices that have established a wireless connection with the large screen device 01 for remote input within a preset time period, and / or devices that have established a distributed network with the large screen device 01, etc., which are not limited in this application.

[0117] Furthermore, in a device with strong input capabilities (such as...) Figure 4 When the mobile phone 04 detects that the user has confirmed the use of the device for remote input, the mobile phone 04 can call the remote input service to display... Figure 4the input interface H as shown. Further, the large-screen device 01 may receive the user's input on Figure 4 the text "hello" edited on the input interface H as shown, input "hello" in the search box F of the large-screen device 01, and further search for programs whose names include "hello" and / or whose names are related to "hello".

[0118] In the example as shown in Figure 4 the illustrated example, the mobile phone 04 may share the input method capability with the large-screen device 01, thereby breaking through the hardware limitation. However, in the example as shown in Figure 4 the illustrated example, when performing cross-device input, the user needs to use both the remote controller and the mobile phone to implement remote input on the large-screen device, which involves a large number of used devices and a complicated operation process.

[0119] In addition, for the case where the display interface of the large-screen device includes multiple edit boxes, when cross-device input is performed based on, for example, Figure 4 the illustrated method, if the edit box is to be switched, the user needs to first use the remote controller to switch the focus frame, so as to retrigger one or more devices with strong input capability to display the remote input confirmation interface. The focus frame refers to the currently active edit box. Further, the user needs to confirm the operation of using the device for remote input on the remote input confirmation interface of a certain device with strong input capability (such as a mobile phone) again, so as to use the device to input information in the switched edit box, which results in frequent device replacement and a cumbersome operation process.

[0120] For example, in the cross-device input scenario for account registration as shown in Figure 5 , it is assumed that 4 edit boxes are displayed on the large-screen device 01, including edit box 1, edit box 2, edit box 3, and edit box 4. Exemplarily, after the user uses the mobile phone 04 to complete the input of the telephone number in the edit box 3 (as shown in Figure 5 in (a)), if the user wants to modify the user name in the edit box 1, the following operations (A) to (D) need to be performed: (A) put down the mobile phone 04 → (B) pick up the remote controller → (C) use the remote controller to switch the focus frame to the edit box 1 → (D) pick up the mobile phone 04 and confirm the use of the device for remote input, and then the user name in the edit box 1 can be modified after the mobile phone 04 displays the input interface (as shown in Figure 5 in (b)).

[0121] Further, when cross-device input is performed based on, for example, Figure 4 or Figure 5 the illustrated method, if the large-screen device 01 sends broadcast information to a plurality of devices with strong input capability, it will cause serious interference to other devices. Further, for the case where a pop-up window of the device displays the remote input confirmation interface, the pop-up window that does not disappear for a long time will cause serious interference to the user, especially for the device currently in use.

[0122] To address the aforementioned issues, embodiments of this application provide a cross-device input method. This method allows remote input from a single device (such as a first device) to a large-screen device (such as a target device) without interfering with other devices possessing strong input capabilities. Furthermore, for large-screen devices with multiple editing boxes on their display interface, this method enables arbitrary switching of the focus box using a single device, simplifying operation.

[0123] like Figure 6 As shown, in the cross-device input process of this application embodiment, the strong input device (such as a mobile phone) and the large-screen device may include an auxiliary module. For example, as... Figure 6 As shown in (a) above, the mobile phone may include an auxiliary module 1. (As...) Figure 6 As shown in (b) above, the large-screen device may include an auxiliary module 2.

[0124] For example, taking a mobile phone and a large-screen device with an Android system including a layered architecture as an example, the operating system of the mobile phone and the large-screen device may include an application layer, an application framework layer, system libraries, an Android runtime, and a kernel layer. Auxiliary module 1 can be located in the application framework layer of the mobile phone operating system; auxiliary module 2 can be located in the application framework layer of the large-screen device operating system. The application framework layer can provide application programming interfaces (APIs) and programming frameworks for applications in the application layer. For a detailed description of the operating system and each layer (such as the application layer, application framework layer, system libraries, Android runtime, and kernel layer of the Android system), please refer to the explanations and descriptions in conventional technology; this application embodiment will not elaborate further.

[0125] The following will, with reference to the accompanying drawings and taking a mobile phone as an example, provide a detailed description of a cross-device input method provided in this application embodiment.

[0126] It is understood that, in this embodiment of the application, assuming a user wishes to remotely input text into an edit box on a large-screen device (i.e., a second device) using a mobile phone (i.e., the first device), the user can initiate remote input on the mobile phone, thereby initiating a connection between the mobile phone and the large-screen device. For example, the user can first enable the remote input function on the mobile phone, and then establish a wireless connection between the mobile phone and the large-screen device for remote input. Specifically, in this embodiment of the application, the wireless connection is specifically used to transmit user-input information sent from the mobile phone (i.e., the first device) to the large-screen device (i.e., the second device).

[0127] like Figure 7 As shown, a cross-device input method provided in this application embodiment may include the following steps S701-S706:

[0128] S701, The mobile phone receives the user's operation to enable the remote input function.

[0129] For example, the operations described above for enabling the remote input function may include, but are not limited to, the operation of the user turning on the remote input switch.

[0130] For example, assuming that a remote input application (hereinafter referred to as "remote input APP") is installed on the mobile phone, the operation to enable the remote input function can be the user opening the remote input APP.

[0131] For example, suppose the remote input app installed on the phone has a remote input switch on its interface. The operation mentioned above to enable the remote input function can be the user's operation of turning on the remote input switch.

[0132] For example, assuming the mobile phone has a remote input setting function, the operation to enable the remote input function can be the user turning on the remote input switch in the remote input settings interface.

[0133] For example, assuming a remote input switch is set in the drop-down menu of a mobile phone, the operation to enable the remote input function described above can be the user's operation of turning on the remote input switch in the drop-down menu.

[0134] It is understood that the above-described operations for enabling remote input function are merely examples, and this application does not limit the specific form of the operations.

[0135] S702, In response to receiving an operation to enable the remote input function, the mobile phone obtains interface information of one or more large-screen devices (such as one or more second devices).

[0136] The interface information may include, but is not limited to, whether there are edit boxes on the interface and / or the number of edit boxes on the interface.

[0137] In some embodiments, the one or more large-screen devices mentioned above are large-screen devices in a distributed network. Here, a distributed network refers to a cluster of distributed devices composed of multiple devices capable of peer-to-peer (P2P) communication.

[0138] For example, such as Figure 7 As shown, assuming the distributed network includes large screen device 1, large screen device 2 and large screen device 3, in response to receiving the above operation to enable the remote input function, the mobile phone obtains the interface information of large screen device 1, large screen device 2 and large screen device 3.

[0139] In other embodiments, the above-mentioned one or more large-screen devices are large-screen devices that have established a wireless connection with a mobile phone for remote input within a preset time period (such as within 24 hours, within a week, within a month, or within half a year).

[0140] For example, assuming the preset time period is within one week, in response to receiving the operation to enable the remote input function, the mobile phone obtains large-screen devices that have established wireless connections with the mobile phone for remote input within the past week.

[0141] In other embodiments, the one or more large-screen devices mentioned above are N large-screen devices that have recently established a wireless connection with a mobile phone for remote input; N is a positive integer.

[0142] For example, assuming that N is a preset value of 3, in response to receiving the operation to enable the remote input function, the mobile phone obtains the interface information of the three large-screen devices that have recently established a wireless connection with the mobile phone for remote input.

[0143] It should be noted that the rules for a mobile phone to obtain interface information of a large-screen device described above are merely examples, and the specific rules in this application embodiment are not limited. For example, the rules for a mobile phone to obtain interface information of a large-screen device can also be a combination of multiple conditions. For instance, in response to receiving the above-mentioned operation to enable the remote input function, the mobile phone obtains the interface information of N (e.g., N=3) large-screen devices that have established wireless connections with the mobile phone for remote input within a preset time period (e.g., within one week). As another example, in response to receiving the above-mentioned operation to enable the remote input function, the mobile phone obtains the interface information of the top three large-screen devices that have established wireless connections with the mobile phone for remote input within a preset time period (e.g., within one week).

[0144] As one implementation method, the mobile phone can obtain interface information from one or more large-screen devices through auxiliary module 1.

[0145] As another implementation, the mobile phone can obtain interface information from one or more large-screen devices through a module used for distributed connectivity (such as a device discovery module). This application does not limit the specific module for information acquisition.

[0146] S703, the mobile phone identifies the target device.

[0147] The target device is one of the aforementioned large-screen devices.

[0148] In some embodiments, it is assumed that the interface information of one or more large-screen devices obtained by the mobile phone indicates that there is only one large-screen device (e.g., Figure 7 If the interface of the large-screen device 1 shown has an editing box, the mobile phone can identify the large-screen device as the target device.

[0149] In other embodiments, it is assumed that the interface information of one or more large-screen devices obtained by the mobile phone indicates that there is only one large-screen device (e.g., ...). Figure 7 If the interface of the large-screen device 1 shown has an editing box, the mobile phone can also display the device's identification information to the user, which is used to notify the large-screen device that it is the target device, or to allow the user to specify the large-screen device as the target device.

[0150] In other embodiments, the mobile phone can receive a user's selection and determine the target device. For example, the mobile phone can display device information to the user, including identification information of a large-screen device with an edit box on the interface. This device information is used to display large-screen devices that the mobile phone can remotely input, so that the user can select the target device from them. The mobile phone can then select a large-screen device (e.g., [device name missing]) based on the user's selection of the device information. Figure 7 The operation of the large screen device 1 shown is used to determine the target device.

[0151] S704: The mobile phone establishes a wireless connection with the target device for remote input.

[0152] As an example, the mobile phone and the target device can establish a wireless connection for remote input through their respective auxiliary modules. Figure 6 The mobile phone with the structure shown in (a) and Figure 6 Taking the target device with the structure shown in (b) as an example, the mobile phone establishes a wireless connection for remote input with the auxiliary module of the target device through its own auxiliary module.

[0153] For example, in a distributed network configuration between a mobile phone and a target device, the auxiliary module 1 of the mobile phone can establish a wireless connection with the auxiliary module 2 of the target device via a remote procedure call (RPC). That is, the mobile phone and the target device establish a wireless connection based on the RPC protocol. For an introduction to RPC, please refer to the explanations and descriptions in conventional technologies; this embodiment will not elaborate further.

[0154] S705, The target device sends a request message to the mobile phone to request the mobile phone to remotely input to the target device's default focus box.

[0155] by Figure 6 The mobile phone with the structure shown in (a) and Figure 6 Taking the target device with the structure shown in (b) as an example, the target device can send request information to the auxiliary module 1 of the mobile phone through the auxiliary module 2. For example, in the case of a distributed network between the mobile phone and the target device, the auxiliary module 2 of the target device can send request information to the auxiliary module 1 of the mobile phone through RPC.

[0156] The aforementioned request information includes the identification information of the target device's default focus box (such as the edit box identifier (identity, ID)) and the data channel interface of the default focus box. The data channel interface is used for remote input.

[0157] In some embodiments, assuming the target device's interface includes only one edit box, the default focus box is that edit box. In this case, before step S705, the auxiliary module 2 of the target device is also used to make the edit box focus, that is, the auxiliary module 2 is also used to set the edit box as the default focus box.

[0158] In other embodiments, assuming the target device's interface includes multiple edit boxes, the default focus box can be the first edit box on the target device's interface. For example, the target device can determine the first edit box based on the coordinate values ​​of the multiple edit boxes in a preset coordinate system. For instance, the origin of the preset coordinate system can be the lower left corner of the target device's screen, the x-axis can be the lower edge of the target device's screen, and the y-axis can be the left edge of the target device's screen. Alternatively, the first edit box can be the one among the multiple edit boxes that simultaneously satisfies the condition of having the smallest x-coordinate and the largest y-coordinate. In this case, before step S705, the auxiliary module 2 of the target device is further configured to focus on the first edit box, i.e., the auxiliary module 2 is further configured to set the first edit box as the focus box.

[0159] In another scenario, the default focus box can be the highest-priority edit box on the target device's interface. For example, this priority can be determined by the target device's auxiliary module 2 based on at least one of the following: the position information of multiple edit boxes, historical input frequency, or default setting information.

[0160] Alternatively, the default focus box can be determined based on other rules or principles. This application does not limit the specific setting rules for the initial focus box (i.e., the default focus box) after the mobile phone and the target device establish a wireless connection for remote input.

[0161] It should be noted that, in this embodiment, the default focus box is visible to the user so that the user knows at any time which edit box to input information into. For example, the default focus box can be highlighted in the edit box, display a cursor inside the edit box, or be bolded in the edit box (e.g., ...). Figure 8 (as shown) and other forms are visible to the user.

[0162] S706, the mobile phone displays the remote input interface.

[0163] The remote input interface is used by users to input information into the default focus box through editing. For example, the remote input interface includes an input box and an input method window.

[0164] This application provides a cross-device input method that can initiate remote input to a large-screen device from a single device (such as a mobile phone 04) without interfering with other devices with strong input capabilities, resulting in a better user experience.

[0165] like Figure 7 As shown, after the mobile phone executes step S706, if the user directly inputs information into the default focus box of the target device through the mobile phone, the mobile phone executes the following step S707-1:

[0166] S707-1. In response to receiving information entered by the user in the input box, the mobile phone sends the information entered by the user in the input box to the target device. The information entered by the user in the input box is used to fill the default focus box of the target device.

[0167] by Figure 6 The mobile phone with the structure shown in (a) and Figure 6 Taking the target device with the structure shown in (b) as an example, the mobile phone can send the information entered by the user in the input box to the auxiliary module 2 of the target device through the auxiliary module 1, so that the auxiliary module 2 can input the corresponding information into the default focus box of the target device.

[0168] Please refer to Figure 8 , Figure 8 Taking a target device's interface that includes multiple edit boxes as an example, a cross-device input example is shown. Figure 8 As shown in (a), the default focus box is edit box 1, and the remote input interface includes... Figure 8 The input box 801 and the input method window 802 are shown in (a) above. Figure 8 As shown in (b), mobile phone 04 can input the username (e.g., ...) into the text edited in input box 801 and into edit box 1 based on the user's operation in input method window 802. Figure 8 (The "Sun" shown in (b)).

[0169] In some embodiments, the remote input interface may further include at least one option. This at least one option is used by the user to switch the focus box, i.e., to adjust the focus box on the target device. For example, if the target device's interface includes multiple edit boxes, the remote input interface may also allow the user to switch the focus box arbitrarily among the multiple edit boxes.

[0170] In some embodiments, the at least one of the above options includes an option for switching to the next edit box and an option for switching to the previous edit box. For example... Figure 8As shown, the remote input interface on mobile phone 04 includes "Previous" and "Next" buttons for users to switch focus boxes. This avoids the cumbersome process of needing to use a remote control to switch focus boxes first and then confirm on the mobile phone. The "Previous" button is used to switch to the previous priority editing box, and the "Next" button is used to switch to the next priority editing box.

[0171] As another example, in the user's Figure 8 After entering a username into edit box 1 on the remote input interface shown, if the user wants to enter information into other edit boxes, then... Figure 9 As shown, after the mobile phone performs step S707-1, the cross-device input method provided in this application embodiment further includes the following steps S708-1, S709-1, and S710-1:

[0172] S708-1, In response to the user's operation of changing the focus frame, the mobile phone sends focus frame switching information to the target device.

[0173] The focus box switching information is used to indicate the switching of the focus box. This information includes the identifier (such as ID) of the new focus box.

[0174] In some embodiments, the mobile phone may store edit box information. This edit box information includes the ID of each edit box on the target device's interface and the priority of each edit box. In response to a user's operation to change the focus box, the mobile phone can determine the ID of the new focus box based on this edit box information and send it to the target device via focus box switching information.

[0175] For example, with Figure 8 Taking the target device interface shown as an example, the edit box information saved on the mobile phone side can be as shown in Table 1 below:

[0176] Table 1

[0177] ID of edit box 1 1 ID of edit box 2 2 ID of edit box 3 3 ID of edit box 4 4

[0178] For example, suppose the user's action of changing the focus box is... Figure 8 In the case of the target device interface and the mobile phone remote input interface, when the user clicks the "Next" button on the remote input interface, the mobile phone determines the next priority edit box of the current focus box (i.e., edit box 1) as edit box 2 based on the edit box information saved on the mobile phone side. Then the mobile phone can determine that the ID of the focus box after the switch is the ID of edit box 2.

[0179] For example, suppose Figure 8 The current focus box of the target device shown is edit box 3. The user's operation to change the focus box is... Figure 8On the remote input interface of the mobile phone shown, when the user clicks the "Previous" button, the mobile phone determines the previous priority of the current focus box (i.e., edit box 3) as edit box 2 based on the edit box information saved on the mobile phone side. Then the mobile phone can determine that the ID of the focus box after switching is the ID of edit box 2.

[0180] It should be noted that the edit box information saved on the mobile phone side can be calculated by the mobile phone itself, specified by the target device, or pre-set by the developer in the mobile phone; this application does not limit this.

[0181] For example, after the mobile phone establishes a wireless connection with the target device for remote input in step S704, the target device can send the identification information (such as edit box ID) and position information of multiple edit boxes on the target device interface to the mobile phone. This allows the mobile phone to determine the priority of the multiple edit boxes based on their position information. For instance, the position information of the edit boxes can be their coordinates in a preset coordinate system.

[0182] Taking a preset coordinate system with the origin at the bottom left corner of the target device's screen, the x-axis at the bottom edge of the target device's screen, and the y-axis at the left edge of the target device's screen as an example, the larger the y-axis coordinate value and the smaller the x-axis coordinate value of the edit box, the higher the priority of the edit box.

[0183] For example, after the mobile phone establishes a wireless connection with the target device for remote input in step S704, the target device can send the identification information (such as the edit box ID) of multiple edit boxes on the target device's interface and the historical input data of the multiple edit boxes to the mobile phone. The mobile phone then determines the priority of the multiple edit boxes based on the historical input data. For instance, the historical input data of the multiple edit boxes may include, but is not limited to, one or more of the following: the input frequency of the multiple edit boxes within a preset time period as statistically analyzed by the background system, and default setting information. For instance, the higher the input frequency statistically analyzed by the background system within the preset time period, the higher the priority of the edit box.

[0184] For example, after the mobile phone establishes a wireless connection for remote input with the target device in step S704, the target device can send the above-mentioned edit box information to the mobile phone.

[0185] In one implementation, the edit box information is calculated and determined by the target device. For example, the edit box information may be determined by the target device based on the position information of multiple edit boxes. Alternatively, the edit box information may be determined by the target device based on historical input data from multiple edit boxes.

[0186] As another implementation method, the information in the edit box can also be pre-set by the developer in the target device.

[0187] In this embodiment, when switching focus boxes, mobile phone 04 can instruct the target device to switch focus boxes based on the edit box information. By using a priority-based approach to focus box switching, it is ensured that edit boxes with higher priority are edited first, thus improving the user experience.

[0188] S709-1 The target device switches the focus frame according to the focus frame switching information.

[0189] by Figure 6 Taking the target device with the structure shown in (b) as an example, after receiving the focus box switching information from the mobile phone, the auxiliary module 2 of the target device can switch the focus box according to the identification information (such as ID) of the switched focus box carried in the focus box switching information.

[0190] like Figure 8 As shown in (b), the default focus box is edit box 1. Assuming that the next priority edit box after edit box 1 is edit box 2, then mobile phone 04 can switch the focus box to edit box 2 based on the user's action of clicking the "Next" button in input box 801. Figure 8 Edit box 2 is shown in (c) above. Wherein, Figure 8 The input box 801 shown in (c) is used to input the password into the switched focus box (i.e., edit box 2).

[0191] S710-1: In response to the user's input operation on the remote input interface, the mobile phone inputs information to the switched focus box.

[0192] For example, suppose the user is Figure 8 If “123456” is entered into input box 801 as shown in (c), then mobile phone 04 responds to the user’s input operation and enters the password 123456 into the switched focus box (i.e., edit box 2).

[0193] As another example, consider the scenario where the user abandons inputting information into the default focus box and instead changes the focus box, such as... Figure 10 As shown, after the target device executes step S706, the cross-device input method provided in this application embodiment further includes the following steps S707-2, S708-2 and S709-2:

[0194] S707-2: In response to the user's operation of changing the focus frame, the mobile phone sends focus frame switching information to the target device.

[0195] The focus box switching information is used to indicate the switching of the focus box. This information includes the identifier (such as ID) of the new focus box.

[0196] S708-2, The target device switches the focus frame according to the focus frame switching information.

[0197] For example, such as Figure 11 As shown in (a), the current focus box is edit box 1. Assume the user abandons the edit box... Figure 11 Instead of editing text in input box 801 as shown in (a), the user clicks the "Next" button in input box 801. Assuming that the next priority input box after input box 1 is input box 2, mobile phone 04 can switch the focus box to input box 2 based on the user's action of clicking the "Next" button in input box 801. Figure 11 Edit box 2 is shown in (b) of the image. Among them, Figure 11 The input box 801 shown in (b) is used to input a password into the switched focus box (i.e., edit box 2).

[0198] S709-2, In response to the user's input operation on the remote input interface, the mobile phone inputs information to the switched focus box.

[0199] For example, suppose the user is Figure 11 If “123456” is entered into input box 801 as shown in (b), then mobile phone 04 responds to the user’s input operation and enters the password 123456 into the switched focus box (i.e., edit box 2).

[0200] For a detailed description of steps S707-2, S708-2 and S709-2 above, please refer to steps S708-1, S709-1 and S710-1 above in the embodiments of this application, which will not be repeated here.

[0201] The cross-device input method provided in this application embodiment is suitable for large-screen devices with multiple editing boxes. It allows for arbitrary switching of the focus box based on a single device, is simple to operate, and provides a good user experience.

[0202] It should be noted that, in the embodiments of this application, clicking... Figure 8 The "Previous" and "Next" buttons shown are merely examples of how to change the focus box; this application does not limit the specific method of changing the focus box.

[0203] For example, the focus frame can be changed by pressing physical buttons (such as pressing the power button and volume button at the same time) or by using preset swipe gestures (such as swiping to the left).

[0204] For example, you can also double-click. Figure 8 The "Previous" or "Next" button shown can be long-pressed. Figure 8 The focus frame can be changed using methods such as the "Previous" or "Next" buttons. The specific method for changing the focus frame in response to user actions such as double-clicking or long-pressing the "Previous" or "Next" buttons can be determined according to the specific settings.

[0205] For example, in the embodiments of this application, at least one of the above options may further include an option for switching across editing boxes.

[0206] It should be noted that, in the embodiments of this application, the above-mentioned at least one option can be in the form of a menu, a button, or a preset operation, and this application is not limited thereto. For example, by double-clicking or long-pressing the "Previous" button, the user can switch between editing boxes, achieving jump focus on editing boxes, such as jumping between two editing boxes to focus, or returning to the first editing box on the interface.

[0207] by Figure 12 For example, as shown in the example, Figure 12 As shown in (a), the current focus box is edit box 3. Suppose that after completing remote input in edit box 3, the user wants to return to edit box 1 to modify the username. Assume that long-pressing the "Previous" button is used to return to the first edit box on the screen or jump forward two edit boxes, then... Figure 12 As shown in (b), in response to the user's long press of the "Previous" button, mobile phone 04 instructs large-screen device 01 to switch the first edit box (i.e., edit box 1) on the interface to the focus box. Figure 12 The input box 801 shown in (b) is used to edit the username in the switched focus box (i.e., edit box 1). Based on Figure 12 As shown in (b) of the interface, users can remotely modify their usernames using their mobile phone 04, for example, changing "Sun" to "Moon".

[0208] by Figure 12 Taking the example shown, it can be understood that if a user wants to return to edit box 1 to modify their username after completing remote input in edit box 3, they can also click the "Previous" button twice to bring edit box 1 back into focus. However, for cross-device input, long-pressing the "Previous" button saves computing power on phone 04 and reduces interaction between phone 04 and the large-screen device 01 compared to clicking it twice. For example, clicking the "Previous" button twice triggers one instance of phone 04 determining the edit box ID and sending focus box switching information; clicking it twice triggers another instance of phone 04 determining the edit box ID and sending focus box switching information. Long-pressing the "Previous" button, however, only triggers one instance of phone 04 determining the edit box ID and sending focus box switching information, thus reducing operational complexity, improving operational efficiency, and enabling jump switching, thereby improving switching efficiency.

[0209] It should be noted that the above-described operation for switching across editing boxes is only an example, and the specific triggering method is not limited in the embodiments of this application.

[0210] It should be understood that the various solutions in the embodiments of this application can be used in a reasonable combination, and the explanations or descriptions of the various terms appearing in the embodiments can be referenced or explained to each other in the various embodiments, without limitation.

[0211] It should also be understood that, in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0212] It is understood that, in order to implement the functions of any of the above embodiments, electronic devices (such as the first device or the second device) include hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0213] This application embodiment can divide an electronic device (such as a first device or a second device) into functional modules. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one processing module. The integrated modules can be implemented in hardware or as software functional modules. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.

[0214] For example, when dividing functional modules in an integrated manner, such as Figure 13 The diagram shown is a structural block diagram of an electronic device provided in an embodiment of this application. For example, the electronic device may be a first device or a second device (such as the target device). Figure 13 As shown, the electronic device may include a transceiver unit 1310, a processing unit 1320, a storage unit 1330, and a display unit 1340.

[0215] In this embodiment, when the electronic device is the first device, the transceiver unit 1310 is used to support the first device in completing the above-mentioned steps S704, S705, S707-1, S707-2, S708-1, S709-2, S710-1, and / or other processes related to the embodiments of this application. The processing unit 1320 is used to support the first device in executing the above-mentioned steps S701, S702, S703, S704, S709-1, S708-2, and / or other processes related to the embodiments of this application. The display unit 1340 is used to support the first device in executing the above-mentioned step S706, and / or other interfaces related to the embodiments of this application.

[0216] When the electronic device is a second device (such as a target device), the transceiver unit 1310 is used to support the target device in establishing a wireless connection with the first device, receive information sent by the first device through the wireless connection, receive focus box switching information from the first device, send position information of multiple edit boxes to the first device, send priority information of multiple edit boxes to the first device, and / or other processes related to the embodiments of this application. The processing unit 1320 is used to support the second device (such as the target device) in determining a default focus box after the transceiver unit 1310 establishes a wireless connection with the first device, fill the default focus box with information sent by the first device through the wireless connection, switch the focus box to the edit box corresponding to the identification information, and / or other processes related to the embodiments of this application. The display unit 1340 is used to support the second device (such as the target device) in displaying an interface including at least one edit box, and / or other interfaces related to the embodiments of this application.

[0217] The storage unit 1330 is used to store computer programs and processing data and / or processing results in the methods provided in the embodiments of this application.

[0218] It should be noted that the aforementioned transceiver unit 1310 may include radio frequency (RF) circuitry. Specifically, electronic devices (such as the first or second device) can receive and transmit wireless signals via RF circuitry. Typically, RF circuitry includes, but is not limited to, antennas, at least one amplifier, transceiver, coupler, low-noise amplifier, and duplexer. Furthermore, the RF circuitry can also communicate with other devices wirelessly. The wireless communication can use any communication standard or protocol, including but not limited to Global System for Mobile Communications (GSMO), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WDMA), Long Term Evolution (LTE), email, and Short Message Service (SMS).

[0219] It should be understood that the various modules in an electronic device can be implemented in software and / or hardware, without specific limitations. In other words, an electronic device is presented in the form of functional modules. Here, "module" can refer to application-specific integrated circuits (ASICs), circuits, processors and memories that execute one or more software or firmware programs, integrated logic circuits, and / or other devices that can provide the aforementioned functions.

[0220] In an alternative approach, when data transmission is implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are implemented. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital video disk (DVD)), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0221] The steps of the methods or algorithms described in conjunction with the embodiments of this application can be implemented in hardware or by a processor executing software instructions. The software instructions can consist of corresponding software modules, which can be stored in RAM, flash memory, ROM, EPROM, EEPROM, registers, hard disk, portable hard disk, CD-ROM, or any other form of storage medium well known in the art. An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and storage medium can reside in an ASIC. Alternatively, the ASIC can reside in an electronic device. Of course, the processor and storage medium can also exist as discrete components in an electronic device.

[0222] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

Claims

1. A cross-device input method, characterized in that, The method includes: In response to receiving an operation from a user to enable the remote input function, the first device determines the device with an edit box on its interface as the target device based on the interface information of m second devices. The target device is one of the m second devices, and the interface of the target device includes one or more edit boxes, where m is an integer greater than or equal to 1. The first device establishes a wireless connection with the target device, and the wireless connection is used to transmit user input information sent by the first device to the target device. The first device displays a remote input interface, which includes an input box and at least one option, the at least one option being used to adjust the focus box on the target device.

2. The method according to claim 1, characterized in that, The first device determines the device with an edit box on its interface as the target device based on the interface information of m second devices, including: The first device displays device information based on the interface information of m second devices. Among the m second devices, multiple devices have an edit box on their interface. The device information includes the identification information of one or more second devices whose interfaces have an edit box. The first device determines the target device based on the user's selection of an identifier in the device information.

3. The method according to claim 1, characterized in that, Of the m second devices, only one device has an edit box on its interface. The first device determines the device with the edit box as the target device based on the interface information of the m second devices, including: The first device determines that the device with the edit box on the interface is the target device.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: The first device receives information entered by the user in the input box; The first device sends the information entered by the user in the input box to the target device. The information entered by the user in the input box is used to fill the default focus box of the target device.

5. The method according to any one of claims 1-3, characterized in that, The method further includes: The first device responds to receiving an operation from the user selecting any one of the at least one options; The first device determines the focus box after the switch; The first device sends focus frame switching information to the target device, the focus frame switching information including the identification information of the switched focus frame.

6. The method according to claim 5, characterized in that, The first device determines the focus box after the switch, including: The first device determines the switched focus box based on the edit box information; the edit box information includes the priority of multiple edit boxes.

7. The method according to claim 6, characterized in that, The target device's interface includes multiple edit boxes; the method further includes: The first device receives the position information of the plurality of edit boxes from the target device; The first device determines the priority of the multiple edit boxes based on their position information.

8. The method according to claim 6, characterized in that, The method further includes: The first device receives the edit box information from the target device.

9. The method according to any one of claims 1-3 and 6-8, characterized in that, The at least one option includes at least one of an option for switching to the next edit box or an option for switching to the previous edit box.

10. The method according to any one of claims 1-3 and 6-8, characterized in that, The at least one option includes an option for switching across edit boxes.

11. A cross-device input method, characterized in that, The method includes: In response to receiving an operation from a user to enable the remote input function, the first device determines the device with an edit box on its interface as the target device based on the interface information of m second devices. The target device is one of the m second devices, and the interface of the target device includes one or more edit boxes, where m is an integer greater than or equal to 1. The first device establishes a wireless connection with the target device, and the wireless connection is used to transmit user input information sent by the first device to the target device. The target device determines the default focus box; The first device displays a remote input interface, which includes an input box and at least one option, the at least one option being used to adjust the focus box on the target device.

12. The method according to claim 11, characterized in that, The method further includes: The first device receives information entered by the user in the input box; The first device sends the information entered by the user in the input box to the target device, and the information entered by the user in the input box is used to fill the default focus box of the target device; The target device fills the information into the default focus box.

13. The method according to claim 11 or 12, characterized in that, The method further includes: The first device responds to receiving an operation from the user selecting any one of the at least one options; The first device determines the focus box after the switch; The first device sends focus frame switching information to the target device, the focus frame switching information including the identification information of the switched focus frame; The target device will switch the focus box to the edit box corresponding to the identification information.

14. The method according to claim 11 or 12, characterized in that, The target device's interface includes multiple edit boxes; the method further includes: The target device sends the position information of the plurality of edit boxes to the first device; or... The target device sends the priority of the plurality of edit boxes to the first device.

15. A first device, characterized in that, The first device includes: Display screen; One or more processors; One or more memory units; The memory stores one or more programs that, when executed by the one or more processors, cause the first device to perform the method of any one of claims 1 to 10.

16. A communication system, characterized in that, The communication system includes: The first device and the target device as described in claim 15.

17. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer program code, which, when executed by a processing circuit, implements the method as described in any one of claims 1-10.

Images