A cross-device collaboration method for input device multiplexing and electronic device

Abstract

The application provides a cross-device cooperation method for input device multiplexing and an electronic device. The method is applied to a first electronic device; the first electronic device comprises a first input device and a first display screen comprising a first cursor movement boundary, and the first display screen displays a cursor; the cursor moves on the first display screen along with the movement of the first input device; a first operation acting on the first input device is detected; the cursor is controlled to move on the first display screen in response to the first operation; after the cursor moves to the first cursor movement boundary, the cursor is hidden; and a trigger message for triggering the switching of a control device of the first input device from the first electronic device to a second electronic device is sent to the second electronic device. The application uses the first input device to input to the first electronic device and the second electronic device, and also realizes the switching between the first electronic device and the second electronic device.

Description

Technical Field

[0001] This application relates to the field of terminals, and more particularly to a cross-device collaboration method and electronic device for input device multiplexing. Background Technology

[0002] Primary electronic devices such as desktop computers and laptops primarily use input devices like mice, keyboards, and touchpads. Secondary electronic devices, such as smart TVs, primarily use input devices like remote controls. In scenarios like using both devices for work, users may switch between inputting data between the primary and secondary devices. While operating the primary device, the user may sometimes need to operate the secondary device, and sometimes not, returning to the primary device. Frequent switching between primary and secondary input devices reduces efficiency, wastes time, and makes operation cumbersome, resulting in a poor user experience. Furthermore, in scenarios requiring extensive text input on secondary devices like smart TVs, using the secondary input device is clearly inconvenient. Therefore, improving the user experience and providing a convenient input method for both primary and secondary electronic devices without adding extra devices has become a necessity. Summary of the Invention

[0003] To address the aforementioned technical problems, this application provides a cross-device collaboration method and electronic device for input device multiplexing. The technical solution provided by this application enables convenient and quick switching of the input receiving object without adding additional devices, and without switching input devices, thus improving the user experience. The technical solution provided by this application uses only a first input device to simultaneously input to both a first and a second electronic device, and also enables switching between the first and second electronic devices.

[0004] In a first aspect, this application provides a cross-device collaboration method for input device multiplexing, applied in a first electronic device. The first electronic device and a second electronic device have a communication connection. The first electronic device includes a first display screen and a first input device. The first display screen has a first cursor movement boundary and displays a cursor. The cursor moves on the first display screen as it moves with the first input device. The method provided by this application includes: the first electronic device detecting a first operation applied to the first input device; responding to the first operation, the first electronic device controlling the cursor to move on the first display screen; when the cursor moves to the first cursor movement boundary of the first display screen, the first electronic device controlling the cursor to hide on the first display screen; and the first electronic device sending a first trigger message to the second electronic device to notify the switching of the control device for the first input device from the first electronic device to the second electronic device.

[0005] This application provides a cross-device collaboration method for input device multiplexing. In this method, a first electronic device detects a first operation applied to a first input device and, in response to the first operation, controls the cursor to move on a first display screen. When the cursor moves to a first cursor movement boundary, the first electronic device sends a first trigger message to a second electronic device. Since this first trigger message is used to notify the switching of the control device for the first input device from the first electronic device to the second electronic device, the second electronic device, upon receiving the first trigger message, can determine the control device that will subsequently control the first input device. The first electronic device also feeds back operation information of subsequently detected operations applied to the first input device to the second electronic device, so that the second electronic device can respond to the operation information and execute the corresponding command. This solution allows for convenient and quick switching of the input receiving object without adding additional devices, and without switching input devices, thus improving the user experience. The technical solution provided by this application uses only the first input device to handle input to both the first and second electronic devices, and also enables switching between the first and second electronic devices.

[0006] It should be noted that the first input device can be part of the first electronic device. Of course, the first input device can also be an external device of the first electronic device. When the first input device is an external device of the first electronic device, there is a communication connection between the first input device and the first electronic device. In this way, the user can operate the first input device to control the cursor to move on the first display screen or input text and other information into the first electronic device by means of the first input device.

[0007] In this embodiment, the control device for the second electronic device to control the first input device can be understood as follows: the first electronic device detects the operation applied to the first input device and feeds back the operation information applied to the first input device to the second electronic device, which then executes the operation applied to the first input device. Similarly, the control device for the first electronic device to control the first input device in this embodiment can be understood as follows: the first electronic device detects the operation on the first input device and executes commands related to the operation on the first input device.

[0008] In one implementation of this application, the first display screen includes a first edge, a second edge, a third edge, and a fourth edge. The first edge is parallel to the second edge, the third edge is parallel to the fourth edge, the first edge and the second edge are parallel to a first direction, and the third edge and the fourth edge are parallel to a second direction. The first direction is perpendicular to the second direction. The first cursor movement boundary is one or more of the first edge, the second edge, the third edge, and the fourth edge.

[0009] In one implementation of this application, the first display screen includes a first edge, a second edge, a third edge, and a fourth edge. The first edge is parallel to the second edge, the third edge is parallel to the fourth edge, the first edge and the second edge are parallel to a first direction, the third edge and the fourth edge are parallel to a second direction, and the first direction is perpendicular to the second direction. The first cursor movement boundary can be any one of the first edge, the second edge, the third edge, and the fourth edge. For example, the first cursor movement boundary can be the first edge and the fourth edge.

[0010] In one implementation of this application, when the control device of the first input device is switched to the second electronic device, the method provided in this application further includes: the first electronic device detecting a second operation applied to the first input device. The first electronic device sends operation information corresponding to the second operation to the second electronic device. This facilitates the subsequent response of the second electronic device to the operation information corresponding to the second operation and the execution of the relevant commands of the operation information corresponding to the second operation.

[0011] For example, taking a keyboard as the first input device, if the first electronic device detects that the second operation performed on the keyboard is the input of the letter X, then the first electronic device sends the operation information corresponding to the letter X to the second electronic device. In this way, the second electronic device can input the letter X into the second electronic device.

[0012] For example, taking a mouse as the first input device, if the first electronic device detects that the second operation applied to the mouse is a movement operation, then the first electronic device sends the operation information corresponding to the movement operation to the second electronic device. In this way, the second electronic device can respond to the operation information corresponding to the movement operation and control the cursor to move on the second display screen.

[0013] In one implementation of this application, the method provided in this embodiment further includes: a first electronic device determining a relative position between itself and a second electronic device. The first electronic device determines a first cursor movement boundary from one or more edges of a first display screen (e.g., a first edge, a second edge, a third edge, and a fourth edge) based on the relative position between itself and the second electronic device. Determining the first cursor movement boundary using the relative position between the first and second electronic devices makes the set boundary more consistent with the position layout of the electronic devices, thus improving the user experience.

[0014] In one implementation of this application, a first electronic device has a first mapping table, which records information about one or more edges of a first display screen associated with each of one or more relative positions. Determining a first cursor movement boundary from one or more edges of the first display screen based on the relative position between the first electronic device and a second electronic device includes: determining the information of the edges associated with the relative position between the first electronic device and the second electronic device as the first cursor movement boundary from the first mapping table.

[0015] In one implementation of this application, a first electronic device has at least one first ultra-wideband UWB base station, and a second electronic device has at least one second UWB base station. Determining the relative position between the first electronic device and the second electronic device includes: transmitting a UWB signal to the second electronic device using at least one first ultra-wideband UWB base station when preset conditions are met; the preset conditions include reaching the period for transmitting the UWB signal or detecting a change in the position of the first electronic device / second electronic device; the first electronic device receiving information from the second electronic device for determining the relative position; and the first electronic device determining the relative position between the first electronic device and the second electronic device based on the information for determining the relative position.

[0016] For example, the information used to determine the relative position can be the relative position information itself. Or, the information used to determine the relative position can be the angular range between the first electronic device and the second electronic device.

[0017] It is worth noting that the first electronic device has an edge associated with each of one or more angle ranges. After receiving the angle range from the first electronic device to the second electronic device, the first electronic device can determine the edge associated with the angle range from the first electronic device to the second electronic device as the first cursor movement boundary. For example, if the angle range from the first electronic device to the second electronic device is angle range 1, and angle range 1 is associated with the first edge, then the first electronic device will determine the first edge as the first cursor movement boundary.

[0018] It is worth noting that the first electronic device has an edge associated with each of one or more relative positions. After receiving the relative positions of the second electronic devices between the first electronic devices, the first electronic device can determine the edge associated with the relative positions of the second electronic devices between the first electronic devices as the first cursor movement boundary. For example, if the relative position of the second electronic devices between the first electronic devices is position 2, and position 2 is associated with the first edge, then the first electronic device will determine the first edge as the first cursor movement boundary.

[0019] In one implementation of this application, the method provided by this application further includes: a second electronic device having at least one second UWB base station, a first electronic device having at least one first UWB base station, and the first electronic device determining the relative position between the first electronic device and the second electronic device, including: the first electronic device detecting a UWB signal 1 from the second electronic device using at least one first UWB base station; and the first electronic device determining the relative position between the first electronic device and the second electronic device based on the UWB signal 1.

[0020] In one implementation of this application, at least one first UWB base station includes two first UWB base stations. The first electronic device determines the relative position between the first electronic device and the second electronic device based on the UWB signal 1, including: the first electronic device calculates the coordinates of the second UWB base station transmitting the UWB signal in a preset coordinate system based on the UWB signal 1; the first electronic device calculates the angle from the second UWB base station to the origin of the preset coordinate system based on the coordinates of the second UWB base station in the preset coordinate system; and the first electronic device uses the angle from the second UWB base station to the origin as the relative position between the first electronic device and the second electronic device.

[0021] In one implementation of this application, the first electronic device calculates the coordinates of the second UWB base station transmitting the UWB signal in a preset coordinate system based on the UWB signal 1. This includes: the first electronic device calculating the distance between the second UWB base station transmitting the UWB signal and each of the two first UWB base stations based on the UWB signal 1; the first electronic device calculating the values ​​of each interior angle of the triangle formed by the two first UWB base stations and the second UWB base station based on the distance between the second UWB base station and each of the two first UWB base stations, and the distance between the two first UWB base stations; and the first electronic device determining the coordinates of the second UWB base station in the preset coordinate system based on the values ​​of each interior angle.

[0022] In one implementation of this application, determining the relative position between a first electronic device and a second electronic device includes: the first electronic device outputting a prompt message indicating whether to select a relative position between the first electronic device and the second electronic device from one or more locations. In response to an operation on a first location among the one or more locations, the first location is determined as the relative position between the first electronic device and the second electronic device. For example, the one or more locations include the first electronic device being located to the left of the second electronic device, or the first electronic device being located to the right of the second electronic device, or the first electronic device being located above the second electronic device. Specific locations can be found in the descriptions of relevant embodiments of this application.

[0023] In one implementation of this application, the method further includes: a first electronic device acquiring an updated relative position between itself and a second electronic device. The first electronic device then updates a first cursor movement boundary based on the acquired updated relative position between the two electronic devices. For example, if the original first cursor movement boundary was a first edge, the first electronic device can subsequently determine the first cursor movement boundary as a second movement boundary based on the updated relative position between the two electronic devices.

[0024] In one implementation of this application, when the cursor moves to the first cursor movement boundary, if the cursor remains at the first cursor movement boundary for more than a preset time or the first electronic device detects an operation to control the cursor to continue moving, the first electronic device controls the cursor to hide on the first display screen and sends a first trigger message to the second electronic device. This avoids accidental operation.

[0025] In one implementation of this application, when the control device of the first input device is switched to the second electronic device, the method provided by this application further includes: the first electronic device receiving a second trigger message from the second electronic device, the second trigger message being used to trigger the switch of the control device of the first input device from the second electronic device to the first electronic device. In response to the second trigger message, a cursor is displayed on the first display screen in an area excluding the first cursor movement boundary. When the cursor is located in the area excluding the first cursor movement boundary on the first display screen, the detected operation acting on the first input device is no longer fed back to the second electronic device. This allows the control device of the first input device to be switched back to the first electronic device.

[0026] In one implementation of this application, when the control device of the first input device is switched to the second electronic device, the method provided in this embodiment further includes: the first electronic device receiving a first file from the second electronic device. This enables file transfer between the first electronic device and the second electronic device.

[0027] In one implementation of this application, before receiving the first file from the second electronic device, the method provided in this embodiment further includes: the first electronic device receiving information about the first file from the second electronic device; the first electronic device outputting a second prompt message, the second prompt message being used to prompt whether to receive the first file; and the first electronic device detecting an operation indicating receipt of the first file and sending a first response message to the second electronic device, the first response message being used to indicate receipt of the first file.

[0028] In one implementation of this application, when the control device of the first input device is controlled by a first electronic device, and the first electronic device also selects a second file using a cursor, if the second file and the cursor are both located at the first cursor movement boundary, a first trigger message is sent to the second electronic device, further including: sending the second file to the second electronic device. This solution can not only trigger the second electronic device to control the control device of the first input device but also achieve the purpose of transferring files to the second electronic device. For example, when the control device of the first input device is controlled by the first electronic device, the user can operate the first input device so that the first electronic device responds to the operation on the first input device by selecting the second file using the cursor.

[0029] In one implementation of this application, before the first electronic device sends the second file to the second electronic device, the method further includes: the first electronic device sending information about the second file to the second electronic device; and the first electronic device receiving a second response message from the second electronic device, the second response message indicating receipt of the second file.

[0030] In one implementation of this application, the method provided in this embodiment further includes: outputting a first prompt message when a second triggering condition is met. The first prompt message is used to indicate whether to collaborate with other devices; upon detecting an operation instructing collaboration with other devices, information about one or more available electronic devices is displayed on a first display screen, the one or more available electronic devices including a second electronic device; the first electronic device detects an operation on the first display screen targeting the second electronic device; and the first electronic device establishes a communication connection with the second electronic device.

[0031] In one implementation of this application, the first cursor movement boundary is located at the edge of the screen of the first display screen.

[0032] Secondly, this application provides a cross-device collaboration method for input device multiplexing, applied in a second electronic device. The second electronic device and a first electronic device have a communication connection. The second electronic device includes a second display screen with a second cursor movement boundary. The method includes: the second electronic device receiving a first trigger message from the first electronic device, the first trigger message being used to notify the control device of the first input device to switch from the first electronic device to the second electronic device; and the second electronic device, in response to the first trigger message, displaying a cursor on the second display screen in an area other than the second cursor movement boundary.

[0033] In this scheme, the second electronic device receives the first trigger message and responds to the first trigger message, which helps the second electronic device to clearly identify the control device that will subsequently control the first input device.

[0034] In one implementation of this application, the method further includes: a second electronic device receiving operation information corresponding to a second operation from a first electronic device. The second electronic device, in response to the operation information, executes the command corresponding to the operation information.

[0035] In one implementation of this application, the method further includes: a second electronic device determining a relative position between a first electronic device and the second electronic device. The second electronic device then determines a second cursor movement boundary from one or more edges of a second display screen based on the relative position between the first and second electronic devices.

[0036] In one implementation of this application, the method further includes: a second electronic device having at least one second UWB base station; the second electronic device determining the relative position between the first electronic device and the second electronic device, comprising: the second electronic device detecting a UWB signal from the first electronic device using at least one second UWB base station; and the second electronic device determining the relative position between the first electronic device and the second electronic device based on the UWB signal.

[0037] In one implementation of this application, at least one second UWB base station includes two second UWB base stations. A second electronic device determines the relative position between the first electronic device and the second electronic device based on the UWB signal, including: the second electronic device calculating the coordinates of the first UWB base station transmitting the UWB signal in a preset coordinate system based on the UWB signal; the second electronic device calculating the angle from the first UWB base station to the origin of the preset coordinate system based on the coordinates of the first UWB base station in the preset coordinate system; and the second electronic device using the angle from the first UWB base station to the origin as the relative position between the first electronic device and the second electronic device. The preset coordinate system is determined by at least one second UWB base station. For example, if at least one second UWB base station includes two second UWB base stations, the origin of the preset coordinate system is the midpoint of the line connecting the two second UWB base stations. If at least one second UWB base station includes a second UWB base station with dual antennas, then the origin of the preset coordinate system is the position of the second UWB base station with dual antennas. Alternatively, the origin of the preset coordinate system may be another point, but the coordinates of the location of each of the at least one second UWB base stations are located in the preset coordinate system.

[0038] In one implementation of this application, the second electronic device calculates the coordinates of the first UWB base station transmitting the UWB signal in a preset coordinate system based on the UWB signal. This includes: the second electronic device calculating the distance between the first UWB base station transmitting the UWB signal and each of the two second UWB base stations based on the UWB signal; the second electronic device calculating the values ​​of each interior angle of the triangle formed by the two second UWB base stations and the first UWB base station based on the distance between the first UWB base station and each of the two second UWB base stations, and the distance between the two second UWB base stations; and the second electronic device determining the coordinates of the first UWB base station in the preset coordinate system based on the values ​​of each interior angle.

[0039] In one implementation of this application, when the period for detecting the UWB signal is reached or a change in the position of the second electronic device / first electronic device is detected, at least one second UWB base station is used to detect the UWB signal from the first electronic device.

[0040] In one implementation of this application, when the second electronic device determines the relative position between the first electronic device and the second electronic device, the method of this application further includes: the second electronic device sending information to the first electronic device for determining the relative position between the first electronic device and the second electronic device.

[0041] In one implementation of this application, when the control device of the first input device is switched to the second electronic device, the method further includes: the second electronic device responding to operation information from the first electronic device to control the cursor to move on the second display screen; when the cursor moves to the second cursor movement boundary, the second electronic device sends a second trigger message to the first electronic device, the second trigger message being used to trigger the switch of the control device of the first input device from the second electronic device to the first electronic device.

[0042] Thirdly, this application provides an electronic device, which includes: a processor; a memory; a first display screen, the first display screen including a first cursor movement boundary, the first display screen displaying a cursor; the cursor moving on the first display screen as a first input device communicatively connected to the first electronic device moves; and a computer program, the computer program being stored in the memory, which, when executed by the processor, causes the electronic device to perform the methods described in the first aspect and various implementations of the first aspect.

[0043] Fourthly, this application provides an electronic device, including: a processor; a memory; a second display screen including a second cursor movement boundary; and a computer program stored in the memory, which, when executed by the processor, causes the electronic device to perform the methods described in the second aspect and various implementations thereof.

[0044] Fifthly, this application provides a cross-device collaborative system for input device multiplexing. The system includes a first electronic device and a second electronic device, which are connected in communication. The first electronic device includes a first display screen with a first cursor movement boundary and a cursor corresponding to a first input device is displayed on the first display screen. The first electronic device is connected in communication with the first input device. The second electronic device includes a second display screen, and the cursor moves on the first display screen as the first input device moves. The first electronic device is used to execute the methods described in the first aspect and various implementations thereof, and the second electronic device is used to execute the methods described in the second aspect and various implementations thereof.

[0045] In a sixth aspect, this application provides a computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program that, when run on an electronic device, causes the electronic device to perform the methods described in the first aspect and various implementations thereof.

[0046] In a seventh aspect, this application provides a computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program that, when run on an electronic device, causes the electronic device to perform the methods described in the first aspect and various implementations thereof.

[0047] Eighthly, a chip is provided. The chip includes a processor and a memory, the processor being configured to read and execute a computer program stored in the memory to perform the method of the first aspect and any implementation thereof.

[0048] The technical effects of the eighth aspect and any of its implementations can be found in the first aspect and any of its implementations, and will not be repeated here.

[0049] Ninthly, please provide a chip. The chip includes a processor and a memory, the processor being used to read and execute a computer program stored in the memory to perform the method of the second aspect and any implementation thereof.

[0050] The technical effects of the ninth aspect and any implementation thereof can be found in the technical effects of the second aspect and any implementation thereof, and will not be repeated here.

[0051] In a tenth aspect, a computer program product is provided, which, when run on a computer, causes the computer to execute the method of the first aspect and any implementation thereof.

[0052] Eleventh aspect, a computer program product, characterized in that, when the computer program product is run on a computer, it causes the computer to execute the method of the second aspect and any implementation thereof. Attached Figure Description

[0053] Figure 1 A schematic diagram illustrating a scenario applicable to a cross-device collaboration method for input device reuse provided in an embodiment of this application; Figure 2 A schematic diagram of the hardware structure of a first electronic device provided in an embodiment of this application; Figure 3 A schematic diagram of the hardware structure of a second electronic device provided in an embodiment of this application; Figure 4 A schematic diagram of the arrangement of a UWB base station on a first electronic device and a second electronic device is provided for embodiments of this application; Figure 5 A schematic diagram showing the arrangement of another UWB base station on a first electronic device and a second electronic device, provided as an embodiment of this application. Figure 6 This is a schematic diagram illustrating the calculation of relative position using a UWB base station in an embodiment of this application; Figure 7 This is a schematic diagram illustrating another method of calculating relative position using a UWB base station in an embodiment of this application; Figure 8 This application provides a schematic diagram of a process for establishing a communication connection between devices. Figure 9 A schematic diagram of the interactive interface corresponding to a first electronic device and a second electronic device, respectively, provided for an embodiment of this application; Figure 10 A flowchart illustrating a cross-device collaboration method for input device multiplexing provided in an embodiment of this application; Figure 11A A schematic diagram of an interface for operating a first electronic device using a first input device, provided as an embodiment of this application; Figure 11B A schematic diagram illustrating how a cursor is hidden from a first electronic device and displayed on a second electronic device, as provided in an embodiment of this application; Figure 11C A schematic diagram of an interactive interface provided in an embodiment of this application; Figure 12A A schematic diagram of an interface for operating a second electronic device using a first input device, provided as an embodiment of this application; Figure 12B A schematic diagram of another interface for reusing a first input device to operate a second electronic device, provided as an embodiment of this application; Figure 13 A schematic diagram of the first cursor movement boundary of a first electronic device provided in an embodiment of this application; Figure 14 A schematic diagram of an interface for interaction between a first electronic device and a user, provided as an embodiment of this application; Figure 15 A schematic diagram of an azimuth angle provided for an embodiment of this application; Figures 16A-16J A schematic diagram showing the different positions of the first electronic device and the second electronic device provided in the embodiments of this application; Figures 17A-17B A schematic diagram illustrating file transfer between a first electronic device and a second electronic device, provided as an embodiment of this application; Figures 18A-18B A schematic diagram illustrating file transfer between a first electronic device and a second electronic device, provided as an embodiment of this application. Figure 19 This is a schematic diagram illustrating a method of reusing a first input device to input text into a second electronic device, as provided in an embodiment of this application. Detailed Implementation

[0054] The technical solutions of the embodiments of this application are described below with reference to the accompanying drawings. In the description of the embodiments of this application, the terminology used is for the purpose of describing specific embodiments only and is not intended to be a limitation of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “the,” “the,” “the,” and “this” are intended to also include expressions such as “one or more,” unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, “at least one” and “one or more” refer to one or more (including two).

[0055] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized. The term "connection" includes direct connections and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.

[0056] In the embodiments of this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.

[0057] Primary electronic devices such as desktop computers and laptops primarily use input devices like mice, keyboards, and touchpads. Secondary electronic devices, such as smart TVs, primarily use input devices like remote controls. In scenarios like using both devices for work, users may switch between inputting data between the primary and secondary devices. While operating the primary device, the user may sometimes need to operate the secondary device, and sometimes not, returning to the primary device. Frequent switching between primary and secondary input devices reduces efficiency, wastes time, and makes operation cumbersome, resulting in a poor user experience. Furthermore, in scenarios requiring extensive text input on secondary devices like smart TVs, using the secondary input device is clearly inconvenient. Therefore, improving the user experience and providing a convenient input method for both primary and secondary electronic devices without adding extra devices has become a necessity.

[0058] To address the aforementioned technical problems, this application provides a cross-device collaboration method and electronic device for input device multiplexing. The technical solution provided by this application enables convenient and quick switching of the input receiving object without adding additional devices, and without switching input devices, thus improving the user experience. The technical solution provided by this application uses only a first input device to simultaneously input to both a first and a second electronic device, and also enables switching between the first and second electronic devices.

[0059] Figure 1 This is a schematic diagram illustrating a scenario for a cross-device collaboration method for input device multiplexing provided in an embodiment of this application. For example... Figure 1 As shown, the first electronic device 100 and the second electronic device 200 establish a communication connection. The first electronic device 100 has a display screen 110 and a first input device 120. The second electronic device 200 has a display screen 210. A cursor 112 is displayed on the display screen 110.

[0060] like Figure 1 As shown, the first input device 120 can be one or more of a mouse 1211, a keyboard 1212, a cursor touch area 1213, and a keyboard area 1214. Taking the mouse 1211 as the first input device 120 as an example, after a communication connection is established between the mouse 1211 and the first electronic device 100, the user can use the mouse 1211 to control the cursor 112 to move on the display screen 110 to select various menus displayed on the display screen 110. For example, as... Figure 1As shown, after the mouse 1211 and the first electronic device 100 establish a connection, a cursor 112 corresponding to the mouse will appear on the display screen 110. During the user's operation of the mouse 1211 or the cursor touch area 1213, the user can rotate or move the mouse 1211 or perform a sliding operation on the cursor touch area 1213, thereby causing the first electronic device 100 to control the movement of the cursor 112 on the display screen 110, ultimately positioning the cursor 112 at the position on the display screen 110 where the user needs to select a menu item, thus enabling the user to select the desired menu item on the display screen 110 using the mouse 1211 or by using the cursor touch area 1213.

[0061] Taking the first input device 120 as a keyboard 1212, which serves as an external device of the first electronic device 100, after establishing a communication connection between the keyboard 1212 and the first electronic device 100, the user can use the keyboard 1212 to input various input information into the first electronic device 100, such as text, numbers, and characters.

[0062] Of course, the keyboard 1212 can also be part of the first electronic device 100. For example, if the first electronic device 100 is a laptop, the keyboard area 1214 typically found on a laptop can be considered as the laptop's keyboard 1212. When the first electronic device 100 is a desktop computer, the desktop computer's keyboard 1212 is usually an external device. It is worth noting that, if the first input device 120 is an external device of the first electronic device 100, and the first electronic device 100 and the first input device 120 establish a wireless communication connection via near field communication (NFC), both the first electronic device 100 and the first input device 120 need to support NFC functionality.

[0063] When the keyboard 1212, mouse 1211, etc., are used as the first input device 120, if the keyboard 1212 and mouse 1211 are external devices of the first electronic device 100, the first electronic device 100 in this embodiment can establish a communication connection with the first input device 120 via a wired method (e.g., a data cable) or a wireless method. For example, the first electronic device 100 can establish a connection with the keyboard 1212 and mouse 1211 via wireless methods such as Bluetooth (BT), Wi-Fi, NFC, etc.

[0064] In this embodiment, the first electronic device 100 and the second electronic device 200 can establish a communication connection through wireless communication technology. This communication connection can be a physical connection or a virtual connection. The physical connection is based on a physical link. A virtual connection does not require a physical link. Compared to a physical connection, a virtual connection saves more power on both the first electronic device 100 and the second electronic device 200, extending their usage time. For example, the wireless communication technology can be Bluetooth. Exemplarily, this wireless communication technology can be Bluetooth Low Energy (BLE), wireless local area networks (WLAN) (such as Wireless Fidelity (Wi-Fi) networks), Zigbee connections, frequency modulation (FM), NFC, infrared (IR) technology, or general 2.4G / 5G frequency band wireless communication technologies. The wireless connection is a connection established using this wireless communication technology. This embodiment does not specifically limit the type of wireless communication technology.

[0065] Of course, the first electronic device 100 can also establish a connection with the second electronic device 200 via wired communication technology. The wired communication connection can be based on protocols such as Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), General-Purpose Interface Bus (GPIB), or Ethernet. This application does not specifically limit the particular communication connection method between the first electronic device 100 and the second electronic device 200.

[0066] For example, if both the first electronic device 100 and the second electronic device 200 have NFC, then by touching the NFC sensing areas of the first electronic device 100 and the second electronic device 200 together and performing the corresponding operation, automatic pairing between the first electronic device 100 and the second electronic device 200 can be achieved. After pairing, the first electronic device 100 and the second electronic device 200 can establish a communication connection.

[0067] It is worth noting that once the communication connection between the first electronic device 100 and the second electronic device 200 is established, it can be considered that the two have a data transmission channel.

[0068] To enable switching between the first input device 120 and the second electronic device 200 when a communication connection exists between them, in this embodiment, the display screen 110 has a first cursor movement boundary (not shown in the figure). When the cursor 112 is located at the first cursor movement boundary, or when the cursor 112 remains at the first cursor movement boundary for a duration exceeding a preset time, or when the cursor 112 is located at the first cursor movement boundary, if the first electronic device 100 detects that it will continue to trigger the operation of moving the cursor 112 toward the screen edge where the first cursor movement boundary is located, then the first electronic device 100 can switch the control device of the first input device 120 to the second electronic device 200, so that the first electronic device 100 and the second electronic device 200 can reuse the same first input device 120. In this way, the user can operate the second electronic device 200 using the first input device 120. For example, if the first input device 120 is a mouse 1211 or a cursor touch area 1213, the user can use the mouse 1211 or cursor touch area 1213 to control the cursor 112 to move on the display screen 210 of the second electronic device 200, in order to select various menus displayed on the display screen 210. Similarly, if the first input device 120 is a keyboard 1211 or keyboard area 1214, when the user needs to input text into the second electronic device 200, the user can operate the keyboard 1211 or keyboard area 1214 to achieve the purpose of inputting text into the second electronic device 200. Similarly, when the first input device 120 is controlled by the second electronic device 200, in order to switch the control device of the first input device 120 to the first electronic device 100, the display screen 210 also has a second cursor movement boundary (not shown in the figure). Thus, when the cursor 112 displayed on the display screen 210 is located at the second cursor movement boundary, or the cursor 112 is located at the second cursor movement boundary for a period of time exceeding a specified duration, or when the second electronic device 200 detects that the cursor 112 is located at the second cursor movement boundary and continues to control the cursor 112 toward the screen edge where the second cursor movement boundary is located, the second electronic device 200 sends a first trigger message to the first electronic device 100 to trigger the first electronic device 100 to re-control the first input device 120, so as to switch the control device of the first input device 120 back to the first electronic device 100. For specific implementation, please refer to the description in the following embodiments.

[0069] The aforementioned first cursor movement boundary can be a default setting or determined by the first electronic device 100 based on its relative position with the second electronic device 200. Similarly, the aforementioned second cursor movement boundary can be a default setting or determined by the second electronic device 200 based on its relative position with the first electronic device 100. For details on how the first electronic device 100 determines the first cursor movement boundary based on its relative position with the second electronic device 200, and how the second electronic device 200 determines the second cursor movement boundary based on its relative position with the first electronic device 100, please refer to the description in the following embodiments.

[0070] Based on the above description, as one implementation, at least one UWB base station (also referred to as a UWB chip) is deployed on the display screen 210 in this embodiment of the application.

[0071] The second electronic device 200 mentioned in this application embodiment refers to an electronic device with a display screen. For example, the electronic device in this application embodiment can be a smart TV, a projection device that projects onto a wall, a smart screen, a desktop computer, various portable laptops, various tablet computers, and other electronic devices with a display screen. Optionally, the electronic device can also be a personal digital assistant (PDA) with a display screen, a handheld device with a display screen, a computing device, an in-vehicle device, a wearable device, an electronic device in a 5G network, or an electronic device in an evolved public land mobile network (PLMN), etc., and this application embodiment is not limited to these. Figure 1 As shown, taking the second electronic device 200 as an example of a smart TV, the smart TV can be operated using a remote control.

[0072] The first electronic device 100 involved in this application embodiment can be a laptop computer, desktop computer, smart TV, a projection device that can project onto a wall, smart screen, desktop computer, various portable laptops, various tablet computers, and other electronic devices with displays, etc. The operating system used by the first electronic device 100 can be, for example, Android, BSD, iOS, Linux, Mac OS X, Windows, Windows Phone, and z / OS.

[0073] In this embodiment of the application, the second electronic device 200 and the first electronic device 100 can be different types of electronic devices. For example, the second electronic device 200 is a smart TV, while the first electronic device 100 is a laptop computer.

[0074] Alternatively, the second electronic device 200 and the first electronic device 100 can be the same type of electronic device. For example, both the first electronic device 100 and the second electronic device 200 can be laptops or smart TVs. This application does not limit this. In the relevant drawings involved in the subsequent embodiments of this application, the first electronic device 100 is a laptop and the second electronic device 200 is a smart TV as an example.

[0075] For example, Figure 2 A schematic diagram of the hardware structure of the first electronic device 100 is shown. (For example...) Figure 2 As shown, the first electronic device 100 may include a display screen 110, a processor 130, an external memory interface 140, an internal memory 190, a USB interface 160, a charging management module 170, a power management module 171, a battery 172, a wireless communication module 180, an antenna 1, and an antenna 2. At least one UWB base station 111 is deployed on the display screen 110. For example, the at least one UWB base station 111 can be a single UWB base station, and the location of the at least one UWB base station 111 deployed on the display screen 110 can be, for example... Figure 4 or Figure 5 The location shown.

[0076] Optionally, the first electronic device 100 may also include: a sensor module 150, etc.

[0077] Optionally, the sensor module 150 may include a direction sensor. Optionally, in this embodiment, the direction sensor may include an inertial measurement unit (IMU). For example, the direction sensor may be a 9-axis IMU composed of an accelerometer sensor, a gyroscope sensor, and a magnetic sensor. Alternatively, the direction sensor may be a 6-axis IMU composed of an accelerometer sensor and a gyroscope sensor, etc. This embodiment is not limited thereto.

[0078] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the first electronic device 100. In other embodiments of this application, the first electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0079] Processor 130 may include one or more processing units. For example, processor 130 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU), etc. Different processing units may be independent components or integrated into one or more processors. In some embodiments, the first electronic device 100 may also include one or more processors 130. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.

[0080] In some embodiments, the processor 130 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM card interface, and / or a USB interface, etc.

[0081] The USB interface 160 is a USB standard compliant interface, specifically a Mini USB interface, MicroUSB interface, USB Type-C interface, etc. The USB interface 160 can be used to connect a charger to charge the first electronic device 100, or to connect headphones for audio playback. The USB interface 160 can be used for data transfer between the first electronic device 100 and peripheral devices, or for establishing a communication connection between the first electronic device 100 and the second electronic device 200. Alternatively, the USB interface 160 can be used to establish a communication connection between the first electronic device 100 and the first input device 120.

[0082] The charging management module 170 receives charging input from the charger. The power management module 171 connects the battery 172, the charging management module 170, and the processor 130. The power management module 171 receives input from the battery 172 and / or the charging management module 170 to power devices requiring power, such as the processor 130, internal memory 190, external memory, display screen 110, and wireless communication module 180. The power management module 171 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 171 may also be located within the processor 130. In other embodiments, the power management module 171 and the charging management module 170 may be located in the same device.

[0083] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the first electronic device 100. In other embodiments of this application, the first electronic device 100 may also adopt different interface connection methods or a combination of multiple interface connection methods as described in the above embodiments.

[0084] The wireless communication function of the first electronic device 100 can be realized through antenna 1, antenna 2 and wireless communication module 180, etc.

[0085] The wireless communication module 180 can provide wireless communication solutions for the first electronic device 100, including Wi-Fi (including Wi-Fi sensing and Wi-Fi AP), Bluetooth (BT), and wireless data transmission modules (e.g., 433MHz, 868MHz, 915MHz). The wireless communication module 180 can be one or more devices integrating at least one communication processing module. The wireless communication module 180 receives electromagnetic waves via antenna 1 or antenna 2 (or antenna 1 and antenna 2), filters and frequency-modulates the electromagnetic wave signals, and sends the processed signal to processor 130. The wireless communication module 180 can also receive signals to be transmitted from processor 130, frequency-modulate and amplify them, and then convert them into electromagnetic waves for radiation via antenna 1 or antenna 2. For example, in this embodiment, the first electronic device 100 can establish a wireless communication connection with the second electronic device 200 through the wireless communication module 180.

[0086] The external storage interface 140 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the first electronic device 100. The external storage card communicates with the processor 130 through the external storage interface 140 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0087] Internal memory 190 can be used to store one or more computer programs, which include instructions. Processor 130 can execute the instructions stored in internal memory 190, thereby causing the first electronic device 100 to perform the methods provided in some embodiments of this application, as well as various applications and data processing. Internal memory 190 may include a code storage area and a data storage area. The code storage area may store the operating system. The data storage area may store data created by the first electronic device 100 during use. In addition, internal memory 190 may include high-speed random access memory, and may also include non-volatile memory, such as one or more disk storage components, flash memory components, universal flash storage (UFS), etc. In some embodiments, processor 130 can execute instructions stored in internal memory 190 and / or instructions stored in memory disposed in processor 130, thereby causing the first electronic device 100 to perform the methods provided in embodiments of this application, as well as other applications and data processing.

[0088] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the first electronic device 100. In other embodiments of this application, the first electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0089] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the first electronic device 100. In other embodiments of this application, the first electronic device 100 may also adopt different interface connection methods or a combination of multiple interface connection methods as described in the above embodiments.

[0090] For example, Figure 3 A schematic diagram of the hardware structure of the second electronic device 200 is shown. (For example...) Figure 3As shown, the second electronic device 200 may include a processor 230, an external memory interface 280, an internal memory 240, a universal serial bus (USB) interface 290, a charging management module 250, a power management module 251, a battery 252, antenna 1, antenna 2, a wireless communication module 260, a sensor module 270, and a display screen 210, on which at least one UWB base station is deployed. For example, at least one UWB base station can be one UWB base station (e.g., UWB base station 2403) or two UWB base stations (e.g., UWB base station 2401 and UWB base station 2402), and the location of the at least one UWB base station deployed on the display screen 210 can be, for example... Figure 4 or Figure 5 The location shown.

[0091] The functions of each module in the second electronic device 200 can be found in the following reference. Figure 2 The function of the corresponding module in the first electronic device 100.

[0092] The second electronic device 200 includes, but is not limited to, tablet computers, desktop computers, portable electronic devices (such as laptops), smart TVs (such as smart screens), in-vehicle computers, smart speakers, augmented reality (AR) devices, virtual reality (VR) devices, and other devices with displays.

[0093] Typically, the second electronic device 200 can use one or more of the following operating systems: Android, YunOS, WebOS, and TIZEN. It is worth noting that the second electronic device 200 can also use other operating systems.

[0094] like Figure 4 As shown, Figure 4 This diagram illustrates the hardware structure of a first electronic device 100 according to an embodiment of this application. Figure 4 As shown, the first electronic device 100 includes a display screen 110, on which a UWB base station 111 is disposed. The UWB base station in this embodiment can also be referred to as a UWB chip.

[0095] Optionally, the UWB base station 111 is located at the center of the display screen 110 to improve the accuracy of target positioning. The UWB base station 111 can also be located at other positions on the display screen 110. The second electronic device 200 includes a display screen 210, on which UWB base stations 2401 and 2402 are deployed. To better achieve accurate target positioning, optionally, the aforementioned UWB base stations 2401 and 2402 can be symmetrically distributed on the left edge (left boundary) and right edge (right boundary) of the display screen 210; in other words, the UWB base stations 2401 and 2402 are symmetrically distributed on both sides of the display screen 210 in the horizontal direction. Alternatively, the UWB base stations 2401 and 2402 can also be symmetrically distributed on the upper edge (upper boundary) and lower edge (lower boundary) of the display screen 210; in other words, the UWB base stations 2401 and 2402 are symmetrically distributed on both sides of the display screen 210 in the vertical direction. It should be noted that UWB base stations 2401 and 2402 are located at the left and right edges, or the top and bottom edges, of the second electronic device 200, respectively, which are preferred distribution positions. UWB base stations 2401 and 2402 can also be located at other positions within the second electronic device 200. These other positions can be symmetrical (left-right symmetrical, top-bottom symmetrical) or asymmetrical.

[0096] In other words, at least one UWB base station on the second electronic device 200 may be distributed in different positions in front of or behind the display screen 210, and all or part of the vertical projection of at least one UWB base station on the display screen 210 is located on the display screen 210.

[0097] As an example, Figure 4 Taking UWB base station 2401 and UWB base station 2402 as an example, which are symmetrically distributed on the left edge (left boundary) and right edge (right boundary) of display screen 210.

[0098] like Figure 4 As shown, the UWB base station 111 on the display screen 110 of the first electronic device 100 is located at the center of the display screen 110.

[0099] Combination Figure 4In this embodiment, the UWB base station 2401 and UWB base station 2402 of the second electronic device 200 are used to receive UWB signals transmitted from the UWB base station 111 of the first electronic device 100. The second electronic device 200 can calculate the relative position between the first electronic device 100 and the second electronic device 200 based on the UWB signals transmitted by the UWB base station 111 (for example, the first electronic device 100 is located to the left, right, lower left, upper left, etc. of the second electronic device 200, or at a specific angle; the specific position can be referred to below). Figures 16A-16J ).

[0100] It should be noted that UWB base stations 2401 and 2402 can also be used to transmit UWB signals to the UWB base station 111 of the first electronic device 100. The first electronic device 100 can receive UWB signals from the second electronic device 200 through the UWB base station 111. The first electronic device 100 can calculate the relative position between the first electronic device 100 and the second electronic device 200 based on the UWB signals from the second electronic device 200.

[0101] The first electronic device 100 described above can transmit UWB signals when the following triggering conditions are met. For example, the first electronic device 100 can be configured to periodically transmit UWB signals, or the first electronic device 100 can be configured to transmit UWB signals only when an operation instructing it to transmit UWB signals is detected, or the first electronic device 100 can transmit UWB signals only when its location is determined to have changed. This application embodiment does not limit this. Similarly, the second electronic device 200 can be configured to periodically monitor UWB signals, or the second electronic device 200 can be configured to monitor UWB signals only when an operation instructing it to monitor UWB signals is detected, or the second electronic device 200 can monitor UWB signals only when its location is determined to have changed. The triggering conditions for the second electronic device 200 to transmit UWB signals through UWB base stations 2401 and 2402 can refer to the triggering conditions for the first electronic device 100 to transmit UWB signals described above, and will not be repeated here. Similarly, the method by which the first electronic device 100 monitors the UWB signal can be the same as the method by which the second electronic device 200 monitors the UWB signal, and will not be repeated here.

[0102] Or, such as Figure 5 As shown, Figure 5 and Figure 4The difference lies in the fact that a UWB base station 2403 is deployed on the display screen 210 of the second electronic device 200. However, the UWB base station 2403 is a dual-antenna UWB base station, meaning it has antenna 1 and antenna 2. This allows the second electronic device 200 to receive UWB signals from at least one UWB base station of the first electronic device 100, thereby calculating the relative position between the first electronic device 100 and the second electronic device 200. It should be noted that the UWB base station 2403 can also transmit UWB signals or receive UWB signals transmitted by the UWB base station 111 of the first electronic device 100.

[0103] It should be understood that, in the embodiments of this application, the specific shape of the display screen 110 of the first electronic device 100 or the display screen 210 of the second electronic device 200 is not limited. For example, the display screen 110 of the first electronic device 100 or the display screen 210 of the second electronic device 200 can be rectangular, or parallelogram, hexagon, octagon, decagon, circle, etc. The embodiments of this application do not impose any limitations here.

[0104] It should also be understood that, in this embodiment, the number of UWB base stations on the display screen 210 can be greater than or equal to two, for example, two, four, or five, etc.; as long as the relative position between the first electronic device 100 and the second electronic device 200 can be determined using the multiple UWB base stations on the display screen 210 to obtain the second cursor movement boundary of the display screen 210, similarly, the number of UWB base stations on the display screen 210 can also be greater than or equal to two. This embodiment does not impose any limitations here.

[0105] Figure 6 This is a schematic diagram illustrating the principle for calculating the relative positions of the first electronic device 100 and the second electronic device 200. (See diagram for example.) Figure 6 As shown, the distance D between UWB base station 2401 and UWB base station 2402 is shown. Here, D is a fixed distance (i.e., default distance) between UWB base station 2401 and UWB base station 2402; or, D is the distance between UWB base station 2401 and UWB base station 2402 calculated by the second electronic device 200 based on the signal between them. The second electronic device 200 calculates the distances L1 and L2 between UWB base station 111 and UWB base station 2401 and UWB base station 2402 respectively based on the UWB signal 1 from the first electronic device 100.

[0106] A triangle can be constructed based on UWB base stations 2401, 2402, and 111. The interior angles of the triangle can be determined using the Law of Cosines. For example, Among them, such as Figure 6 As shown, α represents the angle between line segment 1 and line segment 2. Line segment 1 represents the line connecting UWB base station 111 and UWB base station 2401, and line segment 2 represents the line connecting UWB base station 2401 and UWB base station 2402. It is worth noting that if line segment 2 is the X-axis of the coordinate system, then α represents the angle between line segment 1 and the X-axis.

[0107] β represents the angle between the extension of line segment 2 and line segment 1.

[0108] After obtaining the angles of each interior angle, a coordinate system can be optionally established. For example, a coordinate system can be established with the midpoint of the line connecting UWB base station 2401 and UWB base station 2402 as the origin. Alternatively, a coordinate system can be established with other points as the origin, but the coordinates of the locations of UWB base station 2401 and UWB base station 2402 can be located within that coordinate system.

[0109] For ease of explanation, the following example uses a coordinate system established with the midpoint of UWB base station 2401 and UWB base station 2402 as the origin. The coordinates (X, Y) of UWB base station 111 in this coordinate system are calculated using the following formula, where... , , .

[0110] For example, such as Figure 7 As shown, assuming a dual-antenna UWB base station (also referred to as a dual-antenna UWB tag chip) is deployed on the second electronic device 200, the dual-antenna UWB base station can directly measure the angle information α and distance from the UWB base station 111 of the first electronic device 100 to the dual-antenna UWB base station. The specific process can be referred to the above. Figure 6 The process shown will not be repeated here. It is worth noting that when a dual-antenna UWB base station is deployed on the second electronic device 200, the origin of this coordinate system is the coordinate of the location of the dual-antenna UWB base station, or the coordinate of the location of the dual-antenna UWB base station is located in a coordinate system established with other points as the origin.

[0111] Having obtained the coordinates (X, Y) of UWB base station 111 in the coordinate system, the second electronic device 200 can calculate the angle from UWB base station 111 to the origin O based on its coordinates (X, Y). The second electronic device 200 can then use this angle as the relative position between the first electronic device 100 and the second electronic device 200.

[0112] In the following description, the rectangular display screen 210 of the second electronic device 200 will be used as an example.

[0113] The rectangular display screen 210 includes a first edge, a second edge, a third edge, and a fourth edge. The first edge is parallel to the second edge, the third edge is parallel to the fourth edge, the first edge and the second edge are parallel to a first direction, the third edge and the fourth edge are parallel to a second direction, and the first direction is perpendicular to the second direction. In the following description, the first direction will be the horizontal direction of the display screen 210, the second direction will be the vertical direction of the display screen 210, and the first edge will be the upper edge (or upper boundary) of the display screen 210, the second edge will be the lower edge (or lower boundary) of the display screen 210, the third edge will be the left edge (or left boundary) of the display screen 210, and the fourth edge will be the right edge (or right boundary) of the display screen 210. Similarly, the display screen 110 of the first electronic device 100 also includes a first edge, a second edge, a third edge, and a fourth edge. The first edge is parallel to the second edge, the third edge is parallel to the fourth edge, the first edge and the second edge are parallel to the first direction, the third edge and the fourth edge are parallel to the second direction, and the first direction is perpendicular to the second direction. In the following description, the first direction is the horizontal direction of the display screen 110, the second direction is the vertical direction of the display screen 110, and the first edge is the upper edge (or upper boundary) of the display screen 110, the second edge is the lower edge (or lower boundary) of the display screen 110, the third edge is the left edge (or left boundary) of the display screen 110, and the fourth edge is the right edge (or right boundary) of the display screen 110.

[0114] It should also be understood that, in the embodiments of this application, the first electronic device 100 and the second electronic device 200 can establish a communication connection through various methods such as Wi-Fi connection and Bluetooth connection, so that the first electronic device 100 and the second electronic device 200 can transmit information or messages.

[0115] Figure 8 This is a schematic diagram illustrating a process for establishing a communication connection between devices, provided as an embodiment of this application. This method can be applied to, for example... Figure 1 The system shown. For example... Figure 8 As shown, the method includes: Step 801: When the first triggering condition is met, the first electronic device 100 outputs a first prompt message. The first prompt message is used to indicate whether to cooperate with other electronic devices.

[0116] In one embodiment of this application, the first prompt information may be a voice prompt, a text prompt, or a combination of voice and text prompts; this embodiment of the application does not limit this.

[0117] Taking the remote control of the first electronic device 100 and the second electronic device 200 as an example, if the user touches the NFC area of ​​the first electronic device 100 with the remote control of the second electronic device 200, the first electronic device 100 will determine that the first trigger condition is met and thus output the first prompt information.

[0118] Taking the first electronic device 100's support for voice control as an example, if the first electronic device 100 detects a voice control command from a user, such as "Xiao X Xiao X, collaborate with the large-screen device," then the first electronic device 100 responds to the voice control command and outputs the first prompt message. Here, "Xiao X Xiao X" is the wake-up word of the first electronic device 100. For example, "Xiao X Xiao X" could be "Xiao Yi Xiao Yi," or "Xiao E Xiao E," etc.

[0119] Alternatively, the first electronic device 100 calculates the distance between itself and the remote control based on the relative strength index (RSI) signal. If the distance between the first electronic device 100 and the remote control is less than a preset distance threshold, the first electronic device 100 first prompts the user with a first notification message asking whether to cooperate with the television.

[0120] For example, such as Figure 9 As shown, taking a text-based prompt as an example, when a user wants to input text on a second electronic device 200 using the first input device 120 of the first electronic device 100 (such as a mouse, keyboard area, cursor touch area, or keyboard), or to input a video app or Word document running on the second electronic device 200, the user can touch the first electronic device 100 using the remote control of the second electronic device 200. Under the condition that the first triggering condition is met, such as... Figure 9 As shown in (A), a prompt box 90 (corresponding to the first indication information) is displayed on the screen 110 of the first electronic device 100. The prompt box 90 is used to prompt the user whether to cooperate with other electronic devices. In addition to the text prompting the user whether to cooperate with the television, the prompt box 90 may also include controls 90-1 and 90-2. The activation of control 90-2 indicates cooperation with other electronic devices. The activation of control 90-1 indicates no cooperation with other electronic devices.

[0121] Step 802: Upon detecting a first operation indicating cooperation with other electronic devices, the first electronic device 100 displays information about one or more available electronic devices on the display screen 110.

[0122] In this embodiment, the first electronic device 100 may initiate a signal search upon detecting the first operation to search for one or more available electronic devices that can cooperate with it. Then, the first electronic device 100 displays information about the one or more available electronic devices found on the display screen 110, allowing the user to select a target electronic device (i.e., the second electronic device) to establish a communication connection. Alternatively, the laptop computer 801 may initiate a signal search upon meeting the triggering conditions, but only after detecting the first operation will it display information about one or more available electronic devices on the display screen 110. This embodiment does not limit this approach.

[0123] It is worth noting that the aforementioned one or more available electronic devices may include electronic devices that have enabled NFC, enabled Bluetooth, or are connected to the same wireless network as the first electronic device 100.

[0124] For example, continue to combine Figure 9 If the first electronic device 100 detects that control 90-2 has been triggered, then the first electronic device 100 determines that the first operation has been detected, and thus the first electronic device 100 can determine that the user has authorized the first electronic device 100 to cooperate with the television. Optionally, such as... Figure 9 As shown in (B), the first electronic device 100 begins to search for available electronic devices in the vicinity of the first electronic device 100. Figure 9 (B) in the diagram represents the interface where the first electronic device 100 searches for available electronic devices in its vicinity. This interface displays a prompt box 91 to indicate that the first electronic device 100 is searching for devices. Users can... Figure 9 The interface shown in (B) allows you to trigger control 90-1 to cancel the current search, or trigger control 90-2 to view information that requires help.

[0125] After finding available electronic devices in the vicinity of the first electronic device 100, the first electronic device 100 can then display, as shown below. Figure 9 The interface shown in (C) is shown in the image.

[0126] It is worth noting that, Figure 9 (B) in the diagram represents an optional interface. In practice, the first electronic device 100 may not display this interface. Figure 9 The interface shown in (B) is... Figure 9 (A) in the middle is followed by the following: Figure 9 The interfaces shown in (C) and (D) are shown in the image.

[0127] It is worth noting that if the first electronic device 100 detects that the control 90-1 has been triggered, the first electronic device 100 determines that the user has not authorized the first electronic device 100 to cooperate with the TV. In this case, the first electronic device 100 will not search for available electronic devices in the vicinity of the first electronic device 100 or will not display information about one or more available electronic devices.

[0128] In one embodiment of this application, after the first electronic device 100 initiates a signal search, it may find one or more available electronic devices, such as a smart TV 1 in the living room, a smart TV 2 in the master bedroom, a smart speaker, and a computer 1. In one possible implementation, the first electronic device 100 can display all the found available electronic devices on its display screen 110. In another possible implementation, the first electronic device 100 can display devices among one or more available electronic devices that can cooperate with the first electronic device 100 on its display screen 110. For example, such as... Figure 9 As shown in Figure (C), the first electronic device 100 displays a smart TV in the living room and a smart TV in the bedroom on its display screen 110 using a prompt box 92.

[0129] Optionally, if the first electronic device 100 only displays devices capable of cooperating with it, the method provided in this embodiment may further include: the first electronic device 100 determining which devices among one or more available electronic devices can cooperate with it. For example, the first electronic device 100 can determine the device capable of cooperating with it based on information from one or more available electronic devices. For instance, if the first electronic device 100 determines that it wants to cooperate with a television, then none of the devices among the one or more available electronic devices other than the television are capable of cooperating with it. In other words, the first electronic device 100 may only display information about the televisions it has found on its display screen 110.

[0130] Taking the scenario where, when the triggering condition is met, the first electronic device 100 initiates a signal search to display that one or more available electronic devices have been found, with the user's consent and cooperation with the television, as an example; in another embodiment of this application, when the triggering condition is met, the first electronic device 100 may not prompt the user to determine whether to cooperate with the second electronic device 200, but may directly initiate a signal search to display that one or more available electronic devices have been found.

[0131] Step 803: The first electronic device 100 detects the second operation. In response to the second operation, the first electronic device 100 determines the second electronic device selected by the second operation from one or more available electronic devices.

[0132] like Figure 9As shown in (C), when the user decides to collaborate with the smart TV in the living room (i.e., the second electronic device 200), the user can use the first input device 120 (such as mouse 1211) of the first electronic device 100 to make the cursor 112 select the information corresponding to the smart TV in the living room. At this time, the first electronic device 100 can determine that it has detected the second operation. Optionally, after the user selects the information corresponding to the smart TV in the living room, they can also operate the mouse 1211 of the first electronic device 100 to trigger the control 92-2. In this case, the operation of the first input device 120 of the first electronic device 100 and the operation of the control 92-2 being triggered can both be regarded as the second operation.

[0133] If the first electronic device 100 detects that 92-1 has been triggered, it will not send a connection request, thus suspending the operation of establishing a communication connection with other devices.

[0134] Step 804: The first electronic device 100 sends a connection request to the second electronic device 200. Correspondingly, the second electronic device 200 receives the connection request sent by the first electronic device 100.

[0135] For example, the first electronic device 100 can initiate a connection request to the second electronic device 200 via Bluetooth, NFC, or WIFI communication technology.

[0136] It should be noted that when the display screen 110 of the first electronic device 100 displays information about one or more available electronic devices, the information about the one or more available electronic devices may include identifiers such as the Bluetooth address, MAC address, or IP address of the available electronic device. In this case, the first electronic device 100 can establish a communication connection with the available electronic device based on its Bluetooth address, MAC address, or IP address. In this case, steps 805 and 806 can be omitted. On the other hand, if the information about the available electronic device does not include a MAC address or IP address, but includes a Bluetooth address or other information that can identify the available electronic device, then the first electronic device 100 can obtain the MAC address or IP address of the available electronic device through step 805, and subsequently establish a data transmission channel with the available electronic device based on its MAC address or IP address.

[0137] The connection request can be used to request cooperation with the second electronic device 200, or it can be used to request the address information of the second electronic device 200. The connection request may carry the identifier of the first electronic device 100, which can be its IP address, MAC address, or other information that identifies the first electronic device 100. In this way, after receiving the connection request, the second electronic device 200 can determine which device to establish a data transmission channel with.

[0138] Step 805: In response to the received connection request, the second electronic device 200 sends its address information to the first electronic device 100. Correspondingly, the first electronic device 100 receives the address information from the second electronic device 200. The address information of the second electronic device 200 is used to establish a data transmission channel with the first electronic device 100.

[0139] As an example, the address information of the second electronic device 200 may be the MAC address or IP address of the second electronic device 200, and this application embodiment does not limit this.

[0140] As an optional embodiment, before the second electronic device 200 receives a connection request and sends its address information to the first electronic device 100, the method provided in this embodiment may further include: the second electronic device 200 displaying a second prompt message on its display screen 210. The second prompt message is used to indicate whether collaboration with the first electronic device 100 is permitted.

[0141] Subsequently, if the second electronic device 200 detects a third operation indicating permission to cooperate with the first electronic device 100, the second electronic device 200, in response to the third operation, sends its address information to the first electronic device 100.

[0142] It should be noted that when the second electronic device 200 displays the second prompt information on its display screen 210, if the second electronic device 200 detects a fourth operation indicating that cooperation with the first electronic device 100 is not permitted, the second electronic device 200 sends a rejection response to the first electronic device 100. This rejection response indicates that cooperation with the first electronic device 100 is not permitted.

[0143] like Figure 9 As shown in (D), Figure 9 (D) shows the interface where the second electronic device 200 displays a prompt box 93 (corresponding to the second prompt information) on the display screen 210 after receiving a connection request. Figure 9As shown in (D), the interface may also include controls 93-1 and 93-2. If control 93-2 is triggered, it indicates that the user does not want the second electronic device 200 to cooperate with the first electronic device 100. In this case, the second electronic device 200 can respond to the operation triggered by control 93-2 (for example, the fourth operation mentioned above) and send a rejection response to the first electronic device 100. If control 93-1 is triggered, it indicates that the user wants the second electronic device 200 to cooperate with the first electronic device 100. In this case, the second electronic device 200 can respond to the operation triggered by control 93-1 (for example, the third operation mentioned above) and send the address information of the second electronic device 200 to the first electronic device 100.

[0144] It is worth noting that, in Figure 9 On the interface shown in (D), if the second electronic device 200 does not detect user input within a specified time (e.g., 5 seconds or 10 seconds), the second electronic device 200 assumes that the user wants the second electronic device 200 and the first electronic device 100 to cooperate. Alternatively, in Figure 9 On the interface shown in (D), if the second electronic device 200 does not detect user input within a specified time (e.g., 5 seconds or 10 seconds), the second electronic device 200 assumes that the user does not want the second electronic device 200 and the first electronic device 100 to cooperate. This application embodiment does not limit this aspect.

[0145] As an optional embodiment, in this application embodiment, after receiving a connection request, the second electronic device 200 sends its address information to the first electronic device 100, which is different from... Figure 9 As shown in (D), the prompt box 93 is not displayed, nor are controls 93-1 and 93-2.

[0146] Step 806: The first electronic device 100 establishes a data transmission channel with the second electronic device 200 through the address information of the second electronic device 200.

[0147] It is worth noting that the first electronic device 100, upon obtaining the address information of the second electronic device 200, can establish a communication connection with the second electronic device 200 through various methods such as Bluetooth and Wi-Fi. This established communication connection can be considered a data transmission channel. The specific implementation methods for establishing this data transmission channel will not be elaborated here.

[0148] After successfully establishing a data transmission channel, the first electronic device 100 can store the address information and trust relationship of the second electronic device 200. Similarly, the second electronic device 200 can also store the address information and trust relationship of the first electronic device 100. This way, if subsequent collaborative operations between the first electronic device 100 and the second electronic device 200 need to be restarted, the process of obtaining the address information of the second electronic device 200 does not need to be executed. In other words, if the first electronic device 100 has already stored the address information and trust relationship of the second electronic device 200, then after step 803, the first electronic device 100 can obtain the address information of the second electronic device 200 from the stored trust relationship to establish a data transmission channel between them.

[0149] like Figure 10 As shown, Figure 10 This illustration shows a flowchart of a cross-device collaboration method for input device multiplexing provided in an embodiment of this application. The method is applied to a first electronic device 100, which is connected to a first input device 120. A cursor 112 is displayed on the display screen 110 of the first electronic device 100. Figure 10 As shown, the method provided in this application embodiment includes: Step 1001: When there is a data transmission channel between the first electronic device 100 and the second electronic device 200, the first electronic device 100 detects a movement operation 1 (first operation) acting on the first input device 120.

[0150] For example, the first electronic device 100 can be a laptop computer A or a desktop computer A, and the second electronic device 200 can be a smart TV, a smart projector, or a desktop computer B or a laptop computer B. In this scenario, the first input device 120 of the first electronic device, such as a laptop computer A or a desktop computer A, can be multiplexed to the second electronic device, such as a smart TV or a smart projector.

[0151] Alternatively, the first electronic device 100 can be an electronic device such as a smart TV or smart projector, and the smart TV or smart projector is connected to the first input device 120. The second electronic device 200 can be an electronic device such as a laptop or desktop computer. In this scenario, the first input device 120 of the first electronic device such as a smart TV or smart projector can be multiplexed to the second electronic device such as a laptop or desktop computer.

[0152] The first electronic device 100 can establish a communication connection with the first input device 120 through wireless communication methods such as Bluetooth, WiFi, ZigBee, NFC, or wired communication methods.

[0153] For example, optionally, the first electronic device 100 and the second electronic device 200 can adopt the following... Figure 10 Establish a communication connection as shown.

[0154] It is worth noting that the above Figure 10 The illustrated embodiment is an optional embodiment. Before the first electronic device 100 and the second electronic device 200 execute step 1001, if the first electronic device 100 and the second electronic device 200 have not established a communication connection, then the first electronic device 100 and the second electronic device 200 can communicate via... Figure 8 The embodiments shown establish a communication connection, or a communication connection is established through other means; this application does not limit the scope of the embodiments.

[0155] For example, such as Figure 11A As shown, the first electronic device 100 can receive user input operation 1111 (i.e., movement operation 1) via mouse 1211. The input operation 1111 can be a user operation that moves the mouse 1211. In response to the input operation 1111, the first electronic device 100 controls the cursor 112 to move on the display screen 110.

[0156] Step 1002: In response to movement operation 1, the first electronic device 100 controls the cursor 112 to move on the display screen 110 of the first electronic device 100. Movement operation 1 is used to trigger the first electronic device 100 to control the cursor 112 to move on the display screen 110 of the first electronic device 100.

[0157] For example, such as Figure 11A As shown, the first electronic device 100 controls the cursor 112 to move from point A to point B on the display screen 110.

[0158] Step 1003: When the cursor 112 moves to the first cursor movement boundary on the display screen 110, the first electronic device 100 controls the cursor 112 to hide on the display screen 110.

[0159] It should be noted that, on the one hand, as soon as the cursor 112 moves to the first cursor movement boundary on the display screen 110, the first electronic device 100 will switch the control device of the first input device 120 to the second electronic device 200. On the other hand, if the first electronic device 100 detects an operation to continue controlling the cursor 112 to move at the first cursor movement boundary when the cursor 112 moves to the first cursor movement boundary, then the first electronic device 100 will switch the control device of the first input device 120 to the second electronic device 200. In other words, if the first electronic device 100 does not detect an operation to continue controlling the cursor 112 to move when the cursor 112 moves to the first cursor movement boundary, it will not switch the control device of the first input device 120.

[0160] The so-called hiding of cursor 112 on the display screen 110 of the first electronic device 100 means that because cursor 112 moves to the first cursor movement boundary on the display screen 110 of the first electronic device 100, it meets the condition of switching the control device of the first input device 120 (such as mouse or keyboard). Therefore, the first electronic device 100 temporarily does not display cursor 112 on the display screen 110.

[0161] It is worth noting that, such as Figure 11B As shown, when the first electronic device 100 detects that the cursor 112 is in the position of... Figure 11B When the cursor moves within area A, the first electronic device 100 will not send the first trigger message to the second electronic device 200. In other words, the control device of the first input device 120 is controlled by the first electronic device 100. Area A refers to the area on the display screen 110 excluding the first cursor movement boundary. That is, if the user operates the first input device 120, such as a mouse 1211, the cursor touch area of ​​the first electronic device 100, or a keyboard, the first electronic device 100 responds to the user's operation on the first input device 120 by executing the corresponding command. For example, if the user operates the mouse 1211, the first electronic device 100 controls the cursor 112 to select content displayed on the display screen 110, or controls the cursor 112 to move on the display screen 110. For example, if the user operates the keyboard, the first electronic device 100 responds to the user's operation on the keyboard by inputting the corresponding text into the first electronic device 100. When the user continues to operate the mouse 1211 or the cursor touch area of ​​the first electronic device 100 to perform operation 1112, the first electronic device 100 responds to operation 1112 by continuing to control the movement of the cursor 112 on the display screen 110 of the first electronic device 100. If the first electronic device 100 detects that the cursor 112 has moved to such a position... Figure 11BWhen the first cursor moves to the boundary, the first electronic device 100 sends a first trigger message to the second electronic device 200. For example... Figure 11B As shown, cursor 112 is then displayed on the display screen 210 of the second electronic device 200, and cursor 112 is hidden on the display screen 110 (in the figure, the cursor 112 is hidden on the display screen 110 by a dashed line for intuitive representation).

[0162] In one embodiment of this application, if the time the cursor 112 remains within the first cursor movement boundary exceeds a threshold of 1 (e.g., 5 seconds), or if the first electronic device 100 detects an operation that triggers the cursor 112 to continue moving within the first cursor movement boundary after the cursor 112 has remained within the first cursor movement boundary, then the first electronic device 100 switches the control device of the first input device 120 to the second electronic device 200. This is because, in actual operation, although the cursor 112 may be within the first cursor movement boundary, the user may not necessarily want to switch the control device of the first input device 120. Therefore, by considering the time the cursor 112 remains within the first cursor movement boundary, the user's operating experience can be improved.

[0163] Step 1004: The first electronic device 100 sends a first trigger message to the second electronic device 200, and correspondingly, the second electronic device 200 receives the first trigger message from the first electronic device 100. The first trigger message is used to notify the control device of the first input device 120 to switch from the first electronic device 100 to the second electronic device 200. In other words, the first trigger message is used to trigger the second electronic device 200 to display cursor 112 on the display screen 210 and to control the control device of the first input device 120.

[0164] In one embodiment of this application, if the first electronic device 100 does not establish a data transmission channel with the second electronic device 200, or if the purpose of establishing a data transmission channel between the first electronic device 100 and the second electronic device 200 is not collaborative, then if the cursor 112 is located at the first cursor movement boundary, the control device of the first input device 120 will not switch; in other words, the first electronic device 100 will not execute steps 1004 and 1003. It is worth noting that, in this embodiment of the application, collaboration between the first electronic device 100 and the second electronic device 200 refers to the reuse of the same input device.

[0165] In an optional embodiment of this application, when a data transmission channel is established between the first electronic device 100 and the second electronic device 200, it is assumed that the two can transfer files to each other without authorization. Therefore, the second electronic device 200 does not display a prompt on its display screen 210 to indicate whether to receive the file before receiving the first trigger message. In other words, the second electronic device 200 receives the first trigger message by default.

[0166] In another optional embodiment of this application, before executing step 1003, the method provided in this application embodiment may optionally include: the first electronic device 100 using a fourth prompt message to prompt whether to send a first trigger message to the second electronic device 200. If authorized, the first electronic device 100 then sends the first trigger message to the second electronic device 200. This can avoid erroneous operations that may occur when there is a data transmission channel between the first electronic device 100 and the second electronic device 200.

[0167] To prevent accidental triggering, such as Figure 11C As shown, the first electronic device 100 detects that the cursor 112 has moved to the position shown. Figure 11C When the cursor moves to the first boundary shown, the first electronic device 100 can display a prompt box 1100 (corresponding to the fourth prompt information) on the display screen 110. The prompt box 1100 prompts whether to provide the first trigger message to the second electronic device. In addition to the prompt box 1100, the display screen 110 also displays controls 1101 and 1102. Triggering control 1101 indicates agreement to provide the first trigger message to the second electronic device. Triggering control 1102 indicates disagreement to provide the first trigger message to the second electronic device. If the first electronic device 100 detects that control 1101 has been triggered, it provides the first trigger message to the second electronic device. For example, when the cursor 112 moves to... Figure 11C In the case of the first cursor movement boundary shown, the user can manipulate the mouse 1211 to move the cursor 112 to control 1101 or control 1102. Taking the cursor 112 moving to control 1101 as an example, the user manipulates the mouse 1211 to trigger the first electronic device 100 to control the cursor 112 to select control 1101, thereby triggering control 1101.

[0168] It is worth noting that the steps of the first electronic device 100 controlling the cursor 703 to hide on the display screen 110 of the first electronic device 100 and step 1004 can be executed simultaneously, or the step of the first electronic device 100 controlling the cursor 112 to hide on the display screen 110 of the first electronic device 100 can also be executed after step 1004. This application embodiment does not limit this.

[0169] Step 1005: In response to the received first trigger message, the second electronic device 200 displays cursor 112 on the display screen 210 of the second electronic device 200.

[0170] For example, such as Figure 11B As shown, cursor 112 is then displayed on the display screen 210 of the second electronic device 200.

[0171] For example, when cursor 112 moves on the display screen 110 of the first electronic device 100, the following situation may occur: the user triggers mouse 1211 or cursor touch area 1213, so that the first electronic device 100 controls cursor 112 to be exactly at the first cursor movement boundary. If the user does not continue to move mouse 1211 or perform movement operations in cursor touch area 1213 when cursor 112 is at the first cursor movement boundary, the first trigger message sent by the first electronic device 100 to the second electronic device 200 only triggers the second electronic device 200 to display cursor 112 on the display screen 210 of the second electronic device 200, and to control the control device of the first input device 120.

[0172] For example, when cursor 112 moves on display screen 110, the user triggers the first input device 120, such as mouse 1211 or cursor touch area, so that the first electronic device 100 controls cursor 112 to be located at the first cursor movement boundary. When cursor 112 is located at the first cursor movement boundary, the user continues to perform movement operations on the first input device 120, such as mouse 1211 or cursor touch area. At this time, the first trigger message sent by the first electronic device 100 to the second electronic device 200 is not only used to trigger the second electronic device 200 to display cursor 112 on display screen 210 to control the control device of the first input device 120, but also to trigger the second electronic device 200 to control cursor 112 to execute corresponding operation commands on display screen 210 in response to the first trigger message, such as moving cursor 112 on display screen 210.

[0173] In one possible embodiment of this application, the second electronic device 200 receives a first trigger message from the first electronic device 100 by default.

[0174] In another optional embodiment of this application, before the second electronic device 200 receives the first trigger message from the first electronic device 100, such as Figure 11CAs shown, the second electronic device 200 displays a prompt message 1103 on the display screen 210. The prompt message 1103 indicates whether to receive the first trigger message from the first electronic device 100. If the second electronic device 200 detects that the control 1104 is triggered, it indicates that it receives the first trigger message from the first electronic device 100. If the second electronic device 200 detects that the control 1105 is triggered, it indicates that it refuses to receive the first trigger message from the first electronic device 100. In the case of refusing to receive the first trigger message from the first electronic device 100, the second electronic device 200 sends a rejection response 1 to the first electronic device 100. After receiving the rejection response 1, the first electronic device 100 can determine to continue displaying the cursor 112 on the display screen 110 side of the first electronic device 100. In the case of receiving the first trigger message from the first electronic device 100, the second electronic device 200 sends a receive response 1 to the first electronic device 100. Then, as... Figure 11B The cursor 112 is displayed on the display screen 210 of the second electronic device 200 shown.

[0175] As an example, when the second electronic device 200 displays a prompt message 1103 on the display screen 210, the user can use the remote control of the second electronic device 200 to trigger control 1104 or control 1105, or control it via voice commands, etc. This application embodiment does not limit this.

[0176] In one embodiment of this application, when the first electronic device 100 receives the receiving response 1 sent by the second electronic device 200, it then performs the operation of hiding the cursor 112 on the display screen 110 of the first electronic device 100.

[0177] It is worth noting that, Figure 11C Taking the example of displaying prompt information on both the first electronic device 100 and the second electronic device 200, in actual operation, either the first electronic device 100 or the second electronic device 200 can be selected, and the prompt information can be displayed on its screen. Figure 11C The displayed prompts reduce the complexity of the operation.

[0178] In one embodiment of this application, when the first electronic device 100 and the second electronic device 200 initially receive the first trigger message from the laptop computer, the display screen 210 of the second electronic device 200 may display the following: Figure 11C The prompt message 1103 is shown. Afterwards, if the second electronic device 200 receives the first trigger message from the first electronic device 100 again, it is not necessary to display the prompt message 1103 shown. Figure 11CInstead of displaying the prompt message 1103, it defaults to receiving the first trigger message from the first electronic device 100. This improves the user experience when using the first electronic device 100 and the second electronic device 200 for collaborative operation.

[0179] In another embodiment of this application, each time the second electronic device 200 receives movement information of the cursor 112 from the first electronic device 100, it can display as shown in the image. Figure 11C The prompt message 1103 is shown. Alternatively, for example, if the first electronic device 100 and the second electronic device 200 perform coordinated operation within time period 1, and the first electronic device 100 and the second electronic device 200 receive the first trigger message from the first electronic device 100 for the first time within time period 1, the following message is displayed: Figure 11C The prompt message shown indicates that, during the remaining time periods within time period 1, if the control device of cursor 112 frequently switches between the first electronic device 100 and the second electronic device 200, when the second electronic device 200 receives the first trigger message from the first electronic device 100 again, it may not display a prompt message but will receive it by default. If the data transmission channel between the first electronic device 100 and the second electronic device 200 is disconnected after time period 1, and the data transmission channel between the first electronic device 100 and the second electronic device 200 is restored during time period 2, then the operation of whether to display a prompt message when initially receiving the first trigger message from the first electronic device 100 and when receiving the first trigger message from the first electronic device 100 again during time period 2 can refer to time period 1, and will not be repeated here.

[0180] In an optional embodiment of this application, after receiving the first trigger message, the second electronic device 200 displays the cursor 112 in the same position on the display screen 210 of the second electronic device 200 each time, or the position is different each time, but it is always displayed in the area of ​​the display screen 210 of the second electronic device 200 other than the second cursor movement boundary.

[0181] This application provides a cross-device collaboration method for input device multiplexing. In this method, a first electronic device detects a first operation applied to a first input device and, in response to the first operation, controls the cursor to move on a first display screen. When the cursor moves to a first cursor movement boundary, the first electronic device sends a first trigger message to a second electronic device. Since this first trigger message is used to notify the switching of the control device for the first input device from the first electronic device to the second electronic device, the second electronic device, upon receiving the first trigger message, can determine the control device that will subsequently control the first input device. The first electronic device also feeds back operation information of subsequently detected operations applied to the first input device to the second electronic device, so that the second electronic device can respond to the operation information and execute the corresponding command. This solution allows for convenient and quick switching of the input receiving object without adding additional devices, and without switching input devices, thus improving the user experience. The technical solution provided by this application uses only the first input device to handle input to both the first and second electronic devices, and also enables switching between the first and second electronic devices.

[0182] In an optional embodiment of this application, such as Figure 10 As shown, optionally, when the cursor 112 is displayed on the display screen 210 of the second electronic device 200, the method provided in this application embodiment may further include: Step 1006: The first electronic device 100 feeds back the operation information corresponding to the detected second operation performed on the first input device 120 to the second electronic device 200. Correspondingly, the second electronic device 200 receives the operation information corresponding to the operation performed on the first input device 120 from the first electronic device 100.

[0183] Step 1007: The second electronic device 200 executes the relevant command in response to the operation information corresponding to the operation applied to the first input device 120.

[0184] like Figure 12A As shown, when cursor 112 is displayed on display screen 210, cursor 112 is displayed in the area of ​​display screen 210 other than the second cursor movement boundary. Therefore, as... Figure 12AAs shown, if the first electronic device 100 detects an operation 1211 by the user operating the first input device 120, such as the mouse 1211, then the first electronic device 100 sends operation information corresponding to operation 1211 to the second electronic device 200. The operation information corresponding to operation 1211 may be the user operating the first input device 120 to control the cursor 112 to move on the display screen 210, or the operation information corresponding to operation 1211 may be the user double-clicking / singling the left / right button of the mouse 1211, or the operation information corresponding to operation 1211 may be the user operating the mouse 1211 to trigger the second electronic device 200 to control the file selected by the cursor 112 to move on the display screen 210. This embodiment does not limit this. Assuming the operation information corresponding to operation 1211 is the user operating the first input device 120 to trigger the cursor 112 to move from position A to position B on the display screen 210, then in response to the operation information corresponding to operation 1211, the second electronic device 200 controls the cursor 112 to move from position A to position B on the display screen 210.

[0185] Assuming the cursor 112 is displayed on the screen 210, the user operates the first input device 120, such as the mouse 1211, to trigger the second electronic device 200 to control the cursor 112 to select an image on the screen 210. If, at this time, the first electronic device 100 detects the user's input of a double-click operation 2 (double-clicking the left mouse button 1211), then the first electronic device 100 sends the double-click operation 12 to the second electronic device 200. Upon receiving operation 2, the second electronic device 200, in response to operation 2, displays the interface corresponding to the image on the screen 210, such as... Figure 12B As shown.

[0186] In an optional embodiment of this application, such as Figure 10 As shown, optionally, when the cursor 112 is displayed on the display screen 210 of the second electronic device 200, the method provided in this application embodiment may further include: In step 1008, when the second electronic device 200 detects that the cursor 112 is located at the second cursor movement boundary, the second electronic device 200 sends a second trigger message to the first electronic device 100 using the communication connection with the first electronic device 100. Correspondingly, the first electronic device 100 receives the second trigger message from the second electronic device 200.

[0187] The second trigger message is used to trigger the first electronic device 100 to display cursor 112 on the display screen 110, or the second trigger message is used to trigger the control device of the first input device 120 to switch from the second electronic device 200 to the first electronic device 100.

[0188] In an optional embodiment of this application, if the time the cursor 112 is at the second cursor movement boundary exceeds a threshold 2 (e.g., 6 seconds), the second electronic device 200 sends a second trigger message to the first electronic device 100 to switch the control device of the first input device 120 from the second electronic device 200 to the first electronic device 100.

[0189] It is worth noting that when the second electronic device 200 sends a second trigger message to the first electronic device 100, the second electronic device 200 hides the cursor 112 on the display screen 210.

[0190] It is worth noting that, on the one hand, when the second electronic device 200 detects that the cursor 112 is located at the second cursor movement boundary, it sends a second trigger message. On the other hand, when the cursor 112 is located at the second cursor movement boundary, if the second electronic device detects an operation that triggers the cursor 112 to continue moving, it also sends a second trigger message.

[0191] In one optional embodiment of this application, such as Figure 10 As shown, after receiving the second trigger message, the first electronic device 100, in response to the second trigger message, displays the cursor 112 on the first display screen 110 in an area excluding the first cursor movement boundary. When the cursor 112 is located in the area excluding the first cursor movement boundary on the first display screen 110, the detected operation acting on the first input device 120 is no longer fed back to the second electronic device 200. Based on this, the method provided in this application embodiment may further include: Step 1009: In response to the received second trigger message, the first electronic device 100 displays cursor 112 on the display screen 110 of the first electronic device 100.

[0192] Thus, cursor 112 is displayed on the display screen 110 of the first electronic device 100.

[0193] The specific explanation of step 1009 is similar to that of step 1005, and you can refer to step 1005.

[0194] Step 1010: If the first electronic device 100 detects an operation on the first input device 120, then the first electronic device 100 executes the command corresponding to the operation.

[0195] The term "first electronic device 100 executes the command corresponding to the operation" means that the first electronic device 100 subsequently executes the command corresponding to the operation on the first input device 120. For example, if the first input device 120 is a mouse 1211, and the user uses the mouse 1211 to move the cursor 112 on the first electronic device 100, then the first electronic device 100 responds to the movement operation and controls the cursor 112 to move on the display screen 110. Similarly, if the first input device 120 is a keyboard, and the user inputs the text "The weather is nice today" on the keyboard, then the first electronic device 100 responds to the user's input event on the keyboard and displays the text "The weather is nice today" on the display screen 110.

[0196] By sending a second trigger message from the second electronic device 200 to the first electronic device 100, the control device of the first input device 120 can be switched from the second electronic device 200 to the first electronic device 100.

[0197] The following will describe the setting method of the first cursor movement boundary in the first electronic device 100 from different aspects: Method 1) In an optional embodiment of this application, the first cursor movement boundary is set by default in the first electronic device 100. Before the first electronic device 100 leaves the factory, the developers take into account the user's usage habits and default to using any one or more of the upper edge, lower edge, left edge and right edge of the display screen 110 of the first electronic device 100 as the first cursor movement boundary.

[0198] For example, such as Figure 13 As shown in (A), the upper edge of the display screen 110 of the first electronic device 100 is the first cursor movement boundary. For example, as... Figure 13 As shown in (B) of the diagram, the right edge of the display screen 110 of the first electronic device 100 is the first cursor movement boundary. For example, as... Figure 13 As shown in (C), the right and left edges of the display screen 110 of the first electronic device 100 serve as the first cursor movement boundaries. Alternatively, all four edges of the first electronic device 100 (e.g., the top edge, bottom edge, left edge, and right edge) serve as the first cursor movement boundaries.

[0199] For example, if the right and left edges of the display screen 110 of the first electronic device 100 are both used as the first cursor movement boundary, then when there is a data transmission channel between the first electronic device 100 and the second electronic device 200, if the cursor 112 is located at either the right or left edge, the first electronic device 100 will send the movement information of the cursor 112 to the second electronic device 200 so that the control device of the first input device 120 can be switched from the first electronic device 100 to the second electronic device 200.

[0200] Method 2) In another optional embodiment of this application, the first electronic device 100 can, in response to a user's operation, select one or more edges from its four corresponding edges (e.g., top edge, bottom edge, left edge, and right edge) as the first cursor movement boundary. For example, the first electronic device 100 can issue a prompt message when the user first uses the first electronic device 100 in conjunction with other devices, or each time the user does so. The prompt message indicates the selection of one or more edges from the top edge, bottom edge, left edge, and right edge as the first cursor movement boundary. If the second electronic device 200 is located to the left of the first electronic device 100, the user can trigger the first electronic device 100 to set the left edge of the display screen 110 of the first electronic device 100 as the first cursor movement boundary.

[0201] It is worth noting that the setting method of the second cursor movement boundary in the second electronic device 200 can refer to the descriptions in the above methods 1) and 2), and will not be repeated here.

[0202] In addition to the above-mentioned methods for determining the first cursor movement boundary, the first electronic device 100 in this application embodiment can also determine the first cursor movement boundary in the following manner.

[0203] Method 3) For example, in another possible embodiment of this application, the first electronic device 100 determines the first cursor movement boundary based on the relative position information between the first electronic device 100 and the second electronic device 200.

[0204] For example, the first electronic device 100 can determine the relative position information between the first electronic device 100 and the second electronic device 200 in the following manner.

[0205] In Method A), if the first electronic device 100 has a UWB base station 111 and the second electronic device 200 has UWB base stations 2401 and 2402, the first electronic device 100 sends a UWB signal 1 to the second electronic device 200 through the UWB base station 111. The UWB signal 1 carries the identification information of the first electronic device 100. In this way, the second electronic device 200 can receive the UWB signal 1 through the UWB base stations 2401 and 2402. Afterwards, the second electronic device 200 can determine the relative position between the first electronic device 100 and the second electronic device 200 through the UWB signal 1.

[0206] The principle by which the second electronic device 200 can determine the relative position between the first electronic device 100 and the second electronic device 200 through the UWB signal 1 can be found in [reference needed]. Figure 6 and Figure 7 The description of that location will not be repeated here.

[0207] In an optional embodiment of this application, when the second electronic device 200 determines the relative position between the first electronic device 100 and the second electronic device 200, the second electronic device 200 sends indication information 1 to the first electronic device 100. Correspondingly, the first electronic device 100 receives the indication information 1 from the second electronic device 200. The indication information 1 is used to indicate the relative position between the first electronic device 100 and the second electronic device 200, so that the first electronic device 100 determines the relative position information between the first electronic device 100 and the second electronic device 200 based on the indication information 1.

[0208] As an example, indication information 1 includes the angular range from the first electronic device 100 to the second electronic device 200.

[0209] As another example, the indication information 1 includes the orientation information between the first electronic device 100 and the second electronic device 200. For example, the orientation information is that the first electronic device 100 is located to the left, right, upper left, lower left, lower right, lower left diagonally below, lower right diagonally below, right, and left of the second electronic device 200.

[0210] For example, if instruction information 1 includes the angular range from the first electronic device 100 to the second electronic device 200, then the first electronic device 100 stores a mapping table 1, as shown in Table 1. Mapping table 1 contains the edges corresponding to each angular range. Thus, after obtaining the angular range from the first electronic device 100 to the second electronic device 200, the first electronic device 100 can obtain its first cursor movement boundary by querying mapping table 1. Alternatively, the first electronic device 100 may have mapping tables 2 and 3, as shown in Tables 2 and 3. Mapping table 2 includes the orientation information corresponding to each angular range, and mapping table 3 includes the edges corresponding to each orientation information. Thus, after obtaining the angular range, the first electronic device 100 can obtain its first cursor movement boundary by querying mapping tables 2 and 3.

[0211] Table 1

[0212] For example, if the indication information 1 is -22.5° to 22.5°, the first electronic device 100 can determine that the upper edge of the display screen 110 is the first cursor movement boundary.

[0213] Table 2

[0214] Table 3

[0215] In another optional embodiment of this application (method B), the first electronic device 100 may also prompt the user to input directional information between the first electronic device 100 and the second electronic device 200. Then, the first electronic device 100 obtains the first cursor movement boundary of the laptop computer by querying the mapping table 2 based on the directional information input by the user.

[0216] For example, such as Figure 14 As shown, during the process of setting the first cursor movement boundary, optionally, a prompt box 900 is displayed on the screen 110 of the first electronic device 100. The prompt box 900 is used to prompt the user to select the relative position between the first electronic device 100 and the second electronic device 200. For example, Figure 14 Taking the four types of directional information between them (i.e., the second electronic device 200 is located to the left, right, below, and above the first electronic device 100) as an example, in actual practice, the directional information indicated by the prompt box 900 is not limited to the above four types, but can also be... Figures 16A-16J (The remaining orientation information described in the text). Suppose that the user selects the orientation information between the two devices through the first input device 120 (e.g., mouse 1211) of the first electronic device 100 as: the second electronic device is located to the left of this device. Then the first electronic device 100 can determine that the second electronic device 200 is located to the left of the first electronic device 100. The first electronic device 100 then determines the first cursor movement boundary of the first electronic device 100 as the left edge of the first electronic device 100 by querying the mapping table 3.

[0217] like Figure 15 As shown, Figure 15 The angle range between the first electronic device 100 and the second electronic device 200 is set for different scenarios based on the orientation of the first electronic device 100 relative to the second electronic device 200.

[0218] For example, such as Figure 16A In scenario 1, the second electronic device 200 is located above the first electronic device 100, and the angle between the first electronic device 100 and the second electronic device 200 is between -22.5° and 22.5°.

[0219] For example, such as Figure 16A As shown, if the first electronic device 100 determines that the second electronic device 200 is above the first electronic device 100, then the first electronic device 100 determines that the upper edge of the display screen 110 is the first cursor movement boundary. For the second electronic device 200, if the second electronic device 200 determines that the first electronic device 100 is below the second electronic device 200, then the second electronic device 200 determines that the lower edge of the display screen 210 is the second cursor movement boundary.

[0220] For example, such as Figure 16B In scenario 2, the second electronic device 200 is located to the upper right of the first electronic device 100. In other words, the first electronic device 100 is located to the lower left of the second electronic device 200. Therefore, the angle between the first electronic device 100 and the second electronic device 200 is between -22.5° and -67.5°.

[0221] For example, such as Figure 16B As shown, if the first electronic device 100 determines that the second electronic device 200 is located to the upper right of the first electronic device 100, then the first electronic device 100 determines that the upper edge and right edge of the display screen 110 together constitute the first cursor movement boundary. Alternatively, as... Figure 16C As shown, since the second electronic device 200 is located to the upper right of the first electronic device 100, the first electronic device 100 determines that the right half of the upper edge and the upper half of the right edge of the display screen 110 together constitute the first cursor movement boundary. Alternatively, the first electronic device 100 determines either the upper edge or the right edge of the display screen 110 as the first cursor movement boundary. Or, the first electronic device 100 determines either the right half of the upper edge or the upper half of the right edge of the display screen 110 as the first cursor movement boundary.

[0222] refer to Figure 16B For the second electronic device 200, if the second electronic device 200 determines that it is located to the upper right of the first electronic device 100, then the second electronic device 200 determines that the lower edge and left edge of its display screen 210 together constitute the second cursor movement boundary. Alternatively, as... Figure 16C As shown, since the second electronic device 200 is located to the upper right of the first electronic device 100, the second electronic device 200 determines that the left half of the lower edge and the lower half of the left edge of its display screen 210 together constitute the second cursor movement boundary. In other words, the second electronic device 200 uses the portion of the lower edge and left edge of its display screen 210 closest to the first electronic device 100 as the second cursor movement boundary. Alternatively, the second electronic device 200 determines either the lower edge or the left edge of its display screen 210 as the second cursor movement boundary. Or, the second electronic device 200 determines either the left half of the lower edge or the lower half of the left edge of its display screen 210 as the second cursor movement boundary.

[0223] For example, such as Figure 16DIn scenario 3, the second electronic device 200 is located to the right of the first electronic device 100, or in other words, the first electronic device 100 is located to the left of the second electronic device 200. Therefore, the angle between the first electronic device 100 and the second electronic device 200 is between -67.5° and -112.5°.

[0224] For example, such as Figure 16D As shown, if the first electronic device 100 determines that the second electronic device 200 is located to the right of the first electronic device 100, then the first electronic device 100 determines that the right edge of the display screen 110 of the first electronic device 100 is the first cursor movement boundary.

[0225] refer to Figure 16D For the second electronic device 200, if the second electronic device 200 determines that it is located to the right of the first electronic device 100, then the second electronic device 200 determines that the left edge of the display screen 210 of the second electronic device 200 is the second cursor movement boundary.

[0226] For example, such as Figure 16E In scenario 4, the second electronic device 200 is located diagonally above and to the left of the first electronic device 100. Therefore, the angle between the first electronic device 100 and the second electronic device 200 is between 22.5° and 67.5°.

[0227] For example, such as Figure 16E As shown, if the first electronic device 100 determines that the second electronic device 200 is located diagonally above and to the left of the first electronic device 100, then the first electronic device 100 determines that the left edge and the top edge of the display screen 110 of the first electronic device 100 together constitute the first cursor movement boundary. Alternatively, as... Figure 16F As shown, the first electronic device 100 determines that the upper half of the left edge and the left half of the upper edge of the display screen 110 of the first electronic device 100 together constitute the first cursor movement boundary. Alternatively, if the first electronic device 100 determines that the second electronic device 200 is located diagonally above and to the left of the first electronic device 100, the first electronic device 100 determines that either the upper half of the left edge or the left half of the upper edge of the display screen 110 of the first electronic device 100 constitutes the first cursor movement boundary, or the first electronic device 100 determines that either the left edge or the upper edge of the display screen 110 of the first electronic device 100 constitutes the first cursor movement boundary.

[0228] refer to Figure 16E For the second electronic device 200, if the first electronic device 100 is located diagonally below and to the right of the second electronic device 200, then the second electronic device 200 determines that the right edge and the bottom edge of its display screen 210 together constitute the cursor movement boundary 1. Alternatively, in Figure 16FIn the scenario shown, such as Figure 16F As shown, the second electronic device 200 determines that the lower half of the right edge of the display screen 210 of the second electronic device 200 and the right half of the lower boundary region together constitute the second cursor movement boundary. Alternatively, if the second electronic device 200 determines that the second electronic device 200 is located diagonally above and to the left of the first electronic device 100, the second electronic device 200 determines that either the lower half of the right edge of the display screen of the second electronic device 200 or the right half of the lower edge constitutes the second cursor movement boundary. In other words, the second electronic device 200 uses the portion of the right edge and lower edge of the display screen 210 closest to the first electronic device 100 as the second cursor movement boundary, or the second electronic device 200 determines that any one or more of the right edge and lower edge of the display screen of the second electronic device 200 constitute the second cursor movement boundary.

[0229] For example, such as Figure 16G In scenario 5, the second electronic device 200 is located to the left of the first electronic device 100, or in other words, the first electronic device 100 is located to the right of the second electronic device 200. Therefore, the angle between the first electronic device 100 and the second electronic device 200 is between 67.5° and 112.5°.

[0230] For example, such as Figure 16G As shown, if the first electronic device 100 determines that the second electronic device 200 is located to the left of the first electronic device 100, then the first electronic device 100 determines the left edge of its display screen 110 as the first cursor movement boundary. If the second electronic device 200 is located to the left of the first electronic device 100, then the second electronic device 200 determines the right edge of its display screen 210 as the second cursor movement boundary.

[0231] For example, such as Figure 16H In scenario 6, the second electronic device 200 is located below the first electronic device 100, or in other words, the first electronic device 100 is located above the second electronic device 200. Therefore, the angle between the first electronic device 100 and the second electronic device 200 is between -157.5° and -180°, or between 157.5° and 180°.

[0232] For example, such as Figure 16HAs shown, if the first electronic device 100 determines that the second electronic device 200 is located below the first electronic device 100 (in other words, if the first electronic device 100 is located above the second electronic device 200), then the first electronic device 100 determines that the lower edge of its display screen 110 is the first cursor movement boundary. If the second electronic device 200 is located below the first electronic device 100, then the second electronic device 200 determines that the upper edge of its display screen 210 is the second cursor movement boundary.

[0233] For example, such as Figure 16I In scenario 7, the second electronic device 200 is located to the left and below the first electronic device 100. In other words, the first electronic device 100 is located to the right and above the second electronic device 200. Therefore, the angle between the first electronic device 100 and the second electronic device 200 is between 112.5° and 157.5°.

[0234] For example, such as Figure 16I As shown, if the first electronic device 100 determines that the second electronic device 200 is located diagonally below and to the left of the first electronic device 100, or in other words, the first electronic device 100 is located diagonally above and to the right of the second electronic device 200, then the first electronic device 100 determines that the lower edge and the left edge of the display screen 110 of the first electronic device 100 together constitute the first cursor movement boundary; or, the first electronic device 100 determines that the left half of the lower edge and the lower half of the left edge of the display screen 110 of the first electronic device 100 together constitute the first cursor movement boundary. Of course, in cases such as... Figure 16I In the scenario shown, the first electronic device 100 determines that either the lower edge or the left edge of the display screen 110 of the first electronic device 100 constitutes the first cursor movement boundary, or the first electronic device 100 determines that either the left half of the lower edge or the lower half of the left edge constitutes the first cursor movement boundary.

[0235] refer to Figure 16I For the second electronic device 200, if the second electronic device 200 is located diagonally below and to the left of the first electronic device 100, then the second electronic device 200 determines that the upper edge and right edge of its display screen 210 together constitute the cursor movement boundary 1; or, the second electronic device 200 determines that the right half of the upper edge and the upper half of the right edge of its display screen 210 together constitute the cursor movement boundary 1. Of course, in cases such as... Figure 16I In the scenario shown, the second electronic device 200 determines that either the upper edge or the right edge of the display screen 210 of the second electronic device 200 constitutes the second cursor movement boundary, or the second electronic device 200 determines that either the right half of the upper edge or the upper half of the right edge constitutes the second cursor movement boundary.

[0236] For example, such as Figure 16J In scenario 8, the second electronic device 200 is located diagonally below and to the right of the first electronic device 100. In other words, the first electronic device 100 is located diagonally above and to the left of the second electronic device 200. Therefore, the angle between the first electronic device 100 and the second electronic device 200 is between -112.5° and -157.5°.

[0237] For example, such as Figure 16J As shown, if the first electronic device 100 determines that the second electronic device 200 is located diagonally below and to the right of the first electronic device 100, in other words, the first electronic device 100 is located diagonally above and to the left of the second electronic device 200, then the first electronic device 100 determines that the lower edge and the right edge of the display screen 110 of the first electronic device 100 together constitute the first cursor movement boundary, or the first electronic device 100 determines that the right half of the lower edge and the lower half of the right edge of the display screen 110 of the first electronic device 100 together constitute the first cursor movement boundary. Of course, as... Figure 16J In scenario 8 shown, the first electronic device 100 can also determine either the lower edge or the right edge of the display screen 110 of the first electronic device 100 as the first cursor movement boundary, or either the right half of the lower edge or the lower half of the right edge as the first cursor movement boundary.

[0238] refer to Figure 16J If the second electronic device 200 determines that the first electronic device 100 is located diagonally above and to the left of the second electronic device 200, then the second electronic device 200 determines that the upper edge and left edge of the display screen 210 of the second electronic device 200 together constitute the second cursor movement boundary; or the second electronic device 200 determines that the left half of the upper edge and the upper half of the left edge of the display screen 210 together constitute the second cursor movement boundary. Optionally, the second electronic device 200 uses the portion of the upper edge and left edge of the display screen 210 closest to the first electronic device 100 as the second cursor movement boundary. Of course, if... Figure 16J In scenario 8 shown, the second electronic device 200 can also determine either the upper edge or the left edge of the display screen 210 as the second cursor movement boundary, or either the left half of the upper edge or the upper half of the left edge as the second cursor movement boundary.

[0239] It should be noted that the above Figures 16A-16J The described scheme is merely a series of preferred implementations for determining the first cursor movement boundary / second cursor movement boundary based on the relative positions between the first electronic device 100 and the second electronic device 200. In practice, ... Figure 16ATaking the scenario shown as an example, if the second electronic device 200 is located above the first electronic device 100, the first electronic device 100 can also choose to use one or more of the lower edge, left edge, and right edge of the display screen 110 as the first cursor movement boundary. For example, if the second electronic device 200 is located above the first electronic device 100, the first electronic device 100 can also choose to use the lower edge of the display screen 110 as the first cursor movement boundary.

[0240] Figure 14 and Figures 16A-16J The difference between the methods shown for determining the first cursor movement boundary and the second cursor movement boundary is: Figures 16A-16J The first electronic device 100 and the second electronic device 200 are automatically determined using a UWB base station, while Figure 14 The first electronic device 100 determines this based on the user's operation.

[0241] In an optional embodiment of this application, the first electronic device 100 (second electronic device 200) uses Figures 16A-16J After determining the first cursor movement boundary (second cursor movement boundary) as shown, a prompt message can be output to indicate whether to set the target edge as the first cursor movement boundary (second cursor movement boundary). The target edge is the edge determined by the first electronic device 100 (second electronic device 200) based on the position between the first electronic device 100 and the second electronic device 200. For example... Figure 16A As shown, the target edge is the upper edge of the display screen 110 of the first electronic device 100.

[0242] If the first electronic device 100 detects an operation indicating that the target edge should be used as the first cursor movement boundary, then the first electronic device 100 will use the target edge as the first cursor movement boundary. If the first electronic device 100 detects an operation indicating that the target edge should not be used as the first cursor movement boundary, then the first electronic device 100 will not use the target edge as the first cursor movement boundary. Combining this with the user's operation can make the selected first cursor movement boundary more in line with the user's usage habits, thus improving the user's operating experience.

[0243] For example, although the first electronic device 100 can determine that the second electronic device 200 is located to the left of the first electronic device 100 by sending UWB signals from the UWB base station 111, the first electronic device 100 determines to use the left edge of its display screen 110 as the first cursor movement boundary. Then, the first electronic device 100 prompts the user whether to use the left edge of its display screen 110 as the first cursor movement boundary. If the first electronic device 100 detects that the user has triggered an operation to use the left edge of its display screen 110 as the first cursor movement boundary, then the first electronic device 100 uses the left edge of its display screen 110 as the first cursor movement boundary. If the first electronic device 100 detects that the user has triggered an operation to not use the left edge of its display screen 110 as the first cursor movement boundary, then the first electronic device 100 can prompt the user to select the first cursor movement boundary, for example, by displaying... Figure 14 The interface shown allows the user to select the right edge of the display screen 110 of the first electronic device 100 as the first cursor movement boundary according to their usage habits.

[0244] In an optional embodiment of this application, when there is a collaborative channel between the second electronic device 200 and the first electronic device 100, file transfer can also be realized between the first electronic device 100 and the second electronic device 200.

[0245] Scenario 1: Cursor 112 is located on the display screen 110 of the first electronic device 100, and the first electronic device 100 sends a file to the second electronic device 200.

[0246] As an example, such as Figure 17A As shown, taking the cursor 112 positioned on the display screen 110 of the first electronic device 100 as an example, the user triggers the mouse 1211 through operation 1711, causing the first electronic device 100 to select file 1 displayed on the display screen 110 using the cursor 112. After the cursor 112 selects file 1, the user can continue to operate the mouse 103 to allow the first electronic device 100 to control the cursor 112 to move file 1 on the display screen 110. Figure 17A As shown, when the first electronic device 100 detects that the cursor 112 and file 1 have moved to the first cursor movement boundary, the first electronic device 100 sends file 1 and a first trigger message to the second electronic device 200 via the data transmission channel between the first electronic device 100 and the second electronic device 200. Correspondingly, the second electronic device 200 can receive file 1 and the first trigger message. After receiving the first trigger message, the second electronic device 200 can then... Figure 17B As shown, cursor 112 and document 1 are displayed on the display screen 210 of the second electronic device 200.

[0247] Optional, such as Figure 17A As shown, before the second electronic device 200 receives file 1 and the first trigger message, a prompt message 1700 can be displayed on the display screen 210. If the second electronic device 200 detects that 1701 has been triggered, it indicates that it will receive file 1 and the first trigger message. At this time, the second electronic device 200 sends a receive response to the first electronic device 100, thereby the first electronic device 100 begins to transmit file 1 and the first trigger message to the second electronic device 200. If the second electronic device 200 detects that 1702 has been triggered, it indicates that it will not receive file 1 and the first trigger message. At this time, the second electronic device 200 sends a rejection response to the first electronic device 100, thereby the first electronic device 100 stops transmitting file 1 and the first trigger message to the second electronic device 200.

[0248] The file 1 displayed on the display screen 110 of the first electronic device 100 may be a file stored on the local disk of the first electronic device 100 or a file stored on an external storage device of the first electronic device 100. This application embodiment does not limit this.

[0249] As an example, after receiving file 1, the second electronic device 200 can store file 1. For example, file 1 can be stored in the memory of the second electronic device 200, or in a storage device connected to the second electronic device 200; this embodiment does not limit this. It is worth noting that in this embodiment, the second electronic device 200 has a designated storage area for storing files received from other devices. This allows for partitioning the storage of files already stored within the second electronic device 200 and files received from other devices. The designated storage area can be a storage area within the internal memory of the second electronic device 200, or a storage area in a storage device connected to the second electronic device 200.

[0250] In one embodiment of this application, after receiving file 1, the second electronic device 200 displays a thumbnail corresponding to file 1 on its display screen 210, such as... Figure 17B As shown. Subsequently, when the user needs to open or browse a file, the user can manipulate the first input device 120 to trigger the first electronic device 100 to send an operation event from the first input device 120 to the second electronic device 200. The second electronic device 200 then responds to the operation event from the first electronic device 100 by opening file 1 and displaying file 1 on its screen. Alternatively, the second electronic device 200 may first display a thumbnail of file 1, and after a preset time, automatically display file 1 in full screen on its screen 210.

[0251] In one embodiment of this application, when the first electronic device 100 determines that the second electronic device 200 agrees to receive the file 1, the first electronic device 100 sends the file 1 to the second electronic device 200 via the data transmission channel between the first electronic device 100 and the second electronic device 200.

[0252] As one possible embodiment, before the first electronic device 100 sends file 1 to the second electronic device 200 via the data transmission channel between the first electronic device 100 and the second electronic device 200, the first electronic device 100 sends information about file 1 to the second electronic device 200. Accordingly, as... Figure 17A As shown, optionally, after receiving the information of file 1, the second electronic device 200 prompts whether to accept file 1 via prompt message 1700. Furthermore, as... Figure 17A As shown, the display screen 210 also displays controls 1701 and 1702. Control 1702 indicates that file reception is refused. Control 1701 indicates that file reception is allowed. If the second electronic device 200 detects that control 1701 is triggered, it sends an acceptance response message to the first electronic device 100. Upon receiving the acceptance response message, the first electronic device 100 sends file 1 to the second electronic device 200. If the second electronic device 200 detects that control 1702 is triggered, it sends a rejection response message to the first electronic device 100. Upon receiving the rejection response message, the first electronic device 100 will not send file 1 to the second electronic device 200.

[0253] The above scheme takes the example of the first electronic device 100 first sending information about file 1 to the second electronic device 200, and then sending file 1 itself. In practice, the first electronic device 100 can also directly send file 1 to the second electronic device 200, thus omitting the process of sending information about file 1. When the first electronic device 100 directly sends file 1 to the second electronic device 200, the second electronic device 200 can also prompt the user whether to accept file 1. If the second electronic device 200 decides to refuse to accept the file, it sends a rejection response message to the first electronic device 100. Upon receiving the rejection response message, the first electronic device 100 will stop sending file 1 to the second electronic device 200. If the second electronic device 200 decides to accept the file, it sends an allow response message to the first electronic device 100. Upon receiving the allow response message, the first electronic device 100 will continue sending file 1 to the second electronic device 200.

[0254] It is worth noting that when the second electronic device 200 simultaneously receives the first trigger message and the file, the content displayed on the second electronic device 200, such as... Figure 16AThe user can trigger control 1701 or control 1702 using the remote control of the second electronic device 200, as indicated by the prompt message.

[0255] Scenario 2: The cursor 112 is located on the display screen 210 of the second electronic device 200, and the second electronic device 200 sends a file to the first electronic device 100.

[0256] like Figure 18A As shown, cursor 112 is located at point A on display screen 210. Suppose a user wants to transfer a file (e.g., image 1) from the second electronic device 200 to the first electronic device 100. The user can then perform an input operation 1801 on the first input device 120. Input operation 1801 triggers cursor 112 to move from point A to the thumbnail corresponding to image 1, selecting image 1 and moving it on display screen 210. After detecting input operation 1801 on mouse 1211, the first electronic device 100 sends operation information corresponding to input operation 1801 to the second electronic device 200. In response to the operation information corresponding to input operation 1801, the second electronic device 200 controls cursor 112 to move from point A to the thumbnail corresponding to image 1, selecting image 1 and moving it on display screen 210.

[0257] It is worth noting that regardless of whether the user's input operation 1801 on the mouse 1211 is continuous or intermittent, as long as the cursor 112 is on the display screen 210, the first electronic device 100 will send the operation information detected on the first input device 120 to the second electronic device 200 in real time. A continuous operation means that the actions of moving the cursor from point A to the thumbnail corresponding to image 1, selecting the thumbnail corresponding to image 1, and controlling the movement of the thumbnail corresponding to image 1 on the display screen 210 are consecutive. An intermittent operation means that the user first performs operation 1 (moving the mouse from point A to the thumbnail corresponding to image 1) on the mouse 1211, and then performs operation 2 (selecting the thumbnail corresponding to image 1). In this case, the first electronic device 100 first sends the operation information corresponding to operation 1 to the second electronic device 200. If operation 2 is detected later, then the second electronic device 200 sends the operation information corresponding to operation 2.

[0258] like Figure 18A As shown, assuming the second electronic device 200 controls the thumbnail corresponding to image 1 to move on the display screen 210 to the second cursor movement boundary, the second electronic device 200 sends image 1 and a second trigger message to the first electronic device 100. In this way, the first electronic device 100 can not only receive image 1 from the second electronic device 200, but also, in response to the second trigger message, re-display cursor 112 on the display screen 110, as shown. Figure 18BAs shown. Subsequently, if the first electronic device 100 detects the input operation 1802, the first electronic device 100 executes the command corresponding to the input operation 1802.

[0259] Similarly, after receiving image 1, the first electronic device 100 can first display a thumbnail of image 1, and then display image 1 in full screen after a preset time or after detecting a display operation by the user. Alternatively, the first electronic device 100 can directly display image 1 in full screen after receiving it.

[0260] In one embodiment of this application, when the thumbnail corresponding to the image 1 controlled by the second electronic device 200 moves to the second cursor movement boundary 1 on the display screen 210 of the second electronic device 200, the event of the second electronic device 200 sending the image 1 to the first electronic device 100 can be regarded as the second trigger message.

[0261] In one embodiment of this application, before receiving file 1 and the first trigger message from second electronic device 200, the first electronic device 100 may display a prompt message indicating whether to receive image 1 and the first trigger message from second electronic device 200. For example, a dialog box may be displayed on the display screen 110 of the first electronic device 100, including control A and control B. When control A is detected to be triggered, the first electronic device 100 receives image 1 from second electronic device 200. When control B is detected to be triggered, the first electronic device 100 sends a rejection response to the second electronic device 200. Thus, upon receiving the rejection response, the second electronic device 200 will not continue to send file 1 to the first electronic device 100. Since the first electronic device 100 will be unable to control cursor 112 after switching the control device of the first input device 120 to the second electronic device 200, when the first electronic device 100 receives file 1 and the first trigger message from the second electronic device 200, the first electronic device 100 will by default directly receive the first trigger message to switch the control device of the first input device 120 from the second electronic device 200 to the first electronic device 100. When the first electronic device 100 controls the control device of the first input device 120, the user can manipulate the mouse 1211 to trigger the first electronic device 100 to control the cursor 112 to trigger control 1701 or control 1702.

[0262] It is worth noting that the second electronic device 200 can send file information before sending the file to the first electronic device 100. The second electronic device 200 will then send the file only if the first electronic device 100 agrees to receive it.

[0263] In summary, when the second electronic device 200 controls the control device of the first input device 120, if the user wants to select a file or app on the display screen 110 of the first electronic device 100 using the cursor 112, the user can first trigger the mouse 1211, and the first electronic device 100 will then relay the operation of the mouse 1211 to the second electronic device 200. The second electronic device 200 will then respond to this operation by controlling the cursor 112 to move to the second cursor movement boundary on the display screen 210. This allows the control device of the first input device 120 to be switched from the second electronic device 200 to the first electronic device 100.

[0264] In the above scheme, when the second electronic device 200 controls the control device of the first input device 120, if the file selected by the cursor 112 is located at the cursor movement boundary 1, the cursor 112 is also located at the cursor movement boundary 1. In this case, the second electronic device 200 will trigger the first electronic device 100 to re-control the control device of the first input device 120. On the second electronic device 200 side, the cursor 112 is hidden on the display screen 210. In other words, when the file selected by the cursor 112 is located at the cursor movement boundary 1, the control device of the first input device 120 will change from the second electronic device 200 to the first electronic device 100. However, in practice, the following situation may exist: when the second electronic device 200 controls the control device of the first input device 120, the user may only want to send the file on the second electronic device 200 to the first electronic device 100, and does not want to switch the control device of the first input device 120 from the second electronic device 200 to the first electronic device 100. Based on this, in this embodiment, the second cursor movement boundary can be divided into boundary A and boundary B. If the file selected by cursor 112 is located at boundary B (i.e., both cursor 112 and the file selected by cursor 112 are located at boundary B), the second electronic device 200 sends the file selected by cursor 112 to the first electronic device 100, but does not trigger the first electronic device 100 to regain control of the control device of the first input device 120; that is, the second electronic device 200 does not send the second trigger message to the first electronic device 100. However, if cursor 112 and the file selected by cursor 112 are located at boundary A, or if cursor 112 is located at boundary A, the second electronic device 200 sends the file selected by cursor 112 to the first electronic device 100 and sends the second trigger message to the first electronic device 100 to trigger the first electronic device 100 to regain control of the control device of the first input device 120. Alternatively, the second electronic device 200 may have a third cursor movement boundary in addition to the second cursor movement boundary. The second and third cursor movement boundaries are different. Specifically, when cursor 112 is located at the second cursor movement boundary, the second electronic device 200 sends the second trigger message to the first electronic device 100 to trigger the first electronic device 100 to regain control of the control device of the first input device 120. When cursor 112 and the file selected by cursor 112 are located at the third cursor movement boundary, the second electronic device 200 will not send the second trigger message to the first electronic device 100, but will send the file selected by cursor 112 to the first electronic device 100.

[0265] When a data transmission channel exists between the first electronic device 100 and the second electronic device 200, if the cursor 112 is located within the first cursor movement boundary of the first electronic device 100, the first electronic device 100 can switch the control device of the mouse 1211 to the second electronic device 200, and can also switch the control device of the keyboard to the second electronic device 200. In this way, the user can input corresponding information into the second electronic device 200 using the keyboard of the first electronic device 100.

[0266] For example, such as Figure 19 As shown, taking the first electronic device 100 as an example... Figure 19 Taking the desktop computer shown as an example, the desktop computer is communicatively connected to first input devices 120, such as mouse 1211 and keyboard 1212. Assuming the control of the first input devices 120 (mouse 1211 and keyboard 1212) is switched to the second electronic device 200, if the user wants to input text into document 1901 on the second electronic device 200 using the keyboard 1212, the user can operate the mouse 1211 to trigger the desktop computer to move the cursor 112 to the first cursor movement boundary. When the cursor 112 is at the first cursor movement boundary, the desktop computer can send a first trigger message and keyboard event information to the second electronic device 200. This allows the second electronic device 200 to determine that it has keyboard and mouse capabilities. Subsequently, if the user performs related operations on the keyboard or mouse 103, they can directly use the keyboard or mouse 1211 to operate the second electronic device 200.

[0267] When the desktop computer sends a first trigger message and keyboard event information to the second electronic device 200, if the desktop computer detects user input on the keyboard, it can then relay the user's keyboard input event to the second electronic device 200. The second electronic device 200 then performs a corresponding operation in response to the user's keyboard input event. For example, typing text in document 1901. For example, ... Figure 19 As shown, when a user types "The weather is very nice today~" using the keyboard, the desktop computer sends the click event to the second electronic device 200. The second electronic device 200 can then type "The weather is very nice today~" at the cursor position in document 1601.

[0268] For example, if a user presses the key combination "Ctrl" + "S" on the keyboard, in response to this input operation, the desktop computer sends a control command to the second electronic device 200. This control command triggers the second electronic device 200 to save the document 1901. Therefore, upon receiving the control command, the second electronic device 200 can perform the operation of saving the document 1901. For another example, a user can use mouse 103 to move the cursor 112 to the control 1902 and click the left mouse button. The desktop computer can then relay the mouse operation to the second electronic device 200, which, upon receiving this operation, can then perform the operation of saving the document 1901. Figure 19 As shown, the interface displayed by the second electronic device 200 may also include controls 1907, 1908, 1903, 1904, 1905, and 1906, each with a different function. For example, when the user operates the mouse 103 to trigger control 1905, the second electronic device 200 closes the document 1901. When the user operates the mouse 103 to trigger control 1906 to move, the second electronic device 200 can switch the display page of document 1901 on the screen. When the user operates the mouse 103 to trigger control 1904, the second electronic device 200 can shrink the display window of the current document 1901. When the user operates the mouse 103 to trigger control 1903, the second electronic device 200 can shrink the display of the current document 1901. When the user operates the mouse 103 to trigger control 1907, the second electronic device 200 can adjust the font type of the current document 1901. When the user operates the mouse 103 to trigger the control 1908, the second electronic device 200 can adjust the font size of the current document 1901.

[0269] If the first electronic device 100 determines the first cursor movement boundary based on the relative position between the first electronic device 100 and the second electronic device 200, then if the relative position between the first electronic device 100 and the second electronic device 200 changes, the first electronic device 100 needs to redetermine the first cursor movement boundary.

[0270] For example, such as Figure 16A As shown, assuming the first electronic device 100 determines that the second electronic device 200 is above the first electronic device 100 using the above scheme, then the first electronic device 100 can determine the upper edge of the display screen as the first cursor movement boundary, and the second electronic device 200 can determine the lower boundary area of ​​the display screen as the cursor movement boundary 1. However, in practice, since the first electronic device 100 is portable, the user can carry the first electronic device 100 around, for example, as... Figure 16BAs shown, when the user moves the first electronic device 100 to the lower left of the second electronic device 200, the first electronic device 100 can determine the upper edge and the right edge of the display screen as the first cursor movement boundary, or determine the right half of the upper edge and the upper half of the right edge of the display screen as the first cursor movement boundary.

[0271] In one embodiment of this application, the UWB base station 111 of the first electronic device 100 can periodically transmit a first UWB signal, so that at least one UWB base station of the second electronic device 200 (e.g., the first UWB base station 2401 and the second UWB base station) can periodically acquire the first UWB signal. The second electronic device 200 determines the relative position between the first electronic device 100 and the second electronic device 200 based on the first UWB signal acquired in each period, and then sends the relative position calculated in each period to the first electronic device 100. If the first electronic device 100 determines that the change in relative position meets a preset requirement, it updates the first cursor movement boundary. Of course, the second electronic device 200 can also update the second cursor movement boundary when the change in relative position meets the preset requirement.

[0272] It is worth noting that if the second electronic device 200 or the first electronic device 100 determines that the relative orientation between the first electronic device 100 and the second electronic device 200 is -50° at a first moment, while the relative orientation between the first electronic device 100 and the second electronic device 200 is -60° at the current moment, then the change in relative position determined by the second electronic device 200 or the first electronic device 100 does not meet the preset requirements, and therefore there is no need to update the cursor movement boundary. If the relative orientation between the first electronic device 100 and the second electronic device 200 is -90° at the current moment, then the change in relative position determined by the second electronic device 200 or the first electronic device 100 meets the preset requirements, and therefore it is necessary to update the cursor movement boundary.

[0273] In another embodiment of this application, the second electronic device 200 can send the changed relative position information to the first electronic device 100 only when the change in relative position meets preset requirements. This saves signaling overhead compared to sending the calculated relative position to the first electronic device 100 every cycle.

[0274] In another embodiment of this application, since the periodic transmission of the first UWB signal by the UWB base station 111 of the first electronic device 100 consumes the power consumption of the first electronic device 100, based on this, in the case where the first electronic device 100 has a sensor (such as a gyroscope sensor), if the gyroscope sensor of the first electronic device 100 detects that the position of the first electronic device 100 has changed, such as moving from position A to position B, then the first electronic device 100 controls the UWB base station 111 to transmit the first UWB signal, which can reduce the power consumption of the first electronic device 100 compared with periodic transmission of UWB signal.

[0275] Of course, in practice, besides the position of the first electronic device 100 changing, the position of the second electronic device 200 may also change. For example, the second electronic device 200 may be supported by an adjustable bracket, which the user can adjust to change its position. If the second electronic device 200 determines that its position has changed, it can send a trigger message to the first electronic device 100. This trigger message is used to trigger the first electronic device 100 to control the UWB base station 111 to transmit a first UWB signal. Based on this, a sensor (such as a gyroscope sensor) can also be installed in the second electronic device 200 to detect changes in its position.

[0276] In another possible embodiment of this application, the first electronic device 100 has a control X. When the control X is turned on, if there is a data transmission channel between the first electronic device 100 and the second electronic device 200, and the cursor 112 moves to the first cursor movement boundary, the first electronic device 100 will send a first trigger message to the second electronic device 200 to switch the control device of the first input device 120 from the first electronic device 100 to the second electronic device 200. In other words, if the control X is turned off, if there is a data transmission channel between the first electronic device 100 and the second electronic device 200, even if the cursor 112 moves to the first cursor movement boundary, the first electronic device 100 will not send a first trigger message to the second electronic device 200.

[0277] In one embodiment of this application, when the first electronic device 100 and the second electronic device 200 are operating collaboratively, if the user wishes to end the collaboration, the user can operate the exit button on the remote control of the second electronic device 200. After detecting the operation command from the exit button on the remote control, the second electronic device 200 can send a third trigger message to the first electronic device 100. This third trigger message is used to notify the first electronic device 100 of the control device that will subsequently control the first input device 120. Thus, after receiving the third trigger message, the first electronic device 100 can determine that it will subsequently control the first input device 120, and determine to end the collaboration with the second electronic device 200. That is, if the cursor 112 is subsequently located at the first cursor movement boundary, it will not send the first trigger message to the second electronic device. It is worth noting that the difference between the third trigger message and the second trigger message is that after receiving the second trigger message, if the first electronic device 100 detects that the cursor 112 is again located at the first cursor movement boundary, it will still send the first trigger message to the second electronic device 200. Upon receiving the third trigger message, if the first electronic device 100 detects that the cursor 112 is located at the first cursor movement boundary again, it will not send the first trigger message to the second electronic device 200.

[0278] Alternatively, when the control device of the first input device 120 is reused between the first electronic device 100 and the second electronic device 200, if the first electronic device 100 determines that the user has pressed a specified key on the keyboard, such as the exit key (e.g., Esc), then the first electronic device 100 can terminate the collaboration with the second electronic device 200, and will not subsequently send operation information corresponding to the operation on the first input device 120 back to the second electronic device 200, nor will it restore the display of cursor 112 on the display screen 110. In this case, optionally, when the first electronic device 100 detects that the specified key has been triggered, it can send a fourth trigger message to the second electronic device 200, which is used by the second electronic device 200 to determine the termination of the collaboration with the first electronic device 100.

[0279] For example, the taskbar of the first electronic device 100 can display the current working status, and the collaboration with the second electronic device 200 can be terminated from the status bar control or any other control that can indicate the working status.

[0280] The first electronic device provided in this embodiment is used to execute the cross-device collaboration method for input device multiplexing described above, thus achieving the same effect as the aforementioned implementation method. When using integrated units, the first electronic device may include a processing module, a storage module, a communication module, and a display module. The processing module can be used to control and manage the actions of the first electronic device. For example, it can be used to support the first electronic device in performing related processing steps, such as steps 1001, 1002, 1003, and 1009 described above. The storage module can be used to support the execution of stored program code and data. The communication module can be used for communication between the first electronic device and other devices (e.g., with a second electronic device or a first input device), such as the actions performed by the first electronic device in steps 804-806, and / or the steps performed by the first electronic device in steps 1006, 1004, and 1008. The display module is used to support the first electronic device in performing related display actions, such as steps 801 and 802.

[0281] For example, the first electronic device may be a laptop computer or a desktop computer, and the first input device may include a keyboard or a mouse, etc.

[0282] The second electronic device provided in this embodiment is used to execute the cross-device collaboration method for input device multiplexing described above, thus achieving the same effect as the aforementioned implementation method. When using integrated units, the second electronic device may include a processing module, a storage module, a communication module, and a display module. The processing module can be used to control and manage the actions of the second electronic device. For example, it can be used to support the second electronic device in performing related processing steps, such as steps 1005 and 1007 described above. The storage module can be used to support the execution of stored program code and data. The communication module can be used for communication between the second electronic device and other devices (e.g., with the first electronic device), such as the actions performed by the second electronic device in steps 804-806, and / or the steps performed by the second electronic device in steps 1006, 1004, and 1008. The display module is used to support the first electronic device in performing related display actions.

[0283] For example, the second electronic device may be a laptop, desktop computer, smart TV, smart screen, or other electronic device.

[0284] This application also provides a cross-device collaborative system for input device multiplexing, the system including: the first electronic device and the second electronic device in the above method examples.

[0285] This application also provides a computer-readable storage medium for storing computer program code, the computer program including instructions for executing the cross-device collaboration method for input device multiplexing provided in the above-described embodiments of this application. The readable medium may be a read-only memory (ROM) or a random access memory (RAM), and this application does not limit this.

[0286] This application also provides a computer program product including instructions that, when executed, cause a first electronic device to perform an operation corresponding to the method described above.

[0287] This application also provides two computer program products, each including instructions that, when executed, cause a first electronic device to perform operations corresponding to those described in the above-described methods.

[0288] This application also provides a chip located in an electronic device, the chip including: a processing unit and a communication unit. The processing unit may be, for example, a processor, and the communication unit may be, for example, an input / output interface, pins, or circuits. The processing unit can execute computer instructions to cause the electronic device to perform the cross-device collaboration method for input device multiplexing provided in the above-described embodiments of this application.

[0289] Optionally, the computer instructions are stored in a storage unit.

[0290] Optionally, the storage unit can be an internal storage unit within the chip, such as a register or cache. Alternatively, it can be an external storage unit located within the terminal, such as read-only memory (ROM) or other types of static storage devices capable of storing static information and instructions, such as random access memory (RAM). The processor mentioned above can be a CPU, microprocessor, ASIC, or one or more integrated circuits used to control the cross-device collaborative method for input device multiplexing. The processing unit and the storage unit can be decoupled and located on different physical devices, connected via wired or wireless means to implement their respective functions, thereby supporting the system chip in implementing the various functions described in the above embodiments. Alternatively, the processing unit and the memory can also be coupled to the same device.

[0291] The first electronic device, second electronic device, computer storage medium, computer program product, or chip provided in this embodiment are all used to execute the corresponding methods described above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods described above, and will not be repeated here.

[0292] From the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0293] It should be understood that the apparatuses and methods disclosed in the several embodiments provided in this application can be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the division of modules or units is only a logical functional division. In actual implementation, there may be other division methods, such as multiple units or components being combined or integrated into another device. In addition, some features may be omitted or not performed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be electrical, mechanical, or other forms.

[0294] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units. That is, it can be located in one place or distributed in multiple different locations. Depending on the actual needs, some or all of the units can be selected to achieve the purpose of this solution.

[0295] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit; they can also exist physically separately; or some units can be integrated into one unit while others exist physically separately. The integrated units described above can be implemented in hardware or as software functional units.

[0296] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, all or part of the technical solutions of the embodiments of this application can be embodied in the form of a software product. This software product is stored in a storage medium. The software product includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0297] It should be noted that all or part of the above embodiments provided in this application (e.g., part or all of any feature) can be arbitrarily combined or combined with each other.

[0298] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A cross-device collaboration method for input device multiplexing, applied to a first electronic device; characterized in that, The first electronic device and the second electronic device establish a communication connection through wireless communication technology; the first electronic device includes a first display screen and a first input device, and the first display screen displays a cursor; The cursor moves on the first display screen as the first input device moves; the method includes: Select a second electronic device that will cooperate with the first electronic device; Determine the relative positions between the first electronic device and the second electronic device; Based on the relative position between the first electronic device and the second electronic device, at least one edge corresponding to one or more edges of the first display screen is selected as the first cursor movement boundary. A first operation acting on the first input device is detected; In response to the first operation, the cursor is controlled to move on the first display screen; After the cursor moves to the first cursor movement boundary, the first electronic device detects that the cursor continues to move outside the first cursor movement boundary and does not display the cursor on the first display screen. Send a first trigger message to the second electronic device, the first trigger message being used to notify the second electronic device that the control device of the first input device is switched from the first electronic device to the second electronic device; After the control device of the first input device switches from the first electronic device to the second electronic device, it feeds back the operation information corresponding to the second operation detected on the first input device to the second electronic device. The method further includes: Obtain the updated relative position between the first electronic device and the second electronic device; The first cursor movement boundary is updated based on the updated relative position between the first electronic device and the second electronic device.

2. The method according to claim 1, characterized in that, The first electronic device includes at least one first ultra-wideband UWB base station; the second electronic device includes at least one second UWB base station, and determining the relative position between the first electronic device and the second electronic device includes: After a preset condition is met, a UWB signal is transmitted to the second electronic device using at least one first ultra-wideband UWB base station; wherein, the preset condition includes reaching the period for transmitting the UWB signal, or detecting a change in the position of the first electronic device, or detecting a change in the position of the second electronic device; Receive information from the second electronic device for determining the relative position; The relative positions between the first electronic device and the second electronic device are determined based on the information used to determine the relative positions.

3. The method according to claim 1, characterized in that, The first electronic device stores a first mapping table, which records information about one or more edges of the first display screen associated with each of one or more relative positions. The step of selecting at least one edge corresponding to a cursor movement boundary from one or more edges of the first display screen as the first cursor movement boundary based on the relative position between the first electronic device and the second electronic device includes: determining the information of the edges associated with the relative position between the first electronic device and the second electronic device as the first cursor movement boundary from the first mapping table.

4. The method according to any one of claims 1 to 3, characterized in that, After the control device of the first input device switches from the first electronic device to the second electronic device, the method further includes: Receive a second trigger message from the second electronic device, the second trigger message being used to trigger the switching of the control device of the first input device from the second electronic device to the first electronic device; In response to the second trigger message, the cursor is displayed in an area on the first display screen that is not the boundary of the first cursor movement, and the detected operation information acting on the first input device is no longer sent to the second electronic device.

5. The method according to any one of claims 1 to 3, characterized in that, After the control device of the first input device switches from the first electronic device to the second electronic device, the method further includes: The first file was received from the second electronic device.

6. The method according to claim 5, characterized in that, Before receiving the first file from the second electronic device, the method further includes: Receive information about the first file from the second electronic device; Output a second prompt message, which is used to prompt whether to accept the first file; Upon detecting an operation instructing the receipt of the first file, a first response message is sent to the second electronic device, the first response message indicating that the first file has been received.

7. The method according to any one of claims 1 to 3, characterized in that, When the control device of the first input device is the first electronic device, the first electronic device selects the second file using the cursor. If the second file and the cursor are both located on the first cursor movement boundary, a first trigger message is sent to the second electronic device, further including: Send the second file to the second electronic device.

8. The method according to claim 7, characterized in that, Before sending the second file to the second electronic device, the method further includes: Send the information of the second file to the second electronic device; A second response message is received from the second electronic device, the second response message indicating that the second file has been received.

9. The method according to any one of claims 1 to 3, characterized in that, The method further includes: If the first triggering condition is met, a first prompt message is output; wherein, the first prompt message is used to prompt whether to cooperate with other devices; Upon detecting an operation instructing cooperation with the other devices, information on one or more available electronic devices, including the second electronic device, is displayed on the first display screen. Detecting operations performed on the second electronic device on the first display screen; Establish a communication connection with the second electronic device.

10. The method according to any one of claims 1 to 3, characterized in that, The first cursor movement boundary is located at the edge of the first display screen.

11. A cross-device collaboration method for input device multiplexing, applied to a second electronic device; characterized in that, The second electronic device and the first electronic device establish a communication connection via wireless communication technology. The second electronic device includes a second display screen, which has a second cursor movement boundary. The method includes: Receive a first trigger message from the first electronic device, the first trigger message being used to notify the control device of the first input device to switch from the first electronic device to the second electronic device; In response to the first trigger message, a cursor is displayed on the second display screen in an area other than the second cursor movement boundary; the second cursor movement boundary is determined based on the relative position between the first electronic device and the second electronic device; operation information corresponding to the second operation from the first electronic device is received; In response to the operation information, execute the command corresponding to the operation information; After determining the relative positions between the first electronic device and the second electronic device, the method further includes: Information for determining the relative position between the first electronic device and the second electronic device is sent to the first electronic device.

12. The method according to claim 11, characterized in that, The method further includes: Determine the relative positions between the first electronic device and the second electronic device; The second cursor movement boundary is determined from one or more edges of the second display screen based on the relative position between the first electronic device and the second electronic device.

13. The method according to claim 12, characterized in that, The second electronic device includes at least one second UWB base station; Determining the relative position between the first electronic device and the second electronic device includes: detecting UWB signals from the first electronic device using the at least one second UWB base station; and determining the relative position between the first electronic device and the second electronic device based on the UWB signals.

14. The method according to claim 13, characterized in that, The at least one second UWB base station includes two second UWB base stations; Determining the relative position between the first electronic device and the second electronic device based on the UWB signal includes: calculating the coordinates of the first UWB base station transmitting the UWB signal in a preset coordinate system based on the UWB signal; calculating the angle from the first UWB base station to the origin of the preset coordinate system based on the coordinates of the first UWB base station in the preset coordinate system; and using the angle from the first UWB base station to the origin as the relative position between the first electronic device and the second electronic device, wherein the preset coordinate system is established based on the at least one second UWB base station.

15. The method according to claim 14, characterized in that, The step of calculating the coordinates of the first UWB base station transmitting the UWB signal in a preset coordinate system based on the UWB signal includes: Based on the UWB signal, calculate the distance between the first UWB base station and each of the two second UWB base stations; Based on the distances between the first UWB base station and each of the second UWB base stations, and the distance between the two second UWB base stations, calculate the values ​​of each interior angle of the triangle formed by the two second UWB base stations and the first UWB base station; Based on the values ​​of each interior angle, the coordinates of the first UWB base station in the preset coordinate system are determined.

16. The method according to any one of claims 14-15, characterized in that, After the period of the UWB signal is reached, or after a change in the position of the second electronic device / first electronic device is detected, the UWB signal from the first electronic device is detected using the at least one second UWB base station.

17. The method according to any one of claims 12 to 15, characterized in that, After the control device of the first input device is switched to the second electronic device, the method further includes: In response to operation information from the first electronic device, the cursor is controlled to move on the second display screen; After the cursor moves to the second cursor movement boundary, a second trigger message is sent to the first electronic device; the second trigger message is used to trigger the switching of the control device of the first input device from the second electronic device to the first electronic device.

18. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed on the first electronic device, causes the first electronic device to perform the method as described in any one of claims 1 to 10.

19. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when run on the second electronic device, causes the second electronic device to perform the method as described in any one of claims 11 to 17.

20. A first electronic device, characterized in that, The first electronic device includes: a processor; a memory; a first display screen, the first display screen including a first cursor movement boundary, the first display screen displaying a cursor; the cursor moving on the first display screen as a first input device communicatively connected to the first electronic device moves; and a computer program stored in the memory, which, when executed by the processor, causes the first electronic device to perform the method as described in any one of claims 1 to 10.

21. A second electronic device, characterized in that, The second electronic device includes: a processor; a memory; a second display screen including a second cursor movement boundary; and a computer program stored in the memory, which, when executed by the processor, causes the second electronic device to perform the method as described in any one of claims 11 to 17.

Images