Control method and apparatus

By adjusting the control range and mode of wearable devices and combining ultra-wideband UWB signals for precise positioning, the problem of inflexible control caused by the small touchpad has been solved, enabling flexible and precise control of the controlled devices and improving the user experience.

CN116339578BActive Publication Date: 2025-12-09HONOR DEVICE CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202111605199.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-24
Publication Date
2025-12-09
Estimated Expiration
2041-12-24

AI Technical Summary

Technical Problem

Because wearable devices have small touchpads, users find it difficult to achieve flexible and precise control over the displayed content when controlling the device.

Method used

By adjusting the control range and mode of wearable devices, such as by rotating a button to adjust the size of the control range and switching control modes to achieve the functions of a touchpad or mouse, precise positioning and interaction can be achieved by combining ultra-wideband UWB signals.

Benefits of technology

It enables flexible and precise control of the controlled equipment, improves the user experience, and enhances the convenience and control accuracy of the equipment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116339578B_ABST
    Figure CN116339578B_ABST
Patent Text Reader

Abstract

The embodiment of the application provides a control method and device, relates to the terminal technical field, and the method comprises the following steps: when a first operation is received by a wearable device, the wearable device controls a first controlled device to display a first interface; the first interface comprises a first control range, and the display content of the first control range can be controlled by the wearable device; when a second operation is received by the wearable device, the wearable device controls the first controlled device to adjust the first control range to a second control range, and the size of the second control range is different from the size of the first control range. In this way, the wearable device can adjust the size of the control range, so that the adjusted control range can realize flexible control on the display content in the controlled device.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of terminal, and in particular, to a control method and device. BACKGROUND

[0002] With the popularity and development of the Internet, the functional requirements of terminal devices are increasingly diversified. Taking a wearable device, such as a smart watch, as an example, the smart watch can provide functions such as sending and receiving messages, answering calls, and monitoring human data for the user, and can also achieve functions such as controlling home devices, such as turning on a sound box, through interconnection and intercommunication with other devices.

[0003] However, due to the small size of the touch panel of the wearable device, when the user controls the controlled device using the touch panel, the display content in the controlled device may not be flexibly controlled. SUMMARY

[0004] The embodiments of the present application provide a control method and device, so that the smart watch can adjust the size of the control range to enable flexible control of the display content in the controlled device.

[0005] In a first aspect, the embodiments of the present application provide a control method applied to a wearable device, the method comprising: when the wearable device receives a first operation, the wearable device controls a first controlled device to display a first interface; the first interface includes a first control range, and the display content of the first control range is controllable by the wearable device; when the wearable device receives a second operation, the wearable device controls the first controlled device to adjust the first control range to a second control range, and the size of the second control range is different from the size of the first control range. In this way, the wearable device can adjust the size of the control range, so that the adjusted control range can enable flexible control of the display content in the controlled device.

[0006] In a possible implementation, the wearable device is provided with a first button, and the second operation is an operation for rotating the first button. In this way, the wearable device can adjust the size of the control range by rotating the first button, so that the adjusted control range can enable flexible control of the display content in the controlled device.

[0007] In a possible implementation, the method further includes: when the wearable device receives a third operation on the first button and the control mode of the wearable device is the first control mode, the wearable device adjusts the first control mode to a second control mode, and displays a second interface; wherein the second interface includes at least one control for implementing a click function; the first control mode is used to implement a control function corresponding to a touchpad; and the first control mode is used to implement a control function corresponding to a mouse. In this way, the wearable device can adjust the control mode by pressing the first button, and then the user can select a suitable control mode according to the control requirement of the controlled device, thereby increasing the user experience.

[0008] In a possible implementation, when the wearable device receives a third operation on the first button and the control mode of the wearable device is the first control mode, the wearable device adjusts the first control mode to a second control mode, and displays a second interface, including: when the wearable device receives a third operation on the first button and the control mode of the wearable device is the first control mode, the wearable device displays a third interface; the third interface includes: prompt information for prompting to switch the control mode, a first control for allowing to switch the control mode, and a second control for refusing to switch the control mode; and when the wearable device receives a trigger on the first control, the wearable device adjusts the first control mode to the second control mode, and displays the second interface. In this way, the wearable device initiates a prompt when receiving an operation for switching the control mode, thereby avoiding user misoperation and improving the user experience of using the wearable device to control the controlled device.

[0009] In a possible implementation, the method further includes: when the wearable device receives a fourth operation for controlling a first controlled device, the wearable device controls the first controlled device to execute a control instruction corresponding to the fourth operation. In this way, the user can flexibly control the controlled device by using the wearable device nearby, thereby enhancing the convenience of using the controlled device.

[0010] In a possible implementation, the control mode is the first control mode; when the fourth operation is a single-finger click operation on the wearable device, the control instruction is a click instruction for the first controlled device; when the fourth operation is a single-finger click operation and a single-finger sliding operation on the wearable device, the control instruction is a drag instruction for the first controlled device; when the fourth operation is a single-finger sliding operation along the bottom of the screen on the wearable device, the control instruction is an instruction for opening a program dock for the first controlled device; when the fourth operation is a double-finger sliding operation on the wearable device, the control instruction is an instruction for scrolling the screen for the first controlled device; when the fourth operation is a double-finger pinch operation on the wearable device, the control instruction is an instruction for zooming out the display content for the first controlled device; when the fourth operation is a double-finger stretch operation on the wearable device, the control instruction is an instruction for zooming in the display content for the first controlled device; when the fourth operation is a single-finger upward sliding operation along the bottom of the screen on the wearable device, the control instruction is an instruction for exiting the first interface for the first controlled device; or when the fourth operation is a three-finger upward sliding operation on the wearable device, the control instruction is an instruction for switching to a home screen for the first controlled device. In this way, the user can flexibly control the controlled device through simple operations on the wearable device, and the convenience of using the controlled device is enhanced.

[0011] In a possible implementation, the control mode is the second control mode; the second interface includes a third control and a fourth control; when the fourth operation is a click operation on the third control in the wearable device, the control instruction is a left-click instruction for the first controlled device; or when the fourth operation is a click operation on the fourth control in the wearable device, the control instruction is a right-click instruction for the first controlled device. In this way, the user can implement the related functions of the mouse through simple operations on the wearable device, and flexibly control the controlled device, thereby enhancing the convenience of using the controlled device. The first controlled device can be a computer.

[0012] In a possible implementation, the control mode is the first control mode; when the fourth operation is a single-finger long press operation along the bottom of the screen of the wearable device, the control instruction is a return instruction for the first controlled device; when the fourth operation is a double-finger upward swipe operation along the bottom of the screen of the wearable device, the control instruction is a power-off instruction for the first controlled device; or when the fourth operation is a double-finger swipe operation of the wearable device, the control instruction is an instruction for controlling the volume of the first controlled device. In this way, the user can realize the relevant functions of the remote controller through simple operations on the wearable device, thereby flexibly controlling the controlled device and enhancing the convenience of using the controlled device. The first controlled device can be a large-screen device.

[0013] In a possible implementation, the wearable device is a smart watch, and the first button is a crown or a bezel.

[0014] In a possible implementation, before the wearable device controls the first controlled device to display the first interface after receiving the first operation, the method further includes: the wearable device establishes a connection with the first controlled device; the wearable device sends a first ultra-wideband (UWB) signal to the first controlled device; and the wearable device displays a fourth interface based on the first UWB signal and a second UWB signal, where the second UWB signal is a signal returned by the first controlled device to the wearable device after receiving the first UWB signal, and the fourth interface is used to receive a trigger for controlling the first controlled device. In this way, the wearable device can display a control interface when receiving a response signal corresponding to the sent UWB signal, for example, the wearable device can also wake up the controlled device based on the interaction of the UWB signal.

[0015] In a possible implementation, the wearable device displays the fourth interface based on the first UWB signal and the second UWB signal, including: the wearable device calculates the relative position between the wearable device and the first controlled device by using the time difference between the first UWB signal and the second UWB signal; and when the wearable device determines that the relative position meets a preset position, the wearable device displays the fourth interface. In this way, the wearable device can perform position calculation based on the time difference of the UWB signal, thereby enhancing the accuracy of the UWB signal interaction.

[0016] In a possible implementation, the method further includes: the wearable device sends a third UWB signal to the second controlled device; the wearable device displays a fifth interface based on the third UWB signal and a fourth UWB signal; the fourth UWB signal is a signal returned by the second controlled device to the wearable device when the second controlled device receives the third UWB signal; the fifth interface includes: prompt information for prompting whether to access the second controlled device, a fifth control for accessing the second controlled device, and a sixth control for rejecting to access the second controlled device; when the wearable device receives a trigger for the sixth control, or when no trigger is received for any control in the fifth interface within a preset time threshold, the wearable device rejects to access the second controlled device. In this way, the wearable device can initiate a prompt when accessing other controlled devices, so that the user can determine whether to access a new controlled device according to the prompt information, thereby avoiding user misoperation and improving the use experience of controlling the controlled device by using the wearable device.

[0017] In a possible implementation, the method further includes: when the wearable device receives an operation for exiting the control, the wearable device displays a sixth interface; the sixth interface includes: prompt information for prompting whether to exit the control over the first controlled device, a seventh control for exiting the control over the first controlled device, and an eighth control for continuing to control the first controlled device; when the wearable device receives a trigger for the eighth control, or when no trigger is received for any control in the sixth interface within a preset time threshold, the wearable device continues to control the first controlled device. In this way, the wearable device can initiate a prompt when receiving an exit operation, so that the user can determine whether to exit the interface according to the user's own needs, thereby avoiding user misoperation and improving the use experience of controlling the controlled device by using the wearable device.

[0018] In a possible implementation, the controlled device includes one or more of the following: a large-screen device, a tablet computer, a computer, or a mobile phone.

[0019] In a second aspect, an embodiment of the present application provides a control device. When a first operation is received by a wearable device, a processing unit is configured to control a first controlled device to display a first interface; the first interface includes a first control range, and a display content of the first control range is controllable by the wearable device; when a second operation is received by the wearable device, the processing unit is further configured to control the first controlled device to adjust the first control range to a second control range, and a size of the second control range is different from a size of the first control range.

[0020] In a possible implementation, the wearable device is provided with a first button, and the second operation is an operation for rotating the first button.

[0021] In a possible implementation, when the wearable device receives a third operation on the first button and the control mode of the wearable device is the first control mode, the processing unit is further configured to adjust the first control mode to a second control mode, and the display unit is configured to display a second interface; the second interface includes at least one control for implementing a click function; the first control mode is used to implement a control function corresponding to a touchpad; and the first control mode is used to implement a control function corresponding to a mouse.

[0022] In a possible implementation, when the wearable device receives a third operation on the first button and the control mode of the wearable device is the first control mode, the display unit is configured to display a third interface; the third interface includes prompt information for prompting to switch the control mode, a first control for allowing to switch the control mode, and a second control for refusing to switch the control mode; and when the wearable device receives a trigger on the first control, the processing unit is configured to adjust the first control mode to a second control mode, and the display unit is further configured to display a second interface.

[0023] In a possible implementation, when the wearable device receives a fourth operation for controlling the first controlled device, the processing unit is further configured to control the first controlled device to execute a control instruction corresponding to the fourth operation.

[0024] In a possible implementation, the control mode is the first control mode; when the fourth operation is a single-finger click operation on the wearable device, the control instruction is a click instruction for the first controlled device; when the fourth operation is a single-finger click operation and a single-finger sliding operation on the wearable device, the control instruction is a drag instruction for the first controlled device; when the fourth operation is a single-finger sliding operation along the bottom of the screen on the wearable device, the control instruction is an instruction for opening a program dock for the first controlled device; when the fourth operation is a double-finger sliding operation on the wearable device, the control instruction is an instruction for scrolling the screen for the first controlled device; when the fourth operation is a double-finger pinch operation on the wearable device, the control instruction is an instruction for reducing display content for the first controlled device; when the fourth operation is a double-finger stretch operation on the wearable device, the control instruction is an instruction for enlarging display content for the first controlled device; when the fourth operation is a single-finger upward sliding operation along the bottom of the screen on the wearable device, the control instruction is an instruction for exiting the first interface for the first controlled device; or when the fourth operation is a three-finger upward sliding operation on the wearable device, the control instruction is an instruction for switching to a home screen for the first controlled device.

[0025] In a possible implementation, the control mode is the second control mode; the second interface comprises a third control and a fourth control; when the fourth operation is a click operation on the third control in the wearable device, the control instruction is a left-click instruction for the first controlled device; or when the fourth operation is a click operation on the fourth control in the wearable device, the control instruction is a right-click instruction for the first controlled device.

[0026] In a possible implementation, the control mode is the first control mode; when the fourth operation is a single-finger long press operation on the wearable device, the control instruction is a return instruction for the first controlled device; when the fourth operation is a single-finger upward swipe operation along the bottom of the screen on the wearable device, the control instruction is an instruction for displaying a menu for the first controlled device; when the fourth operation is a double-finger upward swipe operation along the bottom of the screen on the wearable device, the control instruction is a shutdown instruction for the first controlled device; or when the fourth operation is a double-finger swipe operation on the wearable device, the control instruction is an instruction for controlling the volume of the first controlled device.

[0027] In a possible implementation, the wearable device is a smart watch, and the first button is a crown or a bezel.

[0028] In a possible implementation, the communication unit is further configured to establish a connection with the first controlled device; the communication unit is further configured to send a first ultra-wideband (UWB) signal to the first controlled device; and the display unit is further configured to display a fourth interface based on the first UWB signal and a second UWB signal, wherein the second UWB signal is a signal returned by the first controlled device to the wearable device when the first UWB signal is received, and the fourth interface is used to receive a trigger for controlling the first controlled device.

[0029] In a possible implementation, the processing unit is specifically configured to calculate a relative position between the wearable device and the first controlled device by using a time difference between the first UWB signal and the second UWB signal; and the display unit is specifically configured to display the fourth interface when the wearable device determines that the relative position meets a preset position.

[0030] In a possible implementation, the communication unit is further configured to send a third UWB signal to the second controlled device; the display unit is further configured to display a fifth interface based on the third UWB signal and a fourth UWB signal; the fourth UWB signal is a signal returned by the second controlled device to the wearable device upon receiving the third UWB signal; the fifth interface includes prompt information for prompting whether to access the second controlled device, a fifth control for accessing the second controlled device, and a sixth control for rejecting to access the second controlled device; and the processing unit is further configured to reject to access the second controlled device when the wearable device receives a trigger for the sixth control, or when no trigger is received for any control in the fifth interface within a preset time threshold.

[0031] In a possible implementation, the display unit is further configured to display a sixth interface when the wearable device receives an operation for exiting the control; the sixth interface includes prompt information for prompting whether to exit the control over the first controlled device, a seventh control for exiting the control over the first controlled device, and an eighth control for continuing to control the first controlled device; and the processing unit is further configured to continue to control the first controlled device when the wearable device receives a trigger for the eighth control, or when no trigger is received for any control in the sixth interface within a preset time threshold.

[0032] In a possible implementation, the controlled device includes one or more of the following: a large-screen device, a tablet computer, a computer, or a mobile phone.

[0033] In a third aspect, an embodiment of the present application provides a control apparatus, including a processor and a memory, the memory being configured to store code instructions; the processor is configured to execute the code instructions, so that the electronic device performs the control method described in the first aspect or any implementation manner of the first aspect.

[0034] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium, the computer readable storage medium storing instructions, when the instructions are executed, causing a computer to perform the control method described in the first aspect or any implementation manner of the first aspect.

[0035] In a fifth aspect, a computer program product includes a computer program, when the computer program is executed, causing a computer to perform the control method described in the first aspect or any implementation manner of the first aspect.

[0036] It should be understood that the second aspect to the fifth aspect of the present application correspond to the technical solution of the first aspect of the present application, and the beneficial effects obtained by each aspect and the corresponding feasible implementation manner are similar, which will not be described again. BRIEF DESCRIPTION OF DRAWINGS

[0037] Figure 1A scene schematic diagram provided by an embodiment of the present application;

[0038] Figure 2 Another scene schematic diagram provided by an embodiment of the present application;

[0039] Figure 3 A hardware structure schematic diagram of a smart watch provided by an embodiment of the present application;

[0040] Figure 4 A flowchart of a control method provided by an embodiment of the present application;

[0041] Figure 5 An interface schematic diagram of establishing a connection provided by an embodiment of the present application;

[0042] Figure 6 A control interface schematic diagram provided by an embodiment of the present application;

[0043] Figure 7 A prompt interface schematic diagram provided by an embodiment of the present application;

[0044] Figure 8 An interface schematic diagram of adjusting a control range provided by an embodiment of the present application;

[0045] Figure 9 An interface schematic diagram of adjusting a control mode provided by an embodiment of the present application;

[0046] Figure 10 Another prompt interface schematic diagram provided by an embodiment of the present application;

[0047] Figure 11 Another interface schematic diagram of adjusting a control content provided by an embodiment of the present application;

[0048] Figure 12 A structure schematic diagram of a control device provided by an embodiment of the present application;

[0049] Figure 13 A hardware structure schematic diagram of a control device provided by an embodiment of the present application;

[0050] Figure 14 A structure schematic diagram of a chip provided by an embodiment of the present application. DETAILED DESCRIPTION

[0051] For the convenience of clearly describing the technical solutions of the embodiments of the present application, in the embodiments of the present application, the terms of "first", "second", etc. are used to distinguish the same or similar items with basically the same function and role. For example, the first value and the second value are merely used to distinguish different values, and the order is not limited. Those skilled in the art can understand that the terms of "first", "second", etc. do not limit the quantity and the execution order, and the terms of "first", "second", etc. also do not mean that they are necessarily different.

[0052] It should be noted that in the present application, the words "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design scheme described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or having more advantages than other embodiments or design schemes. Rather, the words "exemplary" or "for example" are used in the sense of presenting a specific example.

[0053] In the present application, "at least one" means one or more, and "multiple" means two or more. The "and / or" describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the following three cases: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after it. "At least one of the following" or similar expressions means any combination of these items, including any combination of single item or multiple items. For example, at least one of a, b, or c, can represent a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0054] With the continuous development of communication technology, the possibility of interconnection and intercommunication between devices is brought about. Taking a wearable device as an example, the wearable device is becoming an important control device in the interconnection and intercommunication of multiple devices due to its more intimate and easy-to-reach characteristics.

[0055] Exemplarily, Figure 1 A scene schematic diagram provided by the embodiments of the present application is shown in FIG. 1. As shown in the figure, the scene includes a large screen (or television) 101, a user 102, a smart watch 103 worn by the user, and a remote controller 104 placed on a table. Figure 1

[0056] ​For example, when a user is watching TV on the sofa and needs to exit the current video content, adjust the video progress, adjust the video volume, or turn off the large screen, the user can get up and pick up the remote control 104 placed on the table, and use the function buttons on the remote control 104 to perform the aforementioned functions such as exiting the current video content. However, when the user is lying on the sofa and it is inconvenient to pick up the remote control 104, or the remote control 104 cannot be found, a communication connection needs to be established between the large screen 101 and the smartwatch 103, and the smartwatch 103 can be used to control the display content on the large screen 101.

[0057] However, due to the small size of the touchscreen on a smartwatch, there may be inconsistencies between the user's taps and the response commands on the screen when controlling the large screen, resulting in lower control accuracy.

[0058] In view of this, embodiments of this application provide a control method that enables a smartwatch to flexibly control the displayed content on the controlled device by adjusting the size of the control range.

[0059] In possible implementations, smartwatches can not only control large screens, but also control other controlled devices such as computers, mobile phones, and tablets. For example, Figure 2 This is a schematic diagram of another scenario provided for an embodiment of this application.

[0060] like Figure 2 As shown, when the controlled device is computer 202, the user can use the touchpad of smartwatch 201 to perform the touch functions corresponding to the touchpad on computer 202, such as clicking, dragging, swiping up or down, and zooming on content on computer 202. Alternatively, the user can also use the touchpad of smartwatch 201 to perform mouse-like control functions, such as left-clicking or right-clicking. It can be understood that the user can use the touchpad of smartwatch 201 to replace the touchpad and mouse on computer 202 to control computer 202.

[0061] When the controlled device is the large screen 203, the user can use the touchpad of the smartwatch 201 to turn off the large screen 203, exit video content on the large screen 203, adjust the progress, and adjust the volume. In essence, the user can use the touchpad of the smartwatch 201 to replace a remote control and control the functions of the large screen 203.

[0062] When the controlled device is the mobile phone 204, the user can use the touchpad of the smart watch 201 to realize the touch function of the touch screen of the mobile phone 204, such as click, slide, drag, and the like for the display content in the mobile phone 204, and realize the function of brushing short videos, reading novels, and browsing webpages in the mobile phone 204 through the touch function. It can be understood that the user can use the touchpad of the smart watch 201 to replace the touch screen in the mobile phone 204 to realize the control of the mobile phone 204.

[0063] When the controlled device is the tablet 205, the user uses the touch of the smart watch 201 to realize the control mode of the touch screen of the tablet 205, which can refer to the control mode of the mobile phone 204, and will not be described here.

[0064] It can be understood that the above-mentioned smart watch can also be other wearable devices provided with a touchpad, such as a smart bracelet, a smart glove, or a smart belt, and the like. The specific technology and specific device form of the wearable device in the embodiments of the present application are not limited.

[0065] It can be understood that the above-mentioned controlled device can also be referred to as a terminal, a user equipment (UE), a mobile station (MS), a mobile terminal (MT), and the like. The controlled device can be a mobile phone, a smart television, a wearable device, a tablet, a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, and the like. The specific technology and specific device form of the terminal device in the embodiments of the present application are not limited.

[0066] Therefore, in order to better understand the embodiments of the present application, the structure of the terminal device of the embodiments of the present application is introduced below. An exemplary, Figure 3 A hardware structure schematic diagram of a smart watch provided by the embodiments of the present application.

[0067] The smart watch can include a processor 110, an internal memory 121, a universal serial bus (USB) interface, a charging management module 140, a power management module 141, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a sensor module 180, a key 190, an indicator 192, a camera 193, and a display screen 194, etc. The sensor module 180 can include a gyroscope sensor 180B, a barometer 180C, a magnetic sensor 180D, an acceleration sensor 180E, a temperature sensor 180J, a touch sensor 180K, and an ambient light sensor 180L, etc.

[0068] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the smart watch. In other embodiments of the present application, the smart watch can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0069] The processor 110 can include one or more processing units. Different processing units can be independent devices or integrated into one or more processors. The processor 110 can also be provided with a memory for storing instructions and data.

[0070] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. The power management module 141 is used to connect the charging management module 140 and the processor 110.

[0071] The wireless communication function of the smart watch can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0072] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. The antennas in the smart watch can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas.

[0073] The mobile communication module 150 can provide a solution including 2G / 3G / 4G / 5G wireless communication applied to the smart watch. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1 and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit them to the modem processor for demodulation.

[0074] The wireless communication module 160 can provide solutions for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), ultra wide band (UWB), and the like, which are applied on the smart watch. In embodiments of the present application, the UWB can be used to implement the directional connection between the wearable device and the controlled device.

[0075] The smart watch can realize the display function through the GPU, the display screen 194, and the application processor, and the like. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering.

[0076] The display screen 194 is used to display images, videos, and the like. The display screen 194 includes a display panel. In some embodiments, the smart watch can include one or N display screens 194, N being a positive integer greater than 1.

[0077] The smart watch can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, and the like.

[0078] The camera 193 is used to capture still images or videos. In some embodiments, the smart watch can include one or N cameras 193, N being a positive integer greater than 1.

[0079] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 can include a program storage area and a data storage area.

[0080] The smart watch can realize the audio function through the audio module 170, the speaker 170A, the microphone 170B, and the application processor, and the like. For example, music playing, recording, and the like.

[0081] The audio module 170 is for converting digital audio information into an analog audio signal output, and for converting an analog audio input into a digital audio signal. The speaker 170A, also called a "loudspeaker", is for converting an audio electrical signal into a sound signal. The smart watch can listen to music or listen to a hands-free call through the speaker 170A. The microphone 170B, also called a "receiver", is for converting an audio electrical signal into a sound signal. When the smart watch answers a call or a voice message, the microphone 170B can be held close to a person's ear to listen to the voice.

[0082] The gyroscope sensor 180B can be used to determine the motion posture of the smart watch. The magnetometer sensor 180D includes a Hall sensor. The barometer 180C is for measuring air pressure. In some embodiments, the smart watch can calculate the altitude, assist positioning and navigation through the air pressure value measured by the barometer 180C. The acceleration sensor 180E can detect the magnitude of the acceleration of the smart watch in various directions (generally three axes). The ambient light sensor 180L is for sensing the ambient light brightness. The temperature sensor 180J is for detecting temperature. The touch sensor 180K, also called a "touch device". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch panel".

[0083] The key 190 includes a power-on key, or a volume key, etc. The key 190 can be a mechanical key. It can also be a touch key. The smart watch can receive key input and generate key signal input related to user settings and function control of the smart watch. In the embodiments of the present application, the key 190 can be a crown, which can be used to control the size of the touch range and switch the control mode.

[0084] The indicator 192 can be an indicator light, which can be used to indicate the charging state, the power change, and can also be used to indicate messages, missed calls, notifications, etc.

[0085] The software system of the smart watch can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture, etc.

[0086] The technical solutions of the present application and how the technical solutions of the present application solve the above technical problems will be described in detail below with specific embodiments. The following specific embodiments can be implemented independently, or can be combined with each other, and the same or similar concepts or processes can not be described in detail in some embodiments.

[0087] Exemplary, Figure 4 A flowchart of a control method provided by an embodiment of the present application is shown. In Figure 4 In the corresponding embodiments, the control method can involve a smart watch and a controlled device.

[0088] S401, when the smart watch receives an operation for starting to establish a connection, the smart watch establishes a first connection with the controlled device.

[0089] In the embodiments of the present application, the smart watch can establish a communication connection with the controlled device based on Bluetooth, connection with the same wireless Wi-Fi, or connection with the same account, and the present application does not limit this.

[0090] For example, the connection mode is Bluetooth. The controlled device can be a device that is allowed to start Bluetooth by default, or can be a device that starts Bluetooth based on the user's trigger operation. For example, the controlled device can start Bluetooth for the power-on operation, or can start Bluetooth for the trigger of the function control on the interface of the controlled device. Further, when the smart watch opens the Bluetooth connection, the controlled device is in a state that can be discovered by other devices, and is displayed in the interface of the smart watch.

[0091] In one implementation, the controlled device can be automatically selected by the smart watch according to a preconfigured selection rule. The selection rule can be randomly selected, can be to preferentially select the nearest device, or can be to preferentially select the device with the strongest Bluetooth signal.

[0092] In another implementation, the smart watch can select the controlled device from all Bluetooth-enabled devices in response to the user's operation.

[0093] For example, Figure 5 A connection establishment interface provided by the embodiments of the present application is shown in FIG. 5a. When the smart watch receives an operation to open the Bluetooth function, the smart watch can display an interface as shown in FIG. 5a. Figure 5 The interface can include a control 501 for starting Bluetooth connection, a control for viewing device name, a control for viewing received files, and a control for querying help, etc.

[0094] Further, when the smart watch receives the user's operation in the interface as shown in FIG. 5a, the smart watch can search for Bluetooth-enabled controlled devices, and display an interface as shown in FIG. 5b. Figure 5 Figure 5 Further, when the smart watch receives the user's operation in the interface as shown in FIG. 5a, the smart watch can search for Bluetooth-enabled controlled devices, and display an interface as shown in FIG. 5b. Figure 5 The interface as shown in FIG. 5b can include the available devices found, such as device 502, device 503, and device 504, etc. When the smart watch receives the user's trigger for any device, such as the control corresponding to device 502, the smart watch can send a request to establish a Bluetooth connection to device 502, and establish a first connection with device 502 through the response data returned by device 502.​

[0095] In a possible implementation, in the process of establishing the Bluetooth connection, the controlled device can also generate a random verification code when receiving the request for establishing the Bluetooth connection sent by the smart watch, so that the smart watch can establish the first connection with the controlled device by inputting the random verification code.

[0096] It can be understood that S401 can be a process of establishing a connection between the smart watch and the controlled device, and the connection can be established in other ways in addition to the Bluetooth connection described above, which is not limited in the embodiments of the present application.

[0097] S402, the smart watch sends a UWB signal to the controlled device.

[0098] Adaptively, the controlled device can receive the UWB signal and execute the steps shown in S403 after receiving the UWB signal.

[0099] Illustratively, the smart watch can periodically send the UWB signal; or the smart watch can send the UWB signal when sensing that the user moves the smart watch, such as moving the smart watch past other devices, or sensing that the user points the smart watch in a certain direction.

[0100] It can be understood that since the UWB signal has strong beam directivity, the smart watch is pointed at the controlled device, so that the controlled device can accurately receive the UWB signal.

[0101] S403, the controlled device sends a response signal corresponding to the UWB signal sent by the smart watch.

[0102] S404, the smart watch calculates the relative position between the smart watch and the controlled device by using the time difference between the UWB signal and the response signal.

[0103] In the embodiments of the present application, the relative position can include distance information and direction information between the smart watch and the controlled device. Illustratively, the smart watch can determine the relative position between the devices by using time of flight (TOF), two way ranging (TWR), and angle of arrival (AOA) measurement methods.

[0104] It can be understood that the smart watch can also determine the relative position between the smart watch and the controlled device based on other wireless positioning methods, such as WiFi, zigbee, infrared, radio frequency identification technology, etc., which are not limited in the embodiments of the present application.

[0105] In a possible implementation, the smart watch can also display the control interface upon receiving the response signal corresponding to the UWB signal.

[0106] S405, when the smart watch determines that the relative position meets the preset position, the smart watch displays the control interface.

[0107] In an example, when the smart watch determines that the relative position does not meet the preset position, the smart watch can continue to perform the step shown in S402.

[0108] In an example, the smart watch can meet the preset position when the smart watch passes by the controlled device, or the smart watch can meet the preset position when the smart watch points to the controlled device, and the smart watch can display the control interface.

[0109] In an example, Figure 6 A control interface diagram provided by an embodiment of the present application is shown in Figure 6 In a corresponding embodiment, the smart watch can be provided with a watch dial 602 and a crown 601. The watch dial 602 is provided with a rotatable outer ring, also referred to as a bezel 603, around the watch dial 602, for example, on the outer side of the watch dial 602 or the lower side of the watch dial 602. The crown 601 (or the bezel 603) can be used to control the touch range, and the crown 601 can also be used to switch the control mode. The control mode can include a touch control mode (similar to a touch button) and a click control mode (similar to a mouse).

[0110] In a possible implementation, as shown in a of Figure 6 The bezel 603 and the watch dial 602 can be set together, for example, the watch dial 602 can rotate when the bezel 603 is rotated, or the bezel 603 and the watch dial 602 can be independent of each other, for example, the watch dial 602 can remain stationary when the bezel 603 is rotated. It can be understood that the structure of the bezel and the structural relationship between the bezel and the watch dial are not limited in the embodiment of the present application.

[0111] When the relative position calculated by the smart watch based on the transmitted UWB signal and the response signal corresponding to the UWB signal meets the preset position, the smart watch can display the control interface shown in a of Figure 6 by default, which can be used to implement the touch control mode, for example, the interface can be used to receive the touch operation for controlling the controlled device.

[0112] Further, when the smart watch receives the trigger operation of the user for the crown 601, the smart watch can switch from the interface shown in a of Figure 6 to the interface shown in b of Figure 6 For example,Figure 6 In the interface shown in b, this interface can be used to implement a click control mode. For example, the interface can include multiple controls for controlling clicks, such as control 604 (or can be understood as the left mouse button) and control 605 (or can be understood as the right mouse button). The trigger operation for the crown 601 can be a single press operation, a multiple press operation, or a long press operation, etc.

[0113] In a possible implementation, when the smartwatch receives a user's trigger operation on the crown 601, the smartwatch can display a prompt interface. This prompt interface includes: a prompt message for switching control modes, a control for allowing the switching of control modes, and a control for rejecting the switching of control modes. For example, when the smartwatch receives a user's trigger operation on the control for allowing the switching of control modes, and the current control mode is as follows... Figure 6 When the touch control mode is indicated by 'a', the smartwatch can switch the current control mode and... Figure 6 The interface shown in 'a' switches to, as shown in 'a'. Figure 6 The interface shown in b; or, when the smartwatch receives a user's triggering of the control used to refuse switching control modes, the smartwatch can maintain the current control mode and continue to display as shown in b. Figure 6 The interface shown in 'a'.

[0114] In a possible implementation, when the relative position calculated by the smartwatch based on the transmitted UWB signal and the corresponding response signal meets a preset position, the smartwatch can also display a default position such as... Figure 6 The interface shown in b, and upon receiving a user's trigger operation on crown 601, is... Figure 6 The interface shown in b in the image switches to the one shown in the image. Figure 6 The interface shown in 'a'.

[0115] In a possible implementation, the smartwatch can also adjust the control range when it receives an operation from the user rotating the crown 601 (or bezel 603). This adjustment method can be found below. Figure 8 (or Figure 11 The corresponding implementation example.

[0116] In a possible implementation, when the smartwatch senses other controlled devices based on steps S402-S405 while displaying the control interface, the smartwatch can display a prompt interface. For example, Figure 7 This is a schematic diagram of a prompt interface provided in an embodiment of this application.

[0117] When a smartwatch is controlling another controlled device, and receives actions such as the user pointing the smartwatch at another controlled device or lifting the smartwatch, the smartwatch can send a UWB signal to the other controlled device and receive a corresponding response signal from that device. Furthermore, when the smartwatch determines that its relative position with another controlled device meets a preset requirement, it detects the other controlled device and displays an indicator such as... Figure 7 The interface shown may include: a prompt message, a "Yes" control 702 for controlling the newly detected device 701, and a "No" control 703 for canceling control of the newly detected device 701. The prompt message may read: "Device 701 detected. Please confirm whether to connect to this device." The smartwatch can detect actions such as the user pointing the smartwatch at another controlled device or lifting the smartwatch based on sensors, such as an accelerometer and a gyroscope.

[0118] For example, when the smartwatch receives a user trigger on control 703, or if no trigger is received for any control within a preset time threshold, such as 1 minute, the smartwatch reverts to the control interface of the old device, for example, continuing to display... Figure 6 The interface shown in 'a' or as shown in 'a' Figure 6 The interface shown in b is shown in the image.

[0119] S406. When the smartwatch receives a trigger operation for controlling the controlled device, the smartwatch generates touch information and obtains the control command corresponding to the touch information.

[0120] In this embodiment of the application, the triggering operation for controlling the controlled device can be related to the type of the controlled device. For example, the triggering operation for a smartwatch can be different when controlling different controlled devices.

[0121] In this embodiment, the smartwatch may store the correspondence between touch information (or gesture information, trigger operations, etc.) and control commands. Alternatively, the correspondence between touch information and control commands may also be stored in the controlled device. For example, the smartwatch may send touch information to the controlled device, allowing the controlled device to parse the control commands based on the aforementioned correspondence.

[0122] S407: The smartwatch sends control commands to the controlled device via Bluetooth.

[0123] In possible implementations, when the smartwatch and the controlled device establish a connection in other ways, the smartwatch can also send control commands to the controlled device in other ways. This application embodiment does not limit this.

[0124] S408. The controlled device executes the corresponding function using control commands.

[0125] Based on this, smartwatches can achieve flexible control of controlled devices in various scenarios through a touchpad for receiving touch operations and a crown (or bezel) for controlling the touch range or switching control modes, thus improving the user experience.

[0126] Among the possible implementations, in Figure 4 Based on the corresponding embodiments, the touch operation in the steps shown in S406 may differ when the controlled device is different.

[0127] In one implementation, when the controlled device is a computer or similar device, the user can use a smartwatch to replace the computer's touchpad and mouse to control the computer or similar device. For example, Table 1 is a schematic table illustrating gesture control for a computer provided in an embodiment of this application. Table 1 clarifies the correspondence between control commands used to control the computer and gesture information received by the smartwatch.

[0128] Table 1. Illustration of gesture control for computers

[0129]

[0130] As shown in Table 1, the wake-up command can be understood as follows: when the smartwatch and computer establish an initial connection, and the computer is in sleep mode, the user can point the smartwatch at the computer, so that the smartwatch can send the control command to wake up the computer according to the steps shown in S402-S407. Then the computer can switch from the sleep screen to the display screen before sleep.

[0131] In some possible implementations, the limited area of ​​a smartwatch's touchpad may prevent precise control of the device's display. Therefore, the size of the control area can be adjusted by rotating the crown (or bezel), resulting in a more reasonable operating range. For example, Figure 8 This is a schematic diagram of an interface for adjusting the control range, provided as an embodiment of this application.

[0132] When users use smartwatches in, for example Figure 8 When controlling the computer interface shown in Figure 'a', the user can control the area covered by region 805 at a time by default. It can be understood that the circle containing region 805 can be displayed on the computer interface and will be removed after a certain time threshold, such as 5 seconds. For example, ... Figure 8 The interface shown in 'a' may also include video 801, video 802, video 803, and video 804, etc.

[0133] It can be understood that, due to the small area of the touchpad of the smart watch, when the user needs to control the video 801 as shown by a in FIG. 8B, the video 801 is triggered in the area 805, and the touch may not be accurate to other points such as the video 802. At this time, the user can rotate the crown (or the bezel) to reduce the control range, for example, to the range where the area 806 as shown by b in FIG. 8B is located, so that the area 806 can cover most of the area of the video 801, and accurate touch to the video 801 is achieved. Figure 8 Figure 8

[0134] In a possible implementation, the area 805 can be displayed in a semi-transparent form in the interface as shown by a in FIG. 8B, for example, the area 805 can be a semi-transparent circle. In addition, the terminal device can cancel the display of the area 805 within a time threshold during which the user does not adjust the control area, so as to avoid the influence of the area 805 on the user's viewing of the controlled device. It can be understood that, when the smart watch is of other shapes, the control area can also be displayed in the interface of the controlled device in a shape corresponding to the smart watch, for example, when the smart watch is square, a square control area can be displayed in the interface of the controlled device, and the display mode and the display form of the control area are not limited in the embodiments of the present application. Figure 8

[0135] For example, the user can reduce the area 805 by rotating the crown (or the bezel), and slide the reduced area to the icon (or text, control, etc.) to be touched by sliding the touchpad, as shown by b in FIG. 8B, the reduced area 806 is slid to the surrounding of the video 801, so that the user can control the video 801 by triggering the area 806.

[0136] For example, when the smart watch receives the operation of the user rotating the crown (or the bezel) clockwise (or counterclockwise), the smart watch can reduce the control range; or when the smart watch receives the operation of the user rotating the crown (or the bezel) counterclockwise (or clockwise), the smart watch can expand the control range.

[0137] In a possible implementation, the user can also enlarge the display content by pressing the touchpad in the smart watch with two fingers away from each other, so that the control range can cover most of the area of the content to be selected.

[0138] In a possible implementation, on the basis of the corresponding embodiments, when the user reduces the control range by rotating the crown (or the bezel) of the smart watch, the control mode can also be changed by pressing the crown, and more accurate control of the triggered content can be achieved by the left and right areas of the touchpad. For example, Figure 8 Figure 9 ​​​​An interface diagram for adjusting the control mode is provided in an embodiment of the present application.

[0139] When the user reduces the control range by rotating the crown (or the bezel) of the smart watch, such as reducing to the area 902 as shown in a of Figure 9 , the user can also switch the control mode by pressing the crown, such as switching from the touch control mode to the click control mode, and realize the left click or the right click on the video 801 through the left screen or the right screen (such as the interface shown in b of Figure 6 ) in the touchpad of the smart watch.

[0140] In the interface shown in a of Figure 9 , when the smart watch receives the triggering operation of the user on the right screen of the touchpad, the computer can display the interface shown in b of Figure 9 , in which the menu bar corresponding to the right click on the video 801 can be displayed, such as the menu bar which can include multiple functions, such as the open mode, the copy, the paste, and the rename 902. Further, when the smart watch receives the triggering of the user on the control corresponding to the rename 902, the smart watch can realize the renaming function of the video 801.

[0141] In a possible implementation, when the smart watch receives the operation of the user sliding up along the bottom edge of the touchpad, the smart watch can display the interface for prompting whether to disconnect the control. Exemplarily, Figure 10 Another prompt interface diagram is provided in an embodiment of the present application.

[0142] When the smart watch receives the operation of the user sliding up along the bottom edge of the touchpad, the smart watch can display the interface shown in Figure 10 , which can include: the prompt information, the yes control 1001 for exiting the control of the computer, and the no control 1002 for continuing to control the computer. Wherein, the prompt information can be displayed as: the push exit operation is detected, please determine whether to exit the control of the computer.

[0143] In a possible implementation, when the smart watch receives the triggering of the user on the no control 1002, or does not receive the triggering on any control within a preset time threshold, such as 1 minute, the control interface of the controlled device is restored.

[0144] In another implementation, when the controlled device is a large screen, etc., the user can use the smart watch to replace the remote controller to realize the control on the large screen, etc. Exemplarily, Table 2 is a gesture control schematic table for the large screen provided in an embodiment of the present application, which clearly shows the correspondence between the control instructions for controlling the large screen and the gesture information received by the smart watch.

[0145] Table 2: Gesture control table for large screen

[0146]

[0147] In a possible implementation, as shown in the smart watch in Figure 6 , when the smart watch includes multiple crowns, one of the crowns in the smart watch can be used to implement the switching function of the control mode, and another crown in the smart watch can be used to implement the increasing or decreasing function of the volume. For example, the user can realize the increasing and decreasing of the volume through the rotation operation of the crown.

[0148] In another implementation, when the controlled device is a mobile phone (or a tablet) and the like, the user can use the smart watch to replace the touch screen of the mobile phone (or the tablet) to realize the touch control of the mobile phone (or the tablet) and the like.

[0149] It can be understood that the gesture operation of controlling the mobile phone (or the tablet) by using the smart watch can refer to the touch operation of controlling the mobile phone (or the tablet) by using the touch screen of the mobile phone (or the tablet). For example, when the user controls the mobile phone (or the tablet) to watch a short video by using the smart watch, the user can switch the short video content by sliding up or sliding down in the touch panel of the smart watch; or when the user controls the mobile phone (or the tablet) to read a novel by using the smart watch, the user can turn the page by clicking the left or the right in the touch panel of the smart watch, and exit the novel interface by the operation of sliding left with a single finger.

[0150] In a possible implementation, when the user controls the mobile phone (or the tablet) to watch a short video by using the smart watch, when the user needs to like or view comments and the like, the control range can be adjusted by rotating the crown (or the bezel), so that the smart watch can realize accurate control of the mobile phone. For example, Figure 11 Another interface for adjusting the control content provided by the embodiment of the application.

[0151] When the mobile phone receives the operation of the user opening the short video application, the mobile phone can display the interface as shown in a of Figure 11 , and the smart watch can control the content covered by the area 1102 by default. As shown in the interface a of Figure 11 , the interface can further display: the short video content published by the user Xiao Wang, the control for viewing the information of the publisher corresponding to the short video content, the control for collecting the short video content, the control 1101 for viewing the comments, and the text box for inputting the comments. Among them, the text box for inputting the comments can display: the text information of leaving your wonderful comments, the control for reminding other users in the comments, and the control for adding an expression in the comments.

[0152] For example, as shown inFigure 11 In the interface shown in Figure 'a', when the smartwatch receives a user's operation to rotate the crown (or bezel), this area 1102 can shrink to the size shown in Figure 'a'. Figure 11 The area 1103 is shown as b in the diagram. Furthermore, the smartwatch can receive user input by swiping the screen, for example, swiping area 1103 to... Figure 11 The location of region 1104, indicated by 'c', allows it to cover most of the control 1101 used for viewing comments. Therefore, when the smartwatch receives a user's action on region 1104, it can precisely trigger the control 1101 to open the comment content.

[0153] It is understood that the control commands used to control the controlled device are not limited to the above-mentioned contents, and no such limitation is made in the embodiments of this application.

[0154] It is understood that the interfaces provided in the above embodiments are merely examples and cannot be construed as limiting the embodiments of this application.

[0155] The above combination Figures 4-11 The methods provided in the embodiments of this application have been described. The apparatus for executing the above methods, provided in the embodiments of this application, is described below. Figure 12 As shown, Figure 12 This is a schematic diagram of a control device provided in an embodiment of this application. The control device may be a wearable device in the embodiment of this application, or a chip or chip system within a wearable device.

[0156] like Figure 12 As shown, the control device 120 can be used in communication equipment, circuits, hardware components, or chips. The control device includes a display unit 1201, a processing unit 1202, and a communication unit 1203. The display unit 1201 supports the display steps performed by the control device 120; the processing unit 1202 supports the information processing steps performed by the control device 120; and the communication unit supports the data transmission and reception steps performed by the control device 120. The communication unit 1203 can be an input or output interface, pins, or circuits, etc.

[0157] Specifically, this application provides a control device 120. When a wearable device receives a first operation, a processing unit 1202 is used to control the first controlled device to display a first interface. The first interface includes a first control range, and the display content of the first control range can be controlled by the wearable device. When the wearable device receives a second operation, the processing unit 1202 is also used to control the first controlled device to adjust the first control range to a second control range, the size of which is different from the size of the first control range.

[0158] In a possible implementation, the wearable device is provided with a first button, and the second operation is an operation for rotating the first button.

[0159] In a possible implementation, when the wearable device receives a third operation for the first button and the control mode of the wearable device is the first control mode, the processing unit 1202 is further configured to adjust the first control mode to a second control mode, and the display unit 1201 is configured to display a second interface; the second interface includes at least one control for implementing a click function; the first control mode is used to implement a control function corresponding to a touchpad; and the first control mode is used to implement a control function corresponding to a mouse.

[0160] In a possible implementation, when the wearable device receives a third operation for the first button and the control mode of the wearable device is the first control mode, the display unit 1201 is configured to display a third interface; the third interface includes prompt information for prompting to switch the control mode, a first control for allowing to switch the control mode, and a second control for refusing to switch the control mode; when the wearable device receives a trigger for the first control, the processing unit 1202 is configured to adjust the first control mode to the second control mode, and the display unit 1201 is further configured to display the second interface.

[0161] In a possible implementation, when the wearable device receives a fourth operation for controlling the first controlled device, the processing unit 1202 is further configured to control the first controlled device to execute a control instruction corresponding to the fourth operation.

[0162] In a possible implementation, the control mode is the first control mode; when the fourth operation is a single-finger click operation on the wearable device, the control instruction is a click instruction on the first controlled device; when the fourth operation is a single-finger click operation and a single-finger sliding operation on the wearable device, the control instruction is a drag instruction on the first controlled device; when the fourth operation is a single-finger sliding operation along the bottom of the screen on the wearable device, the control instruction is an instruction for opening a program dock on the first controlled device; when the fourth operation is a double-finger sliding operation on the wearable device, the control instruction is an instruction for scrolling the screen on the first controlled device; when the fourth operation is a double-finger pinch operation on the wearable device, the control instruction is an instruction for zooming out the display content on the first controlled device; when the fourth operation is a double-finger stretch operation on the wearable device, the control instruction is an instruction for zooming in the display content on the first controlled device; when the fourth operation is a single-finger upward sliding operation along the bottom of the screen on the wearable device, the control instruction is an instruction for exiting the first interface on the first controlled device; or, when the fourth operation is a three-finger upward sliding operation on the wearable device, the control instruction is an instruction for switching to a home screen on the first controlled device.

[0163] In a possible implementation, the control mode is the second control mode; the second interface includes a third control and a fourth control; when the fourth operation is a click operation on the third control in the wearable device, the control instruction is a left-click instruction on the first controlled device; or, when the fourth operation is a click operation on the fourth control in the wearable device, the control instruction is a right-click instruction on the first controlled device.

[0164] In a possible implementation, the control mode is the first control mode; when the fourth operation is a single-finger long press operation on the wearable device, the control instruction is a return instruction on the first controlled device; when the fourth operation is a single-finger upward sliding operation along the bottom of the screen on the wearable device, the control instruction is an instruction for displaying a menu on the first controlled device; when the fourth operation is a double-finger upward sliding operation along the bottom of the screen on the wearable device, the control instruction is a shutdown instruction on the first controlled device; or, when the fourth operation is a double-finger sliding operation on the wearable device, the control instruction is an instruction for controlling the volume on the first controlled device.

[0165] In a possible implementation, the wearable device is a smart watch, and the first button is a crown or a bezel.

[0166] In a possible implementation, the communication unit 1203 is further configured to establish a connection with the first controlled device; the communication unit 1203 is further configured to send a first ultra-wideband (UWB) signal to the first controlled device; and the display unit 1201 is further configured to display a fourth interface based on the first UWB signal and a second UWB signal, where the second UWB signal is a signal returned by the first controlled device to the wearable device upon receiving the first UWB signal; and the fourth interface is used to receive a trigger for controlling the first controlled device.

[0167] In a possible implementation, the processing unit 1202 is specifically configured to calculate a relative position between the wearable device and the first controlled device by using a time difference between the first UWB signal and the second UWB signal; and the display unit 1201 is specifically configured to display the fourth interface when the wearable device determines that the relative position meets a preset position.

[0168] In a possible implementation, the communication unit 1203 is further configured to send a third UWB signal to a second controlled device; and the display unit 1201 is further configured to display a fifth interface based on the third UWB signal and a fourth UWB signal, where the fourth UWB signal is a signal returned by the second controlled device to the wearable device upon receiving the third UWB signal; the fifth interface includes prompt information for prompting whether to access the second controlled device, a fifth control for accessing the second controlled device, and a sixth control for rejecting to access the second controlled device; and the processing unit 1202 is further configured to reject to access the second controlled device when the wearable device receives a trigger for the sixth control, or when no trigger for any control in the fifth interface is received within a preset time threshold.

[0169] In a possible implementation, the display unit 1203 is further configured to display a sixth interface when the wearable device receives an operation for exiting the control; the sixth interface includes prompt information for prompting whether to exit the control over the first controlled device, a seventh control for exiting the control over the first controlled device, and an eighth control for continuing to control the first controlled device; and the processing unit 1202 is further configured to continue to control the first controlled device when the wearable device receives a trigger for the eighth control, or when no trigger for any control in the sixth interface is received within a preset time threshold.

[0170] In a possible implementation, the controlled device includes one or more of the following: a large-screen device, a tablet computer, a computer, or a mobile phone.

[0171] In a possible implementation, the control device can further include a storage unit 1204. The processing unit 1202 and the storage unit 1204 are connected through a line. The storage unit 1204 can include one or more memories, which can be one or more devices, circuits, or the like for storing programs or data. The storage unit 1204 can exist independently and be connected to the processing unit 1202 of the control device through a communication line. The storage unit 1204 can also be integrated with the processing unit 1202.

[0172] The storage unit 1204 can store computer execution instructions of the method in the terminal device, so as to enable the processing unit 1202 to execute the method in the above embodiments. The storage unit 1204 can be a register, a cache, or a RAM, and the storage unit 1204 can be integrated with the processing unit 1202. The storage unit 1204 can be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, and the storage unit 1204 can be independent of the processing unit 1202.

[0173] Figure 13 A hardware structure schematic diagram of a control device provided in the embodiments of the present application is shown in FIG. 13. As shown in FIG. 13, the control device includes a processor 1301, a communication line 1304, and at least one communication interface (for example, the communication interface 1303 is exemplified in the following description). Figure 13 Figure 13

[0174] The processor 1301 can be a general central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling program execution of the solutions of the present application.

[0175] The communication line 1304 can include a circuit for transmitting information between the above components.

[0176] The communication interface 1303 uses any transceiver-like device, for example, to communicate with other devices or communication networks, such as an Ethernet, a wireless local area networks (WLAN), and the like.

[0177] Possibly, the control device can further include a memory 1302.

[0178] ​​The memory 1302 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but not limited thereto. The memory may exist independently and be connected to the processor via communication line 1304. The memory may also be integrated with the processor.

[0179] The memory 1302 stores computer execution instructions for implementing the scheme of this application, and the processor 1301 controls the execution. The processor 1301 executes the computer execution instructions stored in the memory 1302, thereby implementing the control method provided in the embodiments of this application.

[0180] It is possible that the computer execution instructions in the embodiments of this application may also be referred to as application code, and the embodiments of this application do not specifically limit this.

[0181] In a specific implementation, as one example, the processor 1301 may include one or more CPUs, for example... Figure 13 CPU0 and CPU1 in the CPU.

[0182] In a specific implementation, as one example, the control device may include multiple processors, for example... Figure 13 Processors 1301 and 1305 are mentioned. Each of these processors can be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor here can refer to one or more devices, circuits, and / or processing cores used to process data (such as computer program instructions).

[0183] For example, Figure 14 This is a schematic diagram of a chip structure provided in an embodiment of this application. The chip 140 includes one or more processors 1420 and a communication interface 1430.

[0184] In some embodiments, the memory 1440 stores elements, such as executable modules or data structures, or a subset or superset thereof.

[0185] In the embodiments of the present application, the memory 1440 can include read-only memory and random access memory, and provide instructions and data for the processor 1420. A part of the memory 1440 can also include non-volatile random access memory (NVRAM).

[0186] In the embodiments of the present application, the memory 1440, the communication interface 1430, and the memory 1440 are coupled together through the bus system 1410. Among them, the bus system 1410 can include not only a data bus, but also a power bus, a control bus, and a status signal bus, etc. For the convenience of description, all kinds of buses are marked as the bus system 1410. Figure 14

[0187] The above-described method of the embodiments of the present application can be applied in the processor 1420 or implemented by the processor 1420. The processor 1420 can be an integrated circuit chip with a processing capability. In the implementation process, each step of the above-described method can be completed by the integrated logic circuit of hardware in the processor 1420 or the instruction of software form. The above-described processor 1420 can be a general-purpose processor (for example, a microprocessor or a conventional processor), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, or discrete hardware components, and the processor 1420 can implement or execute the disclosed methods, steps and logic block diagrams in the embodiments of the present application.

[0188] The steps of the method disclosed in the embodiments of the present application can be directly embodied as a hardware coding processor to execute, or a combination of hardware and software modules in the coding processor to execute. Among them, the software module can be located in a storage medium in the art mature, such as random access memory, read-only memory, programmable read-only memory or electrically erasable programmable memory (EEPROM). The storage medium is located in the memory 1440, and the processor 1420 reads the information in the memory 1440, and combines the hardware to complete the steps of the above-described method.​

[0189] In the above embodiments, the instructions stored in the memory for execution by the processor can be implemented in the form of a computer program product. The computer program product can be written in advance into the memory, or downloaded into the memory in the form of software and installed.

[0190] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the flow or function according to the embodiments of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL) or wireless (such as infrared, wireless, microwave, etc.)) way. The computer-readable storage medium can be any available medium that can be stored by the computer or a data storage device such as a server, data center, etc. integrated with one or more available media sets. For example, the available media can include magnetic media (such as floppy disk, hard disk or magnetic tape), optical media (such as digital versatile disc (DVD)), or semiconductor media (such as solid state disk (SSD)) and the like.

[0191] The embodiments of the present application also provide a computer-readable storage medium. The methods described in the above embodiments can be implemented by software, hardware, firmware or any combination thereof in whole or in part. The computer-readable medium can include computer storage medium and communication medium, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium that can be accessed by a computer.

[0192] As a possible design, the computer readable medium can include compact disc read-only memory (CD-ROM), RAM, ROM, EEPROM, or other optical disk storage; the computer readable medium can include magnetic disk storage or other magnetic storage devices. Moreover, any connection line can also be appropriately referred to as a computer readable medium. For example, if software is transmitted from a website, server or other remote source using a coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology (such as infrared, radio and microwave), the coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology such as infrared, radio and microwave is included in the definition of the medium. As used herein, magnetic disks and optical disks include compact disks (CDs), laser disks, optical disks, digital versatile disks (DVDs), floppy disks and Blu-ray disks, wherein magnetic disks usually magnetically reproduce data, and optical disks optically reproduce data with a laser.

[0193] The above combinations should also be included within the scope of the computer readable medium. The above specification, examples and data provide essential information for a person of ordinary skill in the art to make and use the present application. The general scope of the application is not to be limited based on the specific embodiments described above, but on the full scope of the patent rights set forth in the claims.

Claims

1. A control method characterized by, The method is applied to a wearable device, and the method comprises: When the wearable device receives a first operation, the wearable device controls a first controlled device to display a first interface; the first interface comprises a first control range, which is an operable range of the wearable device for controlling the first controlled device, and the display content of the first control range is acceptable to the control of the wearable device; When the wearable device receives a second operation of rotating a first button, the wearable device controls the first controlled device to adjust the first control range to a second control range, and the size of the second control range is different from that of the first control range; the second control range is an operable range of the wearable device for controlling the first controlled device; When the wearable device receives a third operation of triggering the first button and the control mode of the wearable device is a first control mode, the wearable device adjusts the first control mode to a second control mode and displays a second interface; the second interface comprises at least one control for realizing a click function; the first control mode is used for realizing a control function corresponding to a touchpad; and the second control mode is used for realizing a control function corresponding to a mouse, so as to realize the control of the operable range of the first controlled device.

2. The method of claim 1, wherein, The method further comprises: When the wearable device receives a third operation of triggering the first button and the control mode of the wearable device is a first control mode, the wearable device displays a third interface; the third interface comprises prompt information for prompting the switching of the control mode, a first control for allowing the switching of the control mode, and a second control for rejecting the switching of the control mode; When the wearable device receives a trigger for the first control, the wearable device adjusts the first control mode to the second control mode and displays the second interface.

3. The method of claim 1, wherein, The method further comprises: When the wearable device receives a fourth operation for controlling the first controlled device, the wearable device controls the first controlled device to execute a control instruction corresponding to the fourth operation.

4. The method of claim 3, wherein, The control mode is the first control mode; When the fourth operation is a single-finger click operation of the wearable device, the control instruction is a click instruction of the first controlled device; When the fourth operation is a single-finger click operation and a single-finger sliding operation of the wearable device, the control instruction is a drag instruction of the first controlled device; When the fourth operation is a single-finger sliding operation of the wearable device along the bottom of a screen, the control instruction is an instruction of the first controlled device for opening a program dock. In a case where the fourth operation is a two-finger sliding operation on the wearable device, the control instruction is an instruction for the first controlled device to scroll a screen; In a case where the fourth operation is a two-finger pinch operation on the wearable device, the control instruction is an instruction for the first controlled device to zoom out display content; or in a case where the fourth operation is a two-finger stretch operation on the wearable device, the control instruction is an instruction for the first controlled device to zoom in display content; In a case where the fourth operation is a single-finger upward sliding operation on the wearable device along a bottom of a screen, the control instruction is an instruction for the first controlled device to exit the first interface; Or, in a case where the fourth operation is a three-finger upward sliding operation on the wearable device, the control instruction is an instruction for the first controlled device to switch to a home screen.

5. The method of claim 3, wherein, The control mode is the second control mode; the second interface includes a third control and a fourth control; In a case where the fourth operation is a click operation on the wearable device on the third control, the control instruction is a left-click instruction for the first controlled device; Or, in a case where the fourth operation is a click operation on the wearable device on the fourth control, the control instruction is a right-click instruction for the first controlled device.

6. The method of claim 3, wherein, The control mode is the first control mode; In a case where the fourth operation is a single-finger long press operation on the wearable device, the control instruction is a return instruction for the first controlled device; In a case where the fourth operation is a single-finger upward sliding operation on the wearable device along a bottom of a screen, the control instruction is an instruction for the first controlled device to display a menu; In a case where the fourth operation is a two-finger upward sliding operation on the wearable device along a bottom of a screen, the control instruction is a shutdown instruction for the first controlled device; Or, in a case where the fourth operation is a two-finger sliding operation on the wearable device, the control instruction is an instruction for the first controlled device to control a volume.

7. The method according to any one of claims 2 to 6, characterized in that, The wearable device is a smart watch, and the first button is a crown or a bezel.

8. The method according to any one of claims 1 to 6, characterized in that, Before the wearable device controls the first controlled device to display the first interface upon receiving the first operation, the method further includes: The wearable device establishes a connection with the first controlled device; The wearable device sends a first Ultra-Wide Band (UWB) signal to the first controlled device; The wearable device displays a fourth interface based on the first UWB signal and a second UWB signal; the second UWB signal is a signal returned by the first controlled device to the wearable device upon receiving the first UWB signal; and the fourth interface is used to receive a trigger for controlling the first controlled device.

9. The method of claim 8, wherein, The wearable device displays the fourth interface based on the first UWB signal and the second UWB signal, including: The wearable device calculates a relative position between the wearable device and the first controlled device by using a time difference between the first UWB signal and the second UWB signal; When the wearable device determines that the relative position meets a preset position, the wearable device displays the fourth interface.

10. The method of claim 9, wherein, The method further includes: The wearable device sends a third UWB signal to a second controlled device; The wearable device displays a fifth interface based on the third UWB signal and a fourth UWB signal; the fourth UWB signal is a signal returned by the second controlled device to the wearable device when the second controlled device receives the third UWB signal; the fifth interface includes prompt information for prompting whether to access the second controlled device, a fifth control for accessing the second controlled device, and a sixth control for rejecting to access the second controlled device; When the wearable device receives a trigger for the sixth control, or does not receive a trigger for any control in the fifth interface within a preset time threshold, the wearable device rejects to access the second controlled device.

11. The method of claim 1, wherein, The method further includes: When the wearable device receives an operation for exiting control, the wearable device displays a sixth interface; the sixth interface includes prompt information for prompting whether to exit control over the first controlled device, a seventh control for exiting control over the first controlled device, and an eighth control for continuing to control the first controlled device; When the wearable device receives a trigger for the eighth control, or does not receive a trigger for any control in the sixth interface within a preset time threshold, the wearable device continues to control the first controlled device.

12. The method according to any one of claims 1-6, 9-10, characterized in that, The controlled device includes one or more of a large-screen device, a tablet computer, a computer, or a mobile phone.

13. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, The processor executes the computer program, so that the electronic device performs the method in any one of claims 1 to 12.

14. A computer-readable storage medium, the computer-readable storage medium storing a computer program, characterized in that, The computer program is executed by the processor, so that the computer performs the method in any one of claims 1 to 12.

15. A computer program product, characterised in that, The computer program is executed by the processor, so that the computer performs the method in any one of claims 1 to 12.

Citation Information

Patent Citations

  • Method for smart wearable device to control mobile terminal

    CN107249071A

  • Method for providing interface using mobile device and wearable device

    US20170353686A1

  • Crown of smart watch and operation method for smart watch

    WO2017016264A1