Device operation control method, device operation control apparatus, and storage medium

Abstract

The invention relates to an operation control method of equipment, an operation control device of the equipment and a storage medium. The operation control method of the device comprises the following steps: responding to a working mode of the wearable device as a first mode, the first mode being used for controlling a controlled device based on a mouse control mode and being in pairing connection with the controlled device; and in response to completion of the pairing connection with the controlled equipment and determining that a control instruction for operating the controlled equipment is monitored, sending the control instruction to the controlled equipment to control the controlled equipment. According to the invention, the practicability of the wearable device is improved, the user operation is facilitated, the use is free and convenient, and the user experience is effectively improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of wearable products, and particularly to an operation control method for a device, an operation control device for a device, and a storage medium. Background Art

[0002] At present, electronic devices such as computers have become one of the preferred devices for people's life, study and entertainment. As one of the main input devices, the mouse plays an important role in the operation of electronic devices. However, in situations such as going out with an electronic device, mouse damage, mouse loss, or limited mouse usage environment, it may be impossible or inconvenient to use the mouse, which brings inconvenience to the operation of the electronic device at work. Summary of the Invention

[0003] To overcome the problems existing in the related art, the present disclosure provides an operation control method for a device, an operation control device for a device, and a storage medium.

[0004] According to the first aspect of the embodiments of the present disclosure, an operation control method for a device is provided, including: in response to the working mode of the wearable device being the first mode, where the first mode is used to control a controlled device based on a mouse control method, pairing and connecting with the controlled device; in response to completing the pairing connection with the controlled device and determining that a control instruction for operating the controlled device is detected, sending the control instruction to the controlled device to control the controlled device.

[0005] In an implementation, the determining that a control instruction for operating the controlled device is detected includes: in response to detecting that a functional component on the wearable device is operated, determining that a control instruction for operating the controlled device is detected.

[0006] In an implementation, different functional components on the wearable device correspond to different control instructions; among them, different control instructions correspond to operation control instructions triggered by different mouse function keys.

[0007] In one implementation, the functional components include a first function button, a second function button, a rotatable component supporting a rotation function, and a touch screen. The determination of detecting a control instruction for operating the controlled device and sending the control instruction to the controlled device includes: in response to detecting a click operation on the first function button, sending a first instruction to the controlled device, where the first instruction is used to control the controlled device to perform an operation associated with the left mouse button function; in response to detecting a click operation on the second function button, sending a second instruction to the controlled device, where the second instruction is used to control the controlled device to perform an operation associated with the right mouse button function; in response to detecting a rotation operation of the rotatable component, sending a third instruction to the controlled device based on the rotation operation, where the third instruction is used to control the controlled device to perform an operation associated with the mouse wheel function; in response to detecting a touch operation on the touch screen, sending a fourth instruction to the controlled device based on the touch operation, where the fourth instruction is used to control the controlled device to perform an operation associated with the mouse cursor function.

[0008] In one implementation, the sending of the third instruction to the controlled device based on the rotation operation includes: in response to the rotation operation being an operation in a first rotation direction, sending a first third instruction to the controlled device, where the first third instruction is used to control the controlled device to perform an operation associated with the left rotation function of the mouse wheel; in response to the rotation operation being an operation in a second rotation direction, sending a second third instruction to the controlled device, where the second third instruction is used to control the controlled device to perform an operation associated with the right rotation function of the mouse wheel.

[0009] In one implementation, the sending of the fourth instruction to the controlled device based on the touch operation includes: determining displacement information of the touch finger based on the touch operation; determining cursor positioning information based on the displacement information, and sending a fourth instruction corresponding to the cursor positioning information to the controlled device.

[0010] According to a second aspect of the embodiments of the present disclosure, there is provided an operation control device for a device, including a processing unit configured to, in response to the working mode of the wearable device being a first mode, which is used to control a controlled device based on a mouse control method, pair and connect with the controlled device; and a control unit configured to, in response to completing the pairing connection with the controlled device and determining that a control instruction for operating the controlled device is detected, send the control instruction to the controlled device to control the controlled device.

[0011] In one implementation, the control unit determines that a control instruction for operating the controlled device is detected in the following manner: in response to detecting that a functional component on the wearable device is operated, it is determined that a control instruction for operating the controlled device is detected.

[0012] In one implementation, different functional components on the wearable device correspond to different control instructions; among them, different control instructions correspond to operation control instructions triggered by different mouse function keys.

[0013] In one implementation, the functional components include a first function button, a second function button, a rotating component supporting a rotation function, and a touch screen; the control unit determines a control instruction for operating the controlled device in the following manner and sends the control instruction to the controlled device: in response to detecting a click operation on the first function button, sending a first instruction to the controlled device, the first instruction being used to control the controlled device to execute an operation associated with the function of the left mouse button; in response to detecting a click operation on the second function button, sending a second instruction to the controlled device, the second instruction being used to control the controlled device to execute an operation associated with the function of the right mouse button; in response to detecting a rotation operation of the rotating component, sending a third instruction to the controlled device based on the rotation operation, the third instruction being used to control the controlled device to execute an operation associated with the function of the mouse scroll wheel; in response to detecting a touch operation on the touch screen, sending a fourth instruction to the controlled device based on the touch operation, the fourth instruction being used to control the controlled device to execute an operation associated with the function of the mouse cursor.

[0014] In one implementation, the control unit sends the third instruction to the controlled device based on the rotation operation in the following manner, including: in response to the rotation operation being an operation in a first rotation direction, sending a first third instruction to the controlled device, the first third instruction being used to control the controlled device to execute an operation associated with the left rotation function of the mouse scroll wheel; in response to the rotation operation being an operation in a second rotation direction, sending a second third instruction to the controlled device, the second third instruction being used to control the controlled device to execute an operation associated with the right rotation function of the mouse scroll wheel.

[0015] In one implementation, the control unit sends the fourth instruction to the controlled device based on the touch operation in the following manner, including: determining displacement information of the touch finger based on the touch operation; determining cursor positioning information based on the displacement information, and sending a fourth instruction corresponding to the cursor positioning information to the controlled device.

[0016] According to a third aspect of the embodiments of the present disclosure, an operation control device for a device is provided, including: a processor; a memory for storing processor-executable instructions; wherein, the processor is configured to: execute the operation control method of the device described in the first aspect or any one of the implementations of the first aspect.

[0017] According to a fourth aspect of the embodiments of the present disclosure, a storage medium is provided. Instructions are stored in the storage medium. When the instructions in the storage medium are executed by a processor, the processor is enabled to execute the operation control method of the device described in the first aspect or any one of the embodiments of the first aspect.

[0018] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects: In response to the working mode of the wearable device being the first mode, where the first mode is used to control a controlled device based on a mouse control method, pair and connect with the controlled device; based on the completion of the pairing connection between the wearable device and the controlled device, the wearable device sends a control instruction to the controlled device to complete the control of the controlled device. Through the present disclosure, the practicability of the wearable device is increased, which is convenient for users to operate, free and convenient to use, and effectively improves the user experience.

[0019] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. Brief Description of the Drawings

[0020] The drawings here are incorporated into the specification and constitute a part of this specification, showing the embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure.

[0021] Figure 1 It is a flowchart of an operation control method of a device shown according to an exemplary embodiment.

[0022] Figure 2 It is a schematic diagram of an application scenario of an operation control method of a device shown according to an exemplary embodiment.

[0023] Figure 3 It is a flowchart of the correspondence relationship between a functional component and an operation instruction shown according to an exemplary embodiment.

[0024] Figure 4 It is a schematic diagram of a first function key interaction scenario shown according to an exemplary embodiment.

[0025] Figure 5 It is a schematic diagram of a second function key interaction scenario shown according to an exemplary embodiment.

[0026] Figure 6 It is a schematic diagram of a rotating component interaction scenario shown according to an exemplary embodiment.

[0027] Figure 7 It is a schematic diagram of a touch screen interaction scenario shown according to an exemplary embodiment.

[0028] Figure 8 It is a flowchart of a method for executing a third instruction shown according to an exemplary embodiment.

[0029] Figure 9 is a flowchart of an operation control method of a device shown according to an exemplary embodiment.

[0030] Figure 10 is a flowchart of an operation control method of a device shown according to an exemplary embodiment.

[0031] Figure 11 is a block diagram of an operation control device of a device shown according to an exemplary embodiment.

[0032] Figure 12 is a block diagram of a device for operation control of a device shown according to an exemplary embodiment. Detailed implementation manners

[0033] Here, the exemplary embodiments will be described in detail, and examples thereof are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure.

[0034] Currently, electronic devices have become one of the first-choice devices for people's life, study, and entertainment. As one of the main input devices, the mouse plays an important role in the operation of electronic devices. However, in situations such as going out with electronic devices, mouse damage, mouse loss, or limited mouse usage environment, it may be impossible or inconvenient to use the mouse, which brings inconvenience to the operation of electronic devices at work. To solve the problem of inconvenient operation of electronic devices in the case of no mouse or inconvenient mouse usage, the mouse function can be realized through a handheld device to assist the operation of electronic devices. In the prior art, to realize the mouse function through a handheld device, the handheld device is mainly connected to the electronic device based on an interconnection logic, a specific operation interface is displayed on the screen of the handheld device, and the electronic device is controlled to realize the corresponding mouse function by operating the operation buttons in the operation interface. However, the above method has the problem of poor operation experience.

[0035] Currently, intelligent wearable devices are in a stage of rapid development, and the practical and playable functions of intelligent wearable devices are gradually increasing. However, in the prior art, there are no related products that develop intelligent mouse functions based on intelligent wearable devices.

[0036] In view of this, to solve more practical scenarios for users, the present disclosure proposes an operation control method for a device.

[0037] The operation control method for a device provided by the embodiments of the present disclosure enables the wearable device to be in the first mode, so as to realize controlling the controlled device through the wearable device.

[0038] Figure 1 is a flowchart of an operation control method of a device shown according to an exemplary embodiment. As Figure 1 shown, the method includes steps S11 to S12.

[0039] In step S11, in response to the working mode of the wearable device being the first mode, where the first mode is used to control a controlled device based on a mouse control method, pair and connect with the controlled device.

[0040] In an embodiment of the present disclosure, the wearable device may be a smart watch with buttons, and the controlled device may be an electronic controlled device such as a desktop computer, a laptop computer, a tablet computer, a television, etc. that can use a mouse. The first mode can be understood as controlling the controlled device based on a mouse control method, that is, the wearable device realizes the control of the controlled device through the first mode with a control method corresponding to the mouse, realizes the user's needs, and pairs and connects with the controlled device.

[0041] In an embodiment of the present disclosure, based on the user's use of the wearable device, when the user clicks or uses other operation methods on the wearable device to complete the mode switching, and the working mode of the wearable device becomes the first mode, the user can then search for the wearable device with the working mode of the first mode on the controlled device through Bluetooth search at this time. The controlled device and the wearable device are based on the same network to complete the pairing connection, realizing the control of the controlled device by the user based on the wearable device.

[0042] In step S12, in response to the completion of the pairing connection with the controlled device and the determination that a control instruction for operating the controlled device is detected, send the control instruction to the controlled device to control the controlled device.

[0043] In an embodiment of the present disclosure, based on the completion of the pairing connection between the wearable device and the controlled device, when it is determined that the wearable device detects a control instruction for operating the controlled device, the control instruction can be sent to the controlled device to realize the control of the controlled device by the wearable device. Among them, the control instruction detected by the wearable device for operating the controlled device can be that the user operates the wearable device to realize the control instruction for the operation monitored by the wearable device.

[0044] In an embodiment of the present disclosure, based on the working mode of the wearable device being the first mode and the completion of the pairing connection between the wearable device and the controlled device, determine the control instruction for the operation to realize the control of the controlled device by the wearable device, making it free and convenient for the user to control the controlled device and effectively improving the user experience.

[0045] An application scenario schematic diagram of an operation control method of a device is provided in an embodiment of the present disclosure. As Figure 2 shown, Figure 2It is a schematic diagram of an application scenario of an operation control method for a device shown according to an exemplary embodiment. In this application scenario, there are a wearable device and a controlled device. Here, switching to the mouse mode can be understood as that the working mode of the wearable device is the first mode. After the wearable device is in the first mode, the wearable device connects to the controlled device via Bluetooth, and then the subsequent control of the controlled device by the wearable device can be completed.

[0046] In the embodiments of the present disclosure, determining a control instruction for monitoring an operation of a controlled device may include determining a control instruction for detecting an operation on the controlled device in response to detecting that a functional component on the wearable device is operated. Here, detecting that a functional component on the wearable device is operated can be understood as the user operating the functional component on the wearable device. Based on the user operating the functional component on the wearable device, the wearable device monitors a control instruction for operating the controlled device, and realizes the control of the controlled device by the wearable device.

[0047] In the embodiments of the present disclosure, based on the wearable device with the working mode being the first mode to realize the control of the controlled device, the interaction between the wearable device and the controlled device is realized, and the user experience is improved.

[0048] In the embodiments of the present disclosure, different functional components on the wearable device correspond to different control instructions. Among them, different control instructions correspond to operation control instructions triggered by different mouse function keys. For example, the control instruction corresponding to a certain functional component on the wearable device can realize the function of the left mouse button. Clicking on this functional component on the wearable device can trigger the corresponding control instruction and realize the corresponding functions such as selecting content with the left mouse button.

[0049] In the embodiments of the present disclosure, based on the operation of the functional components of the wearable device, the interaction between the wearable device and the controlled device is further completed, and more practical scenarios of users are solved.

[0050] In the embodiments of the present disclosure, different functional components correspond to different control instructions, and different control instructions correspond to operation control instructions triggered by different mouse function keys.

[0051] Figure 3 It is a flowchart of the corresponding relationship between a functional component and an operation instruction shown according to an exemplary embodiment. As Figure 3 shown, the method includes the following.

[0052] In step S21, determine a control instruction for monitoring an operation of a controlled device, and send the control instruction to the controlled device.

[0053] In the embodiments of the present disclosure, determining a control instruction for monitoring an operation on a controlled device includes responding to monitoring that a functional component on a wearable device is operated. Among them, the functional components correspond to different control instructions, and the functional components include a first function button, a second function button, a rotating component supporting a rotating function, and a touch screen.

[0054] In step S22a, in response to monitoring a click operation on the first function button.

[0055] In step S23a, send a first instruction to the controlled device.

[0056] In the embodiments of the present disclosure, when the wearable device monitors a click operation on the first function button, it sends a first instruction to the controlled device. Among them, the first instruction is used to control the controlled device to perform an operation associated with the function of the left mouse button. For example, when the wearable device monitors a click operation on the first function button and sends a first instruction to the controlled device, the controlled device receives the first instruction and performs an operation associated with the function of the left mouse button such as selecting the page content.

[0057] In one example, as Figure 4 shown, Figure 4 FIG. is a schematic diagram of a first function button interaction scenario shown according to an exemplary embodiment. Among them, 101 is a wearable device, 102 is a controlled device, and 103 is a first function button. In response to the wearable device 101 monitoring a click operation on the first function button 103, a first instruction for performing an operation associated with the function of the left mouse button is sent to the controlled device 102. For example, when the user clicks the first function button 103, the controlled device 102 receives the first instruction sent by the first function button 103 and executes the function of the left mouse button to select "ABCD" from the content of "ABCDEFGH" on the page. The selection of the page content is only for illustrative purposes, and the operation function of the left mouse button is not limited in this application.

[0058] In step S22b, in response to monitoring a click operation on the second function button.

[0059] In step S23b, send a second instruction to the controlled device.

[0060] In the embodiments of the present disclosure, when the wearable device monitors a click operation on the second function button, it sends a second instruction to the controlled device. Among them, the second instruction is used to control the controlled device to perform an operation associated with the function of the right mouse button. For example, when the wearable device monitors a click operation on the second function button and sends a second instruction to the controlled device, the controlled device receives the second instruction and displays a list box for operating on the selected page content and other operations associated with the right mouse button.

[0061] In one example, as Figure 5 shown, Figure 5It is a schematic diagram of a second function button interaction scenario shown according to an exemplary embodiment. Among them, 101 is a wearable device, 102 is a controlled device, and 105 is a second function button. In response to the wearable device 101 detecting a click operation on the second function button 105, a second instruction for performing an operation associated with the right mouse button function is sent to the controlled device 102. For example, when the user clicks the second function button 105, the controlled device 102 receives the second instruction sent by the second function button 105 and executes the function of the right mouse button, and displays a list box for operating on the page content, such as cutting, copying, etc. of the page content. Displaying the list box for operating on the page content is only an exemplary illustration, and the present application does not limit the operation function of the right mouse button.

[0062] In step S22c, in response to detecting a rotation operation of the rotating member.

[0063] In step S23c, a third instruction is sent to the controlled device based on the rotation operation.

[0064] In the embodiments of the present disclosure, in response to the wearable device detecting a rotation operation of the rotating member, a third instruction is sent to the controlled device based on the rotation operation. Among them, the third instruction is used to control the controlled device to perform an operation associated with the mouse wheel function. For example, when the wearable device detects a button for the rotation operation, a third instruction is sent to the controlled device, and the controlled device receives the third instruction and can perform operations associated with the mouse wheel function such as page scrolling on the page.

[0065] In one example, as Figure 6 shown, Figure 6 It is a schematic diagram of a rotating member interaction scenario shown according to an exemplary embodiment. Among them, 101 is a wearable device, 102 is a controlled device, 104 is a rotating member, and 107 is a scroll bar of the page of the controlled device. In response to the wearable device 101 detecting a click operation of the rotation operation of the rotating member 104, a third instruction for performing an operation associated with the mouse wheel function is sent to the controlled device 102. For example, when the user rotates the rotating member 104 of the wearable device 101, the controlled device 102 receives the third instruction sent by the rotating member 104 and executes the function of the mouse wheel through the scroll bar 107 to perform an operation of scrolling up or down the page content. Scrolling up or down the page content is only an exemplary illustration, and the present application does not limit the operation function of the mouse wheel.

[0066] In step S22d, in response to detecting a touch operation on the touch screen.

[0067] In step S23d, a fourth instruction is sent to the controlled device based on the touch operation.

[0068] In an embodiment of the present disclosure, in response to a touch operation on a touch screen detected by a wearable device, a fourth instruction is sent to a controlled device based on the touch operation. The fourth instruction is used to control the controlled device to perform an operation associated with a mouse cursor function. For example, when the wearable device detects a touch operation on the touch screen, a fourth instruction is sent to the controlled device, and the controlled device receives the fourth instruction and completes operations associated with the mouse cursor function such as cursor positioning on a page.

[0069] In one example, as Figure 7 shown, Figure 7 FIG. is a schematic diagram of a touch screen interaction scenario shown according to an exemplary embodiment. Among them, 101 is a wearable device, 102 is a controlled device, and 106 is a touch screen. In response to the wearable device 101 detecting a touch operation on the touch screen 106 by the rotating member 104, a fourth instruction for performing an operation associated with the mouse cursor positioning function is sent to the controlled device 102. For example, when the user touches the touch screen 106 of the wearable device 101, the controlled device 102 receives the fourth instruction sent by the touch screen 106, and positions the cursor on the controlled device 102 through the cursor in front of "A" in the page content "ABCDEFGH". Positioning the cursor on the page content is only for exemplary illustration, and the operation function of the mouse cursor function is not limited in this application.

[0070] In one example, when the wearable device is a smart watch, the smart watch has an upper key, a lower key, and a rotating crown on the smart watch. Among them, the upper key of the smart watch can be a first function button or a second function button, and whether the upper key of the smart watch is a first function button or a second function button can be customized by the user based on personal usage habits. Similarly, it can be understood that the lower key of the smart watch can also be a first function button or a second function button, and whether the lower key of the smart watch is a first function button or a second function button can be customized by the user based on personal usage habits. At the same time, the smart watch has a touch screen, and the user can also customize and adjust the touch screen sensitivity based on personal usage habits on the touch screen. The touch screen sensitivity can be understood as the correspondence between the distance that the user's finger slides on the touch screen and the distance that the cursor moves on the display interface of the controlled device.

[0071] In an embodiment of the present disclosure, based on a control instruction for operating a controlled device detected by a wearable device, a control instruction is sent to the controlled device, enabling the wearable device to have a function corresponding to a mouse, realizing the interaction between the wearable device and the controlled device, and at the same time improving the user experience, making it free and convenient to use.

[0072] In an embodiment of the present disclosure, sending a third instruction to a controlled device based on a rotation operation may further include a first third instruction and a second third instruction.

[0073] Figure 8is a flowchart showing a method for executing a third instruction according to an exemplary embodiment. As Figure 8 shown, the method includes the following.

[0074] In step S31, a third instruction is sent to the controlled device based on a rotation operation.

[0075] In an embodiment of the present disclosure, in response to the wearable device detecting a rotation operation of the rotating component, a third instruction is sent to the controlled device based on the rotation operation.

[0076] In step S32a, in response to the rotation operation being an operation in the first rotation direction.

[0077] In step S33a, a first third instruction is sent to the controlled device.

[0078] In an embodiment of the present disclosure, the wearable device sends a first third instruction to the controlled device in response to the rotation operation being an operation in the first rotation direction. Among them, the first third instruction is used to control the controlled device to execute an operation associated with the left rotation function of the mouse wheel. For example, the wearable device sends a first third instruction to the controlled device in response to the rotation operation being an operation in the first rotation direction, and the controlled device receives the first third instruction and executes an operation associated with the left rotation function of the mouse wheel such as scrolling up the page in the page.

[0079] In step S32b, in response to the rotation operation being an operation in the second rotation direction.

[0080] In step S33b, a second third instruction is sent to the controlled device.

[0081] The wearable device sends a second third instruction to the controlled device in response to the rotation operation being an operation in the second rotation direction. Among them, the second third instruction is used to control the controlled device to execute an operation associated with the right rotation function of the mouse wheel. For example, the wearable device sends a second third instruction to the controlled device in response to the rotation operation being an operation in the second rotation direction, and the controlled device receives the second third instruction and executes an operation associated with the right rotation function of the mouse wheel such as scrolling down the page in the page.

[0082] In an embodiment of the present disclosure, the up and down scrolling of the page of the controlled device is completed based on the first third instruction and the second third instruction. The operation is simple and convenient for use, effectively improving the user experience and meeting the scenario requirements of users in different scenarios.

[0083] In an embodiment of the present disclosure, the fourth instruction can be determined based on displacement information.

[0084] Figure 9 is a flowchart showing a method for operating and controlling a device according to an exemplary embodiment. As Figure 9 shown, the method includes steps S41 to S42.

[0085] In step S41, displacement information of the touch finger is determined based on a touch operation.

[0086] In an embodiment of the present disclosure, the wearable device includes a touch screen. After the wearable device is connected to the controlled device, a corresponding mouse cursor is displayed on the screen of the controlled device. Based on this, after the wearable device is connected to the controlled device, the touch screen of the wearable device can be touched by a finger, which affects the charge below the touch screen. Based on the movement of the finger on the touch screen of the wearable device, the capacitance below the touch screen changes, thereby generating displacement information.

[0087] In step S42, based on the displacement information, cursor positioning information is determined, and a fourth instruction corresponding to the cursor positioning information is sent to the controlled device.

[0088] In an embodiment of the present disclosure, based on the displacement information of the wearable device, the moving direction and moving distance of the mouse are judged, so as to determine the cursor positioning information of the controlled device, and a fourth instruction corresponding to the cursor positioning information is sent to the controlled device, realizing that the wearable device controls the controlled device to execute operations associated with the mouse cursor function.

[0089] In an embodiment of the present disclosure, the positioning of the cursor is completed based on the displacement information, thereby realizing that the wearable device controls the controlled device to execute operations associated with the mouse cursor function. Restoring the mouse operation experience, getting rid of the user's dependence on the mouse, and improving the user's satisfaction.

[0090] Figure 10 It is a flowchart of an operation control method of a device shown according to an exemplary embodiment. As Figure 10 shown, the method includes the following.

[0091] In an embodiment of the present disclosure, in response to the working mode of the wearable device being the first mode, the first mode is used to control the controlled device based on a mouse control method and pair with the controlled device; wherein, the user can choose to wear or take off the wearable device, that is, wearing the wearable device or taking off the wearable device can both realize the pairing connection between the wearable device and the controlled device. Based on the completion of the pairing connection between the wearable device and the controlled device and determining that a control instruction for operating the controlled device is detected, the control instruction is sent to the controlled device to control the controlled device. The control instructions include a first instruction, a second instruction, a third instruction, and a fourth instruction. The control instructions are controlled by the user clicking on the function keys on the wearable device, where the function keys include a first function key, a second function key, a rotatable component supporting a rotation function, and a touch screen.

[0092] In one example, as Figure 10As shown, the left mouse button can be the first function button, and the first function button corresponds to the first instruction, which is used to control the controlled device to perform operations associated with the function of the left mouse button. The right mouse button can be the second function button, and the second function button corresponds to the second instruction, which is used to control the controlled device to perform operations associated with the function of the right mouse button. The mouse wheel can be a rotating component that supports the rotation function. The rotating component corresponds to the third instruction, which is used to control the controlled device to perform operations associated with the function of the mouse wheel, and the third instruction also includes the first third instruction and the second third instruction. The first third instruction is used to control the controlled device to perform operations associated with the left rotation function of the mouse wheel, and the second third instruction is used to control the controlled device to perform operations associated with the right rotation function of the mouse wheel. The cursor positioning of the wearable device can be completed by the touch screen. Based on the detected capacitance change of the touch screen, the capacitance change is transmitted to the processor, and the moving direction or position of the mouse is judged to complete the cursor positioning. The touch screen corresponds to the fourth instruction, which is used to control the controlled device to perform operations associated with the function of the mouse cursor.

[0093] In the embodiments of the present disclosure, in scenarios where the user does not carry or forgets to carry a mouse, such as when temporarily working in a coffee shop, when taking a transportation vehicle and needing to work temporarily, or when giving a speech and it is inconvenient to use a traditional mouse, etc., the wearable device can simulate the mouse function to interact with the controlled device. Based on this, the embodiments of the present disclosure achieve unrestricted mouse operations, simpler and user-friendly operations, and improve the user experience.

[0094] Based on the same concept, the embodiments of the present disclosure also provide an operation control device 100 for a device.

[0095] It can be understood that in order to implement the above functions, the operation control device 100 for a device provided in the embodiments of the present disclosure includes the corresponding hardware structure and / or software module for executing each function. Combining the units and algorithm steps of the examples disclosed in the embodiments of the present disclosure, the embodiments of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiments of the present disclosure.

[0096] Figure 11 is a block diagram of an operation control device 100 for a device shown according to an exemplary embodiment. Refer to Figure 11 , the device includes a processing unit 201 and a control unit 202.

[0097] A processing unit 201, configured to pair and connect with a controlled device in response to the operating mode of the wearable device being a first mode, where the first mode is used to control the controlled device based on a mouse control method.

[0098] A control unit 202, configured to send a control instruction to the controlled device to control the controlled device in response to completing the pairing connection with the controlled device and determining that a control instruction for operating the controlled device is detected.

[0099] In one implementation, the control unit 202 determines that a control instruction for operating the controlled device is detected in the following manner: in response to detecting that a functional component on the wearable device is operated, it is determined that a control instruction for operating the controlled device is detected.

[0100] In one implementation, different functional components on the wearable device correspond to different control instructions; among them, different control instructions correspond to operation control instructions triggered by different mouse function keys.

[0101] In one implementation, the functional components include a first function button, a second function button, a rotating component supporting a rotating function, and a touch screen; the control unit 202 determines that a control instruction for operating the controlled device is detected and sends a control instruction to the controlled device in the following manner: in response to detecting a click operation on the first function button, a first instruction is sent to the controlled device, and the first instruction is used to control the controlled device to perform an operation associated with the function of the left mouse button; in response to detecting a click operation on the second function button, a second instruction is sent to the controlled device, and the second instruction is used to control the controlled device to perform an operation associated with the function of the right mouse button; in response to detecting a rotation operation of the rotating component, a third instruction is sent to the controlled device based on the rotation operation, and the third instruction is used to control the controlled device to perform an operation associated with the function of the mouse scroll wheel; in response to detecting a touch operation on the touch screen, a fourth instruction is sent to the controlled device based on the touch operation, and the fourth instruction is used to control the controlled device to perform an operation associated with the function of the mouse cursor.

[0102] In one implementation, the control unit 202 sends the third instruction to the controlled device based on the rotation operation in the following manner: in response to the rotation operation being an operation in the first rotation direction, a first third instruction is sent to the controlled device, and the first third instruction is used to control the controlled device to perform an operation associated with the left rotation function of the mouse scroll wheel; in response to the rotation operation being an operation in the second rotation direction, a second third instruction is sent to the controlled device, and the second third instruction is used to control the controlled device to perform an operation associated with the right rotation function of the mouse scroll wheel.

[0103] In one implementation, the control unit 202 sends a fourth instruction to the controlled device based on the touch operation in the following manner, including: determining the displacement information of the touch finger based on the touch operation; determining the cursor positioning information based on the displacement information, and sending a fourth instruction corresponding to the cursor positioning information to the controlled device.

[0104] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment related to the method, and will not be elaborated here.

[0105] Figure 12 FIG. is a block diagram of a device 200 for operating control of a device according to an exemplary embodiment. The device 200 may be provided as a wearable device. For example, the device 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0106] Referring to Figure 12 , the device 200 may include one or more of the following components: a processing component 302, a memory 304, a power component 306, a multimedia component 308, an audio component 310, an input / output (I / O) interface 312, a sensor component 314, and a communication component 316.

[0107] The processing component 302 generally controls the overall operation of the device 200, such as operations associated with display, telephone call, data communication, camera operation, and recording operation. The processing component 302 may include one or more processors 320 to execute instructions to complete all or part of the steps of the above method. In addition, the processing component 302 may include one or more modules to facilitate the interaction between the processing component 302 and other components. For example, the processing component 302 may include a multimedia module to facilitate the interaction between the multimedia component 308 and the processing component 302.

[0108] The memory 304 is configured to store various types of data to support the operation of the device 200. Examples of these data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 304 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0109] The power component 306 provides power for various components of the device 200. The power component 306 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 200.

[0110] The multimedia component 308 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 308 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

[0111] The audio component 310 is configured to output and / or input audio signals. For example, the audio component 310 includes a microphone (MIC) that is configured to receive external audio signals when the device 200 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 304 or transmitted via the communication component 316. In some embodiments, the audio component 310 further includes a speaker for outputting audio signals.

[0112] The I / O interface 312 provides an interface between the processing component 302 and a peripheral interface module, which can be a keyboard, a click wheel, buttons, etc. These buttons can include, but are not limited to: a home button, a volume button, a power button, and a lock button.

[0113] The sensor assembly 314 includes one or more sensors for providing a status assessment of various aspects of the device 200. For example, the sensor assembly 314 can detect the on / off state of the device 200, the relative positioning of components, such as the display and keypad of the device 200. The sensor assembly 314 can also detect a change in the position of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200, and the temperature change of the device 200. The sensor assembly 314 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 314 can also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 314 can also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0114] The communication component 316 is configured to facilitate communication between the device 200 and other devices in a wired or wireless manner. The device 200 can access a wireless network based on communication standards, such as WiFi, 3G, or 4G, or a combination thereof. In an exemplary embodiment, the communication component 316 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 316 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0115] In an exemplary embodiment, the device 200 can be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above method.

[0116] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as the memory 304 including instructions, is also provided. The above instructions can be executed by the processor 320 of the device 200 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0117] It can be understood that in the present disclosure, "a plurality of" means two or more, and other quantifiers are similar thereto. "And / or" describes the association relationship of associated objects and indicates that three relationships can exist. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after. The singular forms of "a", "the", and "said" are also intended to include the plural forms unless the context clearly indicates otherwise.

[0118] It can be further understood that terms such as "first", "second", etc. are used to describe various information, but this information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other and do not represent a specific order or degree of importance. In fact, expressions such as "first", "second", etc. can be used interchangeably completely. For example, without departing from the scope of the present disclosure, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information.

[0119] It can be further understood that the orientation or positional relationship indicated by terms such as "center", "longitudinal", "transverse", "front", "rear", "upper", "lower", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present embodiment and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation.

[0120] It can be further understood that unless otherwise specified, "connection" includes direct connection without other components between the two, and also includes indirect connection with other elements between the two.

[0121] It can be further understood that although the operations are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood that they are required to be performed in the specific order shown or in a serial order, or that all the operations shown are required to obtain the desired result. In a specific environment, multitasking and parallel processing may be beneficial.

[0122] Those skilled in the art will readily think of other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of this solution, which follow the general principles of the present disclosure and include common general knowledge or conventional technical means in the technical field not disclosed in the present disclosure.

[0123] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. A method for operating and controlling a device, characterized in that, The method includes: In response to the working mode of the wearable device being the first mode, the first mode is used to control the controlled device based on the mouse control method, and pair and connect with the controlled device; In response to completing the pairing connection with the controlled device and determining that a control instruction for operating the controlled device is detected, send the control instruction to the controlled device to control the controlled device.

2. The method according to claim 1, wherein The determining that a control instruction for operating the controlled device is detected includes: In response to detecting that a functional component on the wearable device is operated, determine that a control instruction for operating the controlled device is detected.

3. The method according to claim 2, characterized in that, Different functional components on the wearable device correspond to different control instructions; Among them, different control instructions correspond to operation control instructions triggered by different mouse function keys.

4. The method according to claim 2 or 3, characterized in that, The functional components include a first function button, a second function button, a rotating component supporting a rotating function, and a touch screen; The determining that a control instruction for operating the controlled device is detected and sending the control instruction to the controlled device includes: In response to detecting a click operation on the first function button, send a first instruction to the controlled device, and the first instruction is used to control the controlled device to perform an operation associated with the function of the left mouse button; In response to detecting a click operation on the second function button, send a second instruction to the controlled device, and the second instruction is used to control the controlled device to perform an operation associated with the function of the right mouse button; In response to detecting a rotation operation of the rotating component, send a third instruction to the controlled device based on the rotation operation, and the third instruction is used to control the controlled device to perform an operation associated with the function of the mouse wheel; In response to detecting a touch operation on the touch screen, send a fourth instruction to the controlled device based on the touch operation, and the fourth instruction is used to control the controlled device to perform an operation associated with the function of the mouse cursor.

5. The method according to claim 4, wherein The sending the third instruction to the controlled device based on the rotation operation includes: In response to the rotation operation being an operation in the first rotation direction, send a first third instruction to the controlled device, and the first third instruction is used to control the controlled device to perform an operation associated with the left rotation function of the mouse wheel; In response to the rotation operation being an operation in the second rotation direction, send a second third instruction to the controlled device, and the second third instruction is used to control the controlled device to perform an operation associated with the right rotation function of the mouse wheel.

6. The method according to claim 4, wherein The sending the fourth instruction to the controlled device based on the touch operation includes: Determine the displacement information of the touch finger based on the touch operation; Based on the displacement information, determine the cursor positioning information, and send a fourth instruction corresponding to the cursor positioning information to the controlled device.

7. An operation control device for a device, characterized in that, The device includes: A processing unit, configured to, in response to the working mode of the wearable device being the first mode, the first mode is used to control the controlled device based on the mouse control method, pair and connect with the controlled device; A control unit, which is configured to send the control instruction to the controlled device to control the controlled device in response to the completion of the pairing connection with the controlled device and the determination that a control instruction for operating the controlled device is detected.

8. The device according to claim 7, characterized in that, The control unit determines that a control instruction for operating the controlled device is detected in the following manner: In response to detecting that a functional component on the wearable device is operated, it is determined that a control instruction for operating the controlled device is detected.

9. The device according to claim 8, wherein, Different functional components on the wearable device correspond to different control instructions; Among them, different control instructions correspond to operation control instructions triggered by different mouse function keys.

10. The device according to claim 8 or 9, characterized in that, The functional components include a first function button, a second function button, a rotatable component supporting a rotation function, and a touch screen; The control unit determines that a control instruction for operating the controlled device is detected and sends a control instruction to the controlled device in the following manner: In response to detecting a click operation on the first function button, a first instruction is sent to the controlled device, and the first instruction is used to control the controlled device to perform an operation associated with the function of the left mouse button; In response to detecting a click operation on the second function button, a second instruction is sent to the controlled device, and the second instruction is used to control the controlled device to perform an operation associated with the function of the right mouse button; In response to detecting a rotation operation of the rotatable component, a third instruction is sent to the controlled device based on the rotation operation, and the third instruction is used to control the controlled device to perform an operation associated with the function of the mouse scroll wheel; In response to detecting a touch operation on the touch screen, a fourth instruction is sent to the controlled device based on the touch operation, and the fourth instruction is used to control the controlled device to perform an operation associated with the function of the mouse cursor.

11. The device according to claim 10, characterized in that, The control unit sends the third instruction to the controlled device based on the rotation operation in the following manner, including: In response to the rotation operation being an operation in the first rotation direction, a first third instruction is sent to the controlled device, and the first third instruction is used to control the controlled device to perform an operation associated with the left rotation function of the mouse scroll wheel; In response to the rotation operation being an operation in the second rotation direction, a second third instruction is sent to the controlled device, and the second third instruction is used to control the controlled device to perform an operation associated with the right rotation function of the mouse scroll wheel.

12. The device according to claim 10, characterized in that, The control unit sends the fourth instruction to the controlled device based on the touch operation in the following manner, including: Determining the displacement information of the touch finger based on the touch operation; Based on the displacement information, determining the cursor positioning information and sending a fourth instruction corresponding to the cursor positioning information to the controlled device.

13. An operation control device of a device, characterized in that, Comprising: A processor: A memory for storing instructions executable by the processor; Wherein, the processor is configured to execute the operation control method of the device according to any one of claims 1 to 6.

14. A storage medium, characterized in that, Instructions are stored in the storage medium, and when the instructions in the storage medium are executed by the processor, the processor can execute the operation control method of the device according to any one of claims 1 to 6.

Images