Equipment operation control method and device and storage medium

By setting the working mode of the wearable device to the target working mode, and using the sensing components to detect user operations, generating control instructions corresponding to mouse operations, the problem of not being able to control the terminal device is solved, and the diversified use of the wearable device and the user experience improvement is achieved.

CN120335696APending Publication Date: 2025-07-18BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410078033.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-01-18
Publication Date
2025-07-18

AI Technical Summary

Technical Problem

In the prior art, it is impossible to use wearable devices to control the terminal device, and the use scenarios of wearable devices cannot be expanded.

Method used

By setting the working mode of the wearable device to the target working mode, paired and connected with the target device, and using sensing components such as an acceleration sensor and touch screen to detect the user's vibration and screen sliding operations, control instructions corresponding to the mouse operation are determined, and sent to the target device to achieve control.

Benefits of technology

The use of wearable devices instead of mouse control of terminal devices is realized, expanding the use scenarios of wearable devices and improving user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120335696A_ABST
    Figure CN120335696A_ABST
Patent Text Reader

Abstract

The invention relates to an operation control method and device of equipment and a storage medium. The equipment operation control method comprises the following steps: responding to a working mode of wearable equipment as a target working mode, and the target working mode is used for controlling target equipment based on a mouse control mode and is in pairing connection with the target equipment; in response to completion of pairing connection with the target device, determining an operation control instruction corresponding to mouse operation based on sensing information detected by a sensing part of the wearable device; and sending the operation control instruction to the target equipment to control the target equipment to execute an operation matched with the operation control instruction. The use scene of the wearable device is expanded, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of intelligent devices, and particularly to an operation control method, apparatus, and storage medium for a device. Background Art

[0002] In the related art, with the continuous development of intelligent devices, people's requirements for external input devices are also getting higher and higher.

[0003] However, in the related art, in the method of controlling a terminal device by using an external input device, a mouse is usually used to control the terminal device, and a wearable device cannot be used to control the terminal device, so the usage scenarios of the wearable device cannot be expanded. Summary of the Invention

[0004] To overcome the problems existing in the related art, the present disclosure provides an operation control method for a device.

[0005] According to a first aspect of an embodiment of the present disclosure, there is provided an operation control method for a device, including: in response to the working mode of the wearable device being a target working mode, where the target working mode is used to control a target device based on a mouse control method, pairing and connecting with the target device; in response to completing the pairing connection with the target device, determining an operation control instruction corresponding to a mouse operation based on sensing information detected by a sensing component of the wearable device; and sending the operation control instruction to the target device to control the target device to perform an operation matching the operation control instruction.

[0006] In one implementation, the sensing component includes an acceleration sensor; the determining an operation control instruction corresponding to a mouse operation based on sensing information detected by a sensing component of the wearable device includes: in response to the acceleration sensor of the wearable device detecting a first shock operation, determining an operation control instruction associated with the function of the left mouse button; and / or

[0007] in response to the acceleration sensor of the wearable device detecting a second shock operation, determining an operation control instruction associated with the function of the right mouse button; where the first shock operation and the second shock operation are different.

[0008] In one implementation, the sensing component includes an acceleration sensor; the determining an operation control instruction corresponding to a mouse operation based on sensing information detected by a sensing component of the wearable device includes: in response to the acceleration sensor of the wearable device detecting a displacement change of the wearable device, determining displacement information of the displacement change; based on the displacement information, generating mouse positioning information corresponding to the displacement information, and determining an operation control instruction corresponding to the mouse positioning information.

[0009] In one implementation, the sensing component includes a touch screen; determining an operation control instruction corresponding to a mouse operation based on the sensing information detected by the sensing component of the wearable device includes: in response to the touch screen of the wearable device detecting a screen sliding operation, determining an operation control instruction corresponding to a mouse wheel operation based on the screen sliding operation.

[0010] In one implementation, determining an operation control instruction corresponding to a mouse wheel operation based on the screen sliding operation includes: in response to the screen sliding operation being a first screen direction sliding operation, determining an operation control instruction corresponding to an upward mouse wheel function operation;

[0011] In response to the screen sliding operation being a second screen direction sliding operation, determining an operation control instruction corresponding to a downward mouse wheel function operation.

[0012] In one implementation, the wearable device is a smart watch.

[0013] According to a second aspect of the embodiments of the present disclosure, there is provided an operation control device for a device, including:

[0014] A processing unit, configured to, in response to the working mode of the wearable device being a target working mode, where the target working mode is used to control a target device based on a mouse control method, pair and connect with the target device; a determining unit, configured to, in response to completing the pairing connection with the target device, determine an operation control instruction corresponding to a mouse operation based on the sensing information detected by the sensing component of the wearable device; a sending unit, configured to send the operation control instruction to the target device to control the target device to perform an operation matching the operation control instruction.

[0015] In one implementation, the sensing component includes an acceleration sensor; the determining unit determines an operation control instruction corresponding to a mouse operation based on the sensing information detected by the sensing component of the wearable device in the following manner: in response to the acceleration sensor of the wearable device detecting a first shock operation, determining an operation control instruction related to an operation associated with the left mouse button function; and / or

[0016] In response to the acceleration sensor of the wearable device detecting a second shock operation, determining an operation control instruction related to an operation associated with the right mouse button function; where the first shock operation and the second shock operation are different.

[0017] In one implementation, the sensing component includes an acceleration sensor; the determining unit determines an operation control instruction corresponding to a mouse operation based on the sensing information detected by the sensing component of the wearable device in the following manner: in response to the acceleration sensor of the wearable device detecting a displacement change of the wearable device, determining displacement information of the displacement change; based on the displacement information, generating mouse positioning information corresponding to the displacement information, and determining an operation control instruction corresponding to the mouse positioning information.

[0018] In one implementation, the sensing component includes a touch screen; the determining unit determines an operation control instruction corresponding to a mouse operation based on the sensing information detected by the sensing component of the wearable device in the following manner: in response to the touch screen of the wearable device detecting a screen sliding operation, determining an operation control instruction corresponding to a mouse wheel operation based on the screen sliding operation.

[0019] In one implementation, the determining unit determines an operation control instruction corresponding to a mouse wheel operation based on the screen sliding operation in the following manner: in response to the screen sliding operation being a first screen direction sliding operation, determining an operation control instruction corresponding to an upward mouse wheel function operation; in response to the screen sliding operation being a second screen direction sliding operation, determining an operation control instruction corresponding to a downward mouse wheel function operation.

[0020] In one implementation, the wearable device is a smart watch.

[0021] According to a third aspect of the embodiments of the present disclosure, a terminal device is provided, including: a processor; a memory for storing processor-executable instructions; wherein, the processor is configured to execute the executable instructions to be able to execute the operation control method of the device in the first aspect or any one of the implementations in the first aspect.

[0022] According to a fourth aspect of the embodiments of the present disclosure, a storage medium is provided, in which instructions are stored, and when the instructions in the storage medium are executed by a processor of a terminal, the terminal device is enabled to execute the operation control method of the device in the first aspect or any one of the implementations in the first aspect.

[0023] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects: setting the working mode of the wearable device to a working mode that conforms to the operation of the target device, and establishing a connection between the wearable device and the target device, ensuring that the target device is controlled by controlling the wearable device through control instructions, expanding the usage scenarios of the wearable device, and improving the user experience.

[0024] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and do not limit the present disclosure. Brief Description of the Drawings

[0025] The drawings herein are incorporated into and constitute a part of this specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure.

[0026] Figure 1 is a flowchart of a method for operating and controlling a device shown according to an exemplary embodiment.

[0027] Figure 2 is a flowchart of a method for determining an operation control instruction shown according to an exemplary embodiment.

[0028] Figure 3 is a flowchart of a method for determining an operation control instruction shown according to an exemplary embodiment.

[0029] Figure 4 is a flowchart of a method for determining an operation control instruction corresponding to a mouse wheel operation shown according to an exemplary embodiment.

[0030] Figure 5 is a flowchart of a method for determining an operation control instruction corresponding to a mouse wheel operation shown according to an exemplary embodiment.

[0031] Figure 6 is a schematic diagram of a wearable device switching to a mouse mode shown according to an exemplary embodiment.

[0032] Figure 7 is a schematic diagram of a wearable device switching to a mouse mode shown according to an exemplary embodiment.

[0033] FIG. 8(a) is a schematic diagram of a selected content shown according to an exemplary embodiment.

[0034] FIG. 8(b) is a schematic diagram of moving up the selected content shown according to an exemplary embodiment.

[0035] FIG. 8(c) is a schematic diagram of moving down the selected content shown according to an exemplary embodiment.

[0036] FIG. 9(a) is a schematic diagram of determining the current position of a cursor shown according to an exemplary embodiment.

[0037] FIG. 9(b) is a schematic diagram of determining the left movement of a cursor shown according to an exemplary embodiment.

[0038] FIG. 9(c) is a schematic diagram of determining the right movement of a cursor shown according to an exemplary embodiment.

[0039] Figure 10 It is a schematic diagram showing cursor information according to an exemplary embodiment.

[0040] Figure 11 It is a block diagram of an operation control device of a device according to an exemplary embodiment.

[0041] Figure 12 It is a block diagram of an operation control device for a device according to an exemplary embodiment. Detailed implementation manners

[0042] Here, the exemplary embodiments will be described in detail, and examples thereof are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure.

[0043] The operation control method of the device provided by the embodiments of the present disclosure is applied to the scenario of instruction interaction between devices. The operation control method of the device involved in the embodiments of the present disclosure is mainly applied to the scenario where a wearable device is used as a mouse.

[0044] In the related art, a user directly controls a target device through a mouse. For example, by clicking the left mouse button, the position of the cursor in the target device is determined, by scrolling the mouse wheel, the display interface in the target device is switched, or by moving the mouse, the position of the cursor in the target device is changed. There is no method of using a wearable device to control instead of a mouse to control the target device.

[0045] In view of this, the present disclosure uses a wearable device to control a target device, thereby replacing the control of the target device by a mouse.

[0046] The target device involved in the embodiments of the present disclosure can be understood as a terminal device with a display interface, and the terminal device can position the vertical and horizontal coordinates of the terminal interface through a mouse.

[0047] Figure 1 It is a flowchart of an operation control method of a device according to an exemplary embodiment. As Figure 1 shown, the operation control method of the device is used in a terminal and includes the following steps.

[0048] In step S11, in response to the working mode of the wearable device being the target working mode, the target working mode is used to control the target device based on the mouse control method, and pair and connect with the target device.

[0049] In one implementation, the working mode of the wearable device is adjusted to the target working mode, and on the premise of being adjusted to the target working mode, a pairing connection is established with the target device by using a wireless connection signal, such as Bluetooth.

[0050] Among them, the wearable device can be understood as a portable device that supports software and data interaction or cloud and cloud interaction, such as a smart watch, a smart bracelet, etc. The target working mode can be understood as a mode of working in the working state of a mouse.

[0051] In step S12, in response to the completion of the pairing connection with the target device, an operation control instruction corresponding to the mouse operation is determined based on the sensing information detected by the sensing component of the wearable device.

[0052] In one implementation, after detecting the completion of the pairing connection between the wearable device and the target device, according to the information sensed by the sensing component on the wearable device indicating the completion of the pairing, it is determined that the wearable device can achieve the same operation functions as a mouse.

[0053] Among them, the sensing component of the wearable device can be understood as a component that can recognize vibration and has a gravity sensor and a gyroscope. The sensing information can be understood as the signal that can sense the completion of the connection with the target device, and the information that can sense the manipulation of the wearable device by the user.

[0054] The operation control instruction can be understood as an instruction for controlling the target device. The operation control instructions involved in the embodiments of the present disclosure can be custom-set by the user according to the module for controlling the target device in the wearable device, or, in the case where the wearable device and the target device are connected, the target device custom-sets the operation control instructions involved in the relevant modules according to the wireless transmission mode.

[0055] In step S13, the operation control instruction is sent to the target device to control the target device to execute the operation matching the operation control instruction.

[0056] In one implementation, the wearable device sends a control instruction to the target device, and controls the target device according to the control instruction.

[0057] In one implementation, in the case where the wearable device and the target device are connected, such as by using a wireless connection method, corresponding control instructions are matched through the information sensed by the sensing component on the wearable device, so as to control the target device, expand the usage scenarios of the wearable device, enhance the diversity of the wearable device as an external input device of the terminal, and improve the user experience.

[0058] Figure 2 It is a flowchart of a method for determining an operation control instruction shown according to an exemplary embodiment. As Figure 2As shown below, the specific steps are as follows:

[0059] The sensing component involved in the embodiments of the present disclosure includes an acceleration sensor.

[0060] In step S21, based on the sensing information detected by the sensing component of the wearable device, an operation control instruction corresponding to the mouse operation is determined.

[0061] In one implementation, according to the sensing information detected by the sensing component of the wearable device, the control intention of the user for the target device is determined, and an operation control instruction corresponding to the mouse operation of the wearable device is determined. For example, according to the different vibration sensations generated by the user on the wearable device detected by the sensor, different functions of the mouse matched by the wearable device are determined.

[0062] In step S22, in response to the first vibration sensation operation detected by the acceleration sensor of the wearable device, an operation control instruction associated with the function of the left mouse button is determined.

[0063] In one implementation, using the first vibration sensation operation detected by the acceleration sensor in the wearable device, the function of the left mouse button corresponding to the wearable device is determined. For example, when the acceleration sensor in the wearable device detects that the user taps the desktop once, the position of the cursor in the target device is located.

[0064] Among them, the first vibration sensation can be understood as the vibration sensation generated by the user tapping the desktop different times when the wearable device can detect the user's vibration sensation. For example, tapping once.

[0065] In step S23, in response to the second vibration sensation operation detected by the acceleration sensor of the wearable device, an operation control instruction associated with the function of the right mouse button is determined.

[0066] In one implementation, using the second vibration sensation operation detected by the acceleration sensor in the wearable device, the function of the right mouse button corresponding to the wearable device is determined. For example, when the acceleration sensor in the wearable device detects that the user taps the desktop twice, an option page of the current cursor position in the target device is displayed.

[0067] Among them, the first vibration sensation operation is different from the second vibration sensation operation. The second vibration sensation can be understood as the vibration sensation generated by the user tapping the desktop different times when the wearable device can detect the user's vibration sensation. For example, tapping twice.

[0068] In one implementation, different vibration sensations are detected by the acceleration sensor of the wearable device, corresponding to the functions of the left and right buttons of the mouse, reducing the usability of the left and right mouse buttons in the target device and enhancing the user's brand-new experience of the wearable device.

[0069] Figure 3 is a flowchart showing a method for determining an operation control instruction according to an exemplary embodiment. As Figure 3 shown, the specific steps are as follows:

[0070] The sensing component involved in the embodiments of the present disclosure includes an acceleration sensor.

[0071] In step S31, based on the sensing information detected by the sensing component of the wearable device, an operation control instruction corresponding to the mouse operation is determined.

[0072] In one implementation, according to the sensing information detected by the sensing component of the wearable device, the control intention of the user for the target device is determined, and the operation control instruction corresponding to the mouse operation of the wearable device is determined. For example, according to the different displacements of the wearable device detected by the sensor, different functions of the mouse matched by the wearable device are determined.

[0073] In step S32, in response to the acceleration sensor of the wearable device detecting a displacement change of the wearable device, the displacement information of the displacement change is determined.

[0074] In one implementation, the position change information of the wearable device detected by the acceleration sensor in the wearable device is used to determine the position change information of the wearable device. For example, the direction information.

[0075] Among them, the displacement information can be understood as the information of the position change of the wearable device. For example, the position change information of the wearable device moving left or right based on the original position.

[0076] In step S33, based on the displacement information, mouse positioning information corresponding to the displacement information is generated, and an operation control instruction corresponding to the mouse positioning information is determined.

[0077] In one implementation, according to the information detected that the position of the wearable device has changed, mouse positioning information corresponding to the displacement information is generated, and an operation control instruction corresponding to the mouse movement operation is determined.

[0078] Among them, the mouse positioning information can be understood as the movement of the corresponding mouse, such as moving left or right, during the movement of the wearable device from the current position, such as moving left or right.

[0079] In one implementation, according to the movement information of the wearable device, the movement information of the mouse is matched, which is convenient for the user to directly operate according to the position of the cursor in the mobile terminal device of the wearable device.

[0080] Figure 4 is a flowchart showing a method for determining an operation control instruction corresponding to a mouse wheel operation according to an exemplary embodiment. As Figure 4As shown below, the specific steps are as follows:

[0081] The sensing component involved in the embodiments of the present disclosure includes a touch screen.

[0082] In step S41, based on the sensing information detected by the sensing component of the wearable device, an operation control instruction corresponding to the mouse operation is determined.

[0083] In one implementation, according to the sensing information detected by the sensing component of the wearable device, the control intention of the user for the target device is determined, and the operation control instruction corresponding to the mouse operation of the wearable device is determined.

[0084] In step S42, in response to the touch screen of the wearable device detecting a screen sliding operation, based on the screen sliding operation, an operation control instruction corresponding to the mouse wheel operation is determined.

[0085] In one implementation, the touch screen in the wearable device is used to detect a screen sliding operation, and the operation control instruction corresponding to the mouse wheel operation of the wearable device is determined. For example, according to the operation of the user sliding the screen in different directions in the wearable device, the operation instructions corresponding to different directions of the mouse wheel sliding are determined.

[0086] In one implementation, according to the screen sliding operation detected by the touch screen in the wearable device, the operation instructions corresponding to different directions of the mouse wheel are determined, which enhances the interaction between the wearable device and the user and improves the user experience.

[0087] Figure 5 It is a flowchart showing a method for determining an operation control instruction corresponding to a mouse wheel operation according to an exemplary embodiment. As Figure 5 shown below, the specific steps are as follows:

[0088] In step S51, based on the screen sliding operation, an operation control instruction corresponding to the mouse wheel operation is determined.

[0089] In one implementation, according to the operation of the screen sliding in the wearable device, the operation control instruction corresponding to the mouse wheel operation of the wearable device is determined.

[0090] In step S52, in response to the screen sliding operation being a first screen direction sliding operation, an operation control instruction corresponding to the mouse wheel up function operation is determined.

[0091] In one implementation, according to the operation of the user sliding the screen upward in the wearable device, the operation instruction corresponding to the mouse wheel sliding upward is determined.

[0092] In step S53, in response to the screen sliding operation being a second screen direction sliding operation, an operation control instruction corresponding to the mouse wheel down function operation is determined.

[0093] In one embodiment, an operation instruction for downward scrolling of a mouse wheel is determined according to a user's operation of swiping down the screen in a wearable device.

[0094] In one embodiment, according to a screen sliding operation detected by a touch screen in a wearable device, operation instructions for different directions of a mouse wheel are determined, enhancing the interaction between the wearable device and the user and improving the user experience.

[0095] In one embodiment, the wearable device is a smart watch.

[0096] Figure 6 It is a schematic diagram of a wearable device switching to a mouse mode shown according to an exemplary embodiment. As Figure 6 shown.

[0097] In one embodiment, when the wearable device is a smart watch and the target device is a laptop, the smart watch is switched to the mouse mode. Search for Bluetooth devices in the laptop and connect to the watch. Then, by tapping the desktop with a finger, the vibration sensation can be recognized, thus simulating the physical buttons of a mouse. Swiping up / down on the screen simulates the scroll wheel, and the movement of the cursor is controlled by moving the wrist, realizing the function of simulating a mouse on the watch side to interact with the laptop.

[0098] Figure 7 It is a schematic diagram of a wearable device switching to a mouse mode shown according to an exemplary embodiment. As Figure 7 shown.

[0099] In one embodiment, the user turns on the mouse mode on the watch side. The controlled device side, such as the computer side, connects to the watch using the Bluetooth mode. The mouse side detects that the user taps the desktop with a finger once, and uses A+G to recognize the vibration sensation, thus realizing the simulation of the left mouse button; by tapping the desktop with a finger twice, the simulation of the right mouse button is realized. The up and down operations on the touch screen correspond to the up and down scrolling of the mouse wheel. By moving the wrist on the desktop, the position information is transmitted to the processor through A+G. According to the data processing by the processor, the moving direction or position is judged to complete the positioning of the cursor.

[0100] Among them, A+G can be understood as a gravity sensor and a gyroscope.

[0101] In one embodiment, when the user's demand for the target device is to move the selected content in the target device up and down in the mode of a mouse, as shown in Fig. 8(a), according to the current position of the content selected by the cursor, slide the display screen of the wearable device upward with a finger, thereby realizing the upward movement operation of the selected content, that is, as shown in Fig. 8(b), slide the display screen of the wearable device downward with a finger, thereby realizing the downward movement operation of the selected content, that is, as shown in Fig. 8(c).

[0102] In one embodiment, when the user's demand for the target device is to move the cursor position in the target device in the mode of a mouse, as shown in Fig. 9(a), according to the current position of the cursor, move the wrist with the wearable device to the left, thereby realizing the leftward movement operation of the cursor position, that is, as shown in Fig. 9(b), move the wrist with the wearable device to the right, thereby realizing the rightward movement operation of the cursor position, that is, as shown in Fig. 9(c).

[0103] In one embodiment, when the user's demand for the target device is to locate a position in the target device in the mode of a mouse, the position in the target device is located by clicking on the desktop, as Figure 10 shown.

[0104] Based on the same concept, the embodiments of the present disclosure also provide an operation control device for a device.

[0105] It can be understood that, in order to implement the above functions, the operation control device for the device provided by the embodiments of the present disclosure includes the corresponding hardware structures and / or software modules for executing each function. Combining the units and algorithm steps of the various examples disclosed in the embodiments of the present disclosure, the embodiments of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving hardware depends on the specific application and design constraint conditions of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiments of the present disclosure.

[0106] Figure 11 is a block diagram of an operation control device for a device shown according to an exemplary embodiment. Referring to Figure 11 , the device 100 includes a processing unit 101, a determination unit 102, and a sending unit 103.

[0107] The processing unit 101 is configured to, in response to the working mode of the wearable device being the target working mode, where the target working mode is used to control the target device based on a mouse control method, pair and connect with the target device;

[0108] The determination unit 102 is configured to, in response to the completion of the pairing connection with the target device, determine an operation control instruction corresponding to the mouse operation based on the sensing information detected by the sensing component of the wearable device;

[0109] The sending unit 103 is configured to send the operation control instruction to the target device to control the target device to perform an operation matching the operation control instruction.

[0110] In an implementation, the sensing component includes an acceleration sensor; the determination unit 102 determines an operation control instruction corresponding to the mouse operation based on the sensing information detected by the sensing component of the wearable device in the following manner: in response to the acceleration sensor of the wearable device detecting a first shock operation, determining an operation control instruction associated with the function of the left mouse button; and / or

[0111] in response to the acceleration sensor of the wearable device detecting a second shock operation, determining an operation control instruction associated with the function of the right mouse button; wherein, the first shock operation and the second shock operation are different.

[0112] In an implementation, the sensing component includes an acceleration sensor; the determination unit 102 determines an operation control instruction corresponding to the mouse operation based on the sensing information detected by the sensing component of the wearable device in the following manner: in response to the acceleration sensor of the wearable device detecting a displacement change of the wearable device, determining displacement information of the displacement change; based on the displacement information, generating mouse positioning information corresponding to the displacement information, and determining an operation control instruction corresponding to the mouse positioning information.

[0113] In an implementation, the sensing component includes a touch screen; the determination unit 102 determines an operation control instruction corresponding to the mouse operation based on the sensing information detected by the sensing component of the wearable device in the following manner: in response to the touch screen of the wearable device detecting a screen sliding operation, determining an operation control instruction corresponding to the mouse wheel operation based on the screen sliding operation.

[0114] In an implementation, the determination unit 102 determines an operation control instruction corresponding to the mouse wheel operation based on the screen sliding operation in the following manner: in response to the screen sliding operation being a first screen direction sliding operation, determining an operation control instruction corresponding to the function operation of the mouse wheel spinning up; in response to the screen sliding operation being a second screen direction sliding operation, determining an operation control instruction corresponding to the function operation of the mouse wheel spinning down.

[0115] In an implementation, the wearable device is a smart watch.

[0116] Regarding the device in the above embodiments, the specific manners in which each module performs operations have been described in detail in the embodiments related to the method, and will not be elaborated herein.

[0117] Figure 12 It is a block diagram of an operation control device 200 for a device shown according to an exemplary embodiment. For example, the device 200 may be a wearable device, a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0118] Referring to Figure 12 , the device 200 may include one or more of the following components: a processing component 202, a memory 204, a power component 206, a multimedia component 208, an audio component 210, an input / output (I / O) interface 212, a sensor component 214, and a communication component 216.

[0119] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, telephone calls, data communication, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to complete all or part of the steps of the above methods. In addition, the processing component 202 may include one or more modules to facilitate the interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate the interaction between the multimedia component 208 and the processing component 202.

[0120] The memory 204 is configured to store various types of data to support the operation of the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0121] The power component 206 provides power to various components of the device 200. The power component 206 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 200.

[0122] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of the touch or swipe actions but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

[0123] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC) that is configured to receive external audio signals when the device 200 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 204 or transmitted via the communication component 216. In some embodiments, the audio component 210 further includes a speaker for outputting audio signals.

[0124] The I / O interface 212 provides an interface between the processing component 202 and a peripheral interface module, which can be a keyboard, a click wheel, buttons, etc. These buttons can include but are not limited to: a home button, a volume button, a power button, and a lock button.

[0125] The sensor component 214 includes one or more sensors for providing an assessment of the various aspects of the state of the device 200. For example, the sensor component 214 can detect the on / off state of the device 200, the relative positioning of components, such as the display and the keypad of the device 200. The sensor component 214 can also detect a change in the position of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200, and the temperature change of the device 200. The sensor component 214 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 214 can also include a light sensor, such as a CMOS or a CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 214 can further include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0126] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a communication standard-based wireless network, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0127] In an exemplary embodiment, the device 200 can be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above method.

[0128] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, and the above instructions can be executed by a processor 220 of the device 200 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0129] It can be understood that "a plurality of" in the present disclosure means two or more, and other quantifiers are similar thereto. "And / or" describes the association relationship of associated objects and indicates that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after. The singular forms of "a", "an", and "the" are also intended to include the plural forms unless the context clearly indicates otherwise.

[0130] It can be further understood that the terms "first", "second", etc. are used to describe various information, but this information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other and do not represent a specific order or importance. In fact, the expressions such as "first" and "second" can be used interchangeably. For example, without departing from the scope of the present disclosure, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information.

[0131] It can be further understood that the orientation or positional relationship indicated by terms such as "center", "longitudinal", "transverse", "front", "rear", "upper", "lower", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing this embodiment and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation.

[0132] It can be further understood that unless otherwise specified, "connection" includes direct connection without other components between the two, and also includes indirect connection with other elements between the two.

[0133] It can be further understood that although the operations are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood as requiring the operations to be performed in the specific order shown or in a serial order, or requiring all the operations shown to obtain the desired result. In a specific environment, multitasking and parallel processing may be advantageous.

[0134] Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure, which follow the general principles of the present disclosure and include known common general knowledge or conventional technical means in the technical field not disclosed in the present disclosure.

[0135] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. A method for operating and controlling a device, characterized in that, The method includes: In response to the working mode of the wearable device being the target working mode, where the target working mode is used to control a target device based on a mouse control method, pair and connect with the target device; In response to completing the pairing connection with the target device, determine an operation control instruction corresponding to a mouse operation based on the sensing information detected by the sensing component of the wearable device; Send the operation control instruction to the target device to control the target device to perform an operation matching the operation control instruction.

2. The method according to claim 1, wherein The sensing component includes an acceleration sensor; The determining an operation control instruction corresponding to a mouse operation based on the sensing information detected by the sensing component of the wearable device includes: In response to the acceleration sensor of the wearable device detecting a first shock operation, determine an operation control instruction associated with the function of the left mouse button; and / or In response to the acceleration sensor of the wearable device detecting a second shock operation, determine an operation control instruction associated with the function of the right mouse button; Wherein, the first shock operation and the second shock operation are different.

3. The method according to claim 1 or 2, characterized in that, The sensing component includes an acceleration sensor; The determining an operation control instruction corresponding to a mouse operation based on the sensing information detected by the sensing component of the wearable device includes: In response to the acceleration sensor of the wearable device detecting a displacement change of the wearable device, determine the displacement information of the displacement change; Based on the displacement information, generate mouse positioning information corresponding to the displacement information, and determine an operation control instruction corresponding to the mouse positioning information.

4. The method according to claim 1, wherein The sensing component includes a touch screen; The determining an operation control instruction corresponding to a mouse operation based on the sensing information detected by the sensing component of the wearable device includes: In response to the touch screen of the wearable device detecting a screen sliding operation, based on the screen sliding operation, determine an operation control instruction corresponding to a mouse wheel operation.

5. The method according to claim 4, wherein The determining an operation control instruction corresponding to a mouse wheel operation based on the screen sliding operation includes: In response to the screen sliding operation being a first screen direction sliding operation, determine an operation control instruction corresponding to the function of the mouse wheel moving up; In response to the screen sliding operation being a second screen direction sliding operation, determine an operation control instruction corresponding to the function of the mouse wheel moving down.

6. The method according to claim 1, wherein The wearable device is a smart watch.

7. An operation control device for a device, characterized in that, It includes: A processing unit, configured to, in response to the working mode of the wearable device being the target working mode, where the target working mode is used to control a target device based on a mouse control method, pair and connect with the target device; A determining unit, configured to, in response to completing the pairing connection with the target device, determine an operation control instruction corresponding to a mouse operation based on the sensing information detected by the sensing component of the wearable device; A sending unit, configured to send the operation control instruction to the target device to control the target device to perform an operation matching the operation control instruction.

8. The operation control device of the device according to claim 7, characterized in that, The sensing component includes an acceleration sensor; The determining unit determines an operation control instruction corresponding to a mouse operation based on the sensing information detected by the sensing component of the wearable device in the following manner: In response to a first vibration sensing operation detected by the acceleration sensor of the wearable device, determining an operation control instruction associated with the function of the left mouse button; and / or In response to a second vibration sensing operation detected by the acceleration sensor of the wearable device, determining an operation control instruction associated with the function of the right mouse button; wherein, the first vibration sensing operation is different from the second vibration sensing operation.

9. The operation control device of the device according to claim 7 or 8, characterized in that, The sensing component includes an acceleration sensor; The determining unit determines an operation control instruction corresponding to a mouse operation based on the sensing information detected by the sensing component of the wearable device in the following manner: In response to a displacement change of the wearable device detected by the acceleration sensor of the wearable device, determining displacement information of the displacement change; Based on the displacement information, generating mouse positioning information corresponding to the displacement information, and determining an operation control instruction corresponding to the mouse positioning information.

10. The operation control device of the device according to claim 7, characterized in that, The sensing component includes a touch screen; The determining unit determines an operation control instruction corresponding to a mouse operation based on the sensing information detected by the sensing component of the wearable device in the following manner: In response to a screen sliding operation detected by the touch screen of the wearable device, based on the screen sliding operation, determining an operation control instruction corresponding to a mouse wheel operation.

11. The operation control device of the device according to claim 10, characterized in that, The determining unit determines an operation control instruction corresponding to a mouse wheel operation based on the screen sliding operation in the following manner: In response to the screen sliding operation being a first screen direction sliding operation, determining an operation control instruction corresponding to the up function operation of the mouse wheel; In response to the screen sliding operation being a second screen direction sliding operation, determining an operation control instruction corresponding to the down function operation of the mouse wheel.

12. The operation control device of the device according to claim 7, characterized in that, The wearable device is a smart watch.

13. An operation control device of a device, characterized in that, Including: A processor; A memory for storing instructions executable by the processor; wherein, the processor is configured to: execute the method according to any one of claims 1-7.

14. A storage medium, characterized in that, Instructions are stored in the storage medium, and when the instructions in the storage medium are executed by the processor of the terminal, the terminal is enabled to execute the method according to any one of claims 1-7.