Control method, electronic device, smart ring, control system, and storage medium

Abstract

Disclosed are a control method, an electronic device, a smart ring, a control system, and a storage medium. The control method comprises: displaying a first application interface; receiving rubbing data collected by a smart ring, wherein the rubbing data is configured for indicating a rubbing direction of a first finger of a user on a second finger of the user, with the smart ring being worn on the first finger; and on the first application interface, executing a preset operation event on the basis of the rubbing direction.

Description

Control method, electronic device, smart ring, control system and storage medium

[0001] This application claims priority to Chinese patent application No. 202310990029.8 filed on August 7, 2023, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present disclosure relate to the field of communication technologies, and in particular to a control method, electronic equipment, a smart ring, a control system, and a storage medium. Background Art

[0003] With the continuous upgrading of electronic devices, the frequency of using electronic devices in daily life is increasing. For example, users can make calls, watch multimedia videos, etc. through electronic devices.

[0004] Summary of the Invention

[0005] In a first aspect, a control method is provided, which includes: displaying a first application interface; receiving rubbing data collected from a smart ring, the rubbing data being used to indicate a rubbing direction of a first finger of a user wearing the smart ring on a second finger of the user; and executing a preset operation event on the first application interface according to the rubbing direction.

[0006] In a second aspect, a control method is provided, which is applied to a smart ring, wherein the smart ring is worn on a user's first finger. The control method includes: in response to a rubbing operation of the first finger on the user's second finger, collecting rubbing data of the first finger; the rubbing data is used to indicate the rubbing direction of the first finger on the second finger; and sending the rubbing data to an electronic device, wherein the rubbing data is used to control the electronic device to execute a preset operation event corresponding to the rubbing direction on a first application interface.

[0007] In a third aspect, a control system is provided, which includes a smart ring and an electronic device. The smart ring is worn on the user's finger, the smart ring is used to execute the control method of the second aspect, and the electronic device is used to execute the control method of the first aspect.

[0008] In a fourth aspect, an electronic device is provided, which includes a processor and a communication interface, wherein the processor and the communication interface support the electronic device to execute the control method of the first aspect.

[0009] In a fifth aspect, a smart ring is provided, comprising a sensor, a processor, and a communication interface. The sensor is configured to collect friction data generated between the finger wearing the smart ring and other fingers; the processor is configured to send control information to an electronic device via the communication interface, the control information indicating the friction data, which in turn corresponds to an operation instruction.

[0010] In a sixth aspect, a computer-readable storage medium is provided, which stores computer instructions. When the computer program instructions are run on a computer, the computer can execute the control method described in the first or second aspect above.

[0011] In a seventh aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the control method described in the first or second aspect above. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] FIG1A is a schematic diagram of an electronic device according to an embodiment of the present disclosure.

[0013] FIG1B is a schematic diagram of another electronic device according to an embodiment of the present disclosure.

[0014] FIG2 is a schematic structural diagram of a control system according to an embodiment of the present disclosure.

[0015] FIG3 is a schematic structural diagram of another control system according to an embodiment of the present disclosure.

[0016] FIG4 is a flow chart of a control method according to an embodiment of the present disclosure.

[0017] FIG5 is a schematic diagram of a rotation angle of a first finger according to an embodiment of the present disclosure.

[0018] FIG6A is a schematic diagram of a volume control of an electronic device controlled by a smart ring according to an embodiment of the present disclosure.

[0019] FIG6B is a schematic diagram of another volume control of an electronic device controlled by a smart ring according to an embodiment of the present disclosure.

[0020] FIG7A is a schematic diagram of a play progress control of an electronic device controlled by a smart ring according to an embodiment of the present disclosure.

[0021] FIG7B is a schematic diagram of another smart ring controlling a playback progress control of an electronic device according to an embodiment of the present disclosure.

[0022] FIG8A is a schematic diagram of a smart ring controlling image zooming of an electronic device according to an embodiment of the present disclosure.

[0023] FIG8B is a schematic diagram of another smart ring controlling image zooming of an electronic device according to an embodiment of the present disclosure.

[0024] FIG9A is a schematic diagram of a smart ring controlling image rotation of an electronic device according to an embodiment of the present disclosure.

[0025] FIG9B is a schematic diagram of another smart ring controlling image rotation of an electronic device according to an embodiment of the present disclosure.

[0026] FIG10A is a schematic diagram of a smart ring controlling a call mode of an electronic device according to an embodiment of the present disclosure.

[0027] FIG10B is a schematic diagram of another smart ring controlling a call mode of an electronic device according to an embodiment of the present disclosure.

[0028] FIG11 is a schematic structural diagram of a control device according to an embodiment of the present disclosure.

[0029] FIG12 is a schematic structural diagram of another control device according to an embodiment of the present disclosure.

[0030] FIG13 is a schematic structural diagram of another control device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0031] In order to enable those skilled in the art to better understand the technical solutions of the embodiments of the present disclosure, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure.

[0032] In the description of the present disclosure, unless otherwise specified, " / " means "or", for example, A / B can mean A or B. "And / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: only A, only B, and A and B. In addition, "at least one" means one or more, and "plurality" means two or more. The words "first", "second", etc. do not limit the quantity and execution order, and the words "first", "second", etc. do not necessarily mean different. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.

[0033] It should be noted that in this disclosure, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described in this disclosure as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.

[0034] In the embodiments of the present disclosure, "indication" can include direct indications and indirect indications. For example, using the indication information below as an example, the indication information can directly carry information A itself or its index to achieve the purpose of directly indicating information A. Alternatively, the indication information can also carry information B that is associated with information A, thereby achieving the purpose of indirectly indicating information A while indicating information B.

[0035] With the continuous development of electronic technology, electronic devices such as VR (Virtual Reality) / AR (Augmented Reality) devices, smartphones, and tablet computers have become widely used. Typically, users operate electronic devices directly with their fingers. However, if users use their fingers to operate electronic devices for too long, it may cause hand discomfort, reducing the user experience.

[0036] Typically, a user can use a finger to directly perform control operations on an electronic device, for example, controlling the playback of multimedia data on the electronic device.

[0037] For example, taking an electronic device as a terminal device, as shown in FIG1A , a user needs to use a finger to operate on the display screen of the electronic device or press a function button of the electronic device to control the electronic device. For example, if the electronic device is playing multimedia data, to control the volume of the multimedia data, the user can press the volume button of the electronic device or perform a sliding operation on the playback interface.

[0038] However, in some scenarios, it is inconvenient for users to directly use their fingers to control electronic devices, for example, when the user is in an environment with many people. Therefore, how to provide users with convenience in controlling electronic devices has become a technical problem that needs to be solved urgently.

[0039] In some embodiments, electronic devices can be controlled based on the recognition results of the user's eyes and gestures. For example, in an AR / VR environment, the device can determine the target object that needs to be controlled by detecting the focus of the human eye. For another example, the electronic device can capture the user's gestures through a camera, and by recognizing the captured images, determine the user's gestures, and then perform corresponding operations based on the user's gestures. However, the recognition process of this method is slow. In addition, the camera is easily affected by ambient light and the captured image is also related to the elevation angle of the camera. There are also problems such as low recognition rate of image recognition and the need for professional handheld devices (poor versatility).

[0040] In some embodiments, as shown in FIG1B , an electronic device (such as a smartwatch) can detect a user's gestures using a miniature radar device and perform corresponding operations based on the user's gestures. However, this approach is technically challenging, difficult to implement, and prone to errors.

[0041] In view of this, an embodiment of the present disclosure provides a control method in which a smart ring collects data on the rubbing of a finger with other fingers and sends the collected rubbing data to an electronic device. The electronic device can execute control instructions corresponding to the rubbing data on the first application interface. In this way, the electronic device can execute operation instructions based on the rubbing data of the user's finger with other fingers. The user does not need to directly contact the electronic device, which improves the user's experience of using the electronic device.

[0042] For example, Figure 2 shows a schematic diagram of a control system according to an embodiment of the present disclosure. The control system may include a smart ring and an electronic device. The smart ring is worn on a user's finger. The smart ring and the electronic device may be connected wirelessly, for example, via Bluetooth, Wireless Fidelity (WiFi), or the like.

[0043] The electronic device is used to execute corresponding operation instructions based on the rubbing data collected by the smart ring. The electronic device can also be called a terminal, user equipment (UE), a mobile station, a mobile terminal, etc. The electronic device can be a mobile phone, a tablet computer, a projector, a smart TV, a smart cockpit, a computer with wireless transceiver function, a virtual reality terminal device, an augmented reality terminal device, a wireless terminal in industrial control, a wireless terminal in unmanned driving, a wireless terminal in remote surgery, a wireless terminal in transportation safety, a wireless terminal in a smart city, a wireless terminal in a smart home, etc. The embodiments of the present disclosure do not limit the device form adopted by the electronic device.

[0044] The smart ring collects finger rubbing data and sends it to an electronic device. The smart ring can be worn on any finger of the user. The rubbing data collected by the smart ring refers to the data generated when the finger wearing the smart ring rubs other fingers.

[0045] In one implementation, as shown in FIG3 , the smart ring may include multiple sensors and multiple modules. The multiple sensors may be used to collect rubbing data. For example, the multiple sensors may include an accelerometer, a gyroscope, a gravity sensor, a sound pickup, etc. The multiple modules may include a microprocessor, a baseband module, a wireless transceiver module, a power module, etc.

[0046] The accelerometer can be used to detect vibration data when the finger wearing the smart ring is pinched. The gyroscope sensor can be used to detect the rotation angle of the finger wearing the smart ring. The sound pickup can be used to detect sound data when the finger wearing the smart ring is rubbed. The gravity sensor can be used to detect the angle between the finger wearing the smart ring and the horizontal plane.

[0047] It is understandable that since the smart ring is worn on the finger, the sound of rubbing the fingers against other fingers can be directly transmitted to the smart ring through bone conduction, which can reduce interference factors in sound collection.

[0048] It should be noted that because the smart ring provided by the embodiments of the present disclosure can be worn on a finger and takes up little space, users can control electronic devices simply by rubbing their fingers. Because the amplitude of the finger rubbing motion is small, the user can operate the ring from within their pocket, thus providing micro-gesture features that enable normal operation in crowded places such as subways and shopping malls.

[0049] The control method provided by the embodiment of the present disclosure is described below in conjunction with the control system shown in Figure 2. The actions, terms, etc. involved in the embodiments of the present disclosure can refer to each other without limitation.

[0050] FIG4 shows a control method according to an embodiment of the present disclosure. As shown in FIG4 , the control method may include S401 to S404 .

[0051] In S401, the electronic device displays a first application interface.

[0052] The first application interface can be used to display a preset operation event. The first application interface can be the interface of the first application. For example, when the first application is an image application, a multimedia application, or the like, the first application interface can be used to display a target object, play multimedia data, etc. The target object can be an image, a cursor, etc.

[0053] In one example, the electronic device may display a first application interface in response to a click operation. A click operation may refer to a user clicking an application on the main interface of the electronic device. Alternatively, the electronic device may display the first application interface in response to trigger information from a smart ring. The trigger information may be used to instruct the execution of an application. For example, the smart ring may send a trigger information to the electronic device in response to the finger wearing the smart ring continuously pressing another finger, or the duration of pressing another finger exceeding a preset time.

[0054] In another example, the electronic device may, in response to the smart ring establishing a communication connection, run a first application and display a first application interface. For example, the smart ring and the first application may have an association relationship. When the electronic device detects that a communication connection has been established with the smart ring, the electronic device may, based on the association relationship, directly run the first application and then display the first application interface.

[0055] In one application scenario, when the power module of the smart ring is in a charging state, the smart ring can disconnect the communication connection with the electronic device. When the power module of the smart ring switches from a charging state to a discharging state, the smart ring can send a communication connection request to the electronic device. After receiving the communication connection request, the electronic device can establish a communication connection with the smart ring, or establish a communication connection with the smart ring in response to an operation allowing the establishment of a communication connection. After the electronic device establishes a communication connection with the smart ring, it can run a first application and then display a first application interface.

[0056] In S402 , in response to a rubbing operation of a first finger on a second finger of a user, the smart ring collects rubbing data of the first finger.

[0057] The first finger is the finger on which the user wears the smart ring. The second finger is a finger of the user other than the first finger. The rubbing operation of the first finger on the second finger may refer to the rubbing operation of the first finger on the second finger.

[0058] It is understood that rubbing the first finger on the second finger can generate vibration, sound and other rubbing data. At the same time, as the first finger rubs on the second finger, the first finger is also constantly rotating. That is, the angle between the first finger and the direction of gravity is also constantly changing.

[0059] For example, as shown in Figure 5, with the first finger being the user's thumb and the second finger being the index finger on the same hand, as the thumb moves from the middle of the index finger to the fingertip, the thumb's rotation angle increases. Correspondingly, the rotation angle of the first finger captured by the smart ring also increases.

[0060] In one implementation, when a user's first and second fingers pinch together, the smart ring can detect vibration data using an accelerometer. In response to the accelerometer detecting the vibration data, the smart ring can begin detecting the first finger's rubbing motion. When the user's first finger rubs against the second finger, the smart ring can detect the first finger's rotational direction using a gyroscope and detect the sound data from the rubbing motion using a sound pickup.

[0061] In the embodiment of the present disclosure, when the first finger and the second finger are rubbed, due to reasons such as the fingerprint patterns of the first finger and the second finger, the rubbing sounds generated when the first finger is rubbed toward the tip of the second finger and when the first finger is rubbed toward the base of the second finger are different. Therefore, based on the rubbing sound, the rubbing direction of the first finger can be determined.

[0062] In S403, the smart ring sends the collected rubbing data to the electronic device. Correspondingly, the electronic device receives the rubbing data collected from the smart ring.

[0063] The rubbing data can be used to indicate the direction in which the first finger rubs against the second finger. For example, the rubbing data can include the direction in which the first finger rubs against the second finger, or the rubbing data can include data used to determine the direction in which the first finger rubs against the second finger. The rubbing data can refer to the rubbing data collected by the smart ring from the start to the stop of the first finger's movement.

[0064] Furthermore, if the gyroscope sensor cannot detect movement data of the first finger, or the acceleration sensor detects that the first finger has stopped moving, or the sound pickup cannot detect the rubbing sound of the first finger, the smart ring may stop collecting the rubbing data of the first finger and send the collected rubbing data to the electronic device. After receiving the rubbing data from the smart ring, the electronic device may execute S404.

[0065] In S404, the electronic device executes a preset operation event on the first application interface according to the rubbing direction of the first finger.

[0066] The rubbing direction of the first finger includes a first direction and a second direction. The first direction and the second direction are different. For example, the first direction is the direction of the fingertip of the second finger, and the second direction is the direction of the base of the second finger. The preset operation event may include any one or more of executing the function of the function control in the first application interface, scaling the target object, moving the target object, and rotating the target object.

[0067] In one example, when the rubbing data includes data for determining the rubbing direction of the first finger on the second finger, the electronic device can determine the rubbing direction of the first finger on the second finger based on the rubbing data, and execute a preset operation event corresponding to the rubbing direction on the first application interface.

[0068] For example, the rubbing data includes vibration data generated when the first finger rubs on the second finger, which is collected by the acceleration sensor. The electronic device can determine the moving direction of the first finger on the second finger based on the vibration data collected by the acceleration sensor.

[0069] For another example, the rubbing data includes the rotation angle of the first finger when the second finger is rubbed by the first finger, which is collected by the gyroscope sensor. The electronic device can determine the moving direction of the first finger on the second finger based on the change in the rotation angle of the first finger. For example, the electronic device can determine the rotation angle and rotation direction of the first finger based on the data detected by the gyroscope sensor, and when the rotation angle gradually increases, determine that the first finger is rubbing in that direction, that is, obtain the rubbing direction of the first finger on the second finger.

[0070] For another example, the rubbing data includes sound data collected by a sound pickup device when a first finger rubs a second finger. The electronic device can determine the rubbing direction that matches the sound data based on a preset correspondence.

[0071] The preset correspondence may include the direction of rubbing toward the fingertip of the second finger and the corresponding sound data (or sound waveform), as well as the direction of rubbing toward the base of the second finger and the corresponding sound data (or sound waveform). The preset correspondence may be pre-configured by the electronic device or pre-established by the electronic device. That is, the electronic device may collect the rubbing data of the first finger rubbing on the second finger in various directions through the smart ring to construct the preset correspondence. For example, the description of the subsequent embodiments may be referred to and will not be repeated here.

[0072] Based on the preset correspondence, the electronic device can convert the collected sound data into a corresponding sound waveform and match the sound waveform with the sound waveform in the preset correspondence, and use the rubbing direction corresponding to the sound waveform with a similarity greater than a threshold as the rubbing direction of the first finger.

[0073] In another example, when the rubbing data includes the rubbing direction of the first finger on the second finger, the electronic device can execute a preset operation event corresponding to the rubbing direction on the first application interface.

[0074] In an embodiment of the present disclosure, after determining the rubbing direction of the first finger on the second finger, the electronic device can determine the corresponding control instruction according to the rubbing direction, and control the first application interface or the object on the first application interface based on the control instruction.

[0075] For example, the electronic device may be pre-configured with configuration information (also referred to as a correspondence), and the configuration information includes a control instruction corresponding to the rubbing direction. After determining the rubbing direction of the first finger, the electronic device may determine the control instruction corresponding to the rubbing direction of the first finger based on the configuration information, and control the first application interface or an object in the first application interface based on the control instruction.

[0076] In one example, the electronic device is pre-configured with configuration information corresponding to different applications. Thus, when the electronic device is running an application, it can determine the control instruction corresponding to the rubbing direction of the first finger based on the configuration information corresponding to the application, and use the control instruction to control objects in the application interface of the application.

[0077] In the disclosed embodiment, the first application interface may include any one of a multimedia data application (e.g., a video application) interface, an image application interface, an application display interface, etc. The following describes the preset operation events in conjunction with each of these multiple application interfaces (e.g., a multimedia data application interface, an image application interface, an application display interface, and a call application interface).

[0078] 1. Multimedia Data Application Interface

[0079] The control events corresponding to the multimedia data application interface may include control events for controlling the playback progress, volume, etc. of the multimedia data.

[0080] In one implementation, a multimedia data application interface is playing multimedia data. In response to a first finger press, the electronic device may display a function control on the multimedia data application interface. The function control may be a volume control or a playback progress control. In response to a rubbing operation of the first finger on a second finger, the electronic device may increase or decrease the progress of the function control based on the rubbing direction of the first finger on the second finger, thereby controlling the playback of the multimedia data.

[0081] In one example, to accurately control the playback of multimedia data, the first finger can control the volume control and playback progress control of the multimedia data in different rubbing directions. For example, taking the thumb as the first finger, when the thumb is rubbed on the index finger, the electronic device can control the volume control of the multimedia data based on the rubbing direction; when the thumb is rubbed on the middle finger, the electronic device can control the playback progress control of the multimedia data based on the rubbing direction.

[0082] It is understandable that when the thumb is rubbed on different fingers, the rotation angle of the thumb is different due to the different positions of different fingers. For example, when the thumb is rubbed on the index finger, the angle between the central axis of the smart ring and the horizontal plane is greater than the angle when the thumb is rubbed on the middle finger. In this way, the smart ring can collect the angle between the central axis of the smart ring and the horizontal plane through the gravity sensor, and send the angle between the central axis and the horizontal plane to the electronic device. The electronic device can determine which finger the thumb is rubbing based on the angle between the central axis of the smart ring and the horizontal plane. For example, the electronic device can be pre-configured with the corresponding rotation angle range when the thumb contacts each finger. Based on this rotation angle range, the electronic device can determine the finger that the thumb contacts.

[0083] In one scenario, combined with the above example, taking the first direction as the fingertip direction and the second direction as the finger base direction as an example, as shown in Figure 6A, in response to the thumb wearing the smart ring touching / pinching the index finger, the electronic device can display the volume control on the multimedia application interface.

[0084] As shown in Figure 6B, in response to the thumb rubbing on the index finger toward the fingertip, the electronic device can increase the progress of the volume control. In response to the thumb rubbing on the index finger toward the finger base, the electronic device can decrease the progress of the volume control.

[0085] In another scenario, combined with the above example, as shown in FIG7A , in response to the thumb of the person wearing the smart ring touching / pinching the middle finger, the electronic device can control the playback progress control on the multimedia application interface.

[0086] As shown in FIG7B , in response to the thumb rubbing the middle finger toward the fingertip, the electronic device can increase the progress of the play progress control (i.e., perform a fast-forward operation). In response to the thumb rubbing the middle finger toward the base, the electronic device can decrease the progress of the play progress control (i.e., perform a rewind operation).

[0087] Based on this scenario, users can control the volume and playback progress of multimedia data by rubbing their fingers, which is more convenient and improves the user experience.

[0088] Furthermore, in order to more accurately control multimedia data, the electronic device can control the progress of the function control according to the rubbing distance of the first finger (such as the thumb) on the second finger. The rubbing distance is proportional to the progress of the function control.

[0089] For example, when you rub your thumb toward the tip of your index finger, the greater the rubbing distance, the louder the multimedia data volume; when you rub your thumb toward the base of your index finger, the greater the rubbing distance, the quieter the multimedia data volume. Similarly, the greater the rubbing distance of your thumb toward the tip of your middle finger, the faster the multimedia data playback progress; the greater the rubbing distance of your thumb toward the base of your middle finger, the faster the multimedia data rewind progress.

[0090] It is understood that the distance of the thumb rubbing is detected based on the thumb's pressing / contact point. For example, the electronic device can calculate the rubbing distance based on the duration and acceleration of the thumb rubbing. Alternatively, the electronic device can directly control the progress of multimedia data function controls based on the duration of the thumb rubbing.

[0091] Furthermore, the electronic device can also control the speed of the function control's progress increase or decrease based on the speed of the thumb rubbing. For example, the faster the thumb rubbing speed, the faster the function control increases or decreases. The slower the thumb rubbing speed, the slower the function control increases or decreases.

[0092] It should be noted that in the disclosed embodiments, the fingers corresponding to the volume control and the play progress control can be set as needed. For example, rubbing the thumb on the index finger can control the play progress control, and rubbing the middle finger can control the volume control. Of course, the second finger can also be other fingers of the user, such as the ring finger, pinky finger, etc., without limitation.

[0093] 2. Image Application Interface

[0094] The control events corresponding to the image application interface may include control events such as image scaling and rotation angle.

[0095] In one implementation, an image application interface displays an image. In response to a first finger rubbing on a second finger, the electronic device can enlarge or reduce the image, or rotate the image.

[0096] In one example, to accurately control an image, the first finger can control image zooming and selection in different directions of rubbing. For example, if the first finger is the thumb, rubbing the thumb on the index finger can control image zooming; rubbing the thumb on the middle finger can control image rotation. The method for the electronic device to detect which finger the thumb is rubbing on can be referred to the description of the above embodiment and will not be repeated here.

[0097] In one example, assuming the first direction is the fingertip direction and the second direction is the fingerbase direction, as shown in FIG8A , in response to rubbing the thumb on the index finger toward the fingertip, the electronic device can enlarge the image. In response to rubbing the thumb on the index finger toward the fingerbase, the electronic device can reduce the image, as shown in FIG8B . The image enlargement / reduction ratio is proportional to the distance / duration of the thumb rubbing.

[0098] In another example, as shown in FIG9A , in response to a thumb rubbing on a middle finger toward the fingertip, the electronic device may rotate in a first direction. As shown in FIG9B , in response to a thumb rubbing on a middle finger toward the base, the electronic device may rotate in a second direction. The first and second directions are different. The image rotation angle is proportional to the distance / duration of the thumb rubbing.

[0099] Based on this scenario, the user can control the scaling and rotation of the image in the image application interface by rubbing their fingers, which is simple and convenient and improves the user experience.

[0100] 3. Application Display Interface

[0101] The application display interface may also be referred to as the main interface. A target object may be set on the application display interface. The electronic device may control the application display interface or the target object on the application display interface based on the rubbing direction of the first finger.

[0102] In one implementation, in response to rubbing the first finger on different fingers, the electronic device can control the application display interface or the target object on the application display interface respectively.

[0103] In one example, taking the thumb as the first finger, the electronic device can control the application display interface in response to the rubbing direction of the thumb on the index finger.

[0104] For example, the electronic device can control the brightness of the application display interface. For example, in response to rubbing the thumb toward the tip of the index finger, the brightness of the application display interface increases; in response to rubbing the thumb toward the base of the index finger, the brightness of the application display interface decreases.

[0105] For another example, the electronic device can control the zoom ratio or resolution of the application display interface. For example, in response to rubbing the thumb toward the tip of the index finger, the display ratio or resolution of the application display interface increases; in response to rubbing the thumb toward the base of the index finger, the display ratio or resolution of the application display interface decreases.

[0106] In another example, taking the thumb as the first finger, the electronic device can control the target object in the application display interface in response to the rubbing direction of the thumb on the middle finger.

[0107] For example, taking the target object as a cursor, in response to the movement of the thumb on the middle finger, the cursor can move in the application display interface. The direction of movement of the cursor is the same as the direction of the thumb rubbing.

[0108] Furthermore, if the application display interface also includes multiple application icons, the electronic device can control the cursor to move across the multiple application icons in response to the movement of the thumb to select a target application from the multiple application icons. In response to the thumb pressing operation, the electronic device can run the selected target application and then display the application interface of the target application. Subsequently, the electronic device can control the application interface of the target application based on the direction of the thumb rubbing.

[0109] In another example, when a cursor is displayed on an application display interface and the application display interface includes multiple objects (such as characters), in response to a thumb press operation, the electronic device can use the position of the cursor as the starting position, and in response to a thumb rubbing operation on the index finger, the electronic device can use the moving area of ​​the cursor as the selected object. In response to the thumb pressing operation again, the electronic device can display a check menu (such as copy, paste, delete, etc.). In response to the thumb rubbing operation, the electronic device can select a corresponding control operation from the check menu according to the rubbing direction and the pressing operation, and perform the control operation on the selected object. For example, a delete operation can be performed on the selected object.

[0110] In another example, the electronic device is a smart bracelet or smart watch. However, due to the limited display space of the smart bracelet or smart watch, fewer applications are displayed on the main interface. The electronic device can switch applications on the main interface in response to rubbing the first finger. For example, in response to rubbing the thumb toward the tip of the index finger, the electronic device can switch the currently displayed application to the application on the left. In response to rubbing the thumb toward the base of the index finger, the electronic device can switch the currently displayed application to the application on the right.

[0111] Furthermore, in response to continuous pressing of the thumb or pinching of the index finger, the smart bracelet or smart watch can run the currently displayed application.

[0112] Based on this scenario, users can control the application interface or objects in the application interface by rubbing their fingers, which is simple and convenient and improves the user experience.

[0113] 4. Call Application Interface

[0114] The control event corresponding to the call application interface may include opening a call mode and closing a call mode. The call application interface may be a mobile phone call interface, or a call interface of an instant messaging application (such as a voice call interface or a video call interface).

[0115] In one implementation, as shown in FIG10A , when an electronic device receives a call request from another device, it may display a call application interface.

[0116] As shown in Figure 10B, in response to a rubbing operation of a first finger on a second finger or a pressing operation of a first finger on a second finger, the electronic device can activate call mode. While the electronic device is in call mode, the electronic device can also control the call volume in response to the rubbing operation of the first finger on the second finger. For example, the above description of controlling the volume control of multimedia data can be referred to and will not be repeated here.

[0117] After the electronic device turns on the call mode, in response to the operation of continuously pressing the second finger with the first finger, the electronic device can end the call mode.

[0118] Based on this scenario, users can answer or hang up calls by rubbing or pressing their fingers, which is simple and convenient and improves the user experience.

[0119] In some embodiments, to collect rubbing data when a first finger is rubbed in different directions on a second finger, the electronic device may output a prompt message in response to establishing an initial connection with the smart ring. This prompt message indicates rubbing the second finger toward the fingertip and base. For example, the prompt message may be displayed in the form of a video or image. In this way, the user can control the rubbing of the first finger on the second finger based on the prompt message.

[0120] In response to the first finger rubbing on the second finger toward the fingertip and base, the smart ring can collect rubbing data and send the collected rubbing data to the electronic device. Based on the rubbing data, the electronic device can establish the above-mentioned preset corresponding relationship.

[0121] Furthermore, to verify the preset correspondence, the electronic device may output a prompt message again, prompting the user to perform a rubbing operation with the first finger. In response to the rubbing operation with the first finger, the electronic device may perform an operation corresponding to the rubbing direction according to the preset correspondence. In response to the user's confirmation operation, the electronic device may store the preset correspondence, or in response to an adjustment operation, the electronic device may again collect rubbing data of the finger in various directions and adjust the preset correspondence.

[0122] Based on this embodiment, after establishing an initial connection with the smart ring, the electronic device can obtain multiple rubbing data based on the user's rubbing operation, and establish a corresponding relationship based on the multiple rubbing data, so as to facilitate the subsequent more accurate identification of the finger's rubbing direction based on the corresponding relationship.

[0123] The various solutions in the above embodiments of the present disclosure can be combined without contradiction.

[0124] It is understandable that, in order to realize the above functions, the control device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art can easily realize that, in combination with the algorithm steps of each example described in the embodiments of the present disclosure, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present disclosure.

[0125] The embodiment of the present disclosure can divide the functional modules of the control device according to the above-mentioned method embodiment. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one functional module. The above-mentioned integrated module can be implemented in the form of hardware or software. It should be noted that the division of modules in the embodiment of the present disclosure is schematic and is only a logical function division. There may be other division methods in actual implementation. The following is an example of dividing each functional module corresponding to each function.

[0126] FIG11 is a schematic diagram of a control device according to an embodiment of the present disclosure, which can perform the functions of the electronic device provided by the above method embodiment. As shown in FIG11 , the control device includes: a display unit 1101 , a receiving unit 1102 , and a processing unit 1103 .

[0127] The display unit 1101 is configured to display a first application interface.

[0128] The receiving unit 1102 is used to receive rubbing data collected from the smart ring, where the rubbing data is used to indicate the rubbing direction of the first finger of the user wearing the smart ring on the second finger of the user.

[0129] The processing unit 1103 is configured to execute a preset operation event on the first application interface according to the rubbing direction.

[0130] In one example, the processing unit 1103 is used to, for example, execute any one or more of the functions of the function controls in the first application interface, the scaling of the target object, the moving direction of the target object, and the rotation direction of the target object according to the rubbing direction.

[0131] In one example, the first application interface is a multimedia playback interface, the function control includes a progress bar, the progress bar includes a volume progress bar or a playback progress bar, and the processing unit 1103 is used, for example, to: display the progress bar in the multimedia playback interface; increase the progress value of the progress bar when the rubbing direction is the first direction; and reduce the progress value of the progress bar when the rubbing direction is the second direction.

[0132] In one example, the processing unit 1103 is used to: when the rubbing direction is a first direction, enlarge the first application interface or enlarge the target object in the first application interface according to the first direction; when the rubbing direction is a second direction, shrink the first application interface or shrink the target object in the first application interface according to the second direction.

[0133] In one example, the magnification ratio and reduction ratio of the first application interface and the target object in the first application interface are proportional to the rubbing distance and / or rubbing duration of the first finger on the second finger.

[0134] In one example, the first application interface is an image display interface, the target object is an image, and the processing unit 1103 is used, for example, to: rotate the image toward the first direction on the image display interface when the rubbing direction is the first direction; and rotate the image toward the second direction on the image display interface when the rubbing direction is the second direction.

[0135] In one example, the rotation angle of the image on the image display interface is proportional to the rubbing distance and / or rubbing duration of the first finger on the second finger.

[0136] In one example, the target object is a cursor, and the processing unit 1103 is used, for example, to control the movement direction of the cursor based on the rubbing direction on the first application interface, and the movement direction of the cursor on the first application interface is the same as the rubbing direction of the finger.

[0137] In one example, the processing unit 1103 is used to, for example: increase the brightness of the first application interface when the rubbing direction is a first direction; and reduce the brightness of the first application interface when the rubbing direction is a second direction.

[0138] In one example, the brightness of the first application interface is proportional to the distance and / or duration of rubbing the first finger on the second finger.

[0139] In one example, the first direction is a direction pointing to the tip of the second finger, and the second direction is a direction pointing to the base of the second finger.

[0140] In one example, the rubbing data includes at least one of the following: vibration data generated when the first finger is rubbed on the second finger; sound data generated when the first finger is rubbed on the second finger; or the rotation angle of the first finger when the first finger is rubbed on the second finger.

[0141] In one example, the rubbing data includes sound data generated when the first finger rubs the second finger. As shown in FIG11 , the control device further includes: a determining unit 1104 .

[0142] The determining unit 1104 is configured to determine matching sound data corresponding to the sound data in the preset sound data. The determining unit 1104 is further configured to determine the moving direction corresponding to the matching sound data as the rubbing direction of the first finger on the second finger.

[0143] In one example, the determination unit 1104 is, for example, used to: determine the rubbing direction corresponding to the rubbing data according to a preset corresponding relationship; the preset corresponding relationship includes a plurality of corresponding relationships between rubbing data and rubbing directions.

[0144] In one example, as shown in FIG11 , the control device further includes: an output unit 1105 and an establishment unit 1106. The output unit 1105 is configured to output verification information, where the verification information is used to indicate rubbing in the first direction and the second direction. The receiving unit 1102 is further configured to receive rubbing data of the first finger when rubbing in the first direction and the rubbing data when rubbing in the second direction collected from the smart ring. The establishment unit 1106 is configured to establish a preset corresponding relationship based on the rubbing data of the first finger when rubbing in the first direction and the rubbing data when rubbing in the second direction.

[0145] FIG12 is a schematic diagram of the structure of another control device according to an embodiment of the present disclosure, which can perform the functions of the smart ring provided by the above method embodiment. As shown in FIG12 , the device includes: a collection unit 1201 and a sending unit 1202.

[0146] The collecting unit 1201 is used to collect rubbing data of the first finger in response to a rubbing operation of the user's first finger on the user's second finger; the rubbing data is used to indicate a rubbing direction of the first finger on the second finger.

[0147] The sending unit 1202 is used to send rubbing data to the electronic device, where the rubbing data is used to control the electronic device to execute a preset operation event corresponding to the rubbing direction on the first application interface.

[0148] In one example, the rubbing data includes at least one of the following: vibration data generated when the first finger is rubbed on the second finger; sound data generated when the first finger is rubbed on the second finger; or the rotation angle of the first finger when the first finger is rubbed on the second finger.

[0149] In one example, as shown in FIG12 , the control device further includes a receiving unit 1203. The receiving unit 1203 is configured to receive verification information indicating rubbing in a preset rubbing direction. The sending unit 1202 is further configured to transmit collected rubbing data to the electronic device in response to the user's rubbing operation of the first finger on the second finger. The rubbing data is used to establish a preset correspondence, wherein the preset correspondence includes a correspondence between multiple rubbing data and a preset rubbing direction.

[0150] In one example, the sending unit 1202 is further configured to send instruction information to the electronic device in response to a pinch operation of the first finger and the second finger, where the instruction information is used to instruct the smart ring to control the electronic device.

[0151] In the case of implementing the functions of the above-mentioned integrated modules in hardware, the embodiments of the present disclosure provide an alternative structure of the control device involved in the above-mentioned embodiments. As shown in Figure 13, the control device 130 includes: a processor 1302 and a bus 1304. In some embodiments, the control device may also include a memory 1301. In some embodiments, the control device may also include a communication interface 1303.

[0152] Processor 1302 may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of this disclosure. Processor 1302 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array, or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof, and may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of this disclosure. Processor 1302 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0153] The communication interface 1303 is used to connect to other devices via a communication network, such as Ethernet, wireless access network, or wireless local area network (WLAN).

[0154] The memory 1301 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0155] As an implementation, the memory 1301 may exist independently of the processor 1302. The memory 1301 may be connected to the processor 1302 via a bus 1304 to store instructions or program codes. When the processor 1302 calls and executes the instructions or program codes stored in the memory 1301, the control method provided in the embodiment of the present disclosure can be implemented.

[0156] In another implementation, the memory 1301 and the processor 1302 may also be integrated together.

[0157] Bus 1304 can be an Extended Industry Standard Architecture (EISA) bus, etc. Bus 1304 can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, FIG13 shows only one thick line, but this does not mean that there is only one bus or only one type of bus.

[0158] Some embodiments of the present disclosure provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium), which stores computer program instructions. When the computer program instructions are executed on a computer, the computer executes the control method described in any of the above embodiments.

[0159] Exemplarily, the above-mentioned computer-readable storage media may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes), optical disks (e.g., compact disks (CDs), digital versatile disks (DVDs), etc.), smart cards, and flash memory devices (e.g., erasable programmable read-only memories (EPROMs), cards, sticks, or key drives, etc.). The various computer-readable storage media described in the present disclosure may represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.

[0160] An embodiment of the present disclosure provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the control method described in any one of the above embodiments.

[0161] The above is only a specific embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or replacements within the technical scope disclosed in the present disclosure should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.

Claims

1. A control method, comprising: Display the first application interface; Receiving rubbing data collected from a smart ring, the rubbing data being used to indicate a rubbing direction of a first finger of a user wearing the smart ring on a second finger of the user; On the first application interface, a preset operation event is executed according to the rubbing direction.

2. The method according to claim 1, wherein: The step of executing a preset operation event on the first application interface according to the rubbing direction includes: According to the rubbing direction, any one or more of the functions of the function controls in the first application interface, the scaling of the target object, the moving direction of the target object, and the rotation direction of the target object are executed.

3. The method according to claim 2, wherein: The first application interface is a multimedia playback interface, the function control includes a progress bar, the progress bar includes a volume progress bar or a playback progress bar, and the preset operation event is executed on the first application interface according to the rubbing direction, including: In the multimedia playback interface, displaying the progress bar; When the rubbing direction is the first direction, increasing the progress value of the progress bar; When the rubbing direction is the second direction, the progress value of the progress bar is reduced.

4. The method according to claim 2, wherein: The step of executing a preset operation event on the first application interface according to the rubbing direction further includes: When the rubbing direction is a first direction, enlarging the first application interface or a target object in the first application interface according to the first direction; When the rubbing direction is the second direction, the first application interface is reduced or the target object in the first application interface is reduced according to the second direction.

5. The method according to claim 4, wherein: The enlargement ratio and reduction ratio of the first application interface and the target object in the first application interface are proportional to the rubbing distance and / or rubbing duration of the first finger on the second finger.

6. The method according to claim 2, wherein: The first application interface is an image display interface, the target object is an image, and the method of executing a preset operation event on the first application interface according to the rubbing direction further includes: When the rubbing direction is a first direction, rotating the image on the image display interface toward the first direction; When the rubbing direction is a second direction, the image is rotated toward the second direction on the image display interface.

7. The method according to claim 6, wherein: The rotation angle of the image on the image display interface is proportional to the rubbing distance and / or rubbing duration of the first finger on the second finger.

8. The method according to claim 2, wherein: The target object is a cursor, and the step of executing a preset operation event according to the rubbing direction on the first application interface includes: On the first application interface, the moving direction of the cursor is controlled based on the rubbing direction, and the moving direction of the cursor on the first application interface is the same as the rubbing direction.

9. The method according to claim 2, wherein: The step of executing a preset operation event on the first application interface according to the rubbing direction includes: When the rubbing direction is the first direction, increasing the brightness of the first application interface; When the rubbing direction is the second direction, the brightness of the first application interface is reduced.

10. The method according to claim 9, wherein: The brightness of the first application interface is proportional to the rubbing distance and / or rubbing duration of the first finger on the second finger.

11. The method according to any one of claims 3 to 10, wherein: The first direction is a direction pointing to the tip of the second finger, and the second direction is a direction pointing to the base of the second finger.

12. The method according to claim 1 or 2, wherein: The rubbing data includes at least one of the following: vibration data generated when the first finger is rubbed on the second finger; Sound data generated when the first finger is rubbed on the second finger; or A rotation angle of the first finger when the first finger is rubbed on the second finger.

13. The method according to claim 12, wherein: In response to the rubbing data including sound data generated when the first finger is rubbed on the second finger, the method further includes: Determining matching sound data corresponding to the sound data in the preset sound data; The moving direction corresponding to the matching sound data is determined as the rubbing direction of the first finger on the second finger.

14. The method according to claim 1, further comprising: According to a preset corresponding relationship, the rubbing direction corresponding to the rubbing data is determined; the preset corresponding relationship includes a plurality of corresponding relationships between rubbing data and rubbing directions.

15. The method according to claim 14, further comprising: Outputting verification information, wherein the verification information is used to indicate rubbing in a first direction and a second direction; receiving rubbing data collected by the smart ring when the first finger is rubbed toward the first direction and rubbing data when the first finger is rubbed toward the second direction; The preset corresponding relationship is established based on the rubbing data when the first finger is rubbed toward the first direction and the rubbing data when the first finger is rubbed toward the second direction.

16. A control method, wherein: Applied to a smart ring, the smart ring is worn on a first finger of a user, and the method comprises: In response to the rubbing operation of the first finger on the second finger of the user, collecting rubbing data of the first finger; the rubbing data is used to indicate the rubbing direction of the first finger on the second finger; The rubbing data is sent to an electronic device, where the rubbing data is used to control the electronic device to execute a preset operation event corresponding to the rubbing direction on a first application interface.

17. The method according to claim 16, wherein: The rubbing data includes at least one of the following: vibration data generated when the first finger is rubbed on the second finger; Sound data generated when the first finger is rubbed on the second finger; or A rotation angle of the first finger when the first finger is rubbed on the second finger.

18. The method according to claim 16 or 17, further comprising: Receiving verification information, where the verification information is used to indicate rubbing in a preset rubbing direction; In response to the rubbing operation of the user's first finger on the second finger, the collected rubbing data is sent to the electronic device, and the rubbing data is used to establish a preset corresponding relationship, and the preset corresponding relationship includes a corresponding relationship between multiple rubbing data and the preset rubbing direction.

19. The method according to claim 16, further comprising: In response to the pinching operation of the first finger and the second finger, indication information is sent to the electronic device, where the indication information is used to instruct the smart ring to control the electronic device.

20. A control system, wherein: The control system comprises a smart ring and an electronic device, wherein the smart ring is worn on a finger of a user, the smart ring is used to execute the method according to any one of claims 16 to 19, and the electronic device is used to execute the method according to any one of claims 1 to 15.

21. A smart ring, wherein: The smart ring is provided with a sensor, a processor and a communication interface; The sensor is used to collect friction data generated by the finger wearing the smart ring and other fingers; The processor is used to send control information to the electronic device through the communication interface, the control information is used to indicate the friction data, and the friction data corresponds to an operation instruction.

22. The smart ring according to claim 21, wherein: The sensor includes one or more of an acceleration sensor, a gyroscope sensor, a pressure sensor, and a microphone.

23. An electronic device, wherein: The electronic device comprises a processor and a communication interface, wherein the processor and the communication interface support the electronic device to execute the method according to any one of claims 1-15.

24. A computer-readable storage medium, wherein: The computer-readable storage medium stores computer program instructions; wherein, when the computer program instructions are executed on a computer, the computer is enabled to perform the method according to any one of claims 1 to 19.

Images