Control method, electronic device, input device, control system, and storage medium

Abstract

Disclosed are a control method, an electronic device, an input device, a control system, and a storage medium. The control method comprises: an electronic device receives movement information from the input device, wherein the movement information is used for indicating a movement operation on a body part of a user, and the body part comprises a hand or an ear; and the electronic device can recognize the movement operation on the body part of the user on the basis of the movement information, and in response to the movement operation on the body part, executes an application event corresponding to the movement operation.

Description

Control method, electronic device, input device, control system, and storage medium

[0001] This disclosure claims priority to Chinese patent application No. 202310990055.0, filed on August 7, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0002] The embodiments of the present disclosure relate to the field of communication technologies, and in particular, to a control method, electronic equipment, input device, control system, and storage medium. Background Art

[0003] As electronic devices are constantly updated, they are used more and more frequently in daily life. For example, users can use electronic devices to make calls, watch multimedia videos, etc.

[0004] Typically, when a user operates an electronic device, they usually operate the electronic device directly with their fingers.

[0005] Summary of the Invention

[0006] In one aspect, a control method is provided. The control method includes: an electronic device receiving sliding information from an input device, the sliding information indicating a first sliding operation performed on a hand by a user of the electronic device; identifying the first sliding operation on the user's hand based on the sliding information; and executing an application event corresponding to the first sliding operation in response to the first sliding operation on the hand.

[0007] In another aspect, a control method is provided. The control method includes: an electronic device receiving rotation information from an input device, the rotation information indicating that a user of the electronic device has performed a first rotation operation on the user's ear; based on the rotation information, identifying the first rotation operation performed by the user on the user's ear; and executing an application event corresponding to the first rotation operation in response to the first rotation operation performed by the user on the user's ear.

[0008] In another aspect, a control method is provided for an input device. The input device is worn on a first finger of a user. The control method includes: in response to a movement operation on a body part of the user, collecting movement information on the body part of the user, the movement information indicating the movement operation on the body part of the user. The input device transmits the movement information to an electronic device, and the movement information is used to control the electronic device to execute an application event corresponding to the movement operation on the body part.

[0009] In another aspect, a control system is provided, comprising an electronic device and an input device. The input device is worn on any finger of a user, and the electronic device can be used to implement the control method described in the above aspect. The input device can be used to implement the control method described in the above aspect.

[0010] In another aspect, an electronic device is provided, which includes a processor and a communication interface, wherein the processor and the communication interface support the electronic device to execute the control method described in the above aspect.

[0011] In some embodiments, the electronic device may further include a memory for storing computer-executable instructions and data necessary for the electronic device. When the electronic device is running, the processor executes the computer-executable instructions stored in the memory to enable the electronic device to perform any of the control methods described above.

[0012] In another aspect, an input device is provided, comprising a sensor, a processor, and a communication interface. The sensor is configured to collect movement information of a user's body part. The processor is configured to transmit the movement information to an electronic device via the communication interface.

[0013] In some embodiments, the input device may further include a memory for storing computer-executable instructions and data necessary for the device. When the input device is in operation, the processor executes the computer-executable instructions stored in the memory to cause the input device to perform the control method described above.

[0014] On the other hand, a computer-readable storage medium is provided, which may be a readable non-volatile storage medium. The computer-readable storage medium stores computer instructions or programs, which, when run on a computer, enable the computer to execute the control method described in any of the above aspects.

[0015] In yet another aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the control method described in any one of the above aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] FIG1 is a schematic diagram of a method of using an electronic device according to some embodiments of the present disclosure.

[0017] FIG2 is a schematic structural diagram of a control system according to some embodiments of the present disclosure.

[0018] FIG3 is a schematic structural diagram of an input device according to some embodiments of the present disclosure.

[0019] FIG4 is a flow chart of a control method according to some embodiments of the present disclosure.

[0020] FIG5 is a flow chart of another control method according to some embodiments of the present disclosure.

[0021] FIG6 is a schematic diagram of a sliding operation of an input device on a finger according to some embodiments of the present disclosure.

[0022] FIG7 is a schematic diagram of skin textures collected when an input device slides in different directions on a finger according to some embodiments of the present disclosure.

[0023] FIG8 is a schematic diagram of skin textures collected when an input device slides between two fingers according to some embodiments of the present disclosure.

[0024] FIG9 is a schematic diagram of skin textures collected when an input device slides along a preset trajectory on a palm according to some embodiments of the present disclosure.

[0025] FIG10 is a schematic diagram of an electronic device executing a page control event according to some embodiments of the present disclosure.

[0026] FIG11 is a schematic diagram of an electronic device executing a multimedia application control event according to some embodiments of the present disclosure.

[0027] FIG12 is a schematic diagram of an electronic device executing an application control event according to some embodiments of the present disclosure.

[0028] FIG13 is a schematic diagram of an electronic device executing a call control event according to some embodiments of the present disclosure.

[0029] FIG14 is a flow chart of another control method according to some embodiments of the present disclosure.

[0030] FIG15 is a schematic diagram illustrating controlling an electronic device to execute a call control event when an input device is rotated within an ear according to some embodiments of the present disclosure.

[0031] FIG16 is a schematic structural diagram of a control device according to some embodiments of the present disclosure.

[0032] FIG17 is a schematic structural diagram of another control device according to some embodiments of the present disclosure.

[0033] FIG18 is a schematic structural diagram of another control device according to some embodiments of the present disclosure. DETAILED DESCRIPTION

[0034] In order to enable those skilled in the art to better understand the technical solutions of the embodiments of the present disclosure, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure.

[0035] In the description of the present disclosure, unless otherwise specified, " / " means "or", for example, A / B can mean A or B. "And / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: only A, only B, and A and B. In addition, "at least one" means one or more, and "plurality" means two or more. Expressions such as "first" and "second" do not limit the quantity and execution order, and expressions such as "first" and "second" do not necessarily limit them to be different. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or multiple items. For example, at least one of a, b, or c can mean: there is a single item of a, b, or c; or there are two of them, such as a and b, a and c, b and c; or all three exist, such as a, b and c, where a, b, and c can be single or multiple.

[0036] It should be noted that in this disclosure, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described in this disclosure as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.

[0037] In the embodiments of the present disclosure, "indication" can include direct indications and indirect indications. For example, using the indication information below as an example, the indication information can directly carry information A itself or its index to achieve the purpose of directly indicating information A. Alternatively, the indication information can also carry information B that is associated with information A, thereby achieving the purpose of indirectly indicating information A while indicating information B.

[0038] With the continuous development of electronic technology, VR (Virtual Reality) / AR (Augmented Reality) devices, smart phones, tablet computers and other electronic devices have been widely used.

[0039] Typically, a user can use a finger to directly perform control operations on an electronic device, for example, controlling the playback of multimedia data on the electronic device.

[0040] For example, taking an electronic device as a terminal device, as shown in Figure 1, a user needs to use a finger to operate on the display screen of the electronic device or press the function buttons of the electronic device to control the electronic device. For example, if the electronic device is playing multimedia data, to control the volume of the multimedia data, the user can press the volume button of the electronic device or perform a sliding operation on the playback interface.

[0041] However, in some scenarios, it's inconvenient for users to directly control electronic devices with their fingers, such as when they're in a crowded environment, when performing input operations while using VR / AR devices, or when they're far away from the electronic device. Therefore, providing users with more convenient ways to control electronic devices has become a pressing technical issue.

[0042] In some embodiments, a user can control an electronic device using buttons or triggers on a handle or controller. For example, a user can control the movement of a cursor on the display interface of an electronic device (e.g., a VR device) by operating the handle or controller. When the cursor moves to a target object or menu option, the user presses a button or trigger, and the electronic device recognizes the selected target object and executes a preset operation instruction on the target object. The target object can be an application or a function control, etc.

[0043] During the execution of an object's function, for example, when an electronic device displays an application interface corresponding to an application, a user may also use a touchpad, trackball, or remote control on a handle or controller to perform page sliding operations. For example, a user may slide a finger on a touchpad or use a remote control to move up, down, left, or right to trigger the electronic device to perform page switching operations on the application interface. For example, the user may scroll a page, switch menus, or browse page content.

[0044] Furthermore, to return to the display interface, the electronic device may be provided with a back button or may respond to a preset gesture to return to the display interface. For example, the electronic device may respond to the back button being triggered to return to the display interface. For another example, the electronic device may recognize the user's gesture and, if the recognized gesture is a preset gesture (e.g., a finger sliding gesture), return to the previous menu or exit the current interface.

[0045] The above-mentioned methods of using handles, controllers or gesture recognition may have the following problems.

[0046] 1. The movements are complicated.

[0047] The need for more hand movements or hand-eye coordination may cause users to feel tedious and inconvenient during the operation, especially after long-term operation, and users may feel tired.

[0048] 2. Space limitations.

[0049] Since the handles or controllers configured for electronic devices usually require a certain amount of space to move and operate, users need to ensure that the surrounding space is large enough so that users can avoid injuries or inconveniences caused by collisions during use.

[0050] 3. Learning curve.

[0051] Since users need to spend time to adapt and learn new interaction methods, users who are not familiar with electronic devices (such as VR devices) or operations may need time to master and become familiar with operating the machine, which increases the user's startup time and learning curve.

[0052] 4. Physical fatigue.

[0053] Prolonged hand movements and use of handles or controllers may cause fatigue or discomfort in the user's hands. This may cause physical fatigue problems for some applications or games that require long-term use.

[0054] 5. Visual interference.

[0055] When selecting, returning, or sliding pages in a VR device, the user's attention may be focused on the handle, controller, or gestures rather than fully focusing on the content of the virtual environment. This may interfere with the user's immersion and experience to a certain extent.

[0056] In view of this, an embodiment of the present disclosure provides a control method, in which a user can perform movement operations on a part of the user's body by using a finger wearing an input device to collect movement information of the body part. After collecting the movement information on the body part, the input device can send the movement information to the electronic device. After receiving the movement information, the electronic device can execute an application event corresponding to the movement operation on the body part. That is, the user can control the electronic device or objects in the electronic device by moving the finger on the body part without directly contacting the electronic device, which increases the fun while also improving the user's experience of using the electronic device.

[0057] In the disclosed embodiments, body parts may include hands and ears. Movement information on body parts may include sliding information on the hands and rotation information on the ears. The method for controlling an electronic device by sliding an input device on the hand can refer to the embodiment shown in FIG5 below, and the method for controlling an electronic device by rotating an input device on the ear can refer to the embodiment shown in FIG14 below.

[0058] For example, FIG2 shows a schematic diagram of a control system provided by an embodiment of the present disclosure. The control system may include an input device and an electronic device. The input device may be worn on a user's finger. The input device and the electronic device may be connected to each other wirelessly. For example, the connection may be via Bluetooth, Wireless Fidelity (WiFi), or the like.

[0059] The electronic device is used to execute corresponding application events based on the movement information collected by the input device. The electronic device can also be called a terminal, user equipment (UE), a mobile station, a mobile terminal, etc. The electronic device can be a mobile phone, a tablet computer, a projector, a smart TV, a smart cockpit, a computer with wireless transceiver function, a virtual reality terminal device, an augmented reality terminal device, a wireless terminal in industrial control, a wireless terminal in unmanned driving, a wireless terminal in remote surgery, a wireless terminal in transportation safety, a wireless terminal in a smart city, a wireless terminal in a smart home, etc. The embodiments of the present disclosure do not limit the device form adopted by the electronic device.

[0060] The input device is used to collect movement information of a body part and transmit the collected movement information of the body part to an electronic device. The input device can be in the form of a finger cap, so that the input device can be worn on any finger of the user (for example, as shown in FIG2 , the input device can be worn on the user's thumb), facilitating user operation without taking up space.

[0061] In some embodiments, as shown in FIG3 , the input device may be provided with one or more sensors, a processor, and a communication interface (or communication module).

[0062] Sensors can be used to collect characteristic information about the contact area. The sensors can be located on the input device at locations corresponding to the user's fingertips or fingertips. For example, the sensors can include one or more of an ultrasonic sensor, a fingerprint sensor, a pressure sensor, and an accelerometer. Thus, when the finger wearing the input device makes contact with a body part, the input device can collect characteristic information about the contact area through the sensors. For example, characteristic information such as skin texture or ear shape and structure can be collected.

[0063] Furthermore, in order to facilitate the input device to adapt to different fingers, the input device can be provided with an adjustment device, which can be used to adjust the gap between the control device input device and the finger. For example, the adjustment device can be a rubber ring.

[0064] For another example, using a fingerprint sensor as an example, based on an operation involving contact with a body part, the input device can use the fingerprint sensor to collect the skin texture of the contacted body part. It is understood that because different skin textures reflect sound waves with different waveforms, the corresponding skin texture can be determined based on the sound wave waveform. In this way, the input device can collect the skin texture of the contacted part through ultrasound.

[0065] In another example, the characteristic information includes a pressure value applied by a finger joint to the input device, and the sensor may include a pressure sensor. The pressure sensor may be triggered to collect the pressure value of the pressing action on a body part. In other words, the input device may collect the pressure value applied by the body part to the input device.

[0066] In another example, the input device may be further provided with a timer, which may also count the contact duration of the input device on the body part and the order in which the input device contacts the plurality of skin lines when moving on the body part.

[0067] Of course, in the embodiment of the present disclosure, the sensor may further include an acceleration sensor, which may be used to detect the direction of movement of a finger wearing the input device when the finger moves on a body part.

[0068] It should be noted that the input device provided by the embodiments of the present disclosure can be worn on a finger and takes up relatively little space. Users can control electronic devices simply by rubbing their fingers. Because the amplitude of the finger rubbing motion is relatively small, the user can operate the device while their hand is in their pocket, making it convenient to control electronic devices in crowded places (e.g., subways and shopping malls).

[0069] In some embodiments, as shown in FIG2 , the control system provided by the embodiment of the present disclosure may further include a server. The server is communicatively connected to the electronic device. The server may be a host or a cloud server.

[0070] In some scenarios, such as when the electronic device is a VR device, the VR device can store the characteristic information of body parts scanned / collected by the input device on a server. The VR device can then retrieve this characteristic information from the server, which not only reduces the storage space of the VR device but also ensures data security and privacy. Furthermore, the VR device can easily access data regardless of the scenario.

[0071] The control method provided by the embodiment of the present disclosure is described below in conjunction with the control system shown in Figure 2. The actions, terms, etc. involved in the embodiments of the present disclosure can refer to each other without limitation.

[0072] FIG4 is a control method provided by an embodiment of the present disclosure. As shown in FIG4 , the method may include:

[0073] S401: In response to a movement operation on a body part of a user, an input device collects movement information on the body part of the user.

[0074] The movement operation on the user's body part may refer to the movement operation of the finger wearing the input device on the user's body part. For example, the movement operation on the user's body part may include a sliding operation on the user's hand or a rotation operation on the user's ear.

[0075] In one scenario, the movement operation on a part of the user's body refers to a sliding operation of a finger wearing an input device on the user's hand. The movement information (or sliding information, hand feature information) collected by the input device may include: the skin texture of the hand through which the sliding operation passes, the order in which the skin texture of the hand through which the sliding operation passes appears over time, the intervals between multiple sub-parts of the hand through which the sliding operation passes, and the curvature of the sliding path of the sliding operation. Specifically, reference may be made to the relevant description of the embodiment shown in FIG5 below, which will not be repeated here.

[0076] In another scenario, the movement operation on the user's body part refers to the finger wearing the input device rotating on the user's ear. The movement information (or rotation information, ear feature information) collected by the input device may include: the skin texture of the ear through which the rotation operation passes, the shape and structure of the ear canal of the ear through which the rotation operation passes, the order in which the skin texture of the ear through which the rotation operation passes appears over time, and the rotation duration of the ear through which the rotation operation passes. Specifically, please refer to the relevant description of the embodiment shown in Figure 14 below, which will not be repeated here.

[0077] S402: The input device sends the collected movement information to the electronic device. Correspondingly, the electronic device receives the movement information from the input device.

[0078] In one example, when it is detected that the input device is not in contact with a body part of the user, for example, when the input device cannot detect a pressure value according to a pressure sensor, the input device may send the collected movement information to the electronic device.

[0079] S403: The electronic device identifies a movement operation on a body part of the user based on the movement information.

[0080] Identifying a movement operation on a user's body part includes identifying the user's body part and the corresponding movement operation. For example, the electronic device can use movement information to first identify whether a finger wearing the input device is sliding on the user's hand or rotating on the user's ear, and then identify the sliding trajectory or rotation direction.

[0081] In some embodiments, the movement information can be used to indicate the skin texture of the contacted body part. For example, the movement information may include the waveform of the sound wave reflected by the skin texture of the contacted body part. The electronic device may determine the skin texture corresponding to the sound wave waveform and the part of the body where the skin texture is located based on a preset correspondence. The preset correspondence may include skin textures of different body parts. For example, the preset correspondence may include a hand template and an ear template. The hand template may include skin textures of different parts of the hand, and the ear template may include the shape structure of different parts of the ear. The preset correspondence may be pre-configured by the electronic device or established by the electronic device, without limitation.

[0082] After determining the part of the body through which the movement operation passes, the electronic device can determine the corresponding movement operation based on the changes in the skin texture in the movement information. For example, the electronic device can determine the direction of movement of the finger on the body part based on the changes in the curvature of the skin texture and the order of appearance over time. For example, by comparing with the template in the preset comparison relationship, it is recognized that the changes in the curvature of the skin texture included in the movement information and the order of appearance over time are first left and then right, then the electronic device can determine that the finger wearing the input device slides to the right on the body part, otherwise, it slides to the left. For another example, by comparing with the template, it is recognized that the changes in the curvature of the skin texture included in the movement information and the trend of the texture direction show "first up and then down", then the electronic device can determine that the finger wearing the input device slides downward on the body part, otherwise, it slides upward.

[0083] S404: In response to the movement operation on the user's body part, the electronic device executes an application event corresponding to the movement operation.

[0084] Application events may include page control, multimedia control, application control, call control and other events.

[0085] In some embodiments, the electronic device may have corresponding configuration information for different application events. The configuration information may include multiple operating instructions corresponding to the application event. The operating instructions may be used to control the application in the application event or objects on the application interface. In this way, the electronic device obtains the corresponding configuration information based on the currently displayed application interface. Then, based on the movement information, the electronic device may select the operating instruction that matches the movement information from the multiple operating instructions included in the configuration information corresponding to the application event and execute the operating instruction on the application interface.

[0086] Based on the technical solution of Figure 4, in the embodiment of the present disclosure, since the input device is worn on the user's finger, the input device can respond to the movement of the finger wearing the input device on the body part and collect feature information of the body part in contact. The electronic device can respond to the movement of the input device on the body part to execute the corresponding application event. In other words, the user can control the electronic device by moving the finger on the body part. In this way, even if it is inconvenient for the user to directly touch the electronic device, the user can still control the electronic device, thereby improving the user experience when using the electronic device.

[0087] The technical solution of the embodiment of the present disclosure is described below with reference to specific body parts.

[0088] Example 1

[0089] In one embodiment, as shown in FIG5 , the embodiment of the present disclosure provides a control method in a scenario where a finger of a user wearing an input device slides on a hand of a user. The method may include S501 to S504 .

[0090] S501: In response to a first sliding operation performed on a hand of a user, collecting sliding information on the hand.

[0091] Slide information can include hand feature information about the hand that the slide operation passes through. For example, as described in the above embodiment, the slide information can include the skin texture of the hand that the first slide operation passes through, the order in which the skin texture of the hand that the first slide operation passes through appears over time, the spacing between multiple sub-parts of the hand that the first slide operation passes through, the curvature of the sliding path of the first slide operation, etc. These types of slide information are described below.

[0092] 1. The skin texture of the hand passed by the first sliding operation.

[0093] The skin texture of the hand through which the first sliding operation passes can also be described as the skin texture of the contact area between the first sliding operation and the hand, the sliding area of ​​the finger wearing the input device on the hand, etc. The sliding area includes skin texture.

[0094] For example, as shown in Figure 6a, the finger wearing the input device is the thumb, and the thumb slides from point A (the tip of the middle finger) to point B (the base of the middle finger) on the user's middle finger. The skin texture captured by the input device can be shown in Figure 6b. Skin texture can include the direction, spacing, shape, etc. It is understandable that the fingerprints of different fingers on the user's hand are different. Therefore, when the input device slides over different fingers, the skin texture captured is also different.

[0095] 2. The order in which the skin lines of the hand passing through the first sliding operation appear over time.

[0096] The order in which the skin textures of the hand passing through the first sliding operation appear over time can also be described as the order in which the skin textures of the area of ​​contact between the first sliding operation and the hand appear over time, or the sliding trajectory of the finger wearing the input device on the hand. It is understandable that due to the different movement directions of the thumb and middle finger, the order in which the skin textures are collected by the input device is also different. In other words, the order in which the skin textures appear over time in the sliding information is different.

[0097] For example, referring to Figure 6, when the user's thumb slides from point A to point B on the middle finger, the order in which the skin lines appear over time can be shown as a in Figure 7. When the user's thumb slides from point B to point A on the middle finger, the order in which the skin lines appear over time can be shown as b in Figure 7.

[0098] As shown in Figure 7, if the input device slides over the same area on the middle finger, the skin textures collected will be the same. However, because the input device slides in different directions on the middle finger, the order in which the skin textures are collected will be different. Therefore, based on the order of the skin textures, the electronic device can be triggered to execute different operation instructions. For more details, please refer to the description of S504 below.

[0099] 3. The distance between the multiple sub-parts of the hand that are passed through by the first sliding operation.

[0100] The spacing between the multiple sub-parts of the hand through which the first slide passes can also be described as the spacing between the fingers through which the first slide passes, the spacing between two fingers through which the first slide passes, etc. A sub-part can be a knuckle of a finger, and the spacing between sub-parts can be the spacing between knuckles.

[0101] For example, as shown in Figure 8(a), the thumb wearing the input device slides from point A between the index and middle fingers to point B. The spacing of the multiple sub-positions captured by the input device is shown in Figure 8(b). It is understandable that for two adjacent fingers on the user's hand, the spacing between the knuckles varies due to the different widths of the knuckles. For example, the spacing between the fingertips is different from the spacing between the middle finger joints.

[0102] 4. The curvature of the sliding path of the first sliding operation.

[0103] The curvature of the sliding route of the first sliding operation can also be described as the trajectory or shape of the first sliding operation on the hand, the change of the sliding route of the finger wearing the input device on the hand, etc.

[0104] For example, as shown in a in FIG9 , the finger wearing the input device is the index finger, and the index finger slides from point A to point B on the palm of the user's hand. The skin texture collected by the input device can be shown in b in FIG9 . It can be understood that since the skin texture of different parts of the user's hand is different, based on the characteristics of the collected skin texture, multiple sub-parts that the input device contacts during the sliding process on the hand can be obtained, and based on the multiple sub-parts, the trajectory of the input device on the hand can be obtained. That is, the curvature of the sliding route passed by the first sliding operation is obtained. For example, as shown in b in FIG9 , the trajectory passed by the first sliding operation can be Z-shaped.

[0105] S502: The input device sends sliding information collected from the user's hand to the electronic device. Correspondingly, the electronic device receives the sliding information from the input device.

[0106] S502 can refer to the description of S402 above and will not be described in detail here.

[0107] S503: The electronic device recognizes a first sliding operation on the user's hand based on the sliding information.

[0108] Identifying the first sliding operation on the user's hand includes identifying the user's hand and the first sliding operation. The first sliding operation may include an upward sliding operation, a downward sliding operation, a right sliding operation, a left sliding operation, and a sliding operation along a preset trajectory.

[0109] In one example, the electronic device can match the skin texture included in the sliding information with preset skin textures on the hand to determine the position of the skin texture included in the sliding information on the hand. Based on the position of each skin texture included in the sliding information on the hand, the electronic device can obtain the sliding operation (such as the sliding trajectory or shape, etc.) of the finger wearing the input device on the hand.

[0110] For example, the electronic device may determine the similarity between the skin texture included in the sliding information and skin textures at multiple locations on the hand, and select the location with the greatest similarity as the location on the hand of the skin texture included in the sliding information. The similarity may include similarity in shape / curvature of the skin texture, similarity in width / length of the skin texture, etc.

[0111] In another example, after determining the locations on the hand corresponding to the multiple skin lines included in the sliding information, the electronic device can determine the order in which the multiple locations appear over time based on the order in which the multiple skin lines were collected. In this way, based on the order in which the multiple locations appear over time, the direction in which the finger wearing the input device moves from the user's hand to the user can be determined.

[0112] S504: In response to a first sliding operation on the hand, the electronic device executes an application event corresponding to the first sliding operation.

[0113] The application event and execution method can refer to the relevant description in S404 above, which will not be repeated here. The first sliding operation can include any one of an upward sliding operation, a downward sliding operation, a left sliding operation, a right sliding operation, and a sliding operation in a preset shape trajectory performed on the user's hand.

[0114] Based on the technical solution of Figure 5, in the embodiment of the present disclosure, the input device can respond to the sliding operation of the finger wearing the input device on the hand, collect and send the contact hand feature information to the electronic device. The electronic device can execute the corresponding application event in response to the sliding operation of the input device on the hand. That is, the user can control the electronic device by sliding the finger on the hand. Even if it is inconvenient for the user to directly touch the electronic device, the user can still control the electronic device, which improves the user experience when using the electronic device.

[0115] The technical solution of FIG5 is described below in conjunction with some application scenarios.

[0116] Scenario 1: Page control.

[0117] Page control may refer to page turning control or page content (eg, font size) control.

[0118] In one example, as shown in a of FIG10 , the electronic device can run a first application and display a first page of the first application in response to an operation in which a finger wearing an input device contacts or presses a preset part of the hand. The first application can be a text application (e.g., a novel application, a news application, etc.), an instant messaging application, etc. The first page can be a text page, a chat page, etc. The preset part can be a finger or a part of the palm (e.g., the palm of the hand), and different parts can correspond to different applications.

[0119] For example, in conjunction with FIG10 a, as shown in FIG10 b, in response to a swipe down or swipe up operation by a user's finger, the electronic device may execute a page turning event to display the second page of the first application. For example, in the case of a swipe down operation, the second page is the next page of the first page; in the case of an up swipe operation, the second page may be the previous page of the first page.

[0120] For another example, in conjunction with FIG10 a, as shown in FIG10 c, in response to a downward or upward swipe operation of a user's finger, the electronic device may execute a page font control event. For example, in the case of a downward swipe operation, the electronic device may enlarge the content displayed on the first page; in the case of an upward swipe operation, the electronic device may reduce the content displayed on the first page.

[0121] In the embodiments of the present disclosure, to facilitate the execution of different page controls, the electronic device can execute different page controls in response to sliding operations on different fingers. For example, in response to a sliding operation on the index finger, the electronic device can execute a page turning event. For another example, in response to a sliding operation on the middle finger, the electronic device can execute a page font control event.

[0122] Furthermore, to make it easier for the user to control the electronic device, in an embodiment of the present disclosure, in response to a left or right swipe of the user's finger, the electronic device can close the first page. In response to a swipe of the user's finger along a preset trajectory, the electronic device can close the first application.

[0123] Based on this page control scenario, when users use electronic devices to read novels, news, chat records and other text content, they can slide the fingers wearing the input device on their hands to turn pages or browse the text content. Compared with sliding operations directly on the display of the electronic device, since the hands are softer, the friction on the user's fingers is smaller, which can reduce the discomfort caused by long-term friction to the fingers and improve the user experience.

[0124] Scenario 2: Multimedia control.

[0125] Multimedia control may refer to control components of a multimedia application, such as a volume control, a progress control, a brightness control, and a focus control.

[0126] In one example, as shown in a of FIG11 , the electronic device may run the multimedia application and display the playback page of the first multimedia in response to the operation of the finger wearing the input device contacting / pressing the part of the hand corresponding to the multimedia application.

[0127] For example, in conjunction with FIG. 11a, as shown in FIG. 11b, in response to a user's finger sliding up or down on the user's hand, the electronic device can execute a multimedia control event. Specifically, a control is displayed on the first multimedia playback page, and the progress of the control is controlled based on the user's finger sliding. In the case of a right swipe, the progress of the control is increased; in the case of a left swipe, the progress of the control is decreased. The increase or decrease in progress can be proportional to the duration or distance of the slide.

[0128] In the embodiment of the present disclosure, in order to facilitate the control of different controls on the first multimedia playback page, the sliding operation of the finger wearing the input device on different fingers can control the progress of different controls.

[0129] For example, sliding a finger on the user's index finger can control the progress of the volume control; sliding a finger on the user's middle finger can control the progress of the play control; sliding a finger on the user's ring finger can control the progress of the brightness control; sliding a finger on the user's thumb can control the progress of the focus control.

[0130] For another example, taking the electronic device as a VR device, in response to the sliding of a finger between two fingers of a user, the electronic device can control the volume control, brightness control, and focus control of the VR device based on the curvature change of the lines between the two fingers, the order in which the lines appear over time, and the change in the width of the gap between the two fingers.

[0131] For example, sliding a finger between the user's index finger and middle finger can control the progress of the volume control; sliding a finger between the middle finger and ring finger can control the progress of the brightness control; sliding a finger between the ring finger and little finger can control the progress of the focus control.

[0132] For another example, to facilitate multimedia switching, in response to a left or right swipe on the user's hand, the electronic device can execute a multimedia switching event and display the playback interface of a second multimedia. For example, in the case of a left swipe, the second multimedia is the previous multimedia of the first multimedia, and in the case of a right swipe, the second multimedia is the next multimedia of the first multimedia.

[0133] Based on this multimedia control scenario, users can control the playback of multimedia by sliding the fingers wearing the input device on their hands. For example, when users watch videos on a smart TV or smart projector, they do not need to waste time looking for the remote control, which makes it easier for users to control the played video and improves the user experience.

[0134] Scenario 3: Application control.

[0135] Application control can refer to launching applications, exiting applications, etc.

[0136] In one example, as shown in a of FIG12 , the electronic device may display a main interface in response to a finger wearing the input device contacting / pressing a preset position on the hand. The main interface may include multiple applications.

[0137] In conjunction with FIG12 a, as shown in FIG12 b, the electronic device can launch a first application corresponding to the first track from among multiple applications based on a sliding operation of a finger wearing the input device on the palm of the hand. Different applications correspond to different tracks.

[0138] For example, if the first track of the finger on the palm is Z-shaped, the first application launched by the electronic device is a photo-taking application; if the first track of the finger on the palm is P-shaped, the first application launched by the electronic device is a call application; if the first track of the finger on the palm is V-shaped, the first application launched by the electronic device is a video application; if the first track of the finger on the palm is M-shaped, the first application launched by the electronic device is an audio application. The above different track shapes are only examples. The sliding tracks corresponding to different applications can be customized by the user. For example, in order to facilitate memory, the user can also use the shape of the first letter of the application to define the track for launching the application. For example, the launch track for the camera application can be defined as a C-shaped track.

[0139] When running a first application, the electronic device can control the controls of the first application in response to a sliding operation. For example, when running a camera application, the electronic device can increase or decrease the progress of the camera application's focus control in response to a sliding operation. When running a call application, the electronic device can increase or decrease the progress of the call volume control in response to a sliding operation. When running a video application or an audio application, the electronic device can increase or decrease the progress of the volume control / playback control in response to a sliding operation.

[0140] Furthermore, when the electronic device is running the first application, the electronic device can also exit the first application and display the main interface in response to a second trajectory of the finger on the palm. The second trajectory is different from the first trajectory. For example, the second trajectory can be S-shaped.

[0141] In one example, in order to avoid performing an erroneous operation, such as erroneously exiting the first application, the electronic device displays a prompt message when detecting the second trajectory of the finger on the palm. The prompt message can be used to prompt whether to confirm exiting the first application. For example, the prompt message can be displayed in the form of an interface. The interface may include "OK" and "NO". "OK" means confirmation and "NO" means denial. In response to the user's finger performing a preset operation on the hand, the electronic device can exit the first application. The preset operation can be set as needed, for example, it can be a circle operation on the hand. That is, in response to the circle operation, the electronic device can determine to execute "OK" and continue to execute the instruction to exit the first application.

[0142] Based on this application control scenario, when using an electronic device, a user can launch the application corresponding to the sliding path by sliding a finger wearing an input device on the palm of their hand. Since different sliding paths can launch different applications, the user can control the launch of different applications with different sliding paths, which increases the fun of using the electronic device and thus improves the user experience.

[0143] Scenario 4: Call control.

[0144] Call control can include starting call mode, ending call mode, call volume control, etc.

[0145] In one example, in response to a call request from another device, the electronic device may display the interface shown in a of FIG13 . In response to a first sliding operation of a finger on a hand of the user wearing the input device, the electronic device may enable call mode. In response to a second sliding operation of a finger on a hand of the user wearing the input device, the electronic device may end call mode. The first sliding operation and the second sliding operation are different. For example, the sliding directions of the first sliding operation and the second sliding operation are different, or the trajectories of the first sliding operation and the second sliding operation are different.

[0146] For example, sliding the finger wearing the input device toward the fingertip indicates that the finger is sliding to the left; sliding the finger wearing the input device toward the fingerbase indicates that the finger is sliding to the right.

[0147] For example, the first sliding operation may be sliding toward the fingertip (i.e., sliding to the left), and the second sliding operation may be sliding toward the base of the finger (i.e., sliding to the right). For another example, the first sliding operation may be an S-shaped trajectory, and the second sliding operation may be an O-shaped trajectory.

[0148] Furthermore, when the call mode is on, as shown in FIG13 b, the electronic device can control the progress of the volume control in response to a third sliding operation of a finger on the hand. The third sliding operation can be a left sliding operation or a right sliding operation. For example, a left sliding operation can increase the progress of the volume control, and a right sliding operation can decrease the progress of the volume control.

[0149] In some other examples, when the call mode is on, the electronic device can also activate a preset function in response to the sliding trajectory of the finger on the hand. For example, if the sliding trajectory is W-shaped, the hands-free call function is activated. For another example, if the sliding trajectory is C-shaped, the recording function is activated while maintaining the call mode.

[0150] Based on this call control scenario, users can answer calls from other users by sliding the fingers wearing the input device on their hands. That is, users can use the call function of the electronic device normally even when it is inconvenient for them to touch the electronic device, thereby providing a better user experience.

[0151] It should be noted that in the disclosed embodiments, the finger wearing the input device can perform sliding operations on other fingers on the same hand to control the electronic device. This allows the user to control the electronic device with a single hand, making user operation more convenient. Of course, the finger wearing the input device can also perform sliding operations on fingers on other hands of the user without limitation.

[0152] Example 2

[0153] In one embodiment, as shown in FIG14 , a control method for a scenario in which a finger of a user wearing an input device rotates on an ear of a user is provided in an embodiment of the present disclosure. The method may include S1401 to S1404 .

[0154] S1401: In response to performing a first rotation operation on a user's ear, collecting rotation information on the ear.

[0155] The rotation information may include characteristic information of the ear portion that the rotation operation passes through. For example, as described in the above embodiment, the rotation information may include the skin texture of the ear portion that the first rotation operation passes through, the shape and structure of the ear canal that the first rotation operation passes through, the order in which the skin texture of the ear portion that the first rotation operation passes through appears over time, and the rotation duration of the ear portion that the first rotation operation passes through. Each of these types of rotation information is described below.

[0156] 1. The skin texture of the ear passed by the first rotation operation.

[0157] The skin texture of the ear that the first rotational operation passes through can also be described as the skin texture of the contact area between the first rotational operation and the ear, the rotational area of ​​the finger wearing the input device on the ear, etc. The rotational area includes skin textures, shape and structure, etc. It is understandable that because the diameter of the input device is slightly larger than the diameter of the ear canal, when the input device rotates within the ear canal, the skin texture of the ear that the first rotational operation passes through can refer to the skin texture of the area scanned by the input device and the acoustic wave sensor.

[0158] For example, as shown in a of FIG15 , the finger wearing the input device is the index finger, which rotates in the user's ear canal. The skin texture collected by the input device may be shown in b of FIG15 .

[0159] In some embodiments, in response to the rotation of the input device within the ear canal, the input device can continuously transmit ultrasonic pulse signals and receive the transmitted signals. Thus, as the input device rotates within the ear canal, through continuous translational scanning, the input device can capture rotational information such as the skin texture and shape of the ear canal.

[0160] In conjunction with the above implementation, when the input device and the electronic device establish an initial connection, the electronic device can obtain characteristic information such as the skin texture and shape and structure of the ear canal by scanning the input device multiple times within the ear canal. Based on the characteristic information of the ear canal obtained through these multiple scans, the electronic device can generate an ear canal template, which can be shown as b in 15. This ear canal template can be used to determine the location / area on the ear of the ear skin texture captured by the input device.

[0161] Later, when the input device controls the electronic device, the electronic device can match the rotation information collected by the input device with the ear canal template to determine the skin texture or ear canal shape structure corresponding to the rotation operation. Based on the skin texture or ear canal shape structure corresponding to the rotation operation, the electronic device can determine a matching instruction and execute the instruction. For example, the electronic device can be configured with a correspondence between the skin texture or ear canal shape structure and the instruction, and based on this correspondence, the electronic device can determine a matching instruction.

[0162] 2. The order in which the skin lines of the ear passing through the first rotation operation appear over time.

[0163] The order in which the skin lines of the ear passing through the first rotation operation appear over time can also be described as the scanning order of the skin lines of the ear passing through the first rotation operation, the rotation direction of the first rotation operation within the ear, etc. It is understandable that the scanning order of the collected skin lines of the ear will vary depending on the direction in which the input device is rotated within the ear canal.

[0164] In one example, the multiple skin textures of the ear captured by the input device can be assigned a timestamp, which can be used to indicate the time the skin texture was captured. For example, when the input device rotates, each time a reflection signal is received, a timestamp can be assigned to the reflection signal to indicate the order in which the reflection signals were captured. In this way, the input device can assign a timestamp to each reflection signal during the rotation process. Based on the timestamps, the electronic device can determine the order in which the skin textures of the ear passing through during the first rotation operation appear over time. In other words, the electronic device can use the timestamps as timestamps.

[0165] 3. The rotation duration of the ear during the first rotation operation.

[0166] The rotation time length of the ear during the first rotation operation may also be described as the rotation time length of the first rotation operation, the rotation time length in the ear, and the like.

[0167] In one example, the electronic device can start timing in response to the start of rotation of the input device, and stop timing in response to the stop of rotation of the input device. In this way, the electronic device can obtain the rotation duration of the input device in the ear. For example, the input device can detect whether the rotation starts through an acceleration sensor, and when the input device starts to rotate, it sends a first indication message to the electronic device, and the first indication message can be used to instruct the input device to start rotating. When the input device detects that the rotation stops through the acceleration sensor, it can send a second indication message to the electronic device, and the second indication message can be used to instruct the input device to stop rotating. In this way, the electronic device can determine the rotation duration of the ear during the first rotation operation based on the first indication message and the second indication message.

[0168] S1402: The input device sends the rotation information collected from the user's ear to the electronic device. Correspondingly, the electronic device receives the rotation information from the input device.

[0169] S1402 can refer to the description of S402 above and will not be repeated here.

[0170] S1403: The electronic device recognizes a first rotation operation on the user's ear based on the rotation information.

[0171] Identifying a first rotation operation on the user's ear includes identifying the user's ear and a first rotation operation. The first rotation operation may include an operation of entering the ear canal of the ear, an operation of rotating clockwise in the ear canal, an operation of rotating counterclockwise in the ear canal, etc.

[0172] In one example, the electronic device can match the skin texture included in the rotation information with the ear template established above to determine the positions of the multiple skin textures or ear shape structures included in the rotation information on the ear. Based on the positions of the multiple skin textures or ear shape structures on the ear, the electronic device can obtain the rotation operation (e.g., rotation direction) of the finger wearing the input device on the ear. Specifically, please refer to the relevant description in S503 above and will not be repeated here.

[0173] S1404: In response to the first rotation operation on the ear, the electronic device executes an application event corresponding to the first rotation operation.

[0174] Application events may include call control, multimedia control and other events.

[0175] In one example, the electronic device may display a call interface in response to a call request from another device, and in response to a user placing an input device into an ear canal, activate a call mode on the call interface. In response to rotation of the input device within the ear canal, the volume of the call mode may be controlled.

[0176] For example, the electronic device can increase the volume of the call mode in response to the user rotating the input device clockwise in the ear canal, and reduce the volume of the call mode in response to the user rotating the input device counterclockwise in the ear canal.

[0177] For the specific implementation of this example, please refer to the relevant description of scenario 4 above and will not be repeated here.

[0178] In another example, the electronic device may display controls (e.g., volume controls, playback controls) on a first playback interface of a multimedia application in response to a user placing an input device into the ear canal of the ear, and increase or decrease the progress of the controls in response to the rotation of the input device in the ear canal.

[0179] For example, the electronic device may increase the progress of the control in response to the user rotating the input device clockwise in the ear canal, and may decrease the progress of the control in response to the user rotating the input device counterclockwise in the ear canal.

[0180] For the specific implementation of this example, please refer to the relevant description of scenario three above and will not be repeated here.

[0181] Based on the technical solution in Figure 14, in an embodiment of the present disclosure, an input device can collect and transmit the collected ear feature information to an electronic device in response to a rotation operation of a finger wearing the input device on the ear. In this way, the electronic device can execute a corresponding application event in response to the rotation operation of the input device on the ear. In other words, a user can control an electronic device by rotating a finger on the ear. This allows users to control electronic devices through common actions, improving the user experience when using electronic devices.

[0182] The various solutions in the above embodiments of the present disclosure can be combined without contradiction.

[0183] It is understandable that, in order to realize the above functions, the control device includes hardware structures and / or software modules corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the algorithm steps of each example described in the embodiments of the present disclosure, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present disclosure.

[0184] The embodiment of the present disclosure can divide the functional modules of the control device according to the above-mentioned method embodiment. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one functional module. The above-mentioned integrated module can be implemented in the form of hardware or software. It should be noted that the division of modules in the embodiment of the present disclosure is schematic and is only a logical function division. There may be other division methods in actual implementation. The following is an example of dividing each functional module corresponding to each function.

[0185] FIG16 is a schematic diagram of the structure of a control device provided by an embodiment of the present disclosure, which can perform the functions of the electronic device provided by the above method embodiment. As shown in FIG16 , the control device includes: a receiving unit 1601 , a determining unit 1602 , and a processing unit 1603 .

[0186] In some embodiments, receiving unit 1601 is configured to receive sliding information from an input device, the sliding information being used to indicate a first sliding operation performed on a hand of a user of the electronic device. Determining unit 1602 is configured to identify the first sliding operation on the hand of the user based on the sliding information. Processing unit 1603 is configured to execute an application event corresponding to the first sliding operation in response to the first sliding operation on the hand.

[0187] In one example, the sliding information includes at least one of the following: the skin texture of the hand through which the first sliding operation passes; the order in which the skin texture of the hand through which the first sliding operation passes appears over time; the hand through which the first sliding operation passes includes multiple sub-parts, and the sliding information includes the spacing between the multiple sub-parts; the curvature of the sliding route of the first sliding operation.

[0188] In one example, the first sliding operation includes any one of the following operations performed on the hand: an upward sliding operation, a downward sliding operation, a left sliding operation, a right sliding operation, and a sliding operation along a preset trajectory.

[0189] In one example, as shown in FIG16 , the device may further include a display unit 1604 configured to display a first page of a first application. A processing unit 1603 is configured to, in response to a downward swipe or upward swipe operation on the user's hand, execute a page turning event to display a second page of the first application; wherein, in the case of a downward swipe operation, the second page is the next page of the first page, and in the case of an upward swipe operation, the second page is the previous page of the first page.

[0190] In one example, display unit 1604 is configured to display controls for a first multimedia application; the controls include any one of a volume control, a progress control, a brightness control, and a focus control. Processing unit 1603 is configured to execute a multimedia control event in response to a left swipe or a right swipe on the user's hand; in the case of a right swipe, the progress of the control is increased, and in the case of a left swipe, the progress of the control is decreased.

[0191] In one example, the display unit 1604 is configured to display a main interface including multiple applications. The processing unit 1603 is configured to: in response to a sliding operation of a user on a palm of a first track, run a first application corresponding to the first track among the multiple applications.

[0192] In one example, the multiple applications include at least one of a photo-taking application, a call application, and a multimedia application; the trajectory corresponding to the photo-taking application is Z-shaped, the trajectory corresponding to the call application is P-shaped, and the trajectory corresponding to the multimedia application includes V-shaped and M-shaped.

[0193] In some further embodiments, the receiving unit 1601 is configured to receive rotation information from an input device, the rotation information being used to indicate that a user using the electronic device has performed a first rotation operation on the user's ear. The determining unit 1602 is configured to identify the user's first rotation operation on the user's ear based on the rotation information. The processing unit 1603 is configured to execute an application event corresponding to the first rotation operation on the ear in response to the user's first rotation operation on the user's ear.

[0194] In one example, the rotation information includes at least one of the following: the skin texture of the ear through which the first rotation operation passes; the ear canal shape structure of the ear through which the first rotation operation passes; the order in which the skin texture of the ear through which the first rotation operation passes appears over time; and the rotation duration of the ear through which the first rotation operation passes.

[0195] In one example, the first rotation operation includes: an operation of entering the ear canal of the ear, an operation of rotating clockwise in the ear canal, and an operation of rotating counterclockwise in the ear canal.

[0196] In one example, the display unit 1604 is configured to display a call interface. The processing unit 1603 is configured to: in response to the user placing the input device into the ear canal of the ear, activate a call mode on the call interface; in response to the user rotating the input device clockwise in the ear canal, increase the volume of the call mode; and in response to the user rotating the input device counterclockwise in the ear canal, decrease the volume of the call mode.

[0197] In one example, the display unit 1604 is configured to display controls on a first playback interface of a multimedia application; the controls include volume controls or playback controls. The processing unit 1603 is configured to: in response to the user rotating the input device clockwise within the user's ear canal, increase the progress of the control; and in response to the user rotating the input device counterclockwise within the user's ear canal, decrease the progress of the control.

[0198] FIG17 is a schematic diagram of the structure of a control device provided by an embodiment of the present disclosure, which can perform the functions of the input device provided by the above method embodiment. As shown in FIG17 , the device includes:

[0199] The collection unit 1701 is used to collect movement information on the user's body parts in response to movement operations on the user's body parts, where the movement information is used to indicate the user's movement operations on the user's body parts, and the body parts include the user's hands or the user's ears.

[0200] The sending unit 1702 is configured to send movement information to the electronic device, where the movement information is used to control the electronic device to execute an application event corresponding to the movement operation on the body part.

[0201] In one example, in a case where the body part includes the user's hand, the movement operation on the user's body part includes a sliding operation on the user's hand, and the movement information includes at least one of the following: the skin texture of the hand through which the sliding operation passes; the order in which the skin texture of the hand through which the sliding operation passes appears over time; the hand through which the sliding operation passes includes multiple sub-parts, and the movement information includes the indirectness of the multiple sub-parts; the curvature of the sliding route of the sliding operation; in a case where the body part includes the user's ear, the movement operation on the user's body part includes a rotation operation on the user's ear, and the movement information includes at least one of the following: the skin texture of the ear through which the rotation operation passes; the ear canal shape structure of the ear through which the rotation operation passes; the order in which the skin texture of the ear through which the rotation operation passes appears over time; the rotation duration of the ear through which the rotation operation passes.

[0202] In one example, the sliding operation includes: an up sliding operation, a down sliding operation, a left sliding operation, a right sliding operation, and a sliding operation along a preset trajectory; the rotation operation includes: an operation of placing the input device into the ear canal of the ear, an operation of rotating it clockwise in the ear canal, and an operation of rotating it counterclockwise in the ear canal.

[0203] In the case of implementing the functions of the above-mentioned integrated modules in the form of hardware, the embodiment of the present disclosure provides another structure of the control device involved in the above-mentioned embodiment. As shown in Figure 18, the control device 180 includes: a memory 1801, a processor 1802, a communication interface 1803, and a bus 1804.

[0204] The memory 1801 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store dynamic information and instructions, an electrically erasable programmable read-only memory (EEPROM), a disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0205] Processor 1802 may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of this disclosure. Processor 1802 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array, or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Processor 1802 may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of this disclosure. Processor 1802 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0206] The communication interface 1803 is used to connect to other devices via a communication network, such as Ethernet, wireless access network, or wireless local area network (WLAN).

[0207] In some embodiments, the memory 1801 may exist independently of the processor 1802 and may be connected to the processor 1802 via a bus 1804 to store instructions or program codes. When the processor 1802 calls and executes the instructions or program codes stored in the memory 1801, the control method provided in the embodiments of the present disclosure can be implemented.

[0208] In some embodiments, the memory 1801 may also be integrated with the processor 1802 .

[0209] Bus 1804 can be an Extended Industry Standard Architecture (EISA) bus, for example. Bus 1804 can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, FIG18 shows only one thick solid line, but this does not mean that there is only one bus or only one type of bus.

[0210] Some embodiments of the present disclosure provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium), which stores computer program instructions. When the computer program instructions are executed on a computer, the computer executes the control method described in any of the above embodiments.

[0211] For example, the computer-readable storage media may include, but are not limited to, magnetic storage devices (e.g., hard disks, floppy disks, or magnetic tapes), optical disks (e.g., compact disks (CDs), digital versatile disks (DVDs), etc.), smart cards, and flash memory devices (e.g., erasable programmable read-only memories (EPROMs), cards, sticks, or key drives, etc.). The various computer-readable storage media described in this disclosure may represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.

[0212] An embodiment of the present disclosure provides a computer program product comprising instructions. When the computer program product is run on a computer, the computer is enabled to execute the control method described in any one of the above embodiments.

[0213] The above is only a specific embodiment of the present disclosure, but the scope of protection of the present disclosure is not limited thereto. Any changes or replacements within the technical scope disclosed in the present disclosure should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be based on the scope of protection of the claims.

Claims

1. A control method, comprising: Receiving sliding information from an input device, the sliding information being used to instruct a user using the electronic device to perform a first sliding operation on a hand of the user; Based on the sliding information, identifying a first sliding operation on the hand of the user; In response to a first sliding operation on the hand, an application event corresponding to the first sliding operation is executed.

2. The method according to claim 1, wherein: The sliding information includes at least one of the following: The skin texture of the hand over which the first sliding operation passes; The order in which the skin lines of the hand passed by the first sliding operation appear over time; The hand portion passed by the first sliding operation includes a plurality of sub-portions, and the sliding information includes the distance between the plurality of sub-portions; The curvature of the sliding path of the first sliding operation.

3. The method according to claim 1 or 2, wherein: The first sliding operation includes any one of the following operations performed on the hand: Slide up, slide down, slide left, slide right, and slide along a preset trajectory.

4. The method according to claim 3, further comprising: Displaying a first page of a first application; In response to the first sliding operation on the hand, executing the application event corresponding to the first sliding operation includes: In response to a swipe down operation or an up operation on the user's hand, a page turning event is executed to display the second page of the first application; wherein, in the case of a swipe down operation, the second page is the next page of the first page, and in the case of an up operation, the second page is the previous page of the first page.

5. The method according to claim 3, further comprising: Displaying a control of the first multimedia application, wherein the control includes any one of a volume control, a progress control, a brightness control, and a focus control; In response to the first sliding operation on the hand, executing the application event corresponding to the first sliding operation includes: In response to a left swipe operation or a right swipe operation on the user's hand, a multimedia control event is executed; wherein, in the case of a right swipe operation, the progress of the control is increased, and in the case of a left swipe operation, the progress of the control is decreased.

6. The method according to claim 3, further comprising: Displaying a main interface, wherein the main interface includes multiple applications; In response to the first sliding operation of the user on the hand, executing the application event corresponding to the first sliding operation of the hand includes: In response to a sliding operation of the user on a palm of the user along a first track, a first application corresponding to the first track among the multiple applications is run.

7. The method according to claim 6, wherein: The multiple applications include at least one of a photo taking application, a call application, and a multimedia application; the trajectory corresponding to the photo taking application is Z-shaped, the trajectory corresponding to the call application is P-shaped, and the trajectory corresponding to the multimedia application includes V-shaped and M-shaped.

8. A control method, comprising: Receiving rotation information from an input device, wherein the rotation information is used to instruct a user using the electronic device to perform a first rotation operation on an ear of the user; Based on the rotation information, identifying a first rotation operation performed by the user on the ear of the user; In response to a first rotation operation performed by the user on the ear of the user, executing an application corresponding to the first rotation operation on the ear event.

9. The method according to claim 8, wherein: The rotation information includes at least one of the following: The skin texture of the ear through which the first rotation operation passes; The ear canal shape structure of the ear through which the first rotation operation passes; The order in which the skin lines of the ear that the first rotation operation passes through appear over time; The duration of the ear rotation during the first rotation operation.

10. The method according to claim 8 or 9, wherein: The first rotation operation includes: an operation of entering the ear canal of the ear, an operation of rotating in a clockwise direction in the ear canal, and an operation of rotating in a counterclockwise direction in the ear canal.

11. The method according to claim 10, further comprising: Display the call interface; In response to the user's first rotation operation on the user's ear, executing an application event corresponding to the first rotation operation on the ear includes: In response to the user placing the input device into the ear canal of the ear, starting a call mode on the call interface; In response to the user rotating the input device in the ear canal in a clockwise direction, increasing the volume of the call mode; In response to the user's operation of rotating the input device in a counterclockwise direction in the ear canal, the volume of the call mode is reduced.

12. The method according to claim 8 or 9, further comprising: Displaying controls on a first playback interface of a multimedia application; the controls include volume controls or playback controls; In response to the user's first rotation operation on the user's ear, executing an application event corresponding to the first rotation operation on the ear includes: In response to the user's operation of rotating the input device in a clockwise direction in the ear canal of the user, increasing the progress of the control; In response to the user's operation of rotating the input device in a counterclockwise direction within the user's ear canal, the progress of the control is reduced.

13. A control method, comprising: In response to a movement operation on a body part of a user, collecting movement information on the body part of the user, the movement information being used to indicate the movement operation of the user on the body part of the user, the body part comprising a hand of the user or an ear of the user; Movement information is sent to an electronic device, where the movement information is used to control the electronic device to execute an application event corresponding to the movement operation on the body part.

14. The method according to claim 13, wherein: In the case where the body part includes a hand of the user, the movement operation on the body part of the user includes a sliding operation on the hand of the user, and the movement information includes at least one of the following: The skin texture of the hand over which the sliding operation is performed; the order in which the skin texture of the hand over which the sliding operation is performed appears over time; The hand portion passed through by the sliding operation includes a plurality of sub-parts, and the movement information includes indirect information of the plurality of sub-parts; a curvature of a sliding path of the sliding operation; In the case where the body part includes an ear of the user, the movement operation on the body part of the user includes a rotation operation on the ear of the user, and the movement information includes at least one of the following: The skin texture of the ear through which the rotation operation passes; The shape and structure of the ear canal of the ear through which the rotation operation passes; The order in which the skin lines of the ear through which the rotation operation passes appear over time; The rotation time of the ear during the rotation operation.

15. The method according to claim 14, wherein: The sliding operation includes: sliding up, sliding down, sliding left, sliding right, and sliding along a preset trajectory; The rotation operation includes: an operation of placing the input device into the ear canal of the ear, an operation of rotating the input device in a clockwise direction in the ear canal, and an operation of rotating the input device in a counterclockwise direction in the ear canal.

16. A control system comprising an input device and an electronic device, wherein: The input device is worn on a finger of a user, the electronic device is used to execute the method according to any one of claims 1-12, and the input device is used to execute the method according to any one of claims 13-15.

17. An input device, wherein: The input device is a finger cap structure, and is provided with a sensor, a processor, and a communication interface; the sensor is located at a position on the input device corresponding to the finger pulp or fingertip of the user; The sensor is used to collect movement information on a body part of the user; The processor is used to send movement information on a body part of the user to the electronic device through the communication interface, and the movement information is used to determine an application event corresponding to the movement information on the body part.

18. The input device according to claim 17, wherein: The sensor includes one or more of an ultrasonic sensor, a pressure sensor, and a fingerprint sensor.

19. An electronic device comprising a processor and a communication interface, wherein: The processor and the communication interface support the electronic device to execute the method according to any one of claims 1-12.

20. A computer-readable storage medium, wherein: The computer-readable storage medium comprises computer program instructions; wherein, when the computer program instructions are executed on a computer, the computer is caused to perform the method according to any one of claims 1 to 15.

Images