Control method, electronic equipment, input equipment and control system

Abstract

The invention discloses a control method, electronic equipment, input equipment and a control system, which are used for improving the experience of a user in using the electronic equipment. The method comprises the steps that the electronic equipment displays a first interface, receives feature information, collected by input equipment, of finger knuckles, and executes a preset operation instruction on the first interface according to the feature information of the finger knuckles.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of electronic devices, and in particular to a control method, electronic device, input device, and control system. Background Art

[0002] With the continuous upgrading of electronic devices, the frequency of using electronic devices in daily life is getting higher and higher. For example, users can use electronic devices to make calls, watch multimedia videos, etc.

[0003] Generally, when a user operates an electronic device, the user usually directly operates the electronic device with a finger. However, if the user operates the electronic device with a finger for too long, the user's hand may feel uncomfortable, which reduces the user experience. Summary of the invention

[0004] The present application provides a control method, an electronic device, an input device and a control system, which are used to improve the user experience when using the electronic device.

[0005] In order to achieve the above objectives, this application adopts the following technical solutions:

[0006] In a first aspect, a control method is provided, the method comprising: an electronic device displays a first interface, the electronic device receives characteristic information of finger joints collected by an input device, and executes a preset operation instruction according to the characteristic information of the finger joints on the first interface.

[0007] In a second aspect, a control method is provided, the method comprising: in response to an operation of contacting a user's finger joint, an input device collects characteristic information of the contacted finger joint, and sends the collected characteristic information of the finger joint to an electronic device. The characteristic information of the finger joint is used to instruct the electronic device to execute a preset operation instruction on a first interface.

[0008] In a third aspect, a control system is provided, the control system comprising an electronic device and an input device, the electronic device can be used to implement the control method of the first aspect. The input device can be used to implement the control method of the second aspect.

[0009] In a fourth aspect, an electronic device is provided. The electronic device includes a processor and a communication interface. The processor and the communication interface support the electronic device to execute the control method of the first aspect.

[0010] In another possible design, the device may further include a memory for storing computer-executable instructions and data necessary for the device. When the device is running, the processor executes the computer-executable instructions stored in the memory so that the device performs the control method described in any possible design of the first aspect.

[0011] In a fifth aspect, an input device is provided, which is a finger cap structure, and is provided with a sensor, a processor, and a communication interface. The sensor is located at a position on the input device corresponding to the finger pulp or fingertip of the user. The sensor is used to collect characteristic information of the user's finger joints. The processor is used to send the characteristic information of the finger joints to the electronic device through the communication interface. The characteristic information is used by the electronic device to execute a preset operation instruction on the first interface.

[0012] In another possible design, the device may further include a memory for storing computer-executable instructions and data necessary for the device. When the device is running, the processor executes the computer-executable instructions stored in the memory so that the device performs the control method described in any possible design of the second aspect.

[0013] In the sixth aspect, a computer-readable storage medium is provided, which may be a readable non-volatile storage medium, and which stores computer instructions or programs. When the computer-readable storage medium is run on a computer, the computer can execute the control method described in any possible design of the first aspect or the second aspect.

[0014] In a seventh aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the control method described in any possible design of the first aspect or the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 A schematic diagram of a control electronic device provided in an embodiment of the present application;

[0016] Figure 2 A schematic diagram of a control system provided in an embodiment of the present application;

[0017] Figure 3 A schematic diagram of the structure of an input device provided in an embodiment of the present application;

[0018] Figure 4 A schematic diagram of a control method provided in an embodiment of the present application;

[0019] Figure 5 A schematic diagram of the correspondence between finger joints and key positions provided in an embodiment of the present application;

[0020] Figure 6 A schematic diagram of an input device controlling characters output by an electronic device provided in an embodiment of the present application;

[0021] Figure 7 A schematic diagram of another correspondence between finger joints and key positions provided in an embodiment of the present application;

[0022] Figure 8 A schematic diagram of another correspondence between finger joints and function keys provided in an embodiment of the present application;

[0023] Fig. 9 A schematic diagram of another control method provided in an embodiment of the present application;

[0024] Fig.10 A schematic diagram of an interface for prompting information provided in an embodiment of the present application;

[0025] Fig.11 A schematic diagram of an input device controlling text input of an electronic device provided in an embodiment of the present application;

[0026] Fig.12 A schematic diagram of the structure of a control device provided in an embodiment of the present application;

[0027] Fig.13 A schematic diagram of the structure of another control device provided in an embodiment of the present application;

[0028] Fig.14 A schematic diagram of the structure of another control device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0029] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0030] In the description of the present application, unless otherwise specified, " / " means "or", for example, A / B can mean A or B. "And / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, "at least one" means one or more, and "plurality" means two or more. The words "first" and "second" do not limit the quantity and execution order, and the words "first" and "second" do not necessarily limit them to be different. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0031] It should be noted that, in this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0032] In the embodiment of the present application, "indication" may include direct indication and indirect indication. For example, taking the indication information in the following text as an example, the indication information may directly carry information A itself or its index to achieve the purpose of directly indicating information A. Alternatively, the indication information may also carry information B that is associated with information A, thereby achieving the purpose of indirectly indicating information A while indicating information B.

[0033] In the technical field of electronic devices, users can directly or indirectly control electronic devices, for example, controlling text input of electronic devices, playing of multimedia data of electronic devices, etc.

[0034] Wherein, the user directly controls the electronic device, which may refer to: the user controls the electronic device by touching or pressing the display screen of the electronic device, or the function key of the electronic device. The user indirectly controls the electronic device, which may refer to: the user controls the operation of the electronic device through a control device (such as a handle, a controller, a glove, a keyboard, etc.).

[0035] For example, taking the electronic device as a terminal device, Figure 1 As shown, the user needs to use a finger to operate on the display screen of the electronic device. For example, the user can use a finger to click a key on the text input interface of the electronic device to input corresponding text or characters.

[0036] For another example, if the electronic device is a virtual reality (VR) device, the user can control the text input of the VR device through a handle or gloves, etc. For another example, if the electronic device is a mobile device, the user can input text in a text input box of the mobile device through a text input control (such as a keyboard on a text input interface).

[0037] In one application scenario, a VR device can display a virtual keyboard in a virtual reality scene, and a user can use buttons or a touchpad on a handle or controller to select characters, numbers, and symbols on the virtual keyboard to control text input of the VR device.

[0038] Since there are too few keys on a handle or controller, the input efficiency is low when the handle or controller is used to control a virtual keyboard for input.

[0039] In another application scenario, when the VR device supports handwriting input, the user can use the touchpad on the controller or the touch sensor on the glove to write text in the virtual scene in a handwritten manner.

[0040] In another application scenario, when the VR device supports virtual pen text input, the user can use the touchpad on the handle or glove to control the virtual pen and write text by hand.

[0041] In the above two application scenarios, writing is performed by handwriting, but the handwriting input speed is slow, and when encountering characters that cannot be written or a single word, it is difficult to continue writing, further reducing the writing efficiency.

[0042] In view of this, an embodiment of the present application provides an input device worn on a finger, which can respond to the contact between the finger and other fingers, collect characteristic information of the finger joints in contact with the finger, and send the characteristic information of the finger joints to the electronic device. The electronic device can execute preset operation instructions corresponding to the characteristic information of the finger joints on the application interface. Since the input device is worn on the user's finger, the user only needs to move the finger to control the electronic device to perform the corresponding operation, without directly touching the electronic device or controlling the terminal through a device such as a control handle. It is simple and convenient, which improves the user experience.

[0043] For example, Figure 2 A schematic diagram of a control system provided by an embodiment of the present application is shown in FIG. The control system may include an input device and an electronic device. The input device is worn on a finger of a user. The input device and the electronic device may be connected to each other in a wireless communication manner. For example, the input device may be connected via Bluetooth, Wireless Fidelity (WiFi), or the like.

[0044] Among them, the electronic device can be used to execute the corresponding preset function according to the control information of the input device. The electronic device can also be called a terminal, a user equipment (UE), a mobile station, a mobile terminal, etc. The electronic device can be a mobile phone, a tablet computer, a computer with a wireless transceiver function, a virtual reality terminal device, an augmented reality terminal device, a wireless terminal in industrial control, a wireless terminal in unmanned driving, a wireless terminal in remote surgery, a wireless terminal in transportation safety, a wireless terminal in a smart city, a wireless terminal in a smart home, etc. The embodiments of the present application do not limit the specific device form adopted by the electronic device.

[0045] The input device may be used to collect characteristic information of a part of the hand in contact with the input device, and send control information indicating the characteristic information of the part to the electronic device. The part may be a finger joint, a palm, or the like. Taking the finger joint as an example, the characteristic information of the finger joint may include one or more of the fingerprint feature of the finger joint, the width of the finger joint, and the pressure value of the finger joint on the input device.

[0046] In some examples, in order to facilitate the collection of characteristic information of the contacted part, the input device may be a finger cap structure. The input device may be worn on the user's finger, so that the user can conveniently use the input device to collect characteristic information of the contacted part.

[0047] After collecting characteristic information of the contact part, the input device can send the collected characteristic information to the electronic device. After receiving the characteristic information collected from the input device, the electronic device can respond to the characteristic information and execute the operation instruction corresponding to the characteristic information.

[0048] In one possible implementation, Figure 3 As shown, the input device may be provided with one or more sensors, a processor, and a communication interface (or communication module).

[0049] The sensor may be used to collect feature information of the part. The processor may be used to send the feature information collected by the sensor to the electronic device through the communication interface. For example, the sensor may include one or more of an ultrasonic sensor, a fingerprint sensor, and a pressure sensor.

[0050] In order to facilitate the collection of characteristic information of the contacted part, the sensor can be set at a position on the input device corresponding to the user's fingertips or fingertips. In this way, when the finger wearing the input device contacts other fingers, the input device can collect characteristic information of the contacted part through the sensor.

[0051] Furthermore, in order to facilitate the input device to adapt to different fingers, the input device may be provided with an adjustment device, which may be used to adjust the gap between the input device and the finger. For example, the adjustment device may be a rubber ring.

[0052] In one example, the feature information includes fingerprint features, and the sensor is an ultrasonic sensor or a fingerprint sensor.

[0053] For example, taking the sensor as an ultrasonic sensor, the input device may further include a receiver. Based on the operation of pressing the finger joint, the ultrasonic sensor is triggered to emit an ultrasonic wave. The ultrasonic wave is reflected back by the contacted finger joint and received by the receiver. Since the fingerprint features of different finger joints are different, the waveforms of the ultrasonic waves reflected back by different finger joints are different. Therefore, the input device can determine the fingerprint features of the contacted finger joint based on the received reflected ultrasonic wave.

[0054] For another example, taking the sensor as a fingerprint sensor, based on an operation of contacting a finger knuckle, the input device can collect fingerprint features of the contacting finger knuckle through the fingerprint sensor.

[0055] In another example, the feature information includes the width of the finger joints, and the sensor may be an ultrasonic sensor. Since the widths of different finger joints are different, the waveforms of the sound waves reflected back by different finger joints are also different. Thus, different width values ​​can be determined based on different waveforms. That is, the input device can collect the width of the finger joints.

[0056] In another example, the characteristic information includes the pressure value of the finger joints on the input device, and the sensor may include a pressure sensor. Based on the operation of pressing the hand, the pressure sensor may be triggered to collect the pressure value of the pressing. That is, the input device may collect the pressure value of the finger joints on the input device.

[0057] In another example, the input device may also be provided with a timer. The timer may also count the contact time between the input device and the finger joint. That is, the above-mentioned characteristic information may also include the contact time.

[0058] Combine the following Figure 2 The control system shown in the figure describes the control method provided by the embodiment of the present application. Among them, the actions, terms, etc. involved in the embodiments of the present application can be referenced to each other without limitation.

[0059] Figure 4 A control method provided in an embodiment of the present application, such as Figure 4 As shown, the method may include:

[0060] S401: The electronic device displays a first interface.

[0061] The first interface may be used to display preset operation instructions. For example, the first interface may be a text input application interface, a multimedia application interface, etc.

[0062] In one example, the electronic device may display the first interface in response to a click operation, or may display the first interface in response to input device trigger information. The click operation may refer to an operation in which a user clicks on an application on the main interface of the electronic device, and the trigger information may be used to instruct the application to run and display the first interface. For example, the input device may send trigger information to the electronic device in response to an operation of continuously pressing a finger joint, or an operation in which the duration of pressing a finger joint exceeds a preset duration.

[0063] S402: In response to an operation of contacting a user's finger knuckle, the input device collects feature information of the contacting finger knuckle.

[0064] The operation of contacting the user's finger knuckles may refer to the operation of the finger wearing the input device contacting / pressing the user's finger knuckles. The finger wearing the input device and the pressed finger knuckles may be knuckles on the same hand of the user or knuckles on different hands of the user without limitation.

[0065] In one example, the sensor is an ultrasonic sensor, and the input device can emit ultrasonic waves through the sensor in response to the pressing operation. In this way, the input device can collect the fingerprint features or width of the knuckles of the contacted finger based on the reflected sound waves.

[0066] In another example, the sensor is a fingerprint sensor, and the input device can directly collect fingerprint features of the knuckles of the contacting fingers in response to the contact operation.

[0067] It can be understood that since the input device is a finger cap structure, the input device can move with the movement of the user's fingers, and when the finger wearing the input device contacts the knuckles of other fingers, the feature information of the contacted knuckles of the fingers can be collected.

[0068] S403: The input device sends the characteristic information of the finger joints to the electronic device. Correspondingly, the electronic device receives the characteristic information of the finger joints sent by the input device.

[0069] The input device may directly send the collected characteristic information of the finger joints to the electronic device, or the input device may also send control information indicating the characteristic information of the finger joints to the electronic device. For example, the control information may include an identifier indicating the characteristic information of the finger joints.

[0070] S404: The electronic device executes a preset operation instruction at the first interface according to the characteristic information of the finger joints.

[0071] Among them, the preset operation instructions may include character input instructions and function control instructions.

[0072] In one example, there may be a correspondence between the characteristic information of the finger joints and the preset operation instructions. The correspondence may be pre-configured by the electronic device or constructed for the electronic device (for details, please refer to the following Fig. 9 Description of the embodiment shown). After receiving the characteristic information of the finger joints collected from the input device, the electronic device can determine the operation instruction of the characteristic information of the finger joints according to the corresponding relationship, and execute the operation instruction on the first interface. Among them, the operation instruction corresponding to the finger joints can be set as needed, for example, executing the text input operation instruction on the text input application interface. For another example, on the multimedia application interface, execute the function control operation instruction.

[0073] In the embodiment of the present application, the characteristic information of a finger joint may correspond to one or more operation instructions, or the combination of the characteristic information of multiple finger joints may correspond to one operation instruction. For example, the combination of the characteristic information of multiple finger joints may realize a preset function. The preset function may be set as needed, for example, the characteristic information of multiple finger joints may be used to perform encryption and decryption functions. Among them, the characteristic information of multiple finger joints may constitute an encryption password and / or a decryption password.

[0074] In one application scenario, the first interface is a text input application interface. For example, the text input application interface may be an interface of a first application. The first application may be an instant messaging application, a short video application, or a document application. The first interface may be a chat interface of an instant messaging application, an evaluation input interface of a short video application, or a text input interface of a document application. The characteristic information of the finger knuckles corresponds to a text input operation of at least one character key position among the multiple character key positions.

[0075] The plurality of character keys may include letter keys a to z, number keys, and punctuation keys. In this way, the electronic device can perform text input operations on the text input application interface according to the characteristic information of the finger joints.

[0076] In one example, the text input control has 9 keys, such as Figure 5 As shown, a correspondence between characteristic information of finger joints and character key positions provided in an embodiment of the present application is provided. Figure 5 In the , a finger joint corresponds to a character key. For example, the middle joint of the index finger corresponds to the character key ABC, and the lower joint of the index finger corresponds to the character key DEF. The character keys corresponding to the other finger joints can refer to Figure 5 , I will not elaborate on it.

[0077] Combined with the above Figure 5 The corresponding relationship, such as Figure 6As shown, in response to contact between the middle knuckle of the index finger and the finger wearing the input device, the electronic device can perform a text input operation corresponding to the character key positions ABC displayed on the text input interface.

[0078] In another example, the text input control has 26 keys, such as Figure 7 As shown, a correspondence between characteristic information of finger joints and character key positions provided in an embodiment of the present application is provided. Figure 7 In the example, a finger joint can correspond to one or more character keys. For example, the middle joint of the index finger corresponds to character keys A, B, and C, and the lower joint of the index finger corresponds to character keys D, E, and F.

[0079] Among them, one finger knuckle corresponding to multiple character keys may mean: different parts of the finger knuckle correspond to one character key, or the entire finger knuckle corresponds to multiple character keys (that is, different parts of the finger knuckle correspond to the same character keys).

[0080] In one possible implementation, when different parts on the knuckles of a finger correspond to a character key, the user only needs to slide the finger wearing the input device on a finger knuckle to collect feature information of different parts and trigger the electronic device to execute operation instructions corresponding to the feature information of the part on the text input interface.

[0081] For example, taking the middle knuckle of the index finger corresponding to character key A, character key B, and character key C as an example, as the input device slides or moves on the middle knuckle of the index finger, the feature information of different parts of the middle knuckle of the index finger can be collected, and then the electronic device is triggered to enter the letter of the character key corresponding to the feature information of each part on the text input interface (that is, a, b, c).

[0082] Based on this method, users can switch between character keys by sliding their fingers on the knuckles. At the same time, compared with inputting characters on a virtual keyboard, using finger touch input is more natural and intuitive, simulating the way we operate in real life, so it is easier for users to get started.

[0083] It is understandable that using finger touch input can avoid finger fatigue and discomfort when using the virtual keyboard for a long time, and can also avoid the need to use external devices such as a physical keyboard or mouse during operation.

[0084] In the case where an entire finger knuckle corresponds to multiple character keys, in order to achieve recognition of different character keys, the multiple character keys corresponding to the same finger knuckle may correspond to different contact pressures or contact durations.

[0085] For example, the middle knuckle of the index finger corresponds to character key position A, character key position B, and character key position B. The contact duration corresponding to character key position A is the first contact duration, the contact duration corresponding to character key position B is the second contact duration, and the contact duration corresponding to character key position C is the third contact duration. The first contact duration, the second contact duration, and the third contact duration are different. For example, the first contact duration is less than the second contact duration, and the second contact duration is less than the third contact duration.

[0086] In this way, the electronic device can display the corresponding character on the text input interface based on the contact time between the input device and the middle knuckle of the index finger. Similarly, the electronic device can also display the corresponding character on the text input interface based on the pressure value of the middle knuckle of the index finger on the input device. That is, the electronic device can output different characters based on the different pressing time or pressing force of the user.

[0087] In another example, the characteristic information of the finger joints may also correspond to a control key. The control key may be one or more of a switch key, a space key, an enter key, and a delete key. The switch key may be an input method switch key (such as Chinese-English switch, uppercase-lowercase switch, etc.).

[0088] Wherein, in the case where the characteristic information of the finger joint corresponds to the switch key position, the electronic device can implement the function of the switch key position in response to the input device continuously pressing / touching the finger joint corresponding to the switch key position. For example, in the case where the switch key position is an uppercase character, the letters corresponding to the above character key position are uppercase letters, and the electronic device can respond to the input device pressing / touching the switch key position, and the letters corresponding to the above character key position are corresponding lowercase letters.

[0089] Furthermore, the electronic device can also perform a preset operation on the characters on the text application input interface in response to the movement of the input device, and the preset operation may include one or more of deletion, copying, and selection. For example, during the process of performing text input on the text application input interface, the electronic device can perform a selection operation on the text / characters on the text application input interface in response to the operation of the input device pressing the finger joint for a time period exceeding a preset time period, and the length of the selected text is proportional to the movement distance / time of the input device on the finger.

[0090] After selecting the text, the electronic device can display controls such as copy and delete on the text input interface. Based on the movement distance of the input device, the electronic device can execute the function of the control that matches the movement distance. Of course, after copying the text, the electronic device can also respond to the operation of long pressing the finger knuckle of the input device to paste the copied text on the text input application interface.

[0091] For example, a cursor is displayed on the text application input interface, and the position of the cursor is the position of the next character input. In response to the input device pressing the finger joint for a period of time exceeding the preset time, the cursor can use the current position as the starting point of text copying, and based on the displacement of the input device, select the text content in the area corresponding to the displacement on the text input interface. When the input device stops moving, the cursor also stops moving, and the position where it stops moving is used as the focus of text copying. In this way, the electronic device can select the text content to be operated on the text application interface based on the movement of the input device.

[0092] After acquiring the text content to be operated, the electronic device can display controls such as copy and delete on the text input interface. The electronic device can determine the control that matches the moving distance of the input device in response to the continued distance of the input device, and perform the operation corresponding to the control (such as copy) on the selected text content when the input device stops moving.

[0093] Based on this method, users can use finger touch input to input various characters more flexibly. At the same time, they can also perform various input operations such as selection, deletion, copying, etc. by moving their fingers, thereby improving the efficiency of character input.

[0094] In another application scenario, the first interface is a multimedia application interface. For example, the first interface may be a multimedia playback interface. The multimedia playback interface may be provided with a plurality of function keys. For example, the function keys may include a volume control key, a playback control key, a switch key, etc. Different finger joints may correspond to different function keys. That is, the electronic device may respond to the input device touching different finger joints, and may perform an operation on the multimedia application interface in which a function key corresponding to the characteristic information of the finger joints is triggered.

[0095] For example, Figure 8 As shown, the index finger corresponds to the volume control button, the volume control button corresponding to the middle knuckle of the index finger has the function of increasing the volume of multimedia data (such as audio data, video data, etc.) (such as volume key +), and the volume control button corresponding to the lower knuckle of the index finger can reduce the multimedia volume (such as volume key -).

[0096] Similarly, the playback progress control button corresponding to the middle finger, the function of the playback control button corresponding to the middle joint of the middle finger is to rewind the playback progress, and the function of the playback control button corresponding to the lower joint of the middle finger is to fast forward the playback progress.

[0097] The ring finger corresponds to the brightness control button. The function of the control button corresponding to the upper knuckle of the ring finger is to reduce the brightness, and the function of the control button corresponding to the middle knuckle of the ring finger is to increase the brightness.

[0098] The pinky finger corresponds to the play control button. For example, the upper knuckle of the pinky finger corresponds to the control button for pausing / resuming multimedia data playback, the middle knuckle corresponds to the control button for playing the next episode (or the next one), and the lower knuckle of the ring finger corresponds to the control button for playing the previous episode (or the next one).

[0099] In one application scenario, when a user uses an electronic device to watch a video, in response to the user pressing the middle knuckle of the index finger using an input device, the input device sends characteristic information of the middle knuckle of the index finger to the electronic device. After receiving the characteristic information of the middle knuckle of the index finger from the input device, the electronic device can increase the playback volume of the video.

[0100] In another application scenario, when a user uses an electronic device to watch a video, in order to fast forward the currently playing video, in response to the user pressing the lower knuckle of the middle finger using the input device, the input device sends feature information of the lower knuckle of the middle finger to the electronic device. After receiving the feature information of the lower knuckle of the middle finger from the input device, the electronic device can fast forward the currently playing video.

[0101] Furthermore, the electronic device can control the volume of the playback and the progress of the multimedia data playback based on the duration of pressing the input device and the finger knuckles. For example, the longer the input device presses the middle finger knuckle of the index finger, the louder the playback volume of the multimedia data. For another example, the longer the input device presses the middle finger knuckle of the middle finger, the longer the rewind duration of the multimedia data, until the input device stops pressing the finger knuckles.

[0102] based on Figure 8 According to the corresponding relationship shown, the electronic device can respond to the input device contacting / pressing different finger joints to execute the operation of the function key corresponding to the characteristic information of the finger joints on the multimedia application interface. For example, when the input device contacts the middle joint of the index finger, the electronic device can increase the volume of the multimedia data.

[0103] In another application scenario, the first interface is a text display interface, and the text on the text display interface cannot be edited. For example, the text display interface is a novel interface, a news content display interface, etc. The function of the function button corresponding to the characteristic information of the finger joints may include a page turning function, a page adjustment function (such as zooming in on a page, zooming out on a page, etc.).

[0104] In one example, the electronic device can perform page turning and page adjustment functions according to the movement of the input device on different finger joints.

[0105] For example, the input device moves from the middle knuckle of the index finger to the lower knuckle of the index finger, and the input device continuously sends characteristic information of the middle knuckle of the index finger and characteristic information of the lower knuckle of the index finger to the electronic device. The electronic device can determine that the input device moves from the middle knuckle of the index finger to the lower knuckle according to the sequence of the characteristic information of the middle knuckle of the index finger and the characteristic information of the lower knuckle sent by the input device. In this case, the electronic device can display the next page of the current page, or enlarge the currently displayed page.

[0106] For another example, the input device moves from the lower knuckle of the index finger to the middle knuckle of the index finger, and the input device continuously sends characteristic information of the lower knuckle of the index finger and characteristic information of the middle knuckle of the index finger to the electronic device. The electronic device can determine that the input device moves from the lower knuckle of the index finger to the middle knuckle according to the sequence of the characteristic information of the lower knuckle of the index finger and the characteristic information of the middle knuckle of the index finger sent by the input device. In this case, the electronic device can display the content of the previous page of the current page, or reduce the currently displayed page.

[0107] Based on the technical solution provided by the embodiment of the present application, since the input device is worn on the user's finger, the input device can respond to the contact between the finger and other finger joints to collect the characteristic information of the contacted finger joints. The electronic device can respond to the characteristic information of the finger joints collected by the input device and execute the preset operation instructions corresponding to the characteristic information of the finger joints on the first interface. That is, the user can control the operation of the electronic device through the contact between the finger joints, without directly contacting the electronic device, which improves the user experience.

[0108] In addition, since the input device can be worn on the finger and occupies less space, the space occupied by the input device on the electronic device can be greatly reduced, while also reducing the cost of the input device and improving the portability and applicability of the device.

[0109] In some embodiments, in order to facilitate the electronic device to determine the preset operation instruction corresponding to the characteristic information of the finger joint, such as Fig. 9 As shown, the method provided in the embodiment of the present application may also include S901 to S903.

[0110] S901. An input device collects feature information of multiple finger joints of a user.

[0111] The plurality of finger joints may be finger joints on the user's hand that establish a corresponding relationship with the key positions and function keys, and the finger joints may be pre-set or determined based on the user's selection.

[0112] In a possible implementation, after establishing a communication connection with the input device, the electronic device may output prompt information for prompting the user to collect characteristic information of the user's finger joints. For example, the electronic device may display the prompt information on a display, or input the prompt information in the form of language playback. Based on the prompt information, the user may use the input device to collect characteristic information of the user's finger joints.

[0113] In one example, the prompt information may include a preset finger joint whose characteristic information needs to be collected. Based on the prompt information, the user uses an input device to collect the characteristic information of the preset finger joint included in the prompt information.

[0114] For example, an electronic device may display Fig.10 The interface shown in the figure shows the finger joints for which feature information needs to be collected and the collection order of each finger joint. In this way, the user can use the input device to collect feature information of the finger joints in sequence according to the collection order.

[0115] For another example, the prompt information may include the key position for which a corresponding relationship needs to be established. Based on the prompt information, the user can select the finger joint corresponding to the key position as needed.

[0116] In a possible implementation, the input device may collect acoustic feature data of different finger joints and fingerprint features. For example, the input device may send ultrasonic waves to the finger joints and obtain the acoustic feature data of the finger joints based on the sound waves reflected by the finger joints.

[0117] In one example, in order to ensure normal communication between the electronic device and the input device, the electronic device may establish a communication connection with the input device when the input device meets a preset condition.

[0118] For example, the preset condition includes at least one of the following: the distance between the input device and the electronic device is less than a preset distance, the signal strength of the input device is greater than a preset value, and the electronic device receives control information from the input device.

[0119] The preset distance and the preset value can be set as needed. The control information is used to indicate that the input device is used for control. For example, the input device can be used to indicate that the input device controls the character output of the electronic device, or controls the playback of multimedia data of the electronic device.

[0120] S902: The input device sends the collected feature information of the multiple finger joints to the electronic device. Correspondingly, the electronic device receives the feature information of the multiple finger joints collected from the input device.

[0121] In one example, after the input device completes the collection of one finger joint, it can send the collected feature information of the finger joint to the electronic device. In this way, the input device can collect and transmit the feature information of multiple finger joints through multiple information interactions with the electronic device.

[0122] In another example, the input device can store the collected feature information of the finger joints in the process of collecting the feature information of each finger joint in sequence according to the collection order. After the feature information of multiple finger joints is completed, the stored feature information of the finger joints is sent to the electronic device. In this way, the input device can send the collected feature information of multiple finger joints to the electronic device at one time.

[0123] In this example, the input device can mark each collected feature information, and the mark can be used to indicate the collection order of the finger joints. In this way, after receiving the feature information of multiple finger joints from the input collection, the electronic device can compare the mark of the feature information with the collection order in the prompt information to distinguish the feature information of each finger joint.

[0124] S903: The electronic device establishes a correspondence between key positions and finger joints according to the feature information of the multiple finger joints collected by the input device.

[0125] In one example, the first interface is a text input application interface, the key positions are character key positions, and one character key position corresponds to multiple characters. Fig.10 The electronic device can establish a prompt message such as Figure 5 The corresponding relationship shown.

[0126] In a possible implementation, the electronic device may also use a preset algorithm to train the collected feature information of multiple finger joints to obtain a model with feature information for identifying finger joints.

[0127] For example, in order to improve the recognition accuracy, the input device can collect feature information of the same finger joint for multiple times. Since the feature information of the finger joints collected each time is different, the electronic device can train or integrate the feature information of each finger joint to obtain the feature information of the finger joint. Then, a correspondence between the feature information of the finger joints and the character key positions of the virtual keyboard is established.

[0128] Based on the above model, when the electronic device performs text input operations, after receiving the feature information of the finger joints from the input device, the electronic device can identify the key positions corresponding to the finger joints that are touched / pressed by the input device based on the model, and then execute the preset operation instructions corresponding to the key positions.

[0129] For example, the electronic device may send the key position recognition result to a currently running application or operating system, so that the application or operating system outputs corresponding text characters according to the key position recognition result.

[0130] based on Fig. 9 According to the technical solution, after establishing a communication connection with an input device, the electronic device can output prompt information for prompting to collect characteristic information of multiple finger joints. The user can collect and send characteristic information of multiple finger joints to the electronic device according to the prompt information. Based on the characteristic information of the multiple finger joints, the electronic device can accurately establish the correspondence between the finger joints and the key positions.

[0131] The method provided in the embodiment of the present application is described below in conjunction with specific application scenarios.

[0132] like Fig.11 As shown in a in , the electronic device displays a main interface. Multiple applications are displayed on the main interface. In response to the movement of the input device on different finger joints, the input device can send the collected feature information of multiple finger joints to the electronic device. After receiving the feature information of multiple finger joints, the electronic device can determine the order in which the input device presses / contacts the finger joints according to the feature information of the multiple finger joints. Based on the order, the electronic device can select a target application from multiple applications and run the target application.

[0133] For example, Fig.11 As shown in a in the figure, the input device moves from the middle knuckle of the middle finger to the middle knuckle of the index finger, and the application selected by the electronic device can be switched from application 1 to application 2. In this way, based on the movement of the input device on different finger knuckles, the electronic device can switch between different applications until the input device stops moving for a period of time exceeding a preset period. At this time, the electronic device can run the application selected at this moment and display the application interface of the application.

[0134] Taking the target application as an instant messaging application as an example, when the electronic device is running the target application, based on the movement of the input device on the finger, the display is as follows: Fig.11 The text input interface shown in b in FIG. The input device is moved on the finger to select the target chat object. Specifically, the selection process of the above application can be referred to.

[0135] The input device continuously sends characteristic information of multiple finger joints to the electronic device in response to the movement on different finger joints. The electronic device can send characteristic information of multiple finger joints to the electronic device according to the characteristic information of the finger joints collected by the input device. Fig.11 Enter the text content on the text input interface shown in b in the figure, and get the following Fig.11For details, please refer to the description in the above embodiment and will not be described in detail.

[0136] After a preset period of time, if the electronic device does not receive the characteristic information of the finger joints sent from the input device, the electronic device can stop text input.

[0137] Furthermore, after the electronic device receives the characteristic information of the finger joints sent from the input device, the electronic device can continue to input text on the text input interface.

[0138] In another application scenario, in a scenario where the electronic device supports fingerprint unlocking, when the electronic device is in a locked screen state, the input device can collect fingerprint features of the contacted finger joints based on the user's movement, and send the collected fingerprint features of the finger joints to the electronic device. The electronic device receives the fingerprint features from the input device. When the received fingerprint features are consistent with the fingerprint features used to release the locked screen state, the electronic device can display the main interface. Subsequently, the electronic device can execute corresponding operation instructions based on the feature information of the finger joints collected by the input device.

[0139] The various solutions in the above embodiments of the present application can be combined without contradiction.

[0140] It is understandable that, in order to realize the above functions, the control device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in conjunction with the algorithm steps of each example described in the embodiments of the present application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0141] The embodiment of the present application can divide the functional modules of the control device according to the above method embodiment. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one functional module. The above integrated module can be implemented in the form of hardware or software. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. The following is an example of dividing each functional module corresponding to each function.

[0142] Fig.12is a schematic diagram of the structure of a control device provided in an embodiment of the present application, and the control device can execute the functions of the electronic device provided in the above method embodiment. Fig.12 As shown, the control device includes:

[0143] The display unit 1201 is used to display the first interface.

[0144] The receiving unit 1202 is used to receive the feature information of the finger joints collected by the input device.

[0145] The processing unit 1203 is used to execute preset operation instructions according to the characteristic information of the finger joints on the first interface.

[0146] In one example, the characteristic information of the finger joints includes at least one of the following: fingerprint characteristics of the finger joints, the width of the finger joints, or the pressure value of the finger joints on the input device.

[0147] In one example, the first interface is a text input application interface, and the characteristic information of the finger joints corresponds to a text input operation of at least one character key position among multiple character keys. The processing unit 1203 is specifically configured to perform a text input operation in the text input application interface according to the characteristic information of the finger joints.

[0148] In one example, the plurality of character key positions include: letter key positions a to z, number key positions, and punctuation mark key positions.

[0149] In one example, in the text input application interface, the text control operation of at least one control key in the plurality of control keys is performed according to the characteristic information of the finger joints. The processing unit 1203 is specifically configured to: in the text input application interface, perform the text control operation according to the characteristic information of the finger joints.

[0150] In one example, the plurality of control keys include a text delete key, an enter key, a space key, and a switch key.

[0151] In one example, the first interface is a multimedia application interface, and characteristic information of different finger joints corresponds to different function keys of the multimedia application. The processing unit 1203 is specifically used to: in the multimedia application interface, execute the operation triggered by the function key corresponding to the characteristic information of the finger joints.

[0152] In one example, Fig.12 As shown, the control device also includes: an establishing unit 1204, which is used to establish a communication connection with the input device when the input device meets a preset condition. The preset condition includes at least one of the following: the distance between the input device and the electronic device is less than a preset distance, the signal strength of the input device is greater than a preset value, or control information from the input device is received, wherein the control information is used to indicate that the input device is controlled.

[0153] In one example, the control configuration parameters of the electronic device indicate that the electronic device supports keyboard control input and supports finger joint-based control input.

[0154] In one example, the finger on which the input device is worn and the finger knuckle are located on the same hand of the user.

[0155] Fig.13 is a schematic diagram of the structure of a control device provided in an embodiment of the present application, and the control device can perform the functions of the input device provided in the above method embodiment. Fig.13 As shown, the device comprises:

[0156] The collecting unit 1301 is used for collecting feature information of the contacted finger knuckles in response to the operation of contacting the user's finger knuckles.

[0157] The sending unit 1302 is used to send characteristic information of the finger joints to the electronic device, where the characteristic information of the finger joints is used to instruct the electronic device to execute a preset operation instruction on the first interface.

[0158] In one example, the characteristic information of the finger joints includes at least one of the following: fingerprint characteristics of the finger joints, the width of the finger joints, or the pressure value of the finger joints on the input device.

[0159] In one example, the first interface is a text input application interface, the characteristic information of the finger joints corresponds to the text input operation of at least one character key among multiple character keys, and the preset operation instruction is to perform the text input operation of the character key corresponding to the characteristic information of the finger joints on the text input application interface.

[0160] In one example, the plurality of character key positions include letter key positions a to z, number key positions, and punctuation mark key positions.

[0161] In one example, the first interface is a multimedia application interface, characteristic information of different finger joints corresponds to different function keys of the multimedia application, and the preset operation instruction is to execute the operation on the multimedia application interface when the function key corresponding to the characteristic information of the finger joints is triggered.

[0162] In the case of implementing the functions of the above-mentioned integrated modules in the form of hardware, the embodiment of the present application provides another possible structure of the control device involved in the above-mentioned embodiment. Fig.14 As shown, the control device 140 includes: a processor 1402 and a bus 1404. Optionally, the control device may also include a memory 1401. Optionally, the control device may also include a communication interface 1403.

[0163] Processor 1402 may be a processor that implements or executes various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of the present application. The processor 1402 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the embodiments of the present application. Processor 1402 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0164] The communication interface 1403 is used to connect with other devices via a communication network, such as Ethernet, wireless access network, wireless local area network (WLAN), etc.

[0165] The memory 1401 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.

[0166] As a possible implementation, the memory 1401 may exist independently of the processor 1402, and the memory 1401 may be connected to the processor 1402 via a bus 1404 to store instructions or program codes. When the processor 1402 calls and executes the instructions or program codes stored in the memory 1401, the method for determining the data sequence provided in the embodiment of the present application can be implemented.

[0167] In another possible implementation, the memory 1401 may also be integrated with the processor 1402 .

[0168] The bus 1404 may be an extended industry standard architecture (EISA) bus, etc. The bus 1404 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.14 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0169] Some embodiments of the present application provide a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium), which stores computer program instructions. When the computer program instructions are executed on a computer, the computer executes the method for determining a data sequence as described in any of the above embodiments.

[0170] Exemplarily, the above-mentioned computer-readable storage media may include, but are not limited to: magnetic storage devices (e.g., hard disks, floppy disks or magnetic tapes, etc.), optical disks (e.g., compact disks (CD), digital versatile disks (DVD), etc.), smart cards and flash memory devices (e.g., erasable programmable read-only memory (EPROM), cards, sticks or key drives, etc.). The various computer-readable storage media described in this application may represent one or more devices and / or other machine-readable storage media for storing information. The term "machine-readable storage medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing and / or carrying instructions and / or data.

[0171] An embodiment of the present application provides a computer program product comprising instructions. When the computer program product is run on a computer, the computer is enabled to execute the method for determining a data sequence described in any of the above embodiments.

[0172] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A control method, characterized in that: The method comprises: Display the first interface; Receiving characteristic information of finger joints collected by an input device; In the first interface, a preset operation instruction is executed according to the characteristic information of the finger joints.

2. The method according to claim 1, characterized in that The characteristic information of the finger joints includes at least one of the following: Fingerprint features of the knuckles of the fingers; the width of the knuckles of the fingers; or The pressure value of the finger knuckle on the input device.

3. The method according to claim 1 or 2, characterized in that: The first interface is a text input application interface, and the characteristic information of the finger joints corresponds to a text input operation of at least one character key position among a plurality of character key positions; The step of executing a preset operation instruction according to the characteristic information of the finger joints on the first interface includes: In the text input application interface, a text input operation is performed according to the feature information of the finger joints.

4. The method according to claim 3, characterized in that The multiple character key positions include: letter key positions a to z, number key positions, and punctuation mark key positions.

5. The method according to claim 3, characterized in that: In the text input application interface, a text control operation of at least one control key among a plurality of control keys corresponding to the characteristic information of the finger joints; The step of executing a preset operation instruction according to the characteristic information of the finger joints on the first interface includes: In the text input application interface, a text control operation is performed according to the characteristic information of the finger joints.

6. The method according to claim 5, characterized in that The multiple control keys include a text delete key, an enter key, a space key, and a switch key.

7. The method according to claim 1 or 2, characterized in that: The first interface is a multimedia application interface, and the characteristic information of different finger joints corresponds to different function keys of the multimedia application; The step of executing a preset operation instruction according to the characteristic information of the finger joints on the first interface includes: In the multimedia application interface, an operation is executed when a function key corresponding to the characteristic information of the finger joint is triggered.

8. The method according to claim 1 or 2, characterized in that: The method further comprises: When the input device satisfies a preset condition, a communication connection with the input device is established; the preset condition includes at least one of the following: The distance between the input device and the electronic device is less than a preset distance; The signal strength of the input device is greater than a preset value; or, Control information is received from the input device, wherein the control information is used to indicate control by the input device.

9. The method according to claim 1 or 2, characterized in that: The method is executed by an electronic device, and a control configuration parameter of the electronic device indicates that the electronic device supports keyboard control input and supports control input based on the finger joints.

10. The method according to claim 1 or 2, characterized in that: The finger on which the input device is worn and the finger knuckle are located on the same hand of the user.

11. A control method, characterized in that: The method comprises: In response to an operation of contacting a user's finger knuckle, collecting feature information of the contacted finger knuckle; The characteristic information of the finger joints is sent to the electronic device, where the characteristic information of the finger joints is used to instruct the electronic device to execute a preset operation instruction on the first interface.

12. The method according to claim 11, characterized in that The characteristic information of the finger joints includes at least one of the following: Fingerprint features of the knuckles of the fingers; the width of the knuckles of the fingers; or The pressure value of the finger knuckle on the input device.

13. The method according to claim 11 or 12, characterized in that: The first interface is a text input application interface, the characteristic information of the finger joints corresponds to a text input operation of at least one character key among multiple character keys, and the preset operation instruction is to perform a text input operation of the character key corresponding to the characteristic information of the finger joints on the text input application interface.

14. The method according to claim 13, characterized in that The multiple character key positions include letter key positions a to z, number key positions, and punctuation mark key positions.

15. The method according to claim 11 or 12, characterized in that: The first interface is a multimedia application interface, and characteristic information of different finger joints corresponds to different function keys of the multimedia application. The preset operation instruction is an operation executed on the multimedia application interface when the function key corresponding to the characteristic information of the finger joints is triggered.

16. A control system, characterized in that: The control system includes an input device and an electronic device, wherein the input device is worn on a user's finger; The input device is used to execute the method according to any one of claims 11 to 15, and the electronic device is used to execute the method according to any one of claims 1 to 10.

17. An electronic device, characterized in that: The electronic device comprises a processor and a communication interface, and the processor and the communication interface support the electronic device to execute the method according to any one of claims 1-10.

18. An input device, characterized in that: The input device is a finger cap structure, and is provided with a sensor, a processor, and a communication interface, wherein the sensor is located at a position on the input device corresponding to the finger pulp or fingertip of the user; The sensor is used to collect characteristic information of the user's finger joints; The processor is used to send characteristic information of the finger joints to the electronic device through the communication interface, and the characteristic information is used for the electronic device to execute preset operation instructions on the first interface.

19. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises computer program instructions; wherein, when the computer program instructions are executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 15.

Images