Somatosensory operating system and method, and device and storage medium
By integrating human communication functions in smart devices and using human communication signals to identify user gestures, the problem of small screen of smart devices causing finger obstruction is solved, and a better human-computer interaction experience is achieved.
Patent Information
- Application Number
- PCT/CN2024/081225
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-15
- Filing Date
- 2024-03-12
- Publication Date
- 2025-02-20
AI Technical Summary
Because smart devices such as smart watches and smart bracelets have a small screen, when using fingers to touch the screen, the area where the fingers block the screen occupies a large area, resulting in the content displayed on the screen being blocked, affecting the user experience.
By integrating the human body communication function in the first electronic device and the second electronic device, using capacitively coupled and current-coupled human body communication signals, the waveform and pre-recording of the received signal intensity change without contacting the screen of the electronic device can be realized by recording the waveform and pre-recording of the received signal intensity without contacting the screen of the electronic device. Set waveform matching, determine the user's operation gestures and execute corresponding control instructions.
It realizes gesture operation without obstructing the screen, improves the user experience of human-computer interaction, and is especially suitable for smart devices with smaller screens.
Smart Images

Figure CN2024081225_20022025_PF_FP_ABST
Abstract
Description
Somatosensory operating system, method, device and storage medium
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on August 15, 2023, with application number 202311029227.4 and invention name “Body sensing operating system, method, device and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of human body communication technology, and in particular to a somatosensory operating system, method, device and storage medium. Background Art
[0003] Gesture operation is now one of the common operating methods of smart devices. For electronic devices with touch screens, touch operations can be performed by gestures such as clicking and sliding on the screen, thereby achieving human-computer interaction.
[0004] However, for electronic devices with smaller screens, such as smart watches and smart bracelets, when using fingers for touch operations, the area of the screen blocked by the fingers occupies a larger area of the screen, resulting in the content displayed on the screen being blocked, affecting the user experience.
[0005] Summary of the Invention
[0006] In order to solve the above technical problems, the present application provides a somatosensory operating system, method, device and storage medium, which aims to realize simple gesture operations such as clicking and sliding based on human body communication technology without contacting the screen of the electronic device, thereby improving the human-computer interaction experience.
[0007] In the first aspect, the present application provides a somatosensory operating system. The system includes: a first electronic device and a second electronic device, wherein the first electronic device and the second electronic device have human body communication modes turned on; the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently turned-on human body communication mode; the first electronic device is used to receive the human body communication signal transmitted by the second electronic device, and record the received signal strength corresponding to the human body communication signal received at each moment to obtain a received signal strength change waveform; the first electronic device is used to determine the target operation gesture corresponding to the received signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture when the received signal strength change waveform matches any preset change waveform in the preset change waveform; the first electronic device is used to execute the control instruction corresponding to the target operation gesture.
[0008] The first electronic device is a controlled terminal, that is, a device that needs to respond to the operation gesture, such as device A, device C, and device D in the following embodiments.
[0009] The second electronic device is a control terminal, that is, a device worn on the user and used to transmit human body communication signals, such as the device B mentioned in the following embodiment.
[0010] The second electronic device for transmitting the human body communication signal may transmit the human body communication signal periodically, or may transmit the human body communication signal continuously after turning on the human body communication mode.
[0011] The received signal strength waveform is used to reflect how the received signal strength of the received human body communication signal changes over time.
[0012] Therefore, by integrating the human body communication function into the first electronic device and the second electronic device, when the human body communication mode is turned on for both the first electronic device and the second electronic device, the second electronic device as the signal sending end is set to continuously or periodically transmit the human body communication signal, and the first electronic device as the signal receiving end records the received signal strength received at each moment, thereby obtaining a received signal strength change waveform. Finally, by matching the obtained received signal change waveform with a pre-stored preset change waveform, the user's current operation gesture can be determined, and then simple gesture operations such as clicking and sliding on the first electronic device or the second electronic device can be realized without contacting the screen of the first electronic device or the second electronic device, thereby improving the human-computer interaction experience.
[0013] According to the first aspect, the human body communication mode includes a capacitive coupling human body communication mode and a current coupling human body communication mode; wherein, when the type of the human body communication mode currently turned on by the second electronic device is the capacitive coupling human body communication mode, the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: the second electronic device is used to transmit a capacitive coupling human body communication signal to the first electronic device; wherein the first electronic device is used to receive the human body communication signal transmitted by the second electronic device, and record the received signal strength corresponding to the human body communication signal received at each moment, and obtain a received signal strength change waveform, including: the first electronic device is used to receive the capacitive coupling human body communication signal transmitted by the second electronic device, and record the capacitive receiving signal strength corresponding to the capacitive coupling human body communication signal received at each moment Signal strength, obtaining a waveform of a change in capacitance received signal strength; wherein, when the type of human body communication mode currently turned on by the second electronic device is a current-coupled human body communication mode, the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of human body communication mode currently turned on, including: the second electronic device is used to transmit a current-coupled human body communication signal to the first electronic device; wherein, the first electronic device is used to receive the human body communication signal transmitted by the second electronic device, and record the received signal strength corresponding to the human body communication signal received at each moment, to obtain a waveform of a change in received signal strength, including: the first electronic device is used to receive the current-coupled human body communication signal transmitted by the second electronic device, and record the current received signal strength corresponding to the current-coupled human body communication signal received at each moment, to obtain a waveform of a change in current received signal strength.
[0014] According to the first aspect, or any implementation of the first aspect above, a second somatosensory operation device is integrated in the second electronic device, and the second somatosensory operation device includes a human body communication transmitting circuit for transmitting a human body communication signal, and the human body communication transmitting circuit includes a capacitive coupling human body communication transmitting circuit and a current coupling human body communication transmitting circuit; wherein, the second electronic device is used to transmit the capacitive coupling human body communication signal to the first electronic device, including: the second electronic device turns on the capacitive coupling human body communication transmitting circuit and turns off the current coupling human body communication transmitting circuit; the second electronic device is used to transmit the capacitive coupling human body communication signal to the first electronic device through the capacitive coupling human body communication transmitting circuit; wherein, the second electronic device is used to transmit the current coupling human body communication signal to the first electronic device, including: the second electronic device is used to turn on the current coupling human body communication transmitting circuit and turns off the capacitive coupling human body communication transmitting circuit; the second electronic device is used to transmit the current coupling human body communication signal to the first electronic device through the current coupling human body communication transmitting circuit.
[0015] According to the first aspect, or any implementation of the first aspect above, the second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling human body communication composite module, the current / capacitive coupling human body communication composite module includes a human body communication module, a circuit switching switch, a voltage-driven amplifier and a current-driven amplifier; wherein the second electronic device is used to turn on the capacitive coupling human body communication transmitting circuit and disconnect the current coupling human body communication transmitting circuit, including: the second electronic device is used to turn on the connection between the human body communication module and the voltage-driven amplifier through the circuit switching switch, and disconnect the connection between the human body communication module and the current-driven amplifier; the second electronic device is used to connect the first port of the voltage-driven amplifier to the first port of the current / capacitive coupling human body communication composite module, The second port of the voltage-driven amplifier is connected to the second port of the current / capacitive coupling type human body communication composite module; the second electronic device is used to disconnect the connection between the first port of the current-driven amplifier and the third port of the current / capacitive coupling type human body communication composite module, and the connection between the second port of the current-driven amplifier and the fourth port of the current / capacitive coupling type human body communication composite module; the second electronic device is used to, through the electrode switching module, conduct the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, conduct the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnect the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnect the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode.
[0016] According to the first aspect, or any implementation of the first aspect above, the second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling human body communication composite module, the current / capacitive coupling human body communication composite module includes a human body communication module, a circuit switching switch, a voltage-driven amplifier and a current-driven amplifier; wherein the second electronic device is used to turn on the current-coupled human body communication transmitting circuit and disconnect the capacitive coupling human body communication transmitting circuit, including: the second electronic device is used to turn on the connection between the human body communication module and the current-driven amplifier through the circuit switching switch, and disconnect the connection between the human body communication module and the voltage-driven amplifier; the second electronic device is used to connect the first port of the current-driven amplifier to the third port of the current / capacitive coupling human body communication composite module, The second port of the current-driven amplifier is connected to the fourth port of the current / capacitive coupling human body communication composite module; the second electronic device is used to disconnect the first port of the voltage-driven amplifier from the first port of the current / capacitive coupling human body communication composite module, and the second port of the voltage-driven amplifier from the second port of the current / capacitive coupling human body communication composite module; the second electronic device is used to, through the electrode switching module, conduct the connection between the third port of the current / capacitive coupling human body communication composite module and the second electrode, conduct the connection between the fourth port of the current / capacitive coupling human body communication composite module and the third electrode, disconnect the connection between the first port of the current / capacitive coupling human body communication composite module and the first electrode, and disconnect the connection between the second port of the current / capacitive coupling human body communication composite module and the second electrode.
[0017] According to the first aspect, or any implementation of the first aspect above, a first somatosensory operation device is integrated in the first electronic device, and the first somatosensory operation device includes a human body communication receiving circuit for receiving human body communication signals, and the human body communication receiving circuit includes a capacitive coupling human body communication receiving circuit and a current coupling human body communication receiving circuit; wherein, the first electronic device is used to receive the capacitive coupling human body communication signal transmitted by the second electronic device, including: the first electronic device is used to turn on the capacitive coupling human body communication receiving circuit and disconnect the current coupling human body communication receiving circuit; the first electronic device is used to receive the capacitive coupling human body communication signal transmitted by the second electronic device through the capacitive coupling human body communication receiving circuit; wherein, the first electronic device is used to receive the current coupling human body communication signal transmitted by the second electronic device, including: the first electronic device is used to turn on the current coupling human body communication receiving circuit and disconnect the capacitive coupling human body communication receiving circuit; the first electronic device is used to receive the current coupling human body communication signal transmitted by the second electronic device through the current coupling human body communication receiving circuit.
[0018] According to the first aspect, or any implementation method of the above first aspect, the first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module and the receiving circuit are connected; wherein, the first electronic device is used to turn on the capacitive coupling type human body communication receiving circuit and disconnect the current coupling type human body communication receiving circuit, including: the first electronic device is used to connect the first port of the receiving circuit to the first port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit is connected to the second port of the current / capacitive coupling type human body communication composite module; the first electronic device is used to turn on the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode through the electrode switching module, turn on the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnect the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnect the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode.
[0019] According to the first aspect, or any implementation method of the above first aspect, the first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module and the receiving circuit are connected; wherein, the first electronic device is used to turn on the current coupling type human body communication receiving circuit and disconnect the capacitive coupling type human body communication receiving circuit, including: the first electronic device is used to connect the first port of the receiving circuit to the third port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit is connected to the fourth port of the current / capacitive coupling type human body communication composite module; the first electronic device is used to turn on the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode through the electrode switching module, turn on the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnect the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnect the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode.
[0020] According to the first aspect, or any implementation method of the first aspect above, the first electronic device and the second electronic device are both in the first state; the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: when the type of the human body communication mode currently turned on by the second electronic device is a capacitive coupling human body communication mode, the second electronic device is used to switch the human body communication mode from the capacitive coupling human body communication mode to the current coupling human body communication mode, and transmit a current coupling human body communication signal to the first electronic device; when the type of the human body communication mode currently turned on by the second electronic device is a current coupling human body communication mode, the second electronic device is used to maintain the current coupling human body communication mode and transmit a current coupling human body communication signal to the first electronic device.
[0021] According to the first aspect, or any implementation of the first aspect above, the first state is a wearing state or a holding state; wherein the first electronic device and the second electronic device are both in the first state, including: the first electronic device and the second electronic device are respectively worn or held by different limbs of the user; wherein, when the first electronic device and the second electronic device are respectively worn or held by different limbs of the user, the first electronic device is used to: match the obtained current reception signal strength change waveform with the first preset change waveform in the preset change waveform, the first preset change waveform is the waveform of the current reception signal strength corresponding to the sliding approach operation gesture made in the first scenario with the actual change, the first scenario is the scenario in which the first electronic device and the second electronic device are worn or held by different limbs of the user, and the first electronic device and the second electronic device are in a current-coupled human body communication mode; when the current reception signal strength change waveform matches the first preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, it is determined that the target gesture corresponding to the current reception signal strength change waveform is the sliding approach operation gesture; When the current received signal strength change waveform does not match the first preset change waveform, the current received signal strength change waveform is matched with the second preset change waveform in the preset change waveform, and the second preset change waveform is the waveform of the current received signal strength corresponding to the sliding away operation gesture made in the first scenario with actual change; when the current received signal strength change waveform matches the second preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, it is determined that the target gesture corresponding to the current received signal strength change waveform is the sliding away operation gesture; when the current received signal strength change waveform does not match the second preset change waveform, the current received signal strength change waveform is matched with the third preset change waveform in the preset change waveform, and the third preset change waveform is the waveform of the current received signal strength corresponding to the click operation gesture made in the first scenario with actual change; when the current received signal strength change waveform matches the third preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, it is determined that the target gesture corresponding to the current received signal strength change waveform is the click operation gesture.
[0022] According to the first aspect, or any implementation method of the above first aspect, the first state is a wearing state or a holding state; wherein, the first electronic device and the second electronic device are both in the first state, including: the first electronic device and the second electronic device are respectively worn or held by the same limb of the user; wherein, when the first electronic device and the second electronic device are worn or held by the same limb of the user, the first electronic device is used to: match the obtained current receiving signal strength change waveform with the fourth preset change waveform in the preset change waveform, the fourth preset change waveform is the waveform of the current receiving signal strength corresponding to the click operation gesture made in the second scenario with the actual change, the second scenario is the scenario in which the first electronic device and the second electronic device are worn or held by the same limb of the user, and the first electronic device and the second electronic device are in a current-coupled human body communication mode; when the current receiving signal strength change waveform matches the fourth preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, it is determined that the target gesture corresponding to the current receiving signal strength change waveform is a click operation gesture.
[0023] According to the first aspect, or any implementation method of the first aspect above, the first electronic device and the second electronic device are in a first state and a second state respectively, and the first state and the second state are different states; the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: when the type of the human body communication mode currently turned on by the second electronic device is a current-coupled human body communication mode, the second electronic device is used to switch the human body communication mode from the current-coupled human body communication mode to the capacitive-coupled human body communication mode, and transmit a capacitive-coupled human body communication signal to the first electronic device; when the type of the human body communication mode currently turned on by the second electronic device is a capacitive-coupled human body communication mode, the second electronic device is used to maintain the capacitive-current-coupled human body communication mode and transmit a capacitive-coupled human body communication signal to the first electronic device.
[0024] According to the first aspect, or any implementation method of the above first aspect, the first state is a wearing state or a holding state, and the second state is a state of being placed on an object; wherein, the first electronic device and the second electronic device are in the first state and the second state, respectively, including: the first electronic device is in the second state, and the second electronic device is in the first state; wherein, when the first electronic device is in the second state and the second electronic device is in the first state, the first electronic device is used to: match the obtained capacitance receiving signal strength change waveform with the fifth preset change waveform in the preset change waveform, the fifth preset change waveform is the waveform of the capacitance receiving signal strength corresponding to the sliding approach operation gesture made in the third scenario with the actual change, the third scenario is the scenario in which the first electronic device is in the second state, the second electronic device is in the first state, and the first electronic device and the second electronic device are in a capacitive coupling human body communication mode; when the capacitance receiving signal strength change waveform matches the fifth preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, determine that the target gesture corresponding to the capacitance receiving signal strength change waveform is Sliding closer operation gesture; when the capacitor received signal strength change waveform does not match the fifth preset change waveform, the capacitor received signal strength change waveform is matched with the sixth preset change waveform in the preset change waveform, and the sixth preset change waveform is the waveform of the capacitor received signal strength corresponding to the sliding away operation gesture made in the third scenario with actual change; when the capacitor received signal strength change waveform matches the sixth preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, it is determined that the target gesture corresponding to the capacitor received signal strength change waveform is the sliding away operation gesture; when the capacitor received signal strength change waveform does not match the sixth preset change waveform, the capacitor received signal strength change waveform is matched with the seventh preset change waveform in the preset change waveform, and the seventh preset change waveform is the waveform of the capacitor received signal strength corresponding to the click operation gesture made in the third scenario with actual change; when the capacitor received signal strength change waveform matches the seventh preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, it is determined that the target gesture corresponding to the capacitor received signal strength change waveform is the click operation gesture.
[0025] The object on which the electronic device is placed is, for example, a desktop.
[0026] According to the first aspect, or any implementation method of the first aspect above, the first electronic device is further used to: when obtaining the received signal strength change waveform, send the received signal strength change waveform to the second electronic device; the second electronic device is further used to: receive the received signal strength change waveform sent by the first electronic device; when the received signal strength change waveform matches any preset change waveform among the preset change waveforms, determine the target operation gesture corresponding to the received signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; send the control instruction corresponding to the target operation gesture to the first electronic device; the first electronic device is further used to: receive the operation instruction corresponding to the target operation gesture sent by the second electronic device; and execute the control instruction corresponding to the target operation gesture.
[0027] According to the first aspect, or any implementation of the first aspect above, the first somatosensory operation device integrated in the first electronic device also includes a human body communication transmitting circuit for transmitting human body communication signals, and the human body communication transmitting circuit includes a capacitive coupling human body communication transmitting circuit and a current coupling human body communication transmitting circuit; the second somatosensory operation device integrated in the second electronic device also includes a human body communication transmitting circuit for receiving human body communication signals, and the human body communication receiving circuit includes a capacitive coupling human body communication receiving circuit and a current coupling human body communication receiving circuit; the first electronic device is further used to: when the current coupling human body communication transmitting circuit is turned on and the capacitive coupling human body communication transmitting circuit, the current coupling human body communication receiving circuit, and the capacitive coupling human body communication receiving circuit are disconnected, Transmitting a current-coupled human body communication signal to a second electronic device; the second electronic device is further used to: receive the current-coupled human body communication signal transmitted by the first electronic device when the current-coupled human body receiving circuit is turned on and the current-coupled human body communication transmitting circuit, the capacitive coupling human body transmitting circuit, and the capacitive coupling human body communication receiving circuit are disconnected, and record the received signal strength corresponding to the current-coupled human body communication signal received at each moment to obtain a current received signal strength change waveform; when the current received signal strength change waveform matches any preset change waveform among the preset change waveforms, determine the target operation gesture corresponding to the current received signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; and execute the control instruction corresponding to the target operation gesture.
[0028] Therefore, by integrating both the human body communication transmitting circuit and the human body communication receiving circuit in the first electronic device and the second electronic device, the two electronic devices can switch identities and realize somatosensory operation.
[0029] According to the first aspect, or any implementation method of the first aspect above, the second electronic device is further used to: when obtaining the current reception signal strength change waveform, send the current reception signal strength change waveform to the first electronic device; the first electronic device is also used to: receive the current reception signal strength change waveform sent by the second electronic device; when the current reception signal strength change waveform matches any preset change waveform among the preset change waveforms, determine the target operation gesture corresponding to the current reception signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; send the control instruction corresponding to the target operation gesture to the second electronic device; the second electronic device is also used to: receive the operation instruction corresponding to the target operation gesture sent by the first electronic device; and execute the control instruction corresponding to the target operation gesture.
[0030] According to the first aspect, or any implementation method of the first aspect above, the first electronic device is also used to: when the capacitive coupling human body communication transmitting circuit is turned on and the current coupling human body communication transmitting circuit, the current coupling human body communication receiving circuit, and the capacitive coupling human body communication receiving circuit are disconnected, transmit a capacitive coupling human body communication signal to the second electronic device; the second electronic device is also used to: when the capacitive coupling human body receiving circuit is turned on and the current coupling human body communication transmitting circuit, the capacitive coupling human body communication transmitting circuit, and the current coupling human body communication receiving circuit are disconnected, receive the capacitive coupling human body communication signal transmitted by the first electronic device, and record the received signal strength corresponding to the capacitive coupling human body communication signal received at each moment to obtain a capacitive receiving signal strength change waveform; when the capacitive receiving signal strength change waveform matches any preset change waveform in the preset change waveforms, determine the target operation gesture corresponding to the capacitive receiving signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; and execute the control instruction corresponding to the target operation gesture.
[0031] According to the first aspect, or any implementation method of the first aspect above, the second electronic device is further used to: when obtaining the capacitance receiving signal strength change waveform, send the capacitance receiving signal strength change waveform to the first electronic device; the first electronic device is also used to: receive the capacitance receiving signal strength change waveform sent by the second electronic device; when the capacitance receiving signal strength change waveform matches any preset change waveform among the preset change waveforms, determine the target operation gesture corresponding to the capacitance receiving signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; send the control instruction corresponding to the target operation gesture to the second electronic device; the second electronic device is also used to: receive the operation instruction corresponding to the target operation gesture sent by the first electronic device; and execute the control instruction corresponding to the target operation gesture.
[0032] In the second aspect, the present application provides a somatosensory operation method, which is applied to a somatosensory operating system. The system includes: a first electronic device and a second electronic device, and the first electronic device and the second electronic device have human body communication mode turned on. The method includes: the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of human body communication mode currently turned on; the first electronic device receives the human body communication signal transmitted by the second electronic device, and records the received signal strength corresponding to the human body communication signal received at each moment to obtain a received signal strength change waveform; when the received signal strength change waveform matches any preset change waveform in the preset change waveform, the first electronic device determines the target operation gesture corresponding to the received signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; the first electronic device executes the control instruction corresponding to the target operation gesture.
[0033] According to the second aspect, the human body communication mode includes a capacitive coupling human body communication mode and a current coupling human body communication mode; wherein, when the type of the human body communication mode currently turned on by the second electronic device is the capacitive coupling human body communication mode, the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: the second electronic device transmits a capacitive coupling human body communication signal to the first electronic device; wherein the first electronic device receives the human body communication signal transmitted by the second electronic device, and records the received signal strength corresponding to the human body communication signal received at each moment, and obtains a received signal strength change waveform, including: the first electronic device receives the capacitive coupling human body communication signal transmitted by the second electronic device, and records the capacitive receiving signal strength corresponding to the capacitive coupling human body communication signal received at each moment. Signal strength, obtaining a waveform of a change in capacitance received signal strength; wherein, when the type of human body communication mode currently turned on by the second electronic device is a current-coupled human body communication mode, the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: the second electronic device transmits a current-coupled human body communication signal to the first electronic device; wherein, the first electronic device receives the human body communication signal transmitted by the second electronic device, and records the received signal strength corresponding to the human body communication signal received at each moment, obtaining a waveform of a change in received signal strength, including: the first electronic device receives the current-coupled human body communication signal transmitted by the second electronic device, and records the current received signal strength corresponding to the current-coupled human body communication signal received at each moment, obtaining a waveform of a change in current received signal strength.
[0034] According to the second aspect, or any implementation method of the second aspect above, a second somatosensory operation device is integrated in the second electronic device, and the second somatosensory operation device includes a human body communication transmitting circuit for transmitting a human body communication signal, and the human body communication transmitting circuit includes a capacitive coupling human body communication transmitting circuit and a current coupling human body communication transmitting circuit; wherein, the second electronic device transmits the capacitive coupling human body communication signal to the first electronic device, including: the second electronic device turns on the capacitive coupling human body communication transmitting circuit and turns off the current coupling human body communication transmitting circuit; the second electronic device transmits the capacitive coupling human body communication signal to the first electronic device through the capacitive coupling human body communication transmitting circuit; wherein, the second electronic device transmits the current coupling human body communication signal to the first electronic device, including: the second electronic device turns on the current coupling human body communication transmitting circuit and turns off the capacitive coupling human body communication transmitting circuit; the second electronic device transmits the current coupling human body communication signal to the first electronic device through the current coupling human body communication transmitting circuit.
[0035] According to the second aspect, or any implementation method of the above second aspect, the second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module, a circuit switching switch, a voltage-driven amplifier and a current-driven amplifier; wherein, the second electronic device turns on the capacitive coupling type human body communication transmitting circuit and disconnects the current-coupled type human body communication transmitting circuit, including: the second electronic device turns on the connection between the human body communication module and the voltage-driven amplifier through the circuit switching switch, and disconnects the connection between the human body communication module and the current-driven amplifier; the second electronic device connects the first port of the voltage-driven amplifier to the first port of the current / capacitive coupling type human body communication composite module, and the current The second port of the voltage-driven amplifier is connected to the second port of the current / capacitive coupling type human body communication composite module; the second electronic device disconnects the first port of the current-driven amplifier from the third port of the current / capacitive coupling type human body communication composite module, and disconnects the second port of the current-driven amplifier from the fourth port of the current / capacitive coupling type human body communication composite module; the second electronic device switches on the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, switches on the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnects the third port of the current / capacitive coupling type human body communication composite module from the second electrode, and disconnects the fourth port of the current / capacitive coupling type human body communication composite module from the third electrode.
[0036] According to the second aspect, or any implementation method of the above second aspect, the second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module, a circuit switching switch, a voltage-driven amplifier and a current-driven amplifier; wherein, the second electronic device turns on the current-coupled type human body communication transmitting circuit and disconnects the capacitive coupling type human body communication transmitting circuit, including: the second electronic device turns on the connection between the human body communication module and the current-driven amplifier through the circuit switching switch, and disconnects the connection between the human body communication module and the voltage-driven amplifier; the second electronic device connects the first port of the current-driven amplifier to the third port of the current / capacitive coupling type human body communication composite module, and the current drives the amplifier. The second port of the current driving amplifier is connected to the fourth port of the current / capacitive coupling type human body communication composite module; the second electronic device disconnects the first port of the voltage driving amplifier from the first port of the current / capacitive coupling type human body communication composite module, and disconnects the second port of the voltage driving amplifier from the second port of the current / capacitive coupling type human body communication composite module; the second electronic device switches on the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, switches on the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnects the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnects the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode through the electrode switching module.
[0037] According to the second aspect, or any implementation method of the second aspect above, a first somatosensory operation device is integrated in the first electronic device, and the first somatosensory operation device includes a human body communication receiving circuit for receiving human body communication signals, and the human body communication receiving circuit includes a capacitive coupling human body communication receiving circuit and a current coupling human body communication receiving circuit; wherein, the first electronic device receives the capacitive coupling human body communication signal transmitted by the second electronic device, including: the first electronic device turns on the capacitive coupling human body communication receiving circuit and turns off the current coupling human body communication receiving circuit; the first electronic device receives the capacitive coupling human body communication signal transmitted by the second electronic device through the capacitive coupling human body communication receiving circuit; wherein, the first electronic device receives the current coupling human body communication signal transmitted by the second electronic device, including: the first electronic device is used to turn on the current coupling human body communication receiving circuit and turns off the capacitive coupling human body communication receiving circuit; the first electronic device receives the current coupling human body communication signal transmitted by the second electronic device through the current coupling human body communication receiving circuit.
[0038] According to the second aspect, or any implementation method of the above second aspect, the first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module and the receiving circuit are connected; wherein, the first electronic device turns on the capacitive coupling type human body communication receiving circuit and disconnects the current coupling type human body communication receiving circuit, including: the first electronic device connects the first port of the receiving circuit to the first port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit to the second port of the current / capacitive coupling type human body communication composite module; the first electronic device turns on the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, turns on the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnects the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnects the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode through the electrode switching module.
[0039] According to the second aspect, or any implementation method of the above second aspect, the first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module and the receiving circuit are connected; wherein, the first electronic device turns on the current coupling type human body communication receiving circuit and disconnects the capacitive coupling type human body communication receiving circuit, including: the first electronic device connects the first port of the receiving circuit to the third port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit to the fourth port of the current / capacitive coupling type human body communication composite module; the first electronic device, through the electrode switching module, turns on the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, turns on the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnects the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnects the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode.
[0040] According to the second aspect, or any implementation method of the above second aspect, the first electronic device and the second electronic device are both in the first state; the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: when the type of the human body communication mode currently turned on by the second electronic device is a capacitive coupling human body communication mode, the second electronic device switches the human body communication mode from the capacitive coupling human body communication mode to the current coupling human body communication mode, and transmits a current coupling human body communication signal to the first electronic device; when the type of the human body communication mode currently turned on by the second electronic device is a current coupling human body communication mode, the second electronic device maintains the current coupling human body communication mode and transmits a current coupling human body communication signal to the first electronic device.
[0041] According to the second aspect, or any implementation of the second aspect above, the first state is a wearing state or a holding state; wherein, the first electronic device and the second electronic device are both in the first state, including: the first electronic device and the second electronic device are respectively worn or held by different limbs of the user; wherein, when the first electronic device and the second electronic device are respectively worn or held by different limbs of the user, the method further includes: the first electronic device matches the obtained current receiving signal strength change waveform with the first preset change waveform in the preset change waveform, the first preset change waveform is the waveform of the current receiving signal strength corresponding to the sliding approach operation gesture made in the first scenario with the actual change, the first scenario is the scenario where the first electronic device and the second electronic device are worn or held by different limbs of the user, and the first electronic device and the second electronic device are in a current-coupled human body communication mode; when the current receiving signal strength change waveform of the first electronic device matches the first preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, it is determined that the target gesture corresponding to the current receiving signal strength change waveform is the sliding approach operation gesture; the first electronic device is in When the current receiving signal strength change waveform does not match the first preset change waveform, the current receiving signal strength change waveform is matched with the second preset change waveform in the preset change waveform, and the second preset change waveform is the waveform of the current receiving signal strength corresponding to the sliding away operation gesture made in the first scenario as it actually changes; when the current receiving signal strength change waveform matches the second preset change waveform, the first electronic device determines that the target gesture corresponding to the current receiving signal strength change waveform is the sliding away operation gesture based on the mapping relationship between the preset change waveform and the operation gesture; when the current receiving signal strength change waveform does not match the second preset change waveform, the first electronic device matches the current receiving signal strength change waveform with the third preset change waveform in the preset change waveform, and the third preset change waveform is the waveform of the current receiving signal strength corresponding to the click operation gesture made in the first scenario as it actually changes; when the current receiving signal strength change waveform matches the third preset change waveform, the first electronic device determines that the target gesture corresponding to the current receiving signal strength change waveform is the click operation gesture based on the mapping relationship between the preset change waveform and the operation gesture.
[0042] According to the second aspect, or any implementation method of the above second aspect, the first state is a wearing state or a holding state; wherein, the first electronic device and the second electronic device are both in the first state, including: the first electronic device and the second electronic device are respectively worn or held by the same limb of the user; wherein, when the first electronic device and the second electronic device are worn or held by the same limb of the user, the method also includes: the first electronic device matches the obtained current receiving signal strength change waveform with the fourth preset change waveform in the preset change waveform, and the fourth preset change waveform is the waveform of the current receiving signal strength corresponding to the click operation gesture made in the second scenario with the actual change, and the second scenario is the scenario in which the first electronic device and the second electronic device are worn or held by the same limb of the user, and the first electronic device and the second electronic device are in a current-coupled human body communication mode; when the current receiving signal strength change waveform matches the fourth preset change waveform, the first electronic device determines that the target gesture corresponding to the current receiving signal strength change waveform is a click operation gesture according to the mapping relationship between the preset change waveform and the operation gesture.
[0043] According to the second aspect, or any implementation method of the above second aspect, the first electronic device and the second electronic device are in a first state and a second state respectively, and the first state and the second state are different states; the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: when the type of the human body communication mode currently turned on by the second electronic device is the current coupling human body communication mode, the second electronic device switches the human body communication mode from the current coupling human body communication mode to the capacitive coupling human body communication mode, and transmits a capacitive coupling human body communication signal to the first electronic device; when the type of the human body communication mode currently turned on by the second electronic device is the capacitive coupling human body communication mode, the second electronic device maintains the capacitive current coupling human body communication mode and transmits a capacitive coupling human body communication signal to the first electronic device.
[0044] According to the second aspect, or any implementation method of the above second aspect, the first state is a wearing state or a holding state, and the second state is a state of being placed on an object; wherein, the first electronic device and the second electronic device are in the first state and the second state, respectively, including: the first electronic device is in the second state, and the second electronic device is in the first state; wherein, when the first electronic device is in the second state and the second electronic device is in the first state, the method further includes: the first electronic device matches the obtained capacitance receiving signal strength change waveform with the fifth preset change waveform in the preset change waveform, and the fifth preset change waveform is a waveform of the capacitance receiving signal strength corresponding to the sliding approach operation gesture made in the third scenario with actual change, and the third scenario is a scenario in which the first electronic device is in the second state, the second electronic device is in the first state, and the first electronic device and the second electronic device are in a capacitive coupling human body communication mode; when the capacitance receiving signal strength change waveform matches the fifth preset change waveform, the first electronic device determines, according to the mapping relationship between the preset change waveform and the operation gesture, that the target gesture corresponding to the capacitance receiving signal strength change waveform is a sliding approach operation gesture. ; When the capacitance received signal strength change waveform does not match the fifth preset change waveform, the first electronic device matches the capacitance received signal strength change waveform with the sixth preset change waveform in the preset change waveforms, where the sixth preset change waveform is a waveform of the capacitance received signal strength corresponding to the sliding away operation gesture made in the third scenario with actual change; when the capacitance received signal strength change waveform matches the sixth preset change waveform, the first electronic device determines, based on the mapping relationship between the preset change waveform and the operation gesture, that the target gesture corresponding to the capacitance received signal strength change waveform is the sliding away operation gesture; when the capacitance received signal strength change waveform does not match the sixth preset change waveform, the first electronic device matches the capacitance received signal strength change waveform with the seventh preset change waveform in the preset change waveforms, where the seventh preset change waveform is a waveform of the capacitance received signal strength corresponding to the click operation gesture made in the third scenario with actual change; when the capacitance received signal strength change waveform matches the seventh preset change waveform, the first electronic device determines, based on the mapping relationship between the preset change waveform and the operation gesture, that the target gesture corresponding to the capacitance received signal strength change waveform is the click operation gesture.
[0045] According to the second aspect, or any implementation of the second aspect above, the method also includes: when the first electronic device obtains the received signal strength change waveform, the received signal strength change waveform is sent to the second electronic device; the second electronic device receives the received signal strength change waveform sent by the first electronic device; when the received signal strength change waveform matches any preset change waveform in the preset change waveforms, the second electronic device determines the target operation gesture corresponding to the received signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; the second electronic device sends a control instruction corresponding to the target operation gesture to the first electronic device; the first electronic device receives the operation instruction corresponding to the target operation gesture sent by the second electronic device; and the first electronic device executes the control instruction corresponding to the target operation gesture.
[0046] According to the second aspect, or any implementation of the second aspect above, the first somatosensory operation device integrated in the first electronic device also includes a human body communication transmitting circuit for transmitting human body communication signals, and the human body communication transmitting circuit includes a capacitive coupling human body communication transmitting circuit and a current coupling human body communication transmitting circuit; the second somatosensory operation device integrated in the second electronic device also includes a human body communication transmitting circuit for receiving human body communication signals, and the human body communication receiving circuit includes a capacitive coupling human body communication receiving circuit and a current coupling human body communication receiving circuit; the method also includes: when the current coupling human body communication transmitting circuit is turned on and the capacitive coupling human body communication transmitting circuit, the current coupling human body communication receiving circuit, and the capacitive coupling human body communication receiving circuit are disconnected, the first electronic device sends a signal to the second electronic device. An electronic device transmits a current-coupled human body communication signal; a second electronic device receives the current-coupled human body communication signal transmitted by the first electronic device when the current-coupled human body receiving circuit is turned on and the current-coupled human body communication transmitting circuit, the capacitive coupling human body transmitting circuit, and the capacitive coupling human body communication receiving circuit are disconnected, and records the received signal strength corresponding to the current-coupled human body communication signal received at each moment to obtain a current received signal strength change waveform; when the current received signal strength change waveform matches any preset change waveform among the preset change waveforms, the second electronic device determines the target operation gesture corresponding to the current received signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; the second electronic device executes the control instruction corresponding to the target operation gesture.
[0047] According to the second aspect, or any implementation of the second aspect above, the method also includes: when the second electronic device obtains the current reception signal strength change waveform, the current reception signal strength change waveform is sent to the first electronic device; the first electronic device receives the current reception signal strength change waveform sent by the second electronic device; when the current reception signal strength change waveform matches any preset change waveform in the preset change waveforms, the first electronic device determines the target operation gesture corresponding to the current reception signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; the first electronic device sends a control instruction corresponding to the target operation gesture to the second electronic device; the second electronic device receives the operation instruction corresponding to the target operation gesture sent by the first electronic device; and the second electronic device executes the control instruction corresponding to the target operation gesture.
[0048] According to the second aspect, or any implementation of the second aspect above, the method also includes: the first electronic device transmits a capacitive coupling human body communication signal to the second electronic device when the capacitive coupling human body communication transmitting circuit is turned on and the current coupling human body communication transmitting circuit, the current coupling human body communication receiving circuit, and the capacitive coupling human body communication receiving circuit are disconnected; the second electronic device receives the capacitive coupling human body communication signal transmitted by the first electronic device when the capacitive coupling human body receiving circuit is turned on and the current coupling human body communication transmitting circuit, the capacitive coupling human body communication transmitting circuit, and the current coupling human body communication receiving circuit are disconnected, and records the received signal strength corresponding to the capacitive coupling human body communication signal received at each moment to obtain a capacitive receiving signal strength change waveform; when the capacitive receiving signal strength change waveform matches any preset change waveform in the preset change waveforms, the second electronic device determines the target operation gesture corresponding to the capacitive receiving signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; the second electronic device executes the control instruction corresponding to the target operation gesture.
[0049] According to the second aspect, or any implementation of the second aspect above, the method also includes: when the second electronic device obtains the capacitance receiving signal strength change waveform, the capacitance receiving signal strength change waveform is sent to the first electronic device; the first electronic device receives the capacitance receiving signal strength change waveform sent by the second electronic device; when the capacitance receiving signal strength change waveform matches any preset change waveform in the preset change waveforms, the first electronic device determines the target operation gesture corresponding to the capacitance receiving signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; the first electronic device sends a control instruction corresponding to the target operation gesture to the second electronic device; the second electronic device receives the operation instruction corresponding to the target operation gesture sent by the first electronic device; and the second electronic device executes the control instruction corresponding to the target operation gesture.
[0050] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.
[0051] In a third aspect, the present application provides an electronic device. The electronic device includes: a memory and a processor, the memory and the processor being coupled; the memory storing program instructions, which, when executed by the processor, cause the electronic device to execute the method instructions executed by the first electronic device, or the method instructions executed by the second electronic device, in the second aspect or any possible implementation of the second aspect.
[0052] In a fourth aspect, the present application provides a computer-readable medium for storing a computer program, wherein the computer program includes instructions for executing the method in the second aspect or any possible implementation of the second aspect.
[0053] In a fifth aspect, the present application provides a computer program comprising instructions for executing the method in the second aspect or any possible implementation of the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0054] FIG1A is a schematic diagram showing the relationship between transmission distance and transmission loss when a current-coupled human body communication signal and a capacitive-coupled human body communication signal are transmitted in vivo;
[0055] FIG1B is a schematic diagram showing the relationship between transmission distance and transmission loss when a capacitive coupling human body communication signal is transmitted outside the body;
[0056] FIG1C is a schematic diagram illustrating an exemplary scenario of transmitting a current-coupled human body communication signal;
[0057] FIG1D is a schematic diagram illustrating an exemplary scenario of transmitting a capacitive coupling human body communication signal;
[0058] FIG2 is an exemplary diagram of a body sensing transmission device provided in an embodiment of the present application;
[0059] FIG3A is a schematic diagram showing an internal structure of a current / capacitive coupling type human body communication composite module in the body sensing transmission device shown in FIG2 ;
[0060] FIG3B is a schematic diagram showing another internal structure of the current / capacitive coupling type human body communication composite module in the body sensing transmission device shown in FIG2 ;
[0061] FIG4 is a schematic diagram showing an internal structure of a current / capacitive coupling type human body communication composite module in the body sensing transmission device shown in FIG2 ;
[0062] FIG5A is a schematic diagram of a current-coupled human body communication circuit formed in a current / capacitive-coupled human body communication composite module when an electronic device integrated with the somatosensory operating device shown in FIG2 operates in a current-coupled human body communication mode and serves as a signal transmitting end (control end);
[0063] FIG5B is a schematic diagram of a current-coupled human body communication circuit formed in a current / capacitive-coupled human body communication composite module when an electronic device integrated with the somatosensory operating device shown in FIG2 operates in a current-coupled human body communication mode and serves as a signal receiving end (controlled end);
[0064] FIG5C is a schematic diagram illustrating a capacitive coupling human body communication circuit formed in a current / capacitive coupling human body communication composite module when an electronic device integrating the somatosensory operating device shown in FIG2 operates in a capacitive coupling human body communication mode and serves as a signal transmitting end (control end);
[0065] FIG5D is a schematic diagram of a capacitive coupling human body communication circuit formed in a current / capacitive coupling human body communication composite module when an electronic device integrating the somatosensory operating device shown in FIG2 operates in a capacitive coupling human body communication mode and serves as a signal receiving end (controlled end);
[0066] FIG6 is a schematic diagram showing the hardware structure of an electronic device integrated with the somatosensory operation device shown in FIG2 ;
[0067] FIG7 is a schematic diagram showing the hardware structure of another electronic device integrated with the somatosensory operation device shown in FIG2 ;
[0068] FIG8 is a schematic diagram exemplarily illustrating a software structure of an electronic device capable of realizing human body operation based on the somatosensory operation device shown in FIG2 ;
[0069] FIG9 is a schematic diagram of an environment in which an electronic device integrating the somatosensory operation device shown in FIG2 is integrated within a set range;
[0070] 10A to 10E are schematic diagrams of user interfaces for exemplarily illustrating activation of the somatosensory operation function;
[0071] FIG11 is a schematic diagram illustrating an exemplary setting range of establishing a somatosensory operation connection between any two electronic devices integrated with the somatosensory operation device shown in FIG2 ;
[0072] FIG12A is a schematic diagram exemplarily illustrating a scenario applicable to the somatosensory operation method provided in the present application;
[0073] FIG12B is a schematic diagram exemplarily illustrating another scenario applicable to the somatosensory operation method provided in the present application;
[0074] FIG13 is a waveform diagram showing, by way of example, how the received signal strength changes over time in response to the sliding gesture in the scenarios shown in FIG12A and FIG12B ;
[0075] FIG14A is a schematic diagram exemplarily illustrating another scenario applicable to the somatosensory operation method provided in the present application;
[0076] FIG14B is a schematic diagram exemplarily illustrating another scenario applicable to the somatosensory operation method provided in the present application;
[0077] FIG15 is a waveform diagram showing, by way of example, how the received signal strength changes over time in response to a sliding gesture performed in the scenarios shown in FIG14A and FIG14B ;
[0078] FIG16A is a schematic diagram exemplarily illustrating another scenario applicable to the somatosensory operation method provided in the present application;
[0079] FIG16B is a schematic diagram exemplarily illustrating another scenario applicable to the somatosensory operation method provided in the present application;
[0080] FIG17 is a waveform diagram showing, by way of example, how the received signal strength changes over time corresponding to the click gesture in the scenarios shown in FIG16A and FIG16B ;
[0081] FIG18 is a schematic diagram exemplarily illustrating another scenario applicable to the somatosensory operation method provided in the present application;
[0082] FIG19 is a waveform diagram showing, by way of example, how the received signal strength corresponding to the click gesture performed in the scenario shown in FIG18 changes over time;
[0083] FIG20 is a schematic diagram exemplarily illustrating another scenario applicable to the somatosensory operation method provided in the present application;
[0084] FIG21 is a waveform diagram showing, by way of example, how the received signal strength changes over time in response to the sliding gesture performed in the scenario shown in FIG20 ;
[0085] FIG22 is a schematic diagram exemplarily illustrating another scenario applicable to the somatosensory operation method provided in the present application;
[0086] FIG23 is a waveform diagram showing, by way of example, how the received signal strength changes over time in response to the sliding gesture performed in the scenario shown in FIG22 ;
[0087] FIG24 is a schematic diagram exemplarily illustrating another scenario applicable to the somatosensory operation method provided in the present application;
[0088] FIG25 is a waveform diagram showing, by way of example, how the received signal strength corresponding to the click gesture performed in the scenario shown in FIG24 changes over time;
[0089] FIG26 is a schematic diagram illustrating an exemplary implementation of the somatosensory operation method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0090] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0091] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.
[0092] In the description and claims of the embodiments of this application, the terms "first" and "second" are used to distinguish different objects, rather than to describe a specific order of objects. For example, the terms "first target object" and "second target object" are used to distinguish different objects, rather than to describe a specific order of objects.
[0093] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0094] In the description of the embodiments of this application, unless otherwise specified, "multiple" means two or more. For example, "multiple processing units" means two or more processing units; "multiple systems" means two or more systems.
[0095] Gesture operation is now one of the common operating methods of smart devices. For electronic devices with touch screens, touch operations can be performed by gestures such as clicking and sliding on the screen, thereby achieving human-computer interaction.
[0096] However, for electronic devices with smaller screens, such as smart watches and smart bracelets, when using fingers for touch operations, the area of the screen blocked by the fingers occupies a larger area of the screen, resulting in the content displayed on the screen being blocked, affecting the user experience.
[0097] In addition, the operation of devices such as headphones and smart glasses currently requires precise touching of specific areas of the device, so the user experience is not good.
[0098] Furthermore, in some implementation scenarios, such as when a user places a touchscreen electronic device (mobile phone, tablet, etc.) on a tabletop to read or watch a short video, they frequently need to switch and turn pages. If they swipe directly on the screen with their fingers, water or oil stains on their fingers may stain the screen, affecting the user experience.
[0099] To enhance the human-computer interaction experience, some current implementations use optical devices such as laser sensors or cameras to capture and process gestures. However, optical devices are limited by the linear nature of light, requiring the hand to be within their operating range. For example, when operating a mobile phone, the hand must be at a certain distance from the screen to utilize gestures using the front-facing camera.
[0100] Furthermore, gesture manipulation based on optical devices requires the hand to be constantly suspended, making it tiring. Furthermore, gesture manipulation based on optical devices is typically performed through a front-facing camera, making it unsuitable for electronic devices that don't have one.
[0101] In addition, gesture operations based on optical devices require the camera to work all the time, which consumes a lot of power for the device.
[0102] For example, among other possible implementations, there are also solutions that use electromagnetic wave signals for gesture operations. However, gesture operations based on electromagnetic wave signals require users to attach or wear special ultra-wideband (UWB) tags or devices on their hands. This not only increases implementation costs but also provides a poor user experience.
[0103] In view of this, the present application provides an operation method, which aims to realize simple gesture operations such as clicking and sliding based on human body communication technology without contacting the screen of the electronic device, thereby improving the human-computer interaction experience.
[0104] Specifically, Intra-Body Communication (IBC) is a non-RF wireless communication technology. Its biggest feature is that it uses the human body as a transmission medium for electrical signals to achieve data transmission and sharing between various electronic devices on the surface and inside the human body. Compared with current short-range wireless communication technologies such as Bluetooth and ZigBee, this technology has the advantages of low power consumption, anti-interference, and high speed.
[0105] At present, human body communication mainly includes two modes: current coupling type human body communication and capacitive coupling type human body communication.
[0106] The galvanic coupling human body communication mode uses the human body as the medium to achieve differential signal transmission. That is, the galvanic coupling human body communication signal transmitted in the galvanic coupling human body communication mode can only be transmitted within the human body and is basically unable to be transmitted outside the human body.
[0107] In addition, it should be noted that the conductivity of human skin, fat and muscle is higher than that of air medium in the current coupled human body communication mode. This is much greater than the product of its operating angular frequency ω and the dielectric constant e (σ>>e). Therefore, when current-coupled human body communication signals are transmitted within the body, they are less susceptible to electromagnetic interference from the surrounding environment, and their transmission loss is primarily related to distance. As shown in Figure 1A, a schematic diagram of in-body transmission distance and transmission loss, shows that current-coupled human body communication signals experience a loss of approximately 6 to 9 dB per 5 cm of transmission within the body. In contrast, wireless signals currently transmitted in free space, such as Bluetooth and ZigBee, experience minimal spatial loss variations due to distance differences, making them difficult to use as input for gesture recognition. As shown in Table 1, this loss is approximately 3 dB per 5 cm.
[0108] Table 1 Transmission loss of wireless signals transmitted in free space
[0109] Among them, the capacitive coupling human body communication mode determines the loop by capacitive coupling between the two electrodes at the transmitting end or the receiving end and the human body and the ground respectively. Compared with the current coupling human body communication mode, the ground electrode at the transmitting end of the capacitive coupling human body communication mode is not in direct contact with the human body, and the coupling loop between it and the signal electrode is relatively weak. Therefore, its signal attenuation is relatively small. That is, the capacitive coupling human body communication signal transmitted in the capacitive coupling human body communication mode has a small transmission loss in the human body, and only after it leaves the human body / electrode will the transmission loss be affected by the distance. As shown in Figure 1A, during the transmission process of the capacitive coupling human body communication signal in the human body, the loss within 25cm does not exceed 5dB, that is, the loss within every 5cm is no more than 1dB. During the transmission process of the capacitive coupling human body communication signal in vitro, the loss per 5cm is about 20dB, as shown in Figure 1B.
[0110] From the above description of the transmission principle of the current-coupled human body communication signal, it can be seen that the current-coupled human body communication signal can be transmitted inside the body / on the surface of the human body. As shown in Figure 1C, the current-coupled human body communication signal emitted by device B will be transmitted on the left arm touched by the right hand finger of the person wearing device B, and then be received by device A worn on the left arm.
[0111] Based on this, the transmission principle of the current-coupled human body communication signal can be utilized to use the current-coupled human body communication signal as the judgment input for gesture recognition in the body / body surface somatosensory operation scenario.
[0112] It should be understood that in order to implement gesture operations based on human body communication, at least two electronic devices are required in a specific implementation. That is, one of them serves as the receiving end (controlled end) of the signal, and the other serves as the transmitting end (controlling end) of the signal. Therefore, in the human body surface somatosensory operation scenario, in some possible implementations, the two electronic devices may be located on different limbs of the user, such as the left hand, left arm, right hand, right arm, left leg, right leg, left ear, right ear, head, or any two limbs.
[0113] For example, in some other possible implementations, the two electronic devices may be located on the same limb of the user, such as any of the limbs mentioned above.
[0114] For ease of explanation, the embodiment of the present application takes the use of two electronic devices to implement gesture operations based on human body communication as an example, and the scenario in which the two electronic devices are respectively located on different limbs of the user is referred to as scenario 1, and the scenario in which the two electronic devices are located on the same limb of the user is referred to as scenario 2.
[0115] In addition, from the above description of the transmission principle of capacitive coupling human body communication signals, it can be seen that capacitive coupling human body communication signals can be transmitted outside the body. As shown in Figure 1D, the capacitive coupling human body communication signal emitted by device B will be transmitted on the table surface touched by the right hand finger of the person wearing device B, and then be received by device D placed on the table surface.
[0116] Based on this, the transmission principle of capacitive coupling human body communication signals can be utilized to use capacitive coupling human body communication signals as judgment input for gesture recognition in an external body sensing operation scenario.
[0117] For the external somatosensory operation scenario, for example, the electronic device as the controlled end is placed on a desktop surface, and the electronic device as the controlling end is located on the user, such as worn on the hand. For ease of explanation, this embodiment of the application is referred to as scenario 3.
[0118] In order to implement gesture recognition in the above scenarios 1, 2, and 3 based on human body communication technology, and then perform human-computer interaction based on the recognized gestures, the embodiments of the present application provide a somatosensory operation device. The device can be integrated into electronic devices such as smart watches, smart bracelets, smart rings, mobile phones, tablets, smart TVs, personal computers, etc., which are not listed here and are not limited by this application.
[0119] 2 , illustratively, the body sensing operation device may include a current / capacitive coupling human body communication composite module, an electrode switching module, a first electrode, a second electrode, and a third electrode.
[0120] It is understandable that since the device can be integrated into both the electronic device serving as the signal transmitting end and the electronic device serving as the signal receiving end, the current / capacitive coupling human body communication composite module in the device is used to transmit a capacitive coupling human body communication signal of a specific frequency in the capacitive coupling human body communication mode, and to transmit a current coupling human body communication signal of a specific frequency in the current coupling human body communication mode. For the electronic device serving as the signal receiving end, the current / capacitive coupling human body communication composite module in the device is used to receive a capacitive coupling human body communication signal of a specific frequency in the capacitive coupling human body communication mode, and to receive a current coupling human body communication signal of a specific frequency in the current coupling human body communication mode.
[0121] Regarding the aforementioned specific frequency, for the capacitive coupling human body communication mode, a frequency with low loss in the capacitive coupling human body communication mode is selected. Correspondingly, for the galvanic coupling human body communication mode, a frequency with low loss in the galvanic coupling human body communication mode is selected.
[0122] The electrode switching module is used to connect the circuit between the first electrode and the second electrode, thereby enabling the somatosensory operation device to operate in a capacitive coupling human body communication mode. Furthermore, the electrode switching module is used to connect the circuit between the second electrode and the third electrode, thereby enabling the somatosensory operation device to operate in a current coupling human body communication mode.
[0123] The first electrode and the second electrode are used in a capacitive coupling human body communication mode, and the second electrode and the third electrode are used in a current coupling human body communication mode.
[0124] Continuing to refer to Figure 2, exemplarily, when the somatosensory operation device operates in the capacitive coupling human body communication mode, it is required that the OUT1 port of the current / capacitive coupling human body communication composite module is connected to the P1 port of the electrode switching module, the P1 port of the electrode switching module is connected to the P5 port of the electrode switching module, and the P5 port of the electrode switching module is connected to the first electrode, and the OUT2 port of the current / capacitive coupling human body communication composite module is connected to the P2 port of the electrode switching module, the P2 port of the electrode switching module is connected to the P6 port of the electrode switching module, and the P6 port of the electrode switching module is connected to the second electrode, thereby forming a coupling loop corresponding to the capacitive coupling human body communication mode.
[0125] Continuing to refer to Figure 2, exemplarily, when the somatosensory operation device operates in the current-coupled human body communication mode, it is necessary for the OUT3 port of the current / capacitive coupling human body communication composite module to be connected to the P3 port of the electrode switching module, the P3 port of the electrode switching module to the P6 port of the electrode switching module, and the P6 port of the electrode switching module to the second electrode, and the OUT4 port of the current / capacitive coupling human body communication composite module to be connected to the P4 port of the electrode switching module, the P4 port of the electrode switching module to the P7 port of the electrode switching module, and the P7 port of the electrode switching module to the third electrode, thereby forming a coupling loop corresponding to the current-coupled human body communication mode.
[0126] 2 , for example, to facilitate distinguishing the current-type signal electrodes, the current-type signal electrode corresponding to the OUT3 port, i.e., the second electrode, can be represented as current-type signal electrode 1. Accordingly, the current-type signal electrode corresponding to the OUT4 port, i.e., the third electrode, can be represented as current-type signal electrode 2.
[0127] Since the current / capacitive coupling human body communication composite module can operate in both capacitive coupling human body communication mode and current coupling human body communication mode, when operating in either capacitive coupling human body communication mode or current coupling human body communication mode, the current / capacitive coupling human body communication composite module can be divided into a transmitting end for transmitting signals and a receiving end for receiving signals.
[0128] Therefore, in a possible implementation, the internal structure of the current / capacitive coupling type human body communication composite module may be as shown in FIG. 3A and FIG. 3B .
[0129] 3A , which exemplarily illustrates the internal structure of a current / capacitive coupling type human body communication composite module of a somatosensory operation device integrated in an electronic device for transmitting human body communication signals.
[0130] As shown in FIG3A , the current / capacitive coupling human body communication composite module may include a human body communication module, a circuit switching switch, a voltage driving amplifier, and a current driving amplifier.
[0131] Among them, for the transmitting end, the human body communication module can be used to transmit signals.
[0132] The circuit switching switch may be a single-pole multi-throw switch. As shown in FIG3A , the circuit switching switch is a single-pole double-throw switch. The circuit switching switch is connected to the human body communication module, the voltage drive amplifier, and the current drive amplifier, respectively.
[0133] The voltage-driven amplifier is used to amplify the signal transmitted by the human body communication module to a specific frequency corresponding to the capacitive coupling human body communication mode, thereby obtaining a capacitive coupling human body communication signal.
[0134] Among them, the current drive amplifier is used to amplify the signal transmitted by the human body communication module to a specific frequency corresponding to the current-coupled human body communication mode, thereby obtaining a current-coupled human body communication signal.
[0135] Based on the structure of the circuit / capacitive coupling human body communication composite module shown in Figure 3A, when the electronic device serving as the transmitting end operates in the current coupling human body communication mode, the moving end (end a) in the circuit switching switch will be connected to the fixed end (end d), thereby realizing the conduction of the line between the human body communication module and the current driving amplifier, so that the signal transmitted by the human body communication module can be amplified by the current driving amplifier to the specific frequency corresponding to the current coupling human body communication mode, that is, the current coupling human body communication signal that needs to be transmitted is obtained.
[0136] Continuing with FIG3A , illustratively, when the electronic device serving as the transmitter operates in current-coupled human body communication mode, the I1 port of the current-driven amplifier is connected to the OUT3 port, and the I2 port of the current-driven amplifier is connected to the OUT4 port. Thus, the current-coupled human body communication signal is output to the second electrode via the OUT3 port, the P3 port, and the P6 port, and to the third electrode via the OUT4 port, the P4 port, and the P7 port, and is ultimately transmitted through the antenna in the electronic device, thereby achieving transmission of the current-coupled human body communication signal.
[0137] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0138] Continuing to refer to Figure 3A, for example, when the electronic device serving as the transmitting end operates in the capacitive coupling human body communication mode, the moving end (end a) in the circuit switching switch will be connected to the fixed end (end b), realizing the conduction of the line between the human body communication module and the voltage-driven amplifier, so that the signal transmitted by the human body communication module can be amplified by the voltage-driven amplifier to the specific frequency corresponding to the capacitive coupling human body communication mode, that is, the capacitive coupling human body communication signal that needs to be transmitted is obtained.
[0139] Continuing with FIG3A , illustratively, when the electronic device serving as the transmitter operates in capacitive coupling human body communication mode, the V1 port of the voltage-driven amplifier will be connected to the OUT1 port, and the V2 port of the voltage-driven amplifier will be connected to the OUT2 port. Thus, the capacitive coupling human body communication signal will be output to the first electrode via the OUT1 port, the P1 port, and the P5 port, and to the second electrode via the OUT2 port, the P2 port, and the P6 port, and ultimately transmitted via the antenna in the electronic device, thereby achieving transmission of the capacitive coupling human body communication signal.
[0140] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0141] 3B , which exemplarily illustrates the internal structure of a current / capacitive coupling type human body communication composite module of a somatosensory operation device integrated in an electronic device for receiving human body communication signals.
[0142] As shown in FIG3B , the current / capacitive coupling type human body communication composite module may include a human body communication module and a receiving circuit.
[0143] Among them, for the receiving end, the human body communication module can be used to receive signals.
[0144] Among them, the receiving circuit is used to receive the capacitive coupling human body communication signal, and transmit the received capacitive coupling human body communication signal to the human body communication module through the circuit switching switch for recognition processing, thereby determining the current gesture.
[0145] Among them, the receiving circuit is also used to receive the current-coupled human body communication signal, and transmit the received current-coupled human body communication signal to the human body communication module through the circuit switching switch for recognition and processing, thereby determining the current gesture.
[0146] Based on the circuit / capacitive-coupled human body communication composite module structure shown in Figure 3B, when the electronic device serving as the receiving end operates in current-coupled human body communication mode, the human body communication module is directly connected to the receiving circuit, achieving continuity between the human body communication module and the receiving circuit. The receiving circuit's R1 port is connected to the OUT3 port, and the receiving circuit's R2 port is connected to the OUT4 port. This allows the current-coupled human body communication signal transmitted by the transmitting end to be received.
[0147] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0148] Continuing with FIG3B , illustratively, when the electronic device serving as the receiving end operates in capacitively coupled human body communication mode, the human body communication module is directly connected to the receiving circuit, achieving continuity between the human body communication module and the receiving circuit. The receiving circuit's R1 port is connected to the OUT1 port, and the receiving circuit's R2 port is connected to the OUT2 port. This allows the capacitively coupled human body communication signal transmitted by the transmitting end to be received.
[0149] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0150] In addition, in another possible implementation, the internal structure of the current / capacitive coupling type human body communication composite module may be as shown in FIG4 .
[0151] 4 , illustratively, the current / capacitive coupling human body communication composite module may include a human body communication module, a circuit switching switch, a voltage driving amplifier, a receiving circuit, and a current driving amplifier.
[0152] For the transmitting end, the human body communication module can be used to transmit signals, and for the receiving end, the human body communication module can be used to receive signals.
[0153] The circuit switching switch can be a single-pole multi-throw switch. As shown in FIG4 , the circuit switching switch is a single-pole triple-throw switch. The circuit switching switch is respectively connected to the human body communication module, the voltage drive amplifier, the receiving circuit, and the current drive amplifier.
[0154] The voltage-driven amplifier is used to amplify the signal transmitted by the human body communication module to a specific frequency corresponding to the capacitive coupling human body communication mode, thereby obtaining a capacitive coupling human body communication signal.
[0155] Among them, the receiving circuit is used to receive the capacitive coupling human body communication signal, and transmit the received capacitive coupling human body communication signal to the human body communication module through the circuit switching switch for recognition processing, thereby determining the current gesture.
[0156] Among them, the receiving circuit is also used to receive the current-coupled human body communication signal, and transmit the received current-coupled human body communication signal to the human body communication module through the circuit switching switch for recognition and processing, thereby determining the current gesture.
[0157] Among them, the current drive amplifier is used to amplify the signal transmitted by the human body communication module to a specific frequency corresponding to the current-coupled human body communication mode, thereby obtaining a current-coupled human body communication signal.
[0158] To better illustrate the current-coupled human body communication circuitry of the current / capacitive-coupled human body communication composite module shown in FIG4 when operating in the current-coupled human body communication mode, and the capacitive-coupled human body communication circuitry of the current-coupled human body communication composite module when operating in the capacitive-coupled human body communication mode, the following detailed description is provided in conjunction with FIG5A, FIG5B, FIG5C, and FIG5D.
[0159] 5A , which exemplarily shows a current-coupled human body communication circuit in an electronic device acting at a transmitting end.
[0160] Referring to Figure 5A, for example, when the electronic device serving as the transmitting end operates in the current-coupled human body communication mode, the moving end (end a) in the circuit switching switch will be connected to the fixed end (end d), thereby realizing the conduction of the line between the human body communication module and the current-driven amplifier, so that the signal transmitted by the human body communication module can be amplified by the current-driven amplifier to the specific frequency corresponding to the current-coupled human body communication mode, that is, the current-coupled human body communication signal that needs to be transmitted is obtained.
[0161] Continuing with FIG5A , illustratively, when the electronic device serving as the transmitter operates in current-coupled human body communication mode, the I1 port of the current-driven amplifier is connected to the OUT3 port, and the I2 port of the current-driven amplifier is connected to the OUT4 port. Thus, the current-coupled human body communication signal is output to the second electrode via the OUT3 port, the P3 port, and the P6 port, and to the third electrode via the OUT4 port, the P4 port, and the P7 port, and is ultimately transmitted through the antenna in the electronic device, thereby achieving transmission of the current-coupled human body communication signal.
[0162] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0163] 5B , which exemplarily shows a current-coupled human body communication circuit in an electronic device acting on a receiving end.
[0164] As shown in Figure 5B , when the receiving electronic device operates in current-coupled human body communication mode, the active terminal (terminal a) of the circuit switch connects to the stationary terminal (terminal c), establishing continuity between the human body communication module and the receiving circuit. The receiving circuit's R1 port connects to the OUT3 port, and the receiving circuit's R2 port connects to the OUT4 port. This allows the receiving device to receive the current-coupled human body communication signal transmitted by the transmitting terminal.
[0165] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0166] 5C , which exemplarily shows a capacitive coupling type human body communication circuit in an electronic device acting at a transmitting end.
[0167] Referring to Figure 5C, for example, when the electronic device serving as the transmitting end operates in the capacitive coupling human body communication mode, the moving end (end a) in the circuit switching switch will be connected to the fixed end (end b), thereby realizing the conduction of the line between the human body communication module and the voltage-driven amplifier, so that the signal transmitted by the human body communication module can be amplified by the voltage-driven amplifier to the specific frequency corresponding to the capacitive coupling human body communication mode, that is, the capacitive coupling human body communication signal that needs to be transmitted is obtained.
[0168] Continuing with FIG5C , illustratively, when the electronic device serving as the transmitter operates in capacitive coupling human body communication mode, the V1 port of the voltage-driven amplifier will be connected to the OUT1 port, and the V2 port of the voltage-driven amplifier will be connected to the OUT2 port. Thus, the capacitive coupling human body communication signal will be output to the first electrode via the OUT1 port, the P1 port, and the P5 port, and to the second electrode via the OUT2 port, the P2 port, and the P6 port, and ultimately transmitted via the antenna in the electronic device, thereby achieving transmission of the capacitive coupling human body communication signal.
[0169] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0170] 5D , which exemplarily shows a capacitive coupling human body communication circuit in an electronic device acting at a receiving end.
[0171] As shown in Figure 5D , when the electronic device serving as the receiving end operates in capacitively coupled human body communication mode, the active terminal (terminal a) of the circuit switch connects to the stationary terminal (terminal c), establishing continuity between the human body communication module and the receiving circuit. The receiving circuit's R1 port connects to the OUT1 port, and the receiving circuit's R2 port connects to the OUT2 port. This allows the capacitively coupled human body communication signal transmitted by the transmitting end to be received.
[0172] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0173] For example, in some possible implementations, for electronic devices that only need to operate in a capacitive coupling human body communication mode, the body sensing operation device may include only the first electrode and the second electrode, without including the third electrode. Accordingly, the current / capacitive coupling human body communication composite module may not include the current drive amplifier shown in Figure 3A or Figure 4.
[0174] For example, in other possible implementations, for an electronic device that only needs to operate in a capacitive coupling human body communication mode and only needs to serve as a transmitter, the body sensing operation device may include only the first electrode and the second electrode, without including the third electrode. Accordingly, the current / capacitive coupling human body communication composite module may not include the current drive amplifier and receiving circuit shown in Figure 4, or the current drive amplifier in Figure 3A.
[0175] For example, in other possible implementations, for an electronic device that only needs to operate in a capacitive coupling human body communication mode and only needs to serve as a receiving end, the somatosensory operation device may include only the first electrode and the second electrode, without including the third electrode. Accordingly, the current / capacitive coupling human body communication composite module may not include the current drive amplifier and voltage drive amplifier shown in Figure 4, that is, the current / capacitive coupling human body communication composite module has the structure shown in Figure 3B.
[0176] In addition, it should be noted that for such electronic devices that only need to work in capacitive coupling human body communication mode, the electrode switching module may not be provided in the somatosensory operation device, that is, the first electrode is directly connected to the OUT1 port, and the second electrode is directly connected to the OUT2 port.
[0177] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0178] For example, in some possible implementations, for electronic devices that only need to operate in a current-coupled human body communication mode, the body sensing operation device may include only the second and third electrodes, without the first electrode. Accordingly, the current / capacitive coupling human body communication composite module may not include the voltage-driven amplifier shown in FIG. 3A or FIG. 4 .
[0179] For example, in other possible implementations, for an electronic device that only needs to operate in a current-coupled human body communication mode and only needs to serve as a transmitter, the body sensing operation device may include only the second and third electrodes, without including the first electrode. Accordingly, the current / capacitive coupling human body communication composite module may not include the voltage-driven amplifier and receiving circuit shown in Figure 4, or the voltage-driven amplifier in Figure 3A.
[0180] For example, in other possible implementations, for an electronic device that only needs to operate in a current-coupled human body communication mode and only needs to serve as a receiving end, the somatosensory operation device may include only the second and third electrodes, without including the first electrode. Accordingly, the current- / capacitive-coupled human body communication composite module may not include the current-driven amplifier and voltage-driven amplifier shown in FIG. 4 , i.e., the current- / capacitive-coupled human body communication composite module may have the structure shown in FIG. 3B .
[0181] In addition, it should be noted that for such electronic devices that only need to work in the current-coupled human body communication mode, the electrode switching module may not be provided in the somatosensory operation device, that is, the second electrode is directly connected to the OUT3 port, and the third electrode is directly connected to the OUT4 port.
[0182] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0183] In order to better understand the technical solutions provided by the embodiments of the present application, before describing the technical solutions of the embodiments of the present application, the hardware structure of the electronic devices to which the embodiments of the present application are applicable, such as the electronic devices that integrate the somatosensory operation devices shown in Figures 2 and 4, will be described in conjunction with the accompanying drawings.
[0184] 6 , which exemplifies the hardware structure of an electronic device 100. The electronic device 100 may be, for example, a mobile phone, a tablet computer, a smart TV, a smart watch, etc., which are not listed here one by one and are not limited in this application.
[0185] As shown in Figure 6, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0186] Among them, the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (AP), a modem processor (Modem), a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc., which are not listed one by one here and are not limited in this application.
[0187] It is understood that regarding the processor 110 including the above-mentioned processing units, in some implementations, the different processing units may be independent devices. That is, each processing unit can be considered a processor. In other implementations, the different processing units may also be integrated into one or more processors. For example, in some implementations, the modem processor may be an independent device. In other implementations, the modem processor may be independent of the processor 110 and provided in the same device as the mobile communication module 150 or other functional modules.
[0188] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0189] The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 .
[0190] Among them, the internal memory 121 can be used to store computer executable program code, and the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, and the somatosensory operation function mentioned in the embodiment of the present application, etc.). The data storage area can store data created during the use of the electronic device 100, such as the parameter information configured when the somatosensory operation function is turned on, such as the parameter information configured in window 10c-6 in (2) of Figure 10C below. For example, the change curve / relationship between the received signal strength and time corresponding to different gestures in the current coupling human body communication mode and the capacitive coupling human body communication mode, etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0191] The charging management module 140 is configured to receive charging input from a charger. The power management module 141 is configured to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160.
[0192] 6 , the wireless communication function of the electronic device 100 can be implemented through the antenna 1 , the antenna 2 , the mobile communication module 150 , the wireless communication module 160 , the modem processor, and the baseband processor.
[0193] It should be noted that antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other implementations, the antennas can be used in conjunction with tuning switches.
[0194] Continuing to refer to Figure 6, the mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The wireless communication module 160 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), and wireless communication solutions based on the somatosensory operation device shown in Figures 2 and 4 provided in the embodiments of the present application applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0195] Specifically in this embodiment, the somatosensory operation can be directly achieved by cooperating with the somatosensory operation device of the structure shown in FIG. 2 and FIG. 4 and the antenna 2 .
[0196] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0197] The audio module 170 may include a speaker 170A, a receiver 170B, a microphone 170C, an earphone jack 170D, etc., which are not listed here one by one and are not limited in this application.
[0198] Among them, the sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc., which are not listed here one by one and are not limited in this application.
[0199] Among them, buttons 190 may include a power button, volume button, etc. Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts or touch vibration feedback. Indicator 192 can be an indicator light that can be used to indicate charging status, power level changes, messages, missed calls, notifications, etc.
[0200] The camera 193 is used to capture still images or videos. In some implementations, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0201] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some implementations, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.
[0202] This concludes the introduction to the hardware structure of the electronic device 100. It should be understood that the electronic device 100 shown in FIG6 is merely an example. In a specific implementation, the electronic device 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have a different component configuration. The various components shown in FIG6 may be implemented in hardware, including one or more signal processing and / or application-specific integrated circuits, software, or a combination of hardware and software.
[0203] 7 , which exemplifies the hardware structure of an electronic device 200. The electronic device 200 may be, for example, a smart ring without a display screen, a camera, or other hardware structures, i.e., a wearable device for monitoring a user's behavior and living habits.
[0204] As shown in FIG7 , the electronic device 200 may include: a processor 210 , a somatosensory operation device 220 , a memory 230 , an antenna 240 , and the like.
[0205] The processor 210 may serve as the nerve center and command center of the electronic device 200. The processor 210 may generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. The processor 210 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory.
[0206] Memory 230 can be used to store computer-executable program code, which includes instructions. Memory 230 can be volatile memory or persistent memory. The computer-executable program code stored in memory 230 can include one or more modules, each of which can include a series of instruction operations in the somatosensory operation device. Memory 230 can include a program storage area and a data storage area.
[0207] Furthermore, the processor 210 can be configured to communicate with the memory 230 to execute a series of instruction operations in the memory 230 on the electronic device 200. The processor 210 executes the computer program instructions stored in the memory 230 to perform various functions and data processing of the electronic device 200.
[0208] Among them, the somatosensory operation device 220 is used to enable the electronic device 200 to establish a somatosensory operation connection with the electronic device 100, and then operate in a current-coupled human body communication mode or a capacitive-coupled human body communication mode to realize the transmission and reception of current-coupled human body communication signals, or the transmission and reception of capacitive-coupled human body communication signals.
[0209] The antenna 240 is used to transmit the capacitive coupling human body communication signal or the current coupling human body communication signal transmitted by the somatosensory operation device 220 , and to receive the capacitive coupling human body communication signal or the current coupling human body communication signal transmitted by the electronic device 100 .
[0210] This concludes the introduction to the hardware structure of the electronic device 200. It should be understood that the electronic device 200 shown in FIG7 is merely an example. In a specific implementation, the electronic device 200 may have more or fewer components than shown in the figure, may combine two or more components, or may have a different component configuration. The various components shown in FIG7 may be implemented in hardware, including one or more signal processing and / or application-specific integrated circuits, software, or a combination of hardware and software.
[0211] In addition, it should be noted that the somatosensory operation method provided in the embodiments of the present application, whether the electronic device serving as the transmitting end or the electronic device serving as the receiving end, must integrate the somatosensory operation device described in the above embodiments. To better understand the somatosensory operation scheme provided in the embodiments of the present application, the software structure of the electronic device integrating the somatosensory operation device is specifically described below with reference to Figure 8.
[0212] Before describing the software structure of the electronic device, the architecture that can be adopted by the software system of the electronic device is first described.
[0213] Specifically, in practical applications, the software system of an electronic device may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
[0214] In addition, it is understandable that the software systems used by current mainstream electronic devices include but are not limited to Windows systems, Android systems, and iOS systems. For ease of explanation, the embodiment of this application takes the layered architecture Android system as an example to exemplify the software structure of the electronic device.
[0215] In addition, it should be understood that the subsequent somatosensory operation solutions provided in the embodiments of the present application are also applicable to other systems in specific implementations.
[0216] See FIG8 , which is a software structure block diagram of the electronic device according to an embodiment of the present application.
[0217] As shown in Figure 8, the layered architecture of electronic devices divides software into several layers, each with clear roles and divisions of labor. Layers communicate with each other through software interfaces. In some implementations, the Android system is divided into five layers: from top to bottom, the application layer / application layer (Applications), the core layer / Application Framework (FWK), the runtime (Runtime) and system libraries, and the underlying hardware abstraction layer (HAL) and Linux kernel layer.
[0218] The application layer may include a series of application packages. As shown in FIG8 , the application package may include applications such as camera, games, somatosensory operation, and settings. These applications are not listed here one by one and are not limited in this application.
[0219] Among them, the somatosensory operation application can be a specially provided application for turning on the somatosensory operation function, searching for electronic devices with the somatosensory operation function turned on around, establishing a somatosensory operation connection with the searched electronic devices, and configuring parameter information.
[0220] Specifically in actual applications, the functions implemented by the somatosensory operation application can also be integrated into the settings application.
[0221] Regarding the operations implemented based on the entrance provided by the somatosensory operation application or the setting application, please refer to Figures 10A to 10E, which will not be described in detail here.
[0222] The framework layer can provide application programming interfaces (APIs) and programming frameworks for applications in the application layer. In some implementations, these programming interfaces and programming frameworks can be described as functions. As shown in Figure 8, the framework layer can include functions such as content providers, window managers, view systems, and resource managers. These functions are not listed here and are not limited in this application.
[0223] It should be noted that the window manager located in the framework layer is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0224] Furthermore, it should be noted that the content provider located in the framework layer is used to store and retrieve data and make it accessible to applications. This data may include video, images, audio, dialed and received calls, browsing history and bookmarks, phone books, etc., which are not listed here and are not limited by this application.
[0225] It should also be noted that the view system located in the framework layer includes visual controls, such as controls for displaying text and images. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0226] In addition, it should be noted that the resource manager located in the framework layer is used to provide various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc., which are not listed here one by one, and this application does not impose any restrictions on this.
[0227] Continuing to refer to FIG8 , illustratively, the runtime, specifically the Android runtime (Android Runtime), may include a core library and a virtual machine, which are mainly responsible for scheduling and management of the Android system.
[0228] The core library consists of two parts: one containing the Java language's callable functions and the other containing the Android core library. The application layer and framework layer run in a virtual machine. The virtual machine executes the application and framework layer Java files as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0229] Continuing with FIG8 , illustratively, the system library may include multiple functional modules, such as a surface manager, a media library, a three-dimensional (3D) graphics processing library (e.g., OpenGL ES), a two-dimensional (2D) graphics engine (e.g., SGL), etc.
[0230] The surface manager manages the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. It supports a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PnG. The 3D graphics processing library implements 3D graphics drawing, image rendering, compositing, and layer processing.
[0231] In addition, it is understandable that the 2D graphics engine mentioned above is a drawing engine for 2D drawing.
[0232] Continuing to refer to FIG8 , illustratively, the HAL layer is an interface layer located between the operating system kernel (kernel layer) and the hardware circuit. Its purpose is to isolate the FWK from the kernel so that Android does not become overly dependent on the kernel, thereby allowing the development of the FWK to be carried out without considering the driver.
[0233] Continuing to refer to FIG8 , illustratively, the HAL layer may include various interfaces, such as an audio and video interface, a GPS interface, a call interface, a WiFi interface, etc., which are not listed one by one here and are not limited in this application.
[0234] 8, illustratively, the kernel layer in the Android system is the layer between hardware and software. The kernel layer may include various processes / threads, power management, various drivers, such as WiFi drivers, etc.
[0235] This concludes the introduction to the software structure of the electronic device. It should be understood that the layers in the software structure shown in FIG8 and the components contained in each layer do not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer layers than shown, and each layer may include more or fewer components, and this application does not limit this.
[0236] Based on the above hardware structure and software structure, the configuration of the prerequisites for implementing the somatosensory operation solution provided in the embodiment of the present application is described below in combination with Figures 9, 10A to 10E, and 11.
[0237] 9 , illustratively, device A (e.g., a smart watch), device B (e.g., a smart ring), device C (e.g., wearable smart glasses), and device D (a mobile phone) are in the same space and can search for each other when the motion sensing function is turned on.
[0238] Based on the above prerequisites, taking the entry for configuring the somatosensory operation function in the setting application as an example, when the user uses device D to perform the relevant configuration of the somatosensory operation function, in one possible implementation method, the user can first click the icon 10a-1 corresponding to the setting application in the interface 10a shown in Figure 10A (1).
[0239] Accordingly, in response to the operation, device D will start the setting application, and the interface 10a shown in (1) of FIG. 10A will switch to the interface 10b shown in (2) of FIG. 10A .
[0240] Referring to (2) in FIG. 10A , for example, specifically in the technical solution provided in this embodiment, the interface 10b needs to include a setting entry corresponding to the somatosensory operation function.
[0241] For example, in one possible implementation, a user can click on the area where the setting entry corresponding to the somatosensory operation function is located in interface 10b, such as area 10b-1 shown in (2) in FIG10A. Accordingly, in response to this operation, device D jumps from interface 10b shown in (2) in FIG10A to interface 10c shown in (1) in FIG10B.
[0242] Referring to (1) in FIG10B , the interface 10c may include one or more controls, for example, a control 10c-1 for returning to the interface 10c and a control for turning on or off a somatosensory operation function.
[0243] For example, in this embodiment, when the control corresponding to the somatosensory operation function is in the style of the control 10c-2 shown in (1) of Figure 10B, it indicates that the somatosensory operation function is not enabled. When the control corresponding to the somatosensory operation function is in the style of the control 10c-2' shown in (2) of Figure 10B, it indicates that the somatosensory operation function is enabled.
[0244] Based on this, when the control corresponding to the somatosensory operation function is in the style of control 10c-2 shown in Figure 10B (1), when the user clicks on control 10c-2, device D will respond to the operation behavior, turn on the somatosensory operation function, and automatically search for nearby electronic devices that have turned on the somatosensory operation function. At the same time, control 10c-2 will switch to control 10c-2'.
[0245] For example, in order to improve the user experience, the user is informed that a search is currently underway for nearby electronic devices that have activated the motion sensing function. In one feasible implementation, a control 10c-3 as shown in (2) in FIG. 10B may be displayed in the interface 10c.
[0246] For example, in a possible implementation, after the motion sensing operation function is turned on, device D can automatically search for devices A, B, and C in FIG9 that also have the motion sensing operation function turned on.
[0247] For example, in a possible implementation, after searching for nearby electronic devices that have activated the motion sensing operation function, the interface 10c may display a device list as shown in (1) in FIG. 10C .
[0248] Referring to (1) in FIG. 10C , illustratively, the device list may display the device name of each searched device, such as device A, device B, and device C shown in the figure.
[0249] Continuing to refer to (1) in FIG. 10C , illustratively, the interface 10c may further include a control 10c - 5 for allowing the user to manually add other somatosensory devices.
[0250] For example, in one possible implementation, if device D does not search for other nearby electronic devices that have enabled the motion sensing operation function, or the searched electronic device is not the electronic device expected by the user, the user may click control 10c-5.
[0251] Exemplarily, in one possible implementation, in response to the operation behavior, device D may jump from interface 10c shown in (1) in FIG. 10C to interface 10d shown in (2) in FIG. 10C .
[0252] Referring to (2) in FIG10C , the interface 10d may include one or more functional controls, for example, a control 10d-1 for returning to the interface 10c shown in (1) in FIG10C , a control 10d-2 for triggering manual addition of a desired electronic device, and a control 10d-3 for triggering addition by scanning a code.
[0253] For example, in one possible implementation, when a user clicks control 10d-2, device D, in response to this operation, may pop up a window or interface for the user to manually enter device information of the device they wish to add, such as IMEI, MEID, etc., so that the user can manually add the desired electronic device. This application does not limit the style of this window or interface.
[0254] For example, in another possible implementation, the user clicks control 10d-3. In response to this operation, device D can jump from interface 10d to the code scanning interface and activate the rear camera of device D. In this way, by scanning the QR code or barcode information provided on the electronic device to be added, the electronic device can be added. This application does not limit the style of this code scanning interface.
[0255] In addition, it should be noted that when the interface 10c shown in (1) of FIG. 10C jumps to the interface 10d shown in (2) of FIG. 10C , the device D will automatically trigger an automatic scan to scan for nearby available somatosensory devices.
[0256] Continuing to refer to (1) in FIG. 10C , for example, if the user desires to establish a somatosensory operation connection with the searched device A, in one possible implementation, the user may click area 10c-4 of the row where device A is located in the device list.
[0257] Exemplarily, in response to the operation behavior, device D may, in one possible implementation, pop up a window 10c-6 as shown in (1) in FIG10D on the interface 10c.
[0258] Referring to (1) in FIG. 10D , illustratively, window 10c-6 may include one or more functional options, such as controls 10c-61 and 10c-62 for the user to select an input method, controls 10c-63 and 10c-64 for the user to select a device identity, controls 10c-65 and 10c-66 for the user to select a processing method, a control 10c-67 for returning (closing window 10c-6), and a control 10c-68 for initiating a somatosensory operation connection request to device A.
[0259] Continuing to refer to (1) in FIG10D , illustratively, the input mode corresponding to control 10c-61 is the body surface input mode, i.e., the current coupling type human body communication signal input mode applicable to scenarios 1 and 2 as described in the above embodiments. The input mode corresponding to control 10c-62 is the external body input mode, i.e., the capacitive coupling type human body communication signal input mode applicable to scenario 3 as described in the above embodiments.
[0260] Specifically in this embodiment, the input mode defaults to the body surface input mode, that is, the control 10c-61 is in the selected state (the style shown in (1) in Figure 10D), and the control 10c-62 is in the unselected state (the style shown in (1) in Figure 10D).
[0261] In addition, it should be noted that when the input mode corresponding to device A is configured as a surface input mode or an external input mode, in order to enable device D and device A to implement the somatosensory operation method provided in this application, the input mode corresponding to device D will be automatically configured as the input mode corresponding to device A.
[0262] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0263] Continuing to refer to (1) in FIG10D , illustratively, the identity corresponding to the control 10c-63 is the controlled end mentioned in the above embodiment, and the identity corresponding to the control 10c-64 is the controlling end mentioned in the above embodiment.
[0264] It is understandable that the controlled end in this embodiment is an electronic device for responding to gestures recognized based on human body communication technology, while the controlling end is an electronic device that transmits the current-coupled human body communication signal or the capacitive-coupled human body communication signal mentioned in the above embodiments.
[0265] Specifically in this embodiment, the identity set for device A defaults to the control end, that is, control 10c-64 is in an unselected state (the style shown in (1) in Figure 10D), and control 10c-65 is in a selected state (the style shown in (1) in Figure 10D).
[0266] In addition, it should be noted that when the identity corresponding to device A is configured as the controlling end, in order to enable device D and device A to implement the somatosensory operation method provided in this application, the identity corresponding to device D will be automatically configured as the controlled end.
[0267] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0268] Continuing to refer to (1) in FIG10D , illustratively, the processing method corresponding to control 10c-65 defaults to being processed by the control end, that is, control 10c-65 is in a selected state (the style shown in (1) in FIG10D ), and control 10c-66 is in an unselected state (the style shown in (1) in FIG10D ).
[0269] It should be noted that the controlled end processing method mentioned in this embodiment refers to the signal transmitting end (control end) being used only to transmit current-coupled human body communication signals or capacitive-coupled human body communication signals of a specific frequency. After receiving the current-coupled human body communication signals or capacitive-coupled human body communication signals transmitted by the transmitting end, the controlled end (receiving end) processes the signals to determine the corresponding received signal strength and time relationship. Based on the received signal strength and time relationship corresponding to the set gestures, such as sliding and clicking, the current gesture can be accurately determined.
[0270] In addition, the control end processes this processing method, which means that the signal transmitting end (control end) not only needs to transmit a current-coupled human body communication signal or a capacitive-coupled human body communication signal of a specific frequency, but also needs to match the current gesture from the set gestures, such as sliding, clicking, etc., based on the received signal strength and time relationship corresponding to the transmitted signal, and then transmit signal instructions corresponding to different gestures to the controlled end, so that the controlled end can respond to the current gesture.
[0271] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0272] Continuing to refer to (1) in Figure 10D, for example, when the user completes the setting of the somatosensory operation of device A according to the parameter information configured in window 10c-6 shown in (1) in Figure 10D and clicks control 10c-68, device D responds to the operation behavior, closes window 10c-6, and generates a somatosensory operation connection request according to the parameter information configured in window 10c-6, and waits for the response of device A to establish the somatosensory operation connection between the two.
[0273] For example, after device A responds and completes the somatosensory operation connection with device D, the window 10c-68 will be closed, and a connected mark will be displayed in the area 10c-4 corresponding to device A in the device list in the interface 10c, as shown in (2) in Figure 10D.
[0274] Referring to (2) in FIG10D , for example, when a connected mark is displayed in area 10c-4 corresponding to device A in the device list in interface 10c, if the user clicks on area 10c-4 again, device D responds to the operation, and in one possible implementation, a window 10c-7 as shown in FIG10E may be displayed.
[0275] 10E , illustratively, window 10c - 7 displays configuration information for device A and controls for modifying the configuration information. Controls 10c - 71 to 10c - 76 have the same functions as controls 10c - 61 to 10c - 66 described above, and are not described in detail here.
[0276] In addition, the control 10c-77 in the window 10c-7 is used to cancel the current modification, and the control 10c-8 is used to save the current modification.
[0277] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0278] Thus, through the processing methods of Figures 10A to 10E, a somatosensory operation connection is established between device D and device A, as shown in Figure 11. In this way, the user can use device A to perform somatosensory operations on device D. Regarding the user's control of somatosensory operations on device D using device A, please refer to the description of scenario 3 in the following embodiment and will not be repeated here.
[0279] In addition, it should be noted that in some possible implementations, for example, for electronic devices that do not have a display screen or cannot install the somatosensory operation application or setting application mentioned in the above embodiments, the somatosensory function of such devices can be configured through a third-party electronic device. For example, a user can use device D to configure the configuration information of the somatosensory function for device A, device B, device C, etc. respectively. For such devices that have been configured with the configuration information of the somatosensory function by device D, in some possible implementations, the somatosensory operation function can be turned on by colliding with each other in a designated area. Accordingly, after the somatosensory operation function is turned on, such electronic devices will operate according to the configuration information configured by device D.
[0280] In addition, in some other possible implementations, the electronic device that first initiates the touch or somatosensory operation connection request can be set by default as the controlled end, the processing method is processed by the controlled end, and the body surface input method is adopted by default.
[0281] Furthermore, in some other possible implementations, two electronic devices configured to use a surface-of-body input method can automatically switch to an external-body input method for detection at a set period or when no input or output of a current-coupled human body communication signal is detected within a set time period. Similarly, when no input or output of a capacitive-coupled human body communication signal is detected within a set period or when no input or output of a capacitive-coupled human body communication signal is detected within a set time period, the two electronic devices can automatically switch to a surface-of-body input method for detection.
[0282] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0283] In the following, in conjunction with the accompanying drawings, two electronic devices that have integrated the somatosensory operation device provided by the above embodiment, turned on the somatosensory operation function, and completed relevant configurations such as input method, identity, processing method, etc. are used as an example to specifically describe scenarios 1, 2, and 3 mentioned in the above implementation.
[0284] Before explaining Scene 1, Scene 2, and Scene 3, the operation gestures that can realize the somatosensory operation in Scene 1, Scene 2, and Scene 3 are first explained.
[0285] Specifically, for scenario 1, since the two electronic devices are located on different limbs of the user, the received signal strength will change during the sliding operation (slide away, slide closer) and the clicking operation. Therefore, the operation gestures that can realize the somatosensory operation in scenario 1 may include the sliding away gesture, the sliding closer gesture, and the clicking gesture.
[0286] Specifically, in scenario 2, since the two electronic devices are located on the same limb of the user, sliding a limb that is not wearing an integrated somatosensory operation device and has not enabled the somatosensory operation function on the limb wearing two electronic devices will not affect the received signal strength. The received signal strength will only change when the user clicks and touches the ground electrode of the controlled end on the limb, such as the first electrode mentioned above. Therefore, the operation gestures that can achieve somatosensory operation in scenario 2 may include click operation gestures.
[0287] Specifically, for scenario 3, since one electronic device is placed on the table and the other electronic device is configured on the user, when the user uses the limb wearing one electronic device to slide or click on the table where the other electronic device is placed, the received signal strength will change. Therefore, the operation gestures that can realize somatosensory operation in scenario 3 may include the operation gesture of sliding away, the operation gesture of sliding close, and the operation gesture of clicking.
[0288] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0289] Based on the operation gestures applicable to the above different scenarios, scenario 1, scenario 2 and scenario 3 are explained.
[0290] Scenario 1: Two electronic devices are located on different limbs of the user
[0291] (1) Slide-to-close gesture scenario
[0292] Referring to Figure 12A, for example, in a possible scenario, the user wears device A on his left arm (integrating the somatosensory operation device provided by the above embodiment, turning on the somatosensory operation function, the input mode is configured as surface input, the identity is configured as the controlled end, and the processing mode is configured as processed by the controlled end), and the user wears device B on his right hand (integrating the somatosensory operation device provided by the above embodiment, turning on the somatosensory operation function, the input mode is configured as surface input, the identity is configured as the controlled end, and the processing mode is configured as processed by the controlled end).
[0293] Referring to Figure 12B, for example, in another possible scenario, the user wears device C on his head (integrating the somatosensory operation device provided by the above embodiment, turning on the somatosensory operation function, the input mode is configured as surface input, the identity is configured as the controlled end, and the processing mode is configured as processed by the controlled end), and the user wears device B on his right hand (integrating the somatosensory operation device provided by the above embodiment, turning on the somatosensory operation function, the input mode is configured as surface input, the identity is configured as the controlled end, and the processing mode is configured as processed by the controlled end).
[0294] Exemplarily, for the scenario shown in Figures 12A and 12B, when the user uses the finger wearing device B to make a sliding approach operation gesture, that is, uses the finger wearing device B to contact the limb wearing the controlled end, such as device A or device C, and then gradually moves toward the controlled end along the sliding direction 1 shown in Figures 12A and 12B from a position away from the controlled end, such as device A or device C, and stays for a set time when close to the controlled end, then lifts the finger wearing device B from the staying position and gradually moves away from the controlled end, device B will emit a current-coupled human body communication signal of a specific frequency.
[0295] Correspondingly, the controlled end will receive the current-coupled human body communication signal transmitted by device B during the process, and record the signal strength of the received current-coupled human body communication signal (hereinafter referred to as received signal strength).
[0296] Since the processing method is configured to be processed by the controlled end, the controlled end, such as device A or device C, receives the current-coupled human body communication signal and obtains the received signal strength corresponding to the current-coupled human body communication signal. It will then determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength changing with time corresponding to the current-coupled human body communication signal) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform will be used as the currently recognized target gesture, and then the corresponding operation will be performed in response to the target gesture.
[0297] It should be noted that the current-coupled human body communication mode can be applied to both scenario 1 and scenario 2. Specifically, in scenario 1, based on the current-coupled human body communication signal, operation gestures such as sliding away, sliding closer, and clicking can be identified. In scenario 2, based on the current-coupled human body communication signal, the operation gesture of clicking can be identified. Therefore, the preset change waveforms preset in the internal memory of the controlled terminal mentioned above may include the waveform corresponding to the operation gesture of sliding away in scenario 1, the waveform corresponding to the operation gesture of sliding closer, the waveform corresponding to the operation gesture of clicking, and the waveform corresponding to the operation gesture of clicking in scenario 2.
[0298] The waveform corresponding to the sliding gesture in scenario 1 is shown in Figure 13. Referring to Figure 13, for example, at time T0_N1, the finger of the person wearing device B or other controlling terminal (such as the finger of the right hand) has not yet made contact with the limb wearing or holding the controlled terminal, such as the left arm or head, and the corresponding received signal strength at this time is, for example, S2.
[0299] Continuing to refer to FIG13 , for example, from moment T0_N1 to moment T1_N1, the fingers of the right hand wearing device B gradually approach the limb where the controlled end is located (such as the left arm in FIG12A , or the face in FIG12B ). During this process, the received signal strength changes with time, gradually increasing from S2 to S3.
[0300] Continuing to refer to Figure 13, for example, as the right finger wearing device B gets closer to the limb where the controlled end is located, the received signal strength will also become stronger and stronger, and when the right finger touches the limb where the controlled end is located, the received signal strength will increase instantaneously. For example, when the right finger touches the limb where the controlled end is located at time T2_N1, the received signal strength will increase to S4.
[0301] Continuing to refer to Figure 13, for example, at time T2_N1, after the finger of the right hand wearing device B contacts the support where the controlled end is located, as the user slides along the sliding direction 1 on the limb wearing the controlled end, the received signal strength gradually becomes stronger. For example, from time T2_N1 to time T3_N1, the received signal strength gradually increases from S4 to S5 as time changes.
[0302] Continuing to refer to FIG13 , for example, when the finger of the right hand contacts the limb where the controlled end is located and stays close to the controlled end for a set time (such as from moment T3_N1 to moment T4_N1), since the distance between device B and the controlled end has not changed, the received signal strength will remain unchanged (or the received signal strength fluctuates slightly) from moment T3_N1 to moment T4_N1, that is, it will remain at S5.
[0303] Continuing to refer to FIG13 , illustratively, when the right hand finger is lifted from the position in contact with the limb where the controlled end is located, the received signal strength will drop rapidly. For example, from time T4_N1 to time T5_N1, the received signal strength will drop rapidly from S5 to S1.
[0304] Continuing to refer to FIG13 , illustratively, when the right hand fingers are lifted and away from the limb where the controlled terminal is located, the received signal strength will continue to decrease. For example, from time T5_N1 to time T6_N1, the received signal strength will decrease from S1 to S0.
[0305] As can be seen from this, for the sliding gesture in Scenario 1, as the user performs this gesture, the received signal strength will change over time as shown in Figure 13. That is, before the first moment (such as time T1_N1), the limb wearing the controlling terminal is not in contact with the limb wearing the controlled terminal, and the received signal strength is weak. However, as the limb wearing the controlling terminal gradually approaches the limb wearing the controlled terminal, the received signal strength will gradually increase. At the second moment (such as time T2_N1), when the limb wearing the controlling terminal makes contact with the limb wearing the controlled terminal, the received signal strength will become significantly stronger. During the time that the limb wearing the controlling device is in contact with the limb wearing the controlled device, as the limb wearing the controlling device slides over the limb wearing the controlled device toward the controlled device, such as from time T2_N1 to time T3_N1, the received signal strength continues to increase. After reaching a certain value, it remains at that value until the limb wearing the controlling device separates from the limb wearing the controlled device (such as from time T4_N1). Then, as the limb wearing the controlling device separates from the limb wearing the controlled device, the received signal strength rapidly decreases, such as from time T4_N1 to time T5_N1, the received signal strength rapidly decreases from S5 to S1. Thereafter, as the limb wearing the controlling device moves away from the limb wearing the controlled device, the received signal strength slowly decreases.
[0306] Therefore, in actual applications, when the waveform obtained based on the current received signal strength and the actual change matches the preset change waveform shown in the preset Figure 13, it can be determined that the operation gesture currently made by the user is the sliding closer operation gesture.
[0307] For example, in some possible implementations, if the agreed sliding gesture operation is used to control the current interface of the controlled end to implement a swipe up operation or a swipe right to turn the page, the controlled end, such as device A or device C, will swipe up or swipe right to turn the page of the current interface in response to the currently recognized operation gesture.
[0308] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0309] (2) Slide away operation gesture scenario:
[0310] Referring to FIG. 14A , for example, the preconditions and configuration locations of device A and device B in FIG. 14A are the same as those in FIG. 12A and are not described again here.
[0311] Referring to FIG. 14B , for example, the preconditions and configuration locations of device C and device B in FIG. 14B are the same as those in FIG. 12B and are not described again here.
[0312] Exemplarily, for the scenario shown in Figures 14A and 14B, when the user uses the finger wearing device B to make a sliding gesture away, that is, uses the finger wearing device B to contact the limb wearing the controlled end, such as device A or device C, and then moves along the sliding direction 2 shown in Figures 14A and 14B from a position close to the controlled end, such as device A or device C, gradually moving away from the controlled end, and staying at a certain distance (such as 5 cm) away from the controlled end for a set time, then lifting the finger wearing device B from the staying position and gradually moving away from the controlled end, device B will emit a current-coupled human body communication signal of a specific frequency.
[0313] Correspondingly, the controlled end will receive the current-coupled human body communication signal transmitted by device B during the process, and record the signal strength of the received current-coupled human body communication signal (hereinafter referred to as received signal strength).
[0314] Since the processing method is configured to be processed by the controlled end, the controlled end, such as device A or device C, receives the current-coupled human body communication signal and obtains the received signal strength corresponding to the current-coupled human body communication signal. It will then determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength changing with time corresponding to the current-coupled human body communication signal) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform will be used as the currently recognized target gesture, and then the corresponding operation will be performed in response to the target gesture.
[0315] The waveform corresponding to the swipe away gesture in scenario 1 is shown in Figure 15. Referring to Figure 15, for example, at time T0_F1, the finger of the person wearing device B or other controlling terminal (such as the finger of the right hand) has not yet made contact with the limb wearing or holding the controlled terminal, such as the left arm or head, and the corresponding received signal strength at this time is, for example, S1.
[0316] Continuing to refer to FIG15 , for example, from moment T0_F1 to moment T1_F1, the fingers of the right hand wearing device B gradually approach the limb where the controlled end is located (such as the left arm in FIG14A , or the face in FIG14B ). During this process, the received signal strength changes with time, gradually increasing from S1 to S2.
[0317] Continuing to refer to Figure 15, for example, as the right finger of the person wearing device B gets closer and closer to the limb where the controlled end is located, the received signal strength will also become stronger and stronger, and when the right finger touches the limb where the controlled end is located, the received signal strength will increase instantaneously. For example, when the right finger touches the limb where the controlled end is located at time T2_F1, the received signal strength will increase to S4.
[0318] Continuing to refer to Figure 15, for example, at time T2_F1, after the finger of the right hand wearing device B contacts the support where the controlled end is located, as the user slides along the sliding direction 2 on the limb wearing the controlled end, the received signal strength gradually weakens as the user gradually moves away from the controlled end. For example, from time T2_F1 to time T3_F1, the received signal strength gradually decreases from S4 to S3 as time changes.
[0319] Continuing to refer to FIG15 , for example, when the finger of the right hand contacts the limb where the controlled end is located and stays at a position away from the controlled end for a set time (such as from moment T3_F1 to moment T4_F1), since the distance between device B and the controlled end has not changed, the received signal strength will remain unchanged (or the received signal strength fluctuates slightly) from moment T3_F1 to moment T4_F1, that is, it will remain at S3.
[0320] Continuing to refer to FIG15 , illustratively, when the right hand finger is lifted from the position in contact with the limb where the controlled end is located, the received signal strength will drop rapidly. For example, from time T4_F1 to time T5_F1, the received signal strength will drop rapidly from S3 to S1.
[0321] Continuing to refer to FIG15 , illustratively, when the right hand fingers are lifted and away from the limb where the controlled terminal is located, the received signal strength will continue to decrease. For example, from time T5_F1 to time T6_F1, the received signal strength will decrease from S1 to S0.
[0322] As can be seen from this, for the swipe away gesture in Scenario 1, as the user performs this gesture, the received signal strength will change over time as shown in Figure 15. That is, before the first moment (e.g., moment T1_F1), the limb wearing the controlling terminal is not in contact with the limb wearing the controlled terminal, and the received signal strength is relatively weak. However, as the limb wearing the controlling terminal gradually approaches the limb wearing the controlled terminal, the received signal strength will gradually increase. At the second moment (e.g., moment T2_F1), when the limb wearing the controlling terminal makes contact with the limb wearing the controlled terminal, the received signal strength will significantly increase. During the time the limb wearing the controlling device is in contact with the limb wearing the controlled device, as the limb wearing the controlling device slides over the limb wearing the controlled device and away from the controlled device, such as from time T2_F1 to time T3_F1, the received signal strength gradually decreases. After reaching a certain value, it remains at that value until the limb wearing the controlling device separates from the limb wearing the controlled device (such as at time T4_F1). Then, as the limb wearing the controlling device separates from the limb wearing the controlled device, the received signal strength rapidly decreases, such as from time T4_F1 to time T5_F1, when the received signal strength rapidly decreases from S3 to S1. Afterwards, as the limb wearing the controlling device moves away from the limb wearing the controlled device, the received signal strength slowly decreases.
[0323] Therefore, in actual applications, when the waveform obtained based on the current received signal strength and the actual change matches the preset change waveform shown in the preset Figure 15, it can be determined that the operation gesture currently made by the user is the slide away operation gesture.
[0324] For example, in some possible implementations, if the agreed sliding away gesture operation is used to control the current interface of the controlled end to implement a sliding operation, or a left swipe to turn the page, the controlled end, such as device A, device C, will slide down or swipe left to turn the page of the current interface in response to the currently recognized operation gesture.
[0325] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0326] (3) Click gesture scene
[0327] Referring to FIG. 16A , for example, the preconditions and configuration locations of device A and device B in FIG. 16A are the same as those in FIG. 12A and are not described again here.
[0328] Referring to FIG. 16B , for example, the preconditions and configuration locations of device C and device B in FIG. 16B are the same as those in FIG. 12B and are not described again here.
[0329] For example, for the scenarios shown in FIG16A and FIG16B, when the user uses the finger wearing device B to make a click operation gesture, that is, uses the finger wearing device B to contact the limb wearing the controlled end, such as device A or device C, such as the right finger moves from the position (1) in FIG16A or (1) in FIG16B to the position (2) in FIG16A or (2) in FIG16B. Then, when receiving the limb where the controlled end is located, it stays for a set time, that is, after staying at the position (2) in FIG16A or (2) in FIG16B for a set time, the finger wearing device B is lifted from the rest position and gradually moves away from the controlled end, that is, during the process of the right finger moving from the position (2) in FIG16A or (2) in FIG16B to the position (3) in FIG16A or (3) in FIG16B, device B will emit a current-coupled human body communication signal of a specific frequency.
[0330] Correspondingly, the controlled end will receive the current-coupled human body communication signal transmitted by device B during the process, and record the signal strength of the received current-coupled human body communication signal (hereinafter referred to as received signal strength).
[0331] Since the processing method is configured to be processed by the controlled end, the controlled end, such as device A or device C, receives the current-coupled human body communication signal and obtains the received signal strength corresponding to the current-coupled human body communication signal. It will then determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength changing with time corresponding to the current-coupled human body communication signal) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform will be used as the currently recognized target gesture, and then the corresponding operation will be performed in response to the target gesture.
[0332] The waveform corresponding to the click gesture in scenario 1 is shown in Figure 17. Referring to Figure 17, for example, at time T0_C1, the finger of the person wearing device B or other controlling terminal (such as the finger of the right hand) has not yet made contact with the limb wearing or holding the controlled terminal, such as the left arm or head, and the corresponding received signal strength at this time is, for example, S2.
[0333] Continuing to refer to FIG17 , for example, from moment T0_C1 to moment T1_C1, the fingers of the right hand wearing device B gradually approach the limb where the controlled end is located (such as the left arm in FIG16A , or the face in FIG16B ). During this process, the received signal strength changes with time, gradually increasing from S2 to S3.
[0334] Continuing to refer to Figure 17, for example, as the right finger wearing device B gets closer to the limb where the controlled end is located, the received signal strength will also become stronger and stronger, and when the right finger touches the limb where the controlled end is located, the received signal strength will increase instantaneously. For example, when the right finger touches the limb where the controlled end is located at time T2_C1, the received signal strength will increase to S4.
[0335] Continuing with FIG17 , for example, at time T2_C1, after the right finger of the wearer B contacts the support where the controlled terminal is located, the right finger continues to press at the contact position for a set time, such as from time T2_C1 to time T3_C1. Since the distance between the right finger and the controlled terminal does not change during this time period, the received signal strength will remain unchanged (or the received signal strength will fluctuate slightly) from time T2_C1 to time T3_C1, that is, remain at S4, or increase to S5, which is slightly greater than S4.
[0336] Continuing to refer to FIG17 , for example, when the right hand finger is lifted from the position in contact with the limb where the controlled end is located, the received signal strength will drop rapidly. For example, from time T3_C1 to time T4_C1, the received signal strength will drop rapidly from S4 / S5 to S1.
[0337] Continuing to refer to FIG17 , illustratively, when the right hand fingers are lifted and away from the limb where the controlled terminal is located, the received signal strength will continue to decrease. For example, from time T4_C1 to time T5_C1, the received signal strength will decrease from S1 to S0.
[0338] As can be seen from this, for the click gesture in Scenario 1, as the user performs this gesture, the received signal strength will change over time as shown in Figure 17. Specifically, before the first moment (e.g., time T1_C1), the limb wearing the controlling device is not in contact with the limb wearing the controlled device, and the received signal strength is weak. However, as the limb wearing the controlling device gradually approaches the limb wearing the controlled device, the received signal strength will gradually increase. At the second moment (e.g., time T2_C1), when the limb wearing the controlling device makes contact with the limb wearing the controlled device, the received signal strength will significantly increase. During the time the limb wearing the controlling device and the limb wearing the controlled device are in contact, the received signal strength will remain constant, or fluctuate less than a threshold (negligible), such as from time T2_C1 to time T3_C1, where it will remain between S3 and S4. Subsequently, as the limb wearing the controlling device separates from the limb wearing the controlled device, the received signal strength will rapidly decrease, such as from S4 to S1 from time T3_C1 to time T4_C1. Afterwards, as the limb wearing the controlling end moves away from the limb wearing the controlled end, the received signal strength will slowly decrease.
[0339] Therefore, in actual applications, when the waveform obtained based on the current received signal strength and the actual change matches the preset change waveform shown in the preset Figure 17, it can be determined that the operation gesture currently made by the user is a click operation gesture.
[0340] For example, in some possible implementations, when the controlled end determines that the current operation gesture is a click operation gesture, in response to the operation gesture, it will click on the current interface, or click on the control in the interface, thereby switching the interface, or pausing the current business, etc.
[0341] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0342] Scenario 2: Two electronic devices are located on the same limb of the user
[0343] Referring to Figure 18, for example, in a possible scenario, the user wears device A on his left arm (integrating the somatosensory operation device provided by the above embodiment, turning on the somatosensory operation function, the input mode is configured as surface input, the identity is configured as the controlled end, and the processing mode is configured as processed by the controlled end), and wears device B on his left hand (integrating the somatosensory operation device provided by the above embodiment, turning on the somatosensory operation function, the input mode is configured as surface input, the identity is configured as the controlled end, and the processing mode is configured as processed by the controlled end).
[0344] It should be noted that the left hand and arm can be regarded as the same limb, and the right hand and right arm can be regarded as the same limb.
[0345] For example, for the scenario shown in Figure 18, when the user is not wearing any electronic device, or the electronic device he is wearing does not integrate the somatosensory operation device in the above embodiment, or the somatosensory operation function is not turned on, the user uses a limb, such as the right finger, to make a clicking gesture, such as using the right finger to touch the ground electrode (such as the first electrode in the above embodiment) area of device A located on the side frame, that is, not in contact with the left arm, and after the area is in contact with the ground electrode for a set period of time, the user lifts the right finger and gradually moves away from the controlled end. In the process, device B will emit a current-coupled human body communication signal of a specific frequency.
[0346] Correspondingly, the controlled end, such as device A, will receive the current-coupled human body communication signal transmitted by device B during the process, and record the signal strength of the received current-coupled human body communication signal (hereinafter referred to as received signal strength).
[0347] Since the processing method is configured to be processed by the controlled end, the controlled end, such as a device, receives a current-coupled human body communication signal and obtains the received signal strength corresponding to the current-coupled human body communication signal. It will determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength corresponding to the current-coupled human body communication signal changing with time) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform is used as the currently recognized target gesture, and then the corresponding operation is performed in response to the target gesture.
[0348] The waveform corresponding to the click gesture in scenario 1 is shown in Figure 19. Referring to Figure 19, for example, at time T0_C2, the fingers of the right hand, which is not wearing any electronic device, have not yet come into contact with the limb wearing or holding device A, such as the left arm, and the corresponding received signal strength at this time is, for example, S1.
[0349] It should be noted that since the device B worn on the left finger is closer to the device A worn on the left arm, the value corresponding to the received signal strength S1 corresponding to time T0_C2 is higher than the value corresponding to S1 in the waveform diagrams shown in Figures 13, 15, and 16.
[0350] Continuing to refer to FIG19 , for example, from moment T0_C2 to moment T1_C2, the fingers of the right hand wearing device B gradually approach the limb where the controlled end is located (such as the ground electrode area on device A in FIG18 ). During this process, the received signal strength changes with time, gradually increasing from S1 to S3.
[0351] Understandably, when the right finger, not wearing any electronic device, touches the ground electrode area of device A, the right finger will block the current-coupled human body communication signal transmitted by device B, and thus the received signal strength will decrease. As shown in Figure 19, for example, when the right finger touches the ground electrode area of device A at time T1_C2, the received signal strength will instantly drop from S3 to S0. During the time that the right finger touches the ground electrode area of device A, such as time T1_C2 to time T2_C2, the received signal strength will remain unchanged (or the received signal strength fluctuates slightly), that is, it will remain at S0.
[0352] Continuing to refer to FIG19 , for example, in the process of lifting the right finger from the ground electrode area of device A, as the right finger moves away from device A, the received signal strength will increase rapidly. For example, from time T2_C2 to time T3_C2, the received signal strength will increase rapidly from S0 to S2.
[0353] Continuing to refer to FIG19 , illustratively, when the fingers of the right hand are lifted and away from the limb where the device A is located, since the distance between the devices A and B is basically fixed, the received signal strength will be maintained between S1 and S3, as shown in S2 in FIG19 .
[0354] As can be seen, for the click gesture in Scenario 1, as the user performs the gesture, the received signal strength will change over time as shown in Figure 19. That is, before the first moment (e.g., moment T1_C2), as the limb (limb 1) not wearing the electronic device with the somatosensory operation function gradually approaches the limb (limb 2) wearing the controlled and controlling terminals, the received signal strength will fluctuate, potentially increasing or decreasing within a small range. Figure 19 uses the increase as an example. At the second moment (e.g., moment T1_C2), when limb 1 and limb 2 come into contact, the received signal strength will rapidly decrease. During the time that limb 1 and limb 2 are in contact, the received signal strength will remain unchanged, or the fluctuation will be less than a threshold (negligible), such as maintaining at S0 from moment T1_C2 to moment T2_C1. Subsequently, as the limb wearing the controlling terminal separates from the limb wearing the controlled terminal, the received signal strength will rapidly increase. For example, from moment T2_C2 to moment T3_C2, the received signal strength will rapidly increase from S0 to S3. Afterwards, as the limb wearing the controlling terminal moves away from the limb wearing the controlled terminal, the received signal strength will remain unchanged, or basically remain at S3.
[0355] Therefore, in actual applications, when the waveform obtained based on the current received signal strength and the actual change matches the preset change waveform shown in the preset Figure 19, it can be determined that the operation gesture currently made by the user is a click operation gesture.
[0356] For example, in some possible implementations, when the controlled end determines that the current operation gesture is a click operation gesture, in response to the operation gesture, it will click on the current interface, or click on the control in the interface, thereby switching the interface, or pausing the current business, etc.
[0357] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0358] Scenario 3: One electronic device is placed on the table, and one electronic device is placed on the user.
[0359] (1) Slide-to-close gesture scenario
[0360] Referring to Figure 20, for example, in a possible scenario, device D (integrating the somatosensory operation device provided by the above embodiment, turning on the somatosensory operation function, the input mode is configured as surface input, the identity is configured as the controlled end, and the processing mode is configured as processed by the controlled end) is placed on the desktop, and device B (integrating the somatosensory operation device provided by the above embodiment, turning on the somatosensory operation function, the input mode is configured as surface input, the identity is configured as the controlled end, and the processing mode is configured as processed by the controlled end) is configured on the user's right hand.
[0361] Exemplarily, for the scenario shown in Figure 20, when the user uses the finger wearing device B to make a sliding gesture, that is, uses the finger wearing device B to move from the position shown in (1) in Figure 20 to the signal electrode area (such as the second electrode and the third electrode in the above embodiment) set in device D along the sliding direction 1 shown in (1) in Figure 20 on the desktop where device D is placed, and when moving to the signal electrode area, contacts the signal electrode, that is, the finger wearing device B moves from the position shown in (1) in Figure 20 to the position shown in (2) in Figure 20, and after contacting the signal electrode for a set time, the finger wearing device B is lifted from the signal electrode area of device D and gradually moves away from device D, that is, in the process of the finger wearing device B changing from the position shown in (2) in Figure 20 to the position shown in (3) in Figure 20, device B will emit a capacitive coupling human body communication signal of a specific frequency.
[0362] Correspondingly, device D receives the capacitive coupling human body communication signal transmitted by device B during the process, and records the signal strength of the received capacitive coupling human body communication signal (hereinafter also represented as received signal strength).
[0363] Since the processing method is configured to be processed by the controlled end, the controlled end, such as device D, receives the capacitive coupling type human body communication signal, and after obtaining the received signal strength corresponding to the capacitive coupling type human body communication signal, it will determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength corresponding to the capacitive coupling type human body communication signal changing with time) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform is used as the currently recognized target gesture, and then the corresponding operation is performed in response to the target gesture.
[0364] It should be noted that the capacitive coupling human body communication mode can be applied to scenario 3. In scenario 3, based on the capacitive coupling human body communication signal, operation gestures such as sliding away, sliding closer, and clicking can be implemented. Therefore, the preset change waveforms preset in the internal memory of the controlled terminal mentioned above may include waveforms corresponding to the sliding away operation gesture, the sliding closer operation gesture, and the clicking operation gesture in scenario 3.
[0365] The waveform corresponding to the sliding gesture in scenario 3 is shown in Figure 21. For example, at time T0_N2, the finger of the right hand of the person wearing device B is not in contact with the tabletop on which device D is placed, and is away from the signal electrode of device D. At this time, the corresponding received signal strength is, for example, S1.
[0366] Continuing to refer to FIG21 , illustratively, from time T0_N2 to time T1_N2, the finger of the right hand of the person wearing device B slides along the sliding direction 1 on the table where device D is placed, gradually approaching the signal electrode area of device D. During this process, that is, the finger of the right hand of the person wearing device B moves from the position (1) in FIG20 to the position (2) in FIG20 , the received signal strength will gradually increase from S2 to S4.
[0367] Continuing to refer to FIG. 21 , illustratively, at time T2_N2 , the finger of the right hand of the person wearing device B touches the signal electrode area of device D, and the received signal strength instantly increases from S4 to S5 .
[0368] It should be noted that in order to avoid erroneous behavior, it can be agreed that in a sliding operation (sliding toward and sliding away), the finger of the right hand wearing device B contacts the signal electrode of device D for a set period of time and then moves away from the signal electrode, which is then determined to be a sliding operation.
[0369] In addition, it should be noted that since both the sliding operation and the clicking operation in scenario 3 require the right finger of the person wearing device B to contact the signal electrode of device D, in order to distinguish between the sliding operation and the clicking operation, the time (maintenance time t) in which the right finger of the person wearing device B contacts the signal electrode of device D during the sliding operation can be pre-set to be less than the pre-set contact time (t_click).
[0370] Continuing to refer to Figure 21, for example, after the finger of the right hand wearing device B contacts the signal electrode of device D, if the finger of the right hand is in contact with the signal electrode of device D from time T2_N2 to time T3_N2, that is, for a period of time t, and the duration from time T2_N2 to time T3_N2 is less than the preset t_click, the received signal strength received by device D will be maintained at S5.
[0371] Continuing to refer to Figure 21, for example, after maintaining time t, the finger of the right hand wearing device B will gradually separate from the signal electrode of device D from time T3_N2 to time T5_N2. During this process, the corresponding received signal strength will gradually decrease from S5 to S3 corresponding to time T4_N2, and then from S3 corresponding to time T4_N2 to S2 corresponding to time T5_N2.
[0372] Continuing to refer to Figure 21, for example, after the right finger of the person wearing device B detaches from the signal electrode of device D, if the right finger quickly moves away from the signal electrode of device D, for example, quickly moves away from the signal electrode of device D from time T5_N2 to time T6_N2, the received signal strength obtained by device D will quickly drop from S2 to S0.
[0373] As can be seen from this, for the sliding gesture in scenario 3, as the user performs this gesture, the received signal strength will change over time as shown in Figure 21. That is, before the first moment (such as time T1_N2), the limb wearing the controlling end is in contact with the object on which the controlled end is placed, such as a table, but before contacting the controlled end, the received signal strength is relatively weak. As the limb wearing the controlling end slides closer to the controlled end on the object on which the controlled end is placed, the received signal strength will become significantly stronger, and when the limb wearing the controlling end contacts the controlled end, the received signal strength will rapidly increase, such as from S4 to S5 at time T2_N2. During the time that the limb wearing the controlling end is in contact with the object on which the controlled end is placed, such as from time T2_N2 to time T3_N2, the received signal strength remains at this value. Afterwards, as the limb wearing the controlling end separates from the controlled end, the received signal strength will rapidly decrease, such as from S5 to S1 from time T4_N1 to time T5_N1. Afterwards, as the limb wearing the controlling terminal moves away from the controlled terminal and away from the object where the controlled terminal is placed, the received signal strength will gradually decrease.
[0374] Therefore, in actual applications, when the waveform obtained based on the current received signal strength and the actual change matches the preset change waveform shown in the preset Figure 21, it can be determined that the operation gesture currently made by the user is the sliding closer operation gesture.
[0375] For example, in some possible implementations, if the agreed sliding gesture operation is used to control the current interface of the controlled end to implement a swipe up operation or a swipe right to turn the page, the controlled end, such as device D, will swipe up or swipe right to turn the page of the current interface in response to the currently recognized operation gesture.
[0376] Take the scenario 3 shown in FIG20 as an example, where device D is placed on a desktop and a novel is read. For example, before the user performs the sliding gesture, the current interface of device D displays page 2 of the novel, as shown in FIG20 (1). After the sliding gesture in scenario 3 is completed according to FIG20 (1) to FIG20 (3), device D responds to the recognized gesture and can turn the novel displayed on the current interface of device D back to page 1.
[0377] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0378] (2) Slide away operation gesture scenario:
[0379] Referring to FIG. 22 , for example, the preconditions, placement positions, and configuration positions of device D and device B in FIG. 22 are the same as those in FIG. 20 and are not described again here.
[0380] For example, for the scenario shown in FIG22 , the user uses the finger wearing device B to make a sliding gesture, that is, uses the finger of the right hand wearing device B to move from a position away from the signal electrode area of device D to the signal electrode area of device D, and after being in contact with the signal electrode of device D for a set time, slides along the sliding direction 2 on the desktop, gradually moving away from the signal electrode of device D. For example, the finger of the right hand wearing device B moves from position (1) in FIG22 to position (2) in FIG22 , stays at position (2) in FIG22 for a set time, and then gradually moves from position (2) in FIG22 to position (3) in FIG22 along the sliding direction 2.
[0381] It is understood that during this process, device B will transmit a capacitively coupled human body communication signal of a specific frequency. Correspondingly, device D will receive the capacitively coupled human body communication signal transmitted by device B during this process and record the signal strength of the received capacitively coupled human body communication signal (hereinafter also represented as received signal strength).
[0382] Since the processing method is configured to be processed by the controlled end, the controlled end, such as device D, receives the capacitive coupling type human body communication signal, and after obtaining the received signal strength corresponding to the capacitive coupling type human body communication signal, it will determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength corresponding to the capacitive coupling type human body communication signal changing with time) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform is used as the currently recognized target gesture, and then the corresponding operation is performed in response to the target gesture.
[0383] The waveform corresponding to the sliding away gesture in scenario 3 is shown in Figure 23. Referring to Figure 23, for example, at time T0_F2, the finger of the right hand wearing device B is not in contact with the signal electrode of device D, and the corresponding received signal strength at this time is, for example, S0.
[0384] Continuing to refer to FIG. 23 , illustratively, from time T0_F2 to time T1_F2, the finger of the right hand wearing device B gradually approaches the signal electrode of device D, and during this process the received signal strength gradually increases from S0 to S1.
[0385] Continuing with FIG23 , for example, at time T2_F2, the finger of the right hand of the person wearing device B quickly touches the signal electrode of device D. Then, from time T1_F2 to time T2_F2, the received signal strength will quickly increase from S1 to S3. Thus, the position of the finger of the right hand of the person wearing device B changes from the scene shown in FIG22 (1) to the scene shown in FIG22 (2).
[0386] Continuing to refer to Figure 23, for example, after the finger of the right hand wearing device B contacts the signal electrode of device D, if the finger of the right hand is in contact with the signal electrode of device D from time T2_F2 to time T3_F2, that is, for a period of time t, and the duration from time T2_F2 to time T3_F2 is less than the preset t_click, the received signal strength received by device D will be maintained at S3.
[0387] Continuing to refer to FIG23 , for example, after maintaining time t, the finger of the right hand wearing device B will gradually separate from the signal electrode of device D from moment T3_F2 to moment T5_F2, and slide along the sliding direction 2, that is, move from the position shown in (2) in FIG22 to the position shown in (3) in FIG22 . During this process, the corresponding received signal strength will gradually decrease from S3 to S2 corresponding to moment T4_F2, and then decrease from S2 corresponding to moment T4_F2 to S1 corresponding to moment T5_F2.
[0388] As can be seen from this, for the swipe away gesture in scenario 3, as the user performs this gesture, the received signal strength will change over time as shown in Figure 23. That is, before the first moment (e.g., moment T1_F2), the limb wearing the controlling terminal has not yet made contact with the object on which the controlled terminal is placed, such as a tabletop, and the received signal strength is relatively weak. As the limb wearing the controlling terminal gradually approaches the controlled terminal, the received signal strength will significantly increase, reaching its highest value when the limb wearing the controlling terminal makes contact with the controlled terminal, such as S3 corresponding to moment T2_F2. During the time the limb wearing the controlling terminal is in contact with the object on which the controlled terminal is placed, such as from moment T2_N2 to moment T3_N2, the received signal strength remains at this value. Thereafter, as the limb wearing the controlling terminal slides away from the object on which the controlled terminal is placed, the received signal strength will rapidly decrease. Thereafter, as the limb wearing the controlling terminal moves away from the object on which the controlled terminal is placed, the received signal strength will gradually decrease.
[0389] Therefore, in actual applications, when the waveform obtained based on the current received signal strength and the actual change matches the preset change waveform shown in the preset Figure 23, it can be determined that the operation gesture currently made by the user is the sliding closer operation gesture.
[0390] For example, in some possible implementations, if the agreed sliding away gesture operation is used to control the current interface of the controlled end to perform a sliding operation or a left swipe to turn the page, the controlled end, such as device D, will slide down or swipe left to turn the page of the current interface in response to the currently recognized operation gesture.
[0391] Take the scenario 3 shown in FIG22 as an example, where device D is placed on a desktop and a novel is read. For example, before the user performs the swipe away gesture, the current interface of device D displays page 2 of the novel, as shown in FIG22 (1). After the swipe away gesture in scenario 3 is completed according to FIG22 (1) to FIG22 (3), device D, in response to the recognized gesture, can turn the novel currently displayed on the interface of device D to page 3.
[0392] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0393] (3) Click gesture scene
[0394] Referring to FIG. 24 , for example, the preconditions, placement positions, and configuration positions of device D and device B in FIG. 24 are the same as those in FIG. 20 and are not described again here.
[0395] For example, for the scenario shown in FIG24 , the user uses the finger of the right hand wearing device B to perform a click operation gesture, that is, uses the finger of the right hand wearing device B to move from a position away from the signal electrode area of device D to the signal electrode area of device D, and after being in contact with the signal electrode of device D for a set time, lifts the finger of the right hand and gradually moves away from the signal electrode of device D. For example, the finger of the right hand wearing device B moves from position (1) in FIG24 to position (2) in FIG24 , stays at position (2) in FIG24 for a set time, and then lifts the finger of the right hand from position (2) in FIG24 to position (3) in FIG24 .
[0396] It is understood that during this process, device B will transmit a capacitively coupled human body communication signal of a specific frequency. Correspondingly, device D will receive the capacitively coupled human body communication signal transmitted by device B during this process and record the signal strength of the received capacitively coupled human body communication signal (hereinafter also represented as received signal strength).
[0397] Since the processing method is configured to be processed by the controlled end, the controlled end, such as device D, receives the capacitive coupling type human body communication signal, and after obtaining the received signal strength corresponding to the capacitive coupling type human body communication signal, it will determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength corresponding to the capacitive coupling type human body communication signal changing with time) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform is used as the currently recognized target gesture, and then the corresponding operation is performed in response to the target gesture.
[0398] The waveform corresponding to the click gesture in scenario 3 is shown in Figure 25. Referring to Figure 25, for example, at time T0_C3, the finger of the right hand wearing device B is not in contact with the signal electrode of device D, and the corresponding received signal strength at this time is, for example, S0.
[0399] Continuing to refer to FIG. 25 , illustratively, from time T0_C3 to time T1_C3, the finger of the right hand wearing device B gradually approaches the signal electrode of device D, and during this process the received signal strength gradually increases from S0 to S2.
[0400] Continuing to refer to Figure 25, for example, from time T1_C3 to time T2_C3, the right finger of the person wearing device B continues to approach the signal electrode of device D. As the distance between the right finger of the person wearing device B and the signal electrode of device D gets closer, the received signal strength will gradually increase from S2 to S4.
[0401] Continuing with FIG25 , for example, at time T3_C3, the finger of the right hand of the person wearing device B quickly touches the signal electrode of device D. Then, from time T2_C3 to time T3_C3, the received signal strength will instantly increase from S4 to S5. Thus, the position of the finger of the right hand of the person wearing device B changes from the scene shown in FIG24 (1) to the scene shown in FIG24 (2).
[0402] Continuing to refer to Figure 25, for example, after the finger of the right hand wearing device B contacts the signal electrode of device D, if the finger of the right hand is in contact with the signal electrode of device D from moment T3_C3 to moment T4_C3, that is, for a period of time t, and the time length from moment T3_C3 to moment T4_C3 is greater than or equal to, that is, not less than the preset t_click, the received signal strength received by device D will be maintained at S5.
[0403] Continuing to refer to FIG. 25 , for example, after maintaining time t, the finger of the right hand wearing device B will be separated from the signal electrode of device D from time T4_C3 to time T5_C3. During this process, the corresponding received signal strength will quickly decrease from S5 to S3 corresponding to time T4_F2.
[0404] Continuing to refer to FIG25, for example, after the right finger of the person wearing device B detaches from the signal electrode of device D, it continues to move away from device D. During this process, the corresponding received signal strength will gradually decrease from S3 to S1 corresponding to the time T6_C3. If the right finger of the person wearing device B continues to move away from the signal electrode of device D, the received signal strength will continue to decrease from S1 corresponding to the time T6_C3 to S0 corresponding to the time T7_C3. Thus, the change in the position of the right finger of the person wearing device B is achieved from the scene shown in (2) of FIG24 to the scene shown in (3) of FIG24.
[0405] It can be seen that for the click operation gesture in scenario 3, as the user makes the operation gesture, the received signal strength will change over time as shown in Figure 25. That is, before the first moment (such as moment T1_C3), the limb wearing the control end is not in contact with the signal electrode of the controlled end, and the received signal strength is weak. As the limb wearing the control end gradually approaches the controlled end, the received signal strength will become significantly stronger, and reach the highest value when the limb wearing the control end is in contact with the controlled end, such as S5 corresponding to moment T3_C3. During the time that the limb wearing the control end is in contact with the object on which the controlled end is placed, such as from moment T3_C3 to moment T4_C3, the received signal strength is maintained at this value, and then as the limb wearing the control end moves away from the controlled end, the received signal strength will gradually decrease.
[0406] Therefore, in actual applications, when the waveform obtained based on the current received signal strength and the actual change matches the preset change waveform shown in the preset Figure 25, it can be determined that the operation gesture currently made by the user is the sliding closer operation gesture.
[0407] For example, in some possible implementations, when device D determines that the current operation gesture is a click operation gesture, in response to the operation gesture, it will click on the current interface, or click on the control in the interface, thereby switching the interface, or pausing the current business, or displaying the taskbar on the current interface, etc.
[0408] Take the scene 3 shown in Figure 24 as an example of a scene where device D is placed on the desktop to watch a novel. For example, before the user performs the click operation gesture, the current interface of device D displays the second page of the novel, as shown in Figure 24 (1). After completing the click operation gesture under scene 3 according to Figure 24 (1) to Figure 24 (3), device D can cancel the page number displayed in the interface, such as "-2-", in response to the recognized operation gesture, and display a taskbar at the bottom of the current interface. For example, the taskbar can display function options for editing the content displayed on the current interface, such as viewing the chapter of the novel currently being viewed, adjusting the font of the novel currently being displayed, and adjusting the reading position.
[0409] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0410] Through the above description of the gesture operations in scenes 1 and 2 corresponding to the current coupling type human body communication mode, the states (locations) of the electronic devices serving as the controlled end and the controlling end in scenes 1 and 2, and the description of the operation gestures in scene 3 corresponding to the capacitive coupling type human body communication mode, and the states (locations) of the electronic devices serving as the controlled end and the controlling end in scene 3, it can be seen that there is a relationship between the state of the electronic device, the human body communication mode, the scene, and the operation gesture as shown in Table 2.
[0411] Table 2 Correspondence between states, modes, scenes and gestures
[0412] Among them, when both the controlled end and the controlling end are in a wearing / holding state, when the controlled end and the controlling end are on different limbs of the user, such as the limbs shown in Figures 12A and 12B, or Figures 14A and 14B, or Figures 16A and 16B in the above embodiments, the current scene of the controlled end and the controlling end is scene 1, and the corresponding operation gestures include sliding closer, sliding away and clicking operation gestures that present the preset waveforms shown in Figures 13, 15 and 17.
[0413] Among them, when the controlled end and the controlling end are both in the wearing / holding state, when the controlled end and the controlling end are on the same limb of the user, such as the limb shown in Figure 18 in the above embodiment, the current scene of the controlled end and the controlling end is scene 2, and the corresponding operation gesture includes the operation gesture of clicking to present the preset waveform shown in Figure 19.
[0414] Among them, when the controlled end is placed on the desktop and the controlling end is in a wearing / holding state, as shown in Figures 20, 22, and 24 in the above embodiments, the current scene of the controlled end and the controlling end is scene 3, and the corresponding operation gestures include sliding closer, sliding away, and clicking operation gestures that present the preset waveforms shown in Figures 21, 23, and 25.
[0415] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0416] As can be seen from the description of the above embodiments, somatosensory operations based on human body communication technology require at least two electronic devices integrated with the somatosensory operation devices described in the above embodiments. In a somatosensory operating system composed of at least two electronic devices integrated with the somatosensory operation devices described in the above embodiments, the specific recognition and processing process of the operational gestures achievable in the above scenarios 1, 2, and 3, as well as the somatosensory operations performed based on the recognized operational gestures, can be as shown in the embodiment of FIG26.
[0417] 26 , a somatosensory operation method is exemplarily shown, which specifically includes:
[0418] 101. The first electronic device and the second electronic device meet a set trigger condition and enable a somatosensory operation function.
[0419] The first electronic device and the second electronic device may be any one of a mobile phone, a tablet computer, a smart watch, a smart bracelet, a smart ring, a smart TV, and a personal computer.
[0420] Illustratively, in a possible implementation, the first electronic device is, for example, device A or device D in the above embodiment; and the second electronic device is, for example, device B in the above embodiment.
[0421] Regarding the first electronic device and the second electronic device meeting the set trigger conditions, in some possible implementations, for example, a collision occurs between designated areas of the two devices. In other possible implementations, for example, a user taps or touches designated areas of the two devices respectively. In other possible implementations, for example, a somatosensory operation function entry provided by an installed settings application is triggered, or a control for enabling the somatosensory operation function in a dedicated somatosensory operation application is triggered, as shown in Figures 10A to 10E.
[0422] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.
[0423] 102 . The first electronic device and the second electronic device establish a somatosensory operation connection based on human body communication technology (operating in a current coupling human body communication mode or a capacitive coupling human body communication mode).
[0424] Taking the implementation shown in Figures 10A to 10E as an example, when establishing a somatosensory operation connection between a first electronic device and a second electronic device based on human body communication technology, the first and second electronic devices can be configured through window 10c-6 displayed on interface 10c in the above embodiment. In this way, when a somatosensory operation connection request is initiated by the first electronic device to the second electronic device, the human body communication mode, the role played in the somatosensory operation, and the object for performing gesture recognition processing can be set for the first and second electronic devices based on the configuration information configured in window 10c-6.
[0425] Regarding the configuration implemented based on controls 10c-61 to 10c-66 provided in window 10c-6, and the human body communication mode indicated to the first electronic device and the second electronic device based on the configuration information generated based on the corresponding configuration, as well as the role played in the somatosensory operation and the object performing gesture recognition processing, please refer to the description part of Figure 10D and will not be repeated here.
[0426] Furthermore, as can be seen from the description of the above embodiments, human body communication modes can include a current-coupled human body communication mode and a capacitive-coupled human body communication mode. In the current-coupled human body communication mode, the human body communication signals exchanged between electronic devices are specifically current-coupled human body communication signals. In the capacitive-coupled human body communication mode, the human body communication signals exchanged between electronic devices are specifically capacitive-coupled human body communication signals.
[0427] In addition, it should be noted that for current-coupled human body communication signals, reception and transmission are achieved through current-coupled human body communication circuits, while for capacitive-coupled human body communication signals, reception and transmission are achieved through capacitive-coupled human body communication circuits.
[0428] In this embodiment, the specific structure of the somatosensory operation device integrated into the first electronic device and the second electronic device can be as shown in Figures 2 and 4, that is, the somatosensory operation device includes a current-coupled human body communication circuit for transmitting current-coupled human body communication signals (composed of Figures 2 + 5A, hereinafter referred to as the first current-coupled human body communication circuit), a current-coupled human body communication circuit for receiving current-coupled human body communication signals (composed of Figures 2 + 5B, hereinafter referred to as the second current-coupled human body communication circuit), a capacitive-coupled human body communication circuit for transmitting capacitive-coupled human body communication signals (composed of Figures 2 + 5C, hereinafter referred to as the first capacitive-coupled human body communication circuit), and a capacitive-coupled human body communication circuit for receiving capacitive-coupled human body communication signals (composed of Figures 2 + 5D, hereinafter referred to as the second capacitive-coupled human body communication circuit).
[0429] Among them, the first current-coupled human body communication circuit and the second current-coupled human body communication circuit are used in conjunction with each other, that is, when the first current-coupled human body communication circuit is turned on in the first electronic device, if you want to realize somatosensory operation based on human body communication technology, the second electronic device needs to turn on the second current-coupled human body communication circuit.
[0430] Correspondingly, the first capacitive coupling type human body communication circuit and the second capacitive coupling type human body communication circuit are used in conjunction with each other, that is, when the first capacitive coupling type human body communication circuit is turned on in the first electronic device, if you want to realize somatosensory operation based on human body communication technology, the second electronic device needs to turn on the second capacitive coupling type human body communication circuit.
[0431] Regarding the conduction and switching of the above four circuits, please refer to the embodiment parts of Figures 5A, 5B, 5C and 5D, which will not be repeated here.
[0432] Therefore, based on the structure of the above-mentioned somatosensory operation device, when the first electronic device and the second electronic device establish a somatosensory operation connection between them, they can select the appropriate input method and role from window 10c-6 according to the current usage scenario, such as scenario 1, scenario 2 and scenario 3 mentioned in the above-mentioned embodiment, so that the first electronic device and the second electronic device can conduct the appropriate human body communication circuit.
[0433] Regarding the correspondence between scenario 1, scenario 2 and scenario 3 and the surface input mode and the external input mode, the correspondence between the surface input mode and the external input mode and the current coupling type human body communication mode and the capacitive coupling type human body communication mode, and the correspondence between the roles played and the above-mentioned four types of human body communication circuits, please refer to Figures 5A, 5B, 5C and 5D, as well as the embodiment part of Figure 10D, and will not be repeated here.
[0434] 103 : Are both the first electronic device and the second electronic device in the first state?
[0435] The first state refers to a state of being worn or held, that is, the first electronic device and the second electronic device are both in the first state, which means that the first electronic device and the second electronic device are both on the user.
[0436] Exemplarily, when the first electronic device and the second electronic device are both in the first state, in some possible implementations, for example, the first electronic device and the second electronic device are in scenario 1 described in the above embodiment, that is, the two electronic devices are located on different limbs of the user.
[0437] Exemplarily, when the first electronic device and the second electronic device are both in the first state, in other possible implementations, for example, the first electronic device and the second electronic device are in scenario 2 described in the above embodiment, that is, the two electronic devices are located in the same limb.
[0438] It should be noted that after the user configures the human body communication mode of the first electronic device and the second electronic device through step 102, a scene switch may occur during use, for example, from scene 1 or scene 2 to scene 3; or from scene 3 to scene 1 or scene 2. If after the scene is changed, the user does not change the configuration information through window 10c-7 in interface 10c in Figure 10E, then the first electronic device and the second electronic device may still be in the human body communication mode corresponding to scene 1 or scene 2, or the human body communication mode corresponding to scene 3. When the first electronic device and the second electronic device are in the human body communication mode corresponding to scene 1 or scene 2, somatosensory operations cannot be performed in scene 3 (current-coupled human body communication signals cannot be transmitted outside the body). Accordingly, when the first electronic device and the second electronic device are in the human body communication mode corresponding to scene 3, somatosensory operations cannot be performed in scene 1 or scene 2 (capacitive-coupled human body communication signals have less loss inside the body).
[0439] Therefore, in actual applications, the status of the first electronic device and the second electronic device may be determined once according to a set time or after completing a set number of gesture recognitions.
[0440] It is understandable that when the electronic device is on the user's body or placed on the desktop, the data collected by the internal sensors is different. Therefore, in some possible implementations, the current location of the electronic device can be determined through sensors in the electronic device, such as a gyroscope.
[0441] For example, when it is determined in step 103 that both the first electronic device and the second electronic device are in the first state, step 104 may be executed. Otherwise, step 108 may be executed.
[0442] 104 , if the first electronic device and the second electronic device are currently in the current coupling human body communication mode, remain unchanged; if the first electronic device and the second electronic device are currently in the capacitive coupling human body communication mode, switch to the current coupling human body communication mode.
[0443] It can be understood that the switching between the current-coupled human body communication mode and the capacitive-coupled human body communication mode is specifically achieved by switching the current-coupled human body communication circuit and the capacitive-coupled human body communication circuit in the current / capacitive-coupled human body communication composite module in the somatosensory operation device. The specific switching details can be found in the embodiment section of Figures 5A, 5B, 5C and 5D, and will not be repeated here.
[0444] 105. The second electronic device serving as the control end transmits a human body communication signal (a current-coupled human body communication signal or a capacitive-coupled human body communication signal), and the first electronic device serving as the controlled end receives the human body communication signal transmitted by the first electronic device, and records the received signal strength of the human body communication signal received at each moment to obtain a received signal strength waveform.
[0445] It should be noted that, when the electronic device serving as the controlled end turns on the somatosensory operation function and operates in the human body communication mode (current coupling human body communication mode or capacitive coupling human body communication mode), the human body communication signal it transmits can be periodic, such as transmitting for a duration of t2 every t1. Alternatively, it can be continuously transmitted. This embodiment does not impose any restrictions on this.
[0446] 106. Whether the received signal waveform matches the preset change waveform.
[0447] The preset variation waveform is, for example, the waveform of the received signal strength varying with time as shown in FIG. 13 , FIG. 15 , FIG. 17 , FIG. 19 , FIG. 21 , FIG. 23 , and FIG. 25 .
[0448] Therefore, the operation of step 106 in this embodiment is specifically to determine whether the waveform of the current received signal strength changing with time matches any waveform shown in Figures 13, 15, 17, 19, 21, 23, and 25.
[0449] Exemplarily, if the received signal waveform matches the preset variation waveform, step 107 is executed. Otherwise, the received signal strength may continue to be recorded until the waveform of the recorded received signal strength varying with time matches the preset variation waveform, or the human body communication mode is switched, or the somatosensory operation is exited.
[0450] In addition, it should be noted that the matching in this embodiment is not limited to the same received signal strength at each time point, but requires that the change of the current received signal waveform is the same as the change of the preset change waveform.
[0451] 107 , determining that the user has performed a somatosensory operation, and executing a control instruction of the operation gesture corresponding to the received signal waveform.
[0452] Among them, the recognized operation gestures are, for example, the sliding closer, sliding away, clicking and other operation gestures in scene 1 in the above embodiment, or the clicking operation gesture in scene 2, or the sliding closer, sliding away, clicking and other operation gestures in scene 3.
[0453] 108 : Whether the first electronic device is in the first state / second state, and whether the second electronic device is in the second state / first state.
[0454] The second state is, for example, the state of being placed on the desktop as described in scenario 3 in the above embodiment.
[0455] As can be seen from the description of the above embodiments, when two electronic devices establish a somatosensory connection, one on the user's body and the other on a table, the corresponding scenario is Scenario 3. In Scenario 3, the first and second electronic devices must be in capacitive coupling human body communication mode. That is, gesture recognition based on capacitive coupling human body communication signals can achieve control of the first or second electronic device as the controlled end. If both electronic devices are placed on a table, somatosensory operation based on human body communication technology will not be possible.
[0456] Therefore, when the first electronic device and the second electronic device are not in the first state at the same time, the determination in step 108 needs to be performed.
[0457] For example, if, through the judgment in step 108, it is determined that the first electronic device is in the first state and the second electronic device is in the second state; or the first electronic device is in the second state and the second electronic device is in the first state, step 109 may be executed. Otherwise, the judgment does not fall within the scope of the somatosensory operation solution provided in the embodiment of the present application.
[0458] For example, in one possible implementation, when it is determined that the first electronic device and the second electronic device do not fall within the scope of the somatosensory operation scheme provided in the embodiment of the present application, in order to further reduce device power consumption, the first electronic device and the second electronic device can be controlled to automatically exit the somatosensory operation, such as disconnecting the somatosensory operation connection and turning off the somatosensory operation function.
[0459] Exemplarily, in another possible implementation, a somatosensory operation connection between the two may also be maintained.
[0460] 109 , if the first electronic device and the second electronic device are currently in the capacitive coupling human body communication mode, remain unchanged; if the first electronic device and the second electronic device are currently in the current coupling human body communication mode, switch to the capacitive coupling human body communication mode.
[0461] It can be understood that the switching between the current-coupled human body communication mode and the capacitive-coupled human body communication mode is specifically achieved by switching the current-coupled human body communication circuit and the capacitive-coupled human body communication circuit in the current / capacitive-coupled human body communication composite module in the somatosensory operation device. The specific switching details can be found in the embodiment section of Figures 5A, 5B, 5C and 5D, and will not be repeated here.
[0462] 110, exit the motion sensing operation.
[0463] It should be understood that the above description is merely an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. For parts not described in detail in this embodiment, please refer to the above embodiment and will not be repeated here.
[0464] Therefore, by integrating a somatosensory operation device of a human body communication circuit that can realize the transmission and reception of different human body communication signals into the first electronic device and the second electronic device, and realizing the somatosensory operation function based on the integrated somatosensory operation device, a somatosensory operation connection between the two is established, so that the human body communication mode can be configured for the first electronic device and the second electronic device according to the usage scenario, and then based on the human body communication technology, simple gesture operations such as clicking and sliding can be realized on the first electronic device or the second electronic device without contacting the screen of the first electronic device or the second electronic device, thereby improving the human-computer interaction experience.
[0465] In addition, to ensure that the user's gestures can be accurately identified when the somatosensory operation is implemented based on human body communication technology, the gesture guidance supported in the above scenarios 1, 2, and 3 can be carried out when the somatosensory operation function is turned on, so that the user can perform a gesture operation according to the guidance. In this way, the electronic device can know in advance the pattern of the received signal waveform corresponding to the various gestures made by the user, and then calibrate the preset change waveform based on the received signal waveform corresponding to the various gestures obtained at this stage, so that the preset change waveform in the current electronic device can be better suitable for the user.
[0466] In addition, it should be noted that, specifically in practical applications, as the controlled end, that is, the electronic device used to receive human body communication signals (current-coupled human body communication signals, or capacitive-coupled human body communication signals), the internal structure of the current / capacitive-coupled human body communication composite module of the somatosensory operation device integrated therein can be as shown in Figure 3B or as shown in Figure 4, and this application does not impose any restrictions on this.
[0467] Correspondingly, as a control end, that is, an electronic device used to transmit and receive human body communication signals (current-coupled human body communication signals, or capacitive-coupled human body communication signals), the internal structure of the current / capacitive-coupled human body communication composite module of the somatosensory operation device integrated therein can be as shown in Figure 3A or as shown in Figure 4, and this application does not impose any restrictions on this.
[0468] In addition, it is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.
[0469] In addition, it should be noted that the somatosensory operation methods provided in the above embodiments implemented by electronic devices in actual application scenarios can also be performed by a chip system included in the electronic device, wherein the chip system may include a processor. The chip system can be coupled to a memory so that when the chip system is running, it calls the computer program stored in the memory to implement the steps performed by the above electronic device. The processor in the chip system can be an application processor or a processor other than an application processor.
[0470] In addition, an embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the somatosensory operation method in the above-mentioned embodiment.
[0471] In addition, an embodiment of the present application further provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the above-mentioned related steps to implement the somatosensory operation method in the above-mentioned embodiment.
[0472] In addition, an embodiment of the present application also provides a chip (which may also be a component or module), which may include one or more processing circuits and one or more transceiver pins; wherein the transceiver pins and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the above-mentioned related method steps to implement the somatosensory operation method in the above-mentioned embodiment to control the receiving pin to receive the signal, so as to control the transmitting pin to send the signal.
[0473] In addition, it can be seen from the above description that the electronic device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0474] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A somatosensory operating system, characterized in that: include: A first electronic device and a second electronic device, wherein the first electronic device and the second electronic device start a human body communication mode; The second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently turned on human body communication mode; The first electronic device is used to receive the human body communication signal transmitted by the second electronic device, and record the received signal strength corresponding to the human body communication signal received at each moment to obtain a received signal strength variation waveform; The first electronic device is used to determine the target operation gesture corresponding to the received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture when the received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms; The first electronic device is used to execute the control instruction corresponding to the target operation gesture.
2. The system according to claim 1, characterized in that The human body communication mode includes a capacitive coupling type human body communication mode and a current coupling type human body communication mode; Wherein, when the type of the human body communication mode currently turned on by the second electronic device is the capacitive coupling human body communication mode, the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: The second electronic device is used to transmit the capacitive coupling human body communication signal to the first electronic device; The first electronic device is used to receive the human body communication signal transmitted by the second electronic device, and record the received signal strength corresponding to the human body communication signal received at each moment, to obtain a received signal strength change waveform, including: The first electronic device is used to receive the capacitive coupling human body communication signal transmitted by the second electronic device, and record the capacitance receiving signal strength corresponding to the capacitive coupling human body communication signal received at each moment, to obtain a capacitance receiving signal strength variation waveform; Wherein, when the type of the human body communication mode currently turned on by the second electronic device is the current coupling type human body communication mode, the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: The second electronic device is used to transmit the current-coupled human body communication signal to the first electronic device; The first electronic device is used to receive the human body communication signal transmitted by the second electronic device, and record the received signal strength corresponding to the human body communication signal received at each moment, to obtain a received signal strength change waveform, including: The first electronic device is used to receive the current-coupled human body communication signal transmitted by the second electronic device, and record the current receiving signal strength corresponding to the current-coupled human body communication signal received at each moment to obtain a current receiving signal strength variation waveform.
3. The system according to claim 2, characterized in that A second somatosensory operation device is integrated in the second electronic device, the second somatosensory operation device includes a human body communication transmitting circuit for transmitting a human body communication signal, the human body communication transmitting circuit includes a capacitive coupling type human body communication transmitting circuit and a current coupling type human body communication transmitting circuit; The second electronic device is used to transmit the capacitive coupling human body communication signal to the first electronic device, including: The second electronic device turns on the capacitive coupling type human body communication transmitting circuit and turns off the current coupling type human body communication transmitting circuit; The second electronic device is used to transmit the capacitive coupling type human body communication signal to the first electronic device through the capacitive coupling type human body communication transmitting circuit; Wherein, the second electronic device is used to transmit the current-coupled human body communication signal to the first electronic device, including: The second electronic device is used to turn on the current coupling type human body communication transmitting circuit and turn off the capacitive coupling type human body communication transmitting circuit; The second electronic device is used to transmit the current-coupled human body communication signal to the first electronic device through the current-coupled human body communication transmitting circuit.
4. The system according to claim 3, characterized in that The second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, wherein the current / capacitive coupling type human body communication composite module includes a human body communication module, a circuit switching switch, a voltage drive amplifier and a current drive amplifier; The second electronic device is used to turn on the capacitive coupling type human body communication transmitting circuit and turn off the current coupling type human body communication transmitting circuit, and includes: The second electronic device is used to switch the circuit switch to connect the human body communication module to the voltage drive amplifier and disconnect the human body communication module from the current drive amplifier; The second electronic device is used to connect the first port of the voltage-driven amplifier to the first port of the current / capacitive coupling type human body communication composite module, and the second port of the voltage-driven amplifier to the second port of the current / capacitive coupling type human body communication composite module; The second electronic device is used to disconnect the first port of the current drive amplifier from the third port of the current / capacitive coupling type human body communication composite module, and disconnect the second port of the current drive amplifier from the fourth port of the current / capacitive coupling type human body communication composite module; The second electronic device is used to conduct the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, conduct the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnect the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnect the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode through the electrode switching module.
5. The system according to claim 3, characterized in that The second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, wherein the current / capacitive coupling type human body communication composite module includes a human body communication module, a circuit switching switch, a voltage drive amplifier and a current drive amplifier; The second electronic device is used to turn on the current coupling type human body communication transmitting circuit and disconnect the capacitive coupling type human body communication transmitting circuit, and includes: The second electronic device is used to switch the circuit switch to connect the human body communication module to the current drive amplifier and disconnect the human body communication module from the voltage drive amplifier; The second electronic device is used to connect the first port of the current drive amplifier to the third port of the current / capacitive coupling type human body communication composite module, and the second port of the current drive amplifier to the fourth port of the current / capacitive coupling type human body communication composite module; The second electronic device is used to disconnect the first port of the voltage-driven amplifier from the first port of the current / capacitive coupling type human body communication composite module, and disconnect the second port of the voltage-driven amplifier from the second port of the current / capacitive coupling type human body communication composite module; The second electronic device is used to conduct the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, conduct the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnect the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnect the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode through the electrode switching module.
6. The system according to claim 2, characterized in that The first electronic device is integrated with a first somatosensory operation device, the first somatosensory operation device includes a human body communication receiving circuit for receiving a human body communication signal, the human body communication receiving circuit includes a capacitive coupling type human body communication receiving circuit and a current coupling type human body communication receiving circuit; The first electronic device is used to receive the capacitive coupling human body communication signal transmitted by the second electronic device, including: The first electronic device is used to turn on the capacitive coupling type human body communication receiving circuit and turn off the current coupling type human body communication receiving circuit; The first electronic device is used to receive the capacitive coupling type human body communication signal transmitted by the second electronic device through the capacitive coupling type human body communication receiving circuit; Wherein, the first electronic device is used to receive the current-coupled human body communication signal transmitted by the second electronic device, including: The first electronic device is used to turn on the current coupling type human body communication receiving circuit and turn off the capacitive coupling type human body communication receiving circuit; The first electronic device is used to receive the current-coupled human body communication signal transmitted by the second electronic device through the current-coupled human body communication receiving circuit.
7. The system according to claim 6, characterized in that The first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module is connected to the receiving circuit; The first electronic device is used to turn on the capacitive coupling type human body communication receiving circuit and turn off the current coupling type human body communication receiving circuit, and includes: The first electronic device is used to connect the first port of the receiving circuit to the first port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit to the second port of the current / capacitive coupling type human body communication composite module; The first electronic device is used to conduct the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, conduct the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnect the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnect the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode through the electrode switching module.
8. The system according to claim 6, characterized in that The first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module is connected to the receiving circuit; The first electronic device is used to turn on the current coupling type human body communication receiving circuit and turn off the capacitive coupling type human body communication receiving circuit, and includes: The first electronic device is used to connect the first port of the receiving circuit to the third port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit to the fourth port of the current / capacitive coupling type human body communication composite module; The first electronic device is used to conduct the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, conduct the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnect the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnect the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode through the electrode switching module.
9. The system according to any one of claims 1 to 8, characterized in that: The first electronic device and the second electronic device are both in a first state; The second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently enabled human body communication mode, including: When the type of the human body communication mode currently turned on by the second electronic device is a capacitive coupling human body communication mode, the second electronic device is used to switch the human body communication mode from the capacitive coupling human body communication mode to the current coupling human body communication mode, and transmit a current coupling human body communication signal to the first electronic device; When the type of the human body communication mode currently turned on by the second electronic device is the current coupling type human body communication mode, the second electronic device is used to maintain the current coupling type human body communication mode and transmit the current coupling type human body communication signal to the first electronic device.
10. The system according to claim 9, characterized in that The first state is a wearing state or a holding state; The first electronic device and the second electronic device are both in a first state, including: The first electronic device and the second electronic device are respectively worn or held by different limbs of the user; When the first electronic device and the second electronic device are respectively worn or held by different limbs of the user, the first electronic device is used to: The obtained current receiving signal strength variation waveform is matched with a first preset variation waveform in the preset variation waveforms, wherein the first preset variation waveform is a current receiving signal strength waveform corresponding to the sliding approach operation gesture made in the first scenario. The first scenario is a scenario in which the first electronic device and the second electronic device are worn or held by different limbs of a user, and the first electronic device and the second electronic device are in a current coupling human body communication mode; When the current received signal strength variation waveform matches the first preset variation waveform, determining, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the current received signal strength variation waveform is a sliding approach operation gesture; When the current received signal strength change waveform does not match the first preset change waveform, matching the current received signal strength change waveform with a second preset change waveform in the preset change waveforms, where the second preset change waveform is a waveform of the current received signal strength corresponding to the slide away operation gesture made in the first scenario with actual change; When the current received signal strength variation waveform matches the second preset variation waveform, determining, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the current received signal strength variation waveform is a slide away operation gesture; When the current received signal strength change waveform does not match the second preset change waveform, matching the current received signal strength change waveform with a third preset change waveform in the preset change waveforms, wherein the third preset change waveform is a waveform of the current received signal strength corresponding to the click operation gesture made in the first scenario with actual change; When the current received signal strength variation waveform matches the third preset variation waveform, the target gesture corresponding to the current received signal strength variation waveform is determined to be a click operation gesture according to a mapping relationship between the preset variation waveform and the operation gesture.
11. The system according to claim 9, characterized in that The first state is a wearing state or a holding state; The first electronic device and the second electronic device are both in a first state, including: The first electronic device and the second electronic device are respectively worn or held by the same limb of the user; Wherein, when the first electronic device and the second electronic device are worn or held by the same limb of the user, the first electronic device is used to: Matching the obtained current receiving signal strength variation waveform with a fourth preset variation waveform in the preset variation waveforms, wherein the fourth preset variation waveform is a waveform of the current receiving signal strength corresponding to the click operation gesture made in a second scenario with actual variation, wherein the second scenario is a scenario in which the first electronic device and the second electronic device are worn or held by the same limb of the user, and the first electronic device and the second electronic device are in a current coupling human body communication mode; When the current received signal strength variation waveform matches the fourth preset variation waveform, the target gesture corresponding to the current received signal strength variation waveform is determined to be a click operation gesture according to a mapping relationship between the preset variation waveform and the operation gesture.
12. The system according to any one of claims 1 to 8, characterized in that: One of the first electronic device and the second electronic device is in a first state and the other is in a second state, and the first state and the second state are different states; The second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently enabled human body communication mode, including: When the type of the human body communication mode currently turned on by the second electronic device is the current coupling human body communication mode, the second electronic device is used to switch the human body communication mode from the current coupling human body communication mode to the capacitive coupling human body communication mode, and transmit a capacitive coupling human body communication signal to the first electronic device; When the type of the human body communication mode currently turned on by the second electronic device is the capacitive coupling human body communication mode, the second electronic device is used to maintain the capacitive coupling human body communication mode and transmit the capacitive coupling human body communication signal to the first electronic device.
13. The system according to claim 12, characterized in that The first state is a wearing state or a holding state, and the second state is a state of being placed on an object; The first electronic device and the second electronic device are in a first state and a second state, respectively, including: The first electronic device is in the second state, and the second electronic device is in the first state; When the first electronic device is in the second state and the second electronic device is in the first state, the first electronic device is used to: Matching the obtained capacitance received signal strength change waveform with a fifth preset change waveform in the preset change waveforms, where the fifth preset change waveform is a waveform of capacitance received signal strength corresponding to a sliding approach operation gesture made in a third scenario with actual change, where the third scenario is a scenario where the first electronic device is in the second state, the second electronic device is in the first state, and the first electronic device and the second electronic device are in a capacitive coupling human body communication mode; When the capacitance received signal strength variation waveform matches the fifth preset variation waveform, determining, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the capacitance received signal strength variation waveform is a sliding approach operation gesture; When the capacitance received signal strength change waveform does not match the fifth preset change waveform, matching the capacitance received signal strength change waveform with a sixth preset change waveform in the preset change waveforms, where the sixth preset change waveform is a waveform of the capacitance received signal strength corresponding to the sliding away operation gesture made in the third scenario with actual change; When the capacitance received signal strength variation waveform matches the sixth preset variation waveform, determining, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the capacitance received signal strength variation waveform is a slide away operation gesture; When the capacitance received signal strength change waveform does not match the sixth preset change waveform, matching the capacitance received signal strength change waveform with a seventh preset change waveform in the preset change waveforms, where the seventh preset change waveform is a waveform of the capacitance received signal strength corresponding to the click operation gesture made in the third scenario with actual change; When the capacitance received signal strength variation waveform matches the seventh preset variation waveform, the target gesture corresponding to the capacitance received signal strength variation waveform is determined to be a click operation gesture according to a mapping relationship between the preset variation waveform and the operation gesture.
14. The system according to any one of claims 1 to 13, characterized in that: The first electronic device is further used for: When the received signal strength variation waveform is obtained, sending the received signal strength variation waveform to the second electronic device; The second electronic device is further used for: receiving the received signal strength change waveform sent by the first electronic device; When the received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms, determining the target operation gesture corresponding to the received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; Sending a control instruction corresponding to the target operation gesture to the first electronic device; The first electronic device is further used for: Receiving an operation instruction corresponding to the target operation gesture sent by the second electronic device; Execute the control instruction corresponding to the target operation gesture.
15. The system according to any one of claims 1 to 13, characterized in that: The first somatosensory operation device integrated in the first electronic device further includes a human body communication transmitting circuit for transmitting a human body communication signal, wherein the human body communication transmitting circuit includes a capacitive coupling type human body communication transmitting circuit and a current coupling type human body communication transmitting circuit; The second body operating device integrated in the second electronic device further includes a human body communication transmitting circuit for receiving a human body communication signal, and the human body communication receiving circuit includes a capacitive coupling type human body communication receiving circuit and a current coupling type human body communication receiving circuit; The first electronic device is further used for: When the current-coupled human body communication transmitting circuit is turned on and the capacitive-coupled human body communication transmitting circuit, the current-coupled human body communication receiving circuit and the capacitive-coupled human body communication receiving circuit are turned off, transmitting the current-coupled human body communication signal to the second electronic device; The second electronic device is further used for: When the current-coupled human body receiving circuit is turned on and the current-coupled human body communication transmitting circuit, the capacitive-coupled human body transmitting circuit, and the capacitive-coupled human body communication receiving circuit are turned off, the current-coupled human body communication signal transmitted by the first electronic device is received, and the received signal strength corresponding to the current-coupled human body communication signal received at each moment is recorded to obtain a current received signal strength variation waveform; When the current received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms, determining a target operation gesture corresponding to the current received signal strength variation waveform according to a mapping relationship between the preset variation waveform and the operation gesture; Execute the control instruction corresponding to the target operation gesture.
16. The system according to claim 15, characterized in that The second electronic device is further used for: When the current received signal strength variation waveform is obtained, sending the current received signal strength variation waveform to the first electronic device; The first electronic device is further used for: receiving the current receiving signal strength change waveform sent by the second electronic device; When the current received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms, determining a target operation gesture corresponding to the current received signal strength variation waveform according to a mapping relationship between the preset variation waveform and the operation gesture; Sending a control instruction corresponding to the target operation gesture to the second electronic device; The second electronic device is further used for: Receiving an operation instruction corresponding to the target operation gesture sent by the first electronic device; Execute the control instruction corresponding to the target operation gesture.
17. The system according to claim 15, characterized in that The first electronic device is further used for: When the capacitive coupling type human body communication transmitting circuit is turned on, and the current coupling type human body communication transmitting circuit, the current coupling type human body communication receiving circuit, and the capacitive coupling type human body communication receiving circuit are turned off, transmitting the capacitive coupling type human body communication signal to the second electronic device; The second electronic device is further used for: When the capacitive coupling type human body receiving circuit is turned on and the current coupling type human body communication transmitting circuit, the capacitive coupling type human body transmitting circuit and the current coupling type human body communication receiving circuit are turned off, the capacitive coupling type human body communication signal transmitted by the first electronic device is received, and the received signal strength corresponding to the capacitive coupling type human body communication signal received at each moment is recorded to obtain a capacitive received signal strength variation waveform; When the capacitance received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms, determining the target operation gesture corresponding to the capacitance received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; Execute the control instruction corresponding to the target operation gesture.
18. The system according to claim 17, characterized in that The second electronic device is further used for: When the capacitance received signal strength variation waveform is obtained, sending the capacitance received signal strength variation waveform to the first electronic device; The first electronic device is further used for: receiving the capacitance receiving signal strength change waveform sent by the second electronic device; When the capacitance received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms, determining the target operation gesture corresponding to the capacitance received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; Sending a control instruction corresponding to the target operation gesture to the second electronic device; The second electronic device is further used for: Receiving an operation instruction corresponding to the target operation gesture sent by the first electronic device; Execute the control instruction corresponding to the target operation gesture.
19. A somatosensory operation method, characterized in that: Applied to a somatosensory operating system, the system comprises: a first electronic device and a second electronic device, wherein the first electronic device and the second electronic device are in a human body communication mode; The method comprises: The second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently enabled human body communication mode; The first electronic device receives the human body communication signal transmitted by the second electronic device, and records the received signal strength corresponding to the human body communication signal received at each moment, to obtain a received signal strength variation waveform; When the received signal strength variation waveform matches any preset variation waveform, the first electronic device determines the target operation gesture corresponding to the received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; The first electronic device executes the control instruction corresponding to the target operation gesture.
20. The method according to claim 19, characterized in that The human body communication mode includes a capacitive coupling type human body communication mode and a current coupling type human body communication mode; Wherein, when the type of the human body communication mode currently turned on by the second electronic device is the capacitive coupling human body communication mode, the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: The second electronic device transmits the capacitive coupling human body communication signal to the first electronic device; The first electronic device receives the human body communication signal transmitted by the second electronic device, and records the received signal strength corresponding to the human body communication signal received at each moment, to obtain a received signal strength variation waveform, including: The first electronic device receives the capacitive coupling human body communication signal transmitted by the second electronic device, and records the capacitance receiving signal strength corresponding to the capacitive coupling human body communication signal received at each moment, to obtain a capacitance receiving signal strength variation waveform; Wherein, when the type of the human body communication mode currently turned on by the second electronic device is the current coupling type human body communication mode, the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: The second electronic device transmits the current-coupled human body communication signal to the first electronic device; The first electronic device receives the human body communication signal transmitted by the second electronic device, and records the received signal strength corresponding to the human body communication signal received at each moment, to obtain a received signal strength variation waveform, including: The first electronic device receives the current-coupled human body communication signal transmitted by the second electronic device, and records the current receiving signal strength corresponding to the current-coupled human body communication signal received at each moment, to obtain a current receiving signal strength variation waveform.
21. The method according to claim 20, characterized in that A second somatosensory operation device is integrated in the second electronic device, the second somatosensory operation device includes a human body communication transmitting circuit for transmitting a human body communication signal, the human body communication transmitting circuit includes a capacitive coupling type human body communication transmitting circuit and a current coupling type human body communication transmitting circuit; The second electronic device transmitting the capacitive coupling human body communication signal to the first electronic device includes: The second electronic device turns on the capacitive coupling type human body communication transmitting circuit and turns off the current coupling type human body communication transmitting circuit; The second electronic device transmits the capacitive coupling type human body communication signal to the first electronic device through the capacitive coupling type human body communication transmitting circuit; The second electronic device transmitting the current-coupled human body communication signal to the first electronic device includes: The second electronic device turns on the current coupling type human body communication transmitting circuit and turns off the capacitive coupling type human body communication transmitting circuit; The second electronic device transmits the current-coupled human body communication signal to the first electronic device through the current-coupled human body communication transmitting circuit.
22. The method according to claim 21, characterized in that The second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, wherein the current / capacitive coupling type human body communication composite module includes a human body communication module, a circuit switching switch, a voltage drive amplifier and a current drive amplifier; The second electronic device turns on the capacitive coupling type human body communication transmitting circuit and turns off the current coupling type human body communication transmitting circuit, including: The second electronic device switches on the connection between the human body communication module and the voltage drive amplifier and disconnects the connection between the human body communication module and the current drive amplifier through the circuit switching switch; The second electronic device connects the first port of the voltage-driven amplifier to the first port of the current / capacitive coupling type human body communication composite module, and the second port of the voltage-driven amplifier to the second port of the current / capacitive coupling type human body communication composite module; The second electronic device disconnects the first port of the current drive amplifier from the third port of the current / capacitive coupling type human body communication composite module, and disconnects the second port of the current drive amplifier from the fourth port of the current / capacitive coupling type human body communication composite module; The second electronic device, through the electrode switching module, conducts the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, conducts the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnects the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnects the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode.
23. The method according to claim 21, characterized in that The second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, wherein the current / capacitive coupling type human body communication composite module includes a human body communication module, a circuit switching switch, a voltage drive amplifier and a current drive amplifier; The second electronic device turns on the current coupling type human body communication transmitting circuit and turns off the capacitive coupling type human body communication transmitting circuit, including: The second electronic device switches on the connection between the human body communication module and the current drive amplifier and disconnects the connection between the human body communication module and the voltage drive amplifier through the circuit switching switch; The second electronic device connects the first port of the current drive amplifier to the third port of the current / capacitive coupling type human body communication composite module, and the second port of the current drive amplifier to the fourth port of the current / capacitive coupling type human body communication composite module; The second electronic device disconnects the first port of the voltage-driven amplifier from the first port of the current / capacitive coupling type human body communication composite module, and disconnects the second port of the voltage-driven amplifier from the second port of the current / capacitive coupling type human body communication composite module; The second electronic device, through the electrode switching module, conducts the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, conducts the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnects the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnects the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode.
24. The method according to claim 20, characterized in that The first electronic device is integrated with a first somatosensory operation device, the first somatosensory operation device includes a human body communication receiving circuit for receiving a human body communication signal, the human body communication receiving circuit includes a capacitive coupling type human body communication receiving circuit and a current coupling type human body communication receiving circuit; The first electronic device receives the capacitive coupling human body communication signal transmitted by the second electronic device, including: The first electronic device turns on the capacitive coupling type human body communication receiving circuit and turns off the current coupling type human body communication receiving circuit; The first electronic device receives the capacitive coupling type human body communication signal transmitted by the second electronic device through the capacitive coupling type human body communication receiving circuit; The first electronic device receives the current-coupled human body communication signal transmitted by the second electronic device, including: The first electronic device is used to turn on the current coupling type human body communication receiving circuit and turn off the capacitive coupling type human body communication receiving circuit; The first electronic device receives the current-coupled human body communication signal transmitted by the second electronic device through the current-coupled human body communication receiving circuit.
25. The method according to claim 24, characterized in that The first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module is connected to the receiving circuit; The first electronic device turns on the capacitive coupling type human body communication receiving circuit and turns off the current coupling type human body communication receiving circuit, including: The first electronic device connects the first port of the receiving circuit to the first port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit to the second port of the current / capacitive coupling type human body communication composite module; The first electronic device, through the electrode switching module, conducts the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, conducts the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnects the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnects the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode.
26. The method according to claim 24, characterized in that The first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module is connected to the receiving circuit; The first electronic device turns on the current coupling type human body communication receiving circuit and turns off the capacitive coupling type human body communication receiving circuit, including: The first electronic device connects the first port of the receiving circuit to the third port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit to the fourth port of the current / capacitive coupling type human body communication composite module; The first electronic device, through the electrode switching module, conducts the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, conducts the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnects the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnects the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode.
27. The method according to any one of claims 19 to 26, characterized in that The first electronic device and the second electronic device are both in a first state; The second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently enabled human body communication mode, including: When the type of the human body communication mode currently turned on by the second electronic device is a capacitive coupling human body communication mode, the second electronic device switches the human body communication mode from the capacitive coupling human body communication mode to a current coupling human body communication mode, and transmits a current coupling human body communication signal to the first electronic device; When the type of the human body communication mode currently turned on by the second electronic device is the current coupling type human body communication mode, the second electronic device maintains the current coupling type human body communication mode and transmits the current coupling type human body communication signal to the first electronic device.
28. The method according to claim 27, characterized in that The first state is a wearing state or a holding state; The first electronic device and the second electronic device are both in a first state, including: The first electronic device and the second electronic device are respectively worn or held by different limbs of the user; Wherein, when the first electronic device and the second electronic device are respectively worn or held by different limbs of the user, the method further includes: The first electronic device matches the obtained current receiving signal strength variation waveform with a first preset variation waveform in the preset variation waveforms, where the first preset variation waveform is a waveform of the current receiving signal strength corresponding to the sliding approach operation gesture made in a first scenario with actual variation, where the first scenario is a scenario where the first electronic device and the second electronic device are worn or held by different limbs of the user, and the first electronic device and the second electronic device are in a current coupling human body communication mode; When the current received signal strength variation waveform matches the first preset variation waveform, the first electronic device determines, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the current received signal strength variation waveform is a sliding approach operation gesture; When the current received signal strength variation waveform does not match the first preset variation waveform, the first electronic device matches the current received signal strength variation waveform with a second preset variation waveform in the preset variation waveforms, where the second preset variation waveform is a waveform of the current received signal strength corresponding to the slide away operation gesture made in the first scenario with actual variation; When the current received signal strength variation waveform matches the second preset variation waveform, the first electronic device determines, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the current received signal strength variation waveform is a slide away operation gesture; When the current received signal strength variation waveform does not match the second preset variation waveform, the first electronic device matches the current received signal strength variation waveform with a third preset variation waveform among the preset variation waveforms, wherein the third preset variation waveform is a waveform of the current received signal strength corresponding to the click operation gesture made in the first scenario with actual variation; When the current received signal strength variation waveform matches the third preset variation waveform, the first electronic device determines that the target gesture corresponding to the current received signal strength variation waveform is a click operation gesture according to a mapping relationship between the preset variation waveform and the operation gesture.
29. The method according to claim 27, characterized in that The first state is a wearing state or a holding state; The first electronic device and the second electronic device are both in a first state, including: The first electronic device and the second electronic device are respectively worn or held by the same limb of the user; Wherein, when the first electronic device and the second electronic device are worn or held by the same limb of the user, the method further includes: The first electronic device matches the obtained current receiving signal strength variation waveform with a fourth preset variation waveform in the preset variation waveforms, where the fourth preset variation waveform is a waveform of the current receiving signal strength corresponding to the click operation gesture made in a second scenario with actual variation, where the second scenario is a scenario in which the first electronic device and the second electronic device are worn or held by the same limb of the user, and the first electronic device and the second electronic device are in a current coupling human body communication mode; When the current received signal strength variation waveform matches the fourth preset variation waveform, the first electronic device determines that the target gesture corresponding to the current received signal strength variation waveform is a click operation gesture according to a mapping relationship between the preset variation waveform and the operation gesture.
30. The method according to any one of claims 19 to 26, characterized in that One of the first electronic device and the second electronic device is in a first state and the other is in a second state, and the first state and the second state are different states; The second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently enabled human body communication mode, including: When the type of the human body communication mode currently turned on by the second electronic device is the current coupling human body communication mode, the second electronic device switches the human body communication mode from the current coupling human body communication mode to the capacitive coupling human body communication mode, and transmits a capacitive coupling human body communication signal to the first electronic device; When the type of the human body communication mode currently turned on by the second electronic device is the capacitive coupling human body communication mode, the second electronic device maintains the capacitive coupling human body communication mode and transmits the capacitive coupling human body communication signal to the first electronic device.
31. The method according to claim 30, characterized in that The first state is a wearing state or a holding state, and the second state is a state of being placed on an object; The first electronic device and the second electronic device are in a first state and a second state, respectively, including: The first electronic device is in the second state, and the second electronic device is in the first state; Wherein, when the first electronic device is in the second state and the second electronic device is in the first state, the method further includes: The first electronic device matches the obtained capacitance received signal strength variation waveform with a fifth preset variation waveform in the preset variation waveforms, where the fifth preset variation waveform is a waveform of capacitance received signal strength corresponding to a sliding approach operation gesture made in a third scenario with actual variation, where the third scenario is a scenario where the first electronic device is in the second state, the second electronic device is in the first state, and the first electronic device and the second electronic device are in a capacitive coupling human body communication mode; When the capacitance received signal strength variation waveform matches the fifth preset variation waveform, the first electronic device determines, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the capacitance received signal strength variation waveform is a sliding approach operation gesture; When the capacitance received signal strength variation waveform does not match the fifth preset variation waveform, the first electronic device matches the capacitance received signal strength variation waveform with a sixth preset variation waveform among the preset variation waveforms, where the sixth preset variation waveform is a waveform of the capacitance received signal strength corresponding to the sliding away operation gesture made in the third scenario with actual variation; When the capacitance received signal strength variation waveform matches the sixth preset variation waveform, the first electronic device determines, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the capacitance received signal strength variation waveform is a slide away operation gesture; When the capacitance received signal strength variation waveform does not match the sixth preset variation waveform, the first electronic device matches the capacitance received signal strength variation waveform with a seventh preset variation waveform among the preset variation waveforms, where the seventh preset variation waveform is a waveform of the capacitance received signal strength corresponding to the click operation gesture made in the third scenario with actual variation; When the capacitance received signal strength variation waveform matches the seventh preset variation waveform, the first electronic device determines that the target gesture corresponding to the capacitance received signal strength variation waveform is a click operation gesture according to a mapping relationship between the preset variation waveform and the operation gesture.
32. The method according to any one of claims 19 to 31, characterized in that The method further comprises: When the first electronic device obtains the received signal strength variation waveform, the first electronic device sends the received signal strength variation waveform to the second electronic device; The second electronic device receives the received signal strength change waveform sent by the first electronic device; When the received signal strength variation waveform matches any preset variation waveform, the second electronic device determines the target operation gesture corresponding to the received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; The second electronic device sends a control instruction corresponding to the target operation gesture to the first electronic device; The first electronic device receives an operation instruction corresponding to the target operation gesture sent by the second electronic device; The first electronic device executes the control instruction corresponding to the target operation gesture.
33. The method according to any one of claims 19 to 31, characterized in that The first somatosensory operation device integrated in the first electronic device further includes a human body communication transmitting circuit for transmitting a human body communication signal, wherein the human body communication transmitting circuit includes a capacitive coupling type human body communication transmitting circuit and a current coupling type human body communication transmitting circuit; The second body operating device integrated in the second electronic device further includes a human body communication transmitting circuit for receiving a human body communication signal, and the human body communication receiving circuit includes a capacitive coupling type human body communication receiving circuit and a current coupling type human body communication receiving circuit; The method further comprises: The first electronic device transmits the current-coupled human body communication signal to the second electronic device when the current-coupled human body communication transmitting circuit is turned on and the capacitive-coupled human body communication transmitting circuit, the current-coupled human body communication receiving circuit and the capacitive-coupled human body communication receiving circuit are turned off; The second electronic device receives the current-coupled human body communication signal transmitted by the first electronic device when the current-coupled human body receiving circuit is turned on and the current-coupled human body communication transmitting circuit, the capacitive-coupled human body transmitting circuit and the capacitive-coupled human body communication receiving circuit are turned off, and records the received signal strength corresponding to the current-coupled human body communication signal received at each moment to obtain a current received signal strength variation waveform; When the current received signal strength variation waveform matches any preset variation waveform, the second electronic device determines the target operation gesture corresponding to the current received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; The second electronic device executes the control instruction corresponding to the target operation gesture.
34. The method according to claim 33, characterized in that The method further comprises: When the second electronic device obtains the current received signal strength variation waveform, the second electronic device sends the current received signal strength variation waveform to the first electronic device; The first electronic device receives the current receiving signal strength variation waveform sent by the second electronic device; When the current received signal strength variation waveform matches any preset variation waveform, the first electronic device determines the target operation gesture corresponding to the current received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; The first electronic device sends a control instruction corresponding to the target operation gesture to the second electronic device; The second electronic device receives the operation instruction corresponding to the target operation gesture sent by the first electronic device; The second electronic device executes the control instruction corresponding to the target operation gesture.
35. The method according to claim 33, characterized in that The method further comprises: The first electronic device transmits the capacitive coupling type human body communication signal to the second electronic device when the capacitive coupling type human body communication transmitting circuit is turned on and the current coupling type human body transmitting circuit, the current coupling type human body communication receiving circuit and the capacitive coupling type human body communication receiving circuit are turned off; The second electronic device receives the capacitive coupling type human body communication signal transmitted by the first electronic device when the capacitive coupling type human body receiving circuit is turned on and the current coupling type human body communication transmitting circuit, the capacitive coupling type human body transmitting circuit and the current coupling type human body communication receiving circuit are turned off, and records the received signal strength corresponding to the capacitive coupling type human body communication signal received at each moment to obtain a capacitive received signal strength variation waveform; When the capacitance receiving signal strength variation waveform matches any preset variation waveform, the second electronic device determines the target operation gesture corresponding to the capacitance receiving signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; The second electronic device executes the control instruction corresponding to the target operation gesture.
36. The method according to claim 35, characterized in that The method further comprises: When the second electronic device obtains the capacitance received signal strength variation waveform, the second electronic device sends the capacitance received signal strength variation waveform to the first electronic device; The first electronic device receives the capacitance receiving signal strength change waveform sent by the second electronic device; When the capacitance received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms, the first electronic device determines the target operation gesture corresponding to the capacitance received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; The first electronic device sends a control instruction corresponding to the target operation gesture to the second electronic device; The second electronic device receives the operation instruction corresponding to the target operation gesture sent by the first electronic device; The second electronic device executes the control instruction corresponding to the target operation gesture.
37. An electronic device, characterized in that: The electronic device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the somatosensory operation method as described in any one of claims 19 to 36.
38. A computer-readable storage medium, characterized in that: It includes a computer program, which, when running on an electronic device, enables the electronic device to execute the somatosensory operation method as described in any one of claims 19 to 36.
Citation Information
Patent Citations
Wrist gesture control system and method
CN102915111A
Human body communication based wireless input system and implementation method thereof
CN105005382A
Motion-correlation control system to control communication of a wearable device
CN106339073A
Virtual reality system and interaction control method
CN110727344A
Composite electrode suitable for current / capacitance coupling type human body communication
CN110932793A