Somatosensory operation system, method, equipment and storage medium
By integrating human communication functions in smart devices, using the waveform of the reception intensity of human communication signals to match the preset waveform, the user gestures are determined, and the problem of finger obstruction caused by small screen of smart devices is solved, and the contactless gesture operation is realized, which improves users Experience.
Patent Information
- Application Number
- CN202311029227.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-15
- Publication Date
- 2025-02-21
- Estimated Expiration
- 2043-08-15
AI Technical Summary
Because smart devices such as smart watches and smart bracelets have a small screen, when using fingers to touch the screen, the area where the fingers block the screen occupies a large area, resulting in the content displayed on the screen being blocked, affecting the user experience.
By integrating the human body communication function in the first electronic device and the second electronic device, using the capacitively coupled and current-coupled human body communication modes, the second electronic device transmits the human body communication signal, the first electronic device records the waveform of the received signal intensity change, and Matching with the preset waveform, determine the user's operation gestures, so as to realize clicking, sliding and other operations without contacting the screen.
It realizes simple gesture operation without contacting the screen of the electronic device, which improves the human-computer interaction experience, especially in the use of smart devices.
Smart Images

Figure CN119493467A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of human body communication technology, and in particular to a somatosensory operating system, method, device and storage medium. Background Art
[0002] At present, gesture operation has become one of the common operation methods of smart devices. For electronic devices with touch screens, touch operations can be performed by gestures such as clicking and sliding on the screen to achieve human-computer interaction.
[0003] However, for electronic devices with smaller screens, such as smart watches and smart bracelets, when using fingers for touch operations, the area of the screen blocked by the fingers occupies a larger area of the screen, resulting in the content displayed on the screen being blocked, affecting the user experience. Summary of the invention
[0004] In order to solve the above technical problems, the present application provides a somatosensory operating system, method, device and storage medium, which aims to realize simple gesture operations such as clicking and sliding based on human body communication technology without contacting the screen of the electronic device, thereby improving the human-computer interaction experience.
[0005] In the first aspect, the present application provides a somatosensory operating system. The system includes: a first electronic device and a second electronic device, wherein the first electronic device and the second electronic device have human body communication modes turned on; the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently turned-on human body communication mode; the first electronic device is used to receive the human body communication signal transmitted by the second electronic device, and record the received signal strength corresponding to the human body communication signal received at each moment to obtain a received signal strength change waveform; the first electronic device is used to determine the target operation gesture corresponding to the received signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture when the received signal strength change waveform matches any preset change waveform in the preset change waveform; the first electronic device is used to execute the control instruction corresponding to the target operation gesture.
[0006] The first electronic device is a controlled terminal, that is, a device that needs to respond to the operation gesture, such as the device A, device C, device D, etc. mentioned in the following embodiments.
[0007] The second electronic device is a control terminal, that is, a device worn on the user and used to transmit human body communication signals, such as the device B mentioned in the following embodiment.
[0008] The second electronic device for transmitting the human body communication signal may transmit the human body communication signal periodically, or may transmit the human body communication signal continuously after turning on the human body communication mode.
[0009] The received signal strength waveform is used to reflect how the received signal strength of the received human body communication signal changes over time.
[0010] Therefore, by integrating the human body communication function in the first electronic device and the second electronic device, when the human body communication mode is turned on in both the first electronic device and the second electronic device, the second electronic device as the signal sending end is set to continuously or periodically transmit the human body communication signal, and the first electronic device as the signal receiving end records the received signal strength received at each moment, thereby obtaining a received signal strength change waveform, and finally by matching the obtained received signal change waveform with a pre-stored preset change waveform, the user's current operation gesture can be determined, and then simple gesture operations such as clicking, sliding, etc. can be implemented on the first electronic device or the second electronic device without contacting the screen of the first electronic device or the second electronic device, thereby improving the human-computer interaction experience.
[0011] According to a first aspect, a human body communication mode includes a capacitive coupling human body communication mode and a current coupling human body communication mode; wherein, when the type of the human body communication mode currently turned on by the second electronic device is the capacitive coupling human body communication mode, the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: the second electronic device is used to transmit a capacitive coupling human body communication signal to the first electronic device; wherein the first electronic device is used to receive the human body communication signal transmitted by the second electronic device, and record the received signal strength corresponding to the human body communication signal received at each moment, and obtain a received signal strength change waveform, including: the first electronic device is used to receive the capacitive coupling human body communication signal transmitted by the second electronic device, and record the capacitive receiving signal strength corresponding to the capacitive coupling human body communication signal received at each moment Signal strength, obtain a waveform of the change in capacitance received signal strength; wherein, when the type of human body communication mode currently turned on by the second electronic device is a current-coupled human body communication mode, the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: the second electronic device is used to transmit a current-coupled human body communication signal to the first electronic device; wherein the first electronic device is used to receive the human body communication signal transmitted by the second electronic device, and record the received signal strength corresponding to the human body communication signal received at each moment, to obtain a waveform of the change in received signal strength, including: the first electronic device is used to receive the current-coupled human body communication signal transmitted by the second electronic device, and record the current received signal strength corresponding to the current-coupled human body communication signal received at each moment, to obtain a waveform of the change in current received signal strength.
[0012] According to the first aspect, or any implementation method of the first aspect above, a second somatosensory operation device is integrated in the second electronic device, and the second somatosensory operation device includes a human body communication transmitting circuit for transmitting a human body communication signal, and the human body communication transmitting circuit includes a capacitive coupling human body communication transmitting circuit and a current coupling human body communication transmitting circuit; wherein the second electronic device is used to transmit the capacitive coupling human body communication signal to the first electronic device, including: the second electronic device turns on the capacitive coupling human body communication transmitting circuit and turns off the current coupling human body communication transmitting circuit; the second electronic device is used to transmit the capacitive coupling human body communication signal to the first electronic device through the capacitive coupling human body communication transmitting circuit; wherein the second electronic device is used to transmit the current coupling human body communication signal to the first electronic device, including: the second electronic device is used to turn on the current coupling human body communication transmitting circuit and turns off the capacitive coupling human body communication transmitting circuit; the second electronic device is used to transmit the current coupling human body communication signal to the first electronic device through the current coupling human body communication transmitting circuit.
[0013] According to the first aspect, or any implementation of the first aspect above, the second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling human body communication composite module, the current / capacitive coupling human body communication composite module includes a human body communication module, a circuit switching switch, a voltage-driven amplifier and a current-driven amplifier; wherein the second electronic device is used to turn on the capacitive coupling human body communication transmitting circuit and disconnect the current coupling human body communication transmitting circuit, including: the second electronic device is used to turn on the connection between the human body communication module and the voltage-driven amplifier through the circuit switching switch, and disconnect the connection between the human body communication module and the current-driven amplifier; the second electronic device is used to connect the first port of the voltage-driven amplifier to the first port of the current / capacitive coupling human body communication composite module, The second port of the voltage-driven amplifier is connected to the second port of the current / capacitive coupling type human body communication composite module; the second electronic device is used to disconnect the connection between the first port of the current-driven amplifier and the third port of the current / capacitive coupling type human body communication composite module, and the connection between the second port of the current-driven amplifier and the fourth port of the current / capacitive coupling type human body communication composite module; the second electronic device is used to conduct the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, conduct the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnect the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnect the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode through the electrode switching module.
[0014] According to the first aspect, or any implementation of the first aspect above, the second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling human body communication composite module, the current / capacitive coupling human body communication composite module includes a human body communication module, a circuit switching switch, a voltage-driven amplifier and a current-driven amplifier; wherein the second electronic device is used to turn on the current-coupled human body communication transmitting circuit and disconnect the capacitive coupling human body communication transmitting circuit, including: the second electronic device is used to turn on the connection between the human body communication module and the current-driven amplifier and disconnect the connection between the human body communication module and the voltage-driven amplifier through the circuit switching switch; the second electronic device is used to connect the first port of the current-driven amplifier to the third port of the current / capacitive coupling human body communication composite module, The second port of the current-driven amplifier is connected to the fourth port of the current / capacitive coupling type human body communication composite module; the second electronic device is used to disconnect the connection between the first port of the voltage-driven amplifier and the first port of the current / capacitive coupling type human body communication composite module, and the connection between the second port of the voltage-driven amplifier and the second port of the current / capacitive coupling type human body communication composite module; the second electronic device is used to conduct the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, conduct the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnect the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnect the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode through the electrode switching module.
[0015] According to the first aspect, or any implementation of the first aspect above, a first somatosensory operation device is integrated in a first electronic device, and the first somatosensory operation device includes a human body communication receiving circuit for receiving a human body communication signal, and the human body communication receiving circuit includes a capacitive coupling human body communication receiving circuit and a current coupling human body communication receiving circuit; wherein the first electronic device is used to receive a capacitive coupling human body communication signal transmitted by a second electronic device, including: the first electronic device is used to turn on the capacitive coupling human body communication receiving circuit and disconnect the current coupling human body communication receiving circuit; the first electronic device is used to receive the capacitive coupling human body communication signal transmitted by the second electronic device through the capacitive coupling human body communication receiving circuit; wherein the first electronic device is used to receive the current coupling human body communication signal transmitted by the second electronic device, including: the first electronic device is used to turn on the current coupling human body communication receiving circuit and disconnect the capacitive coupling human body communication receiving circuit; the first electronic device is used to receive the current coupling human body communication signal transmitted by the second electronic device through the current coupling human body communication receiving circuit.
[0016] According to the first aspect, or any implementation of the first aspect above, the first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module and the receiving circuit are connected; wherein, the first electronic device is used to turn on the capacitive coupling type human body communication receiving circuit and disconnect the current coupling type human body communication receiving circuit, including: the first electronic device is used to connect the first port of the receiving circuit to the first port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit is connected to the second port of the current / capacitive coupling type human body communication composite module; the first electronic device is used to turn on the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode through the electrode switching module, turn on the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnect the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnect the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode.
[0017] According to the first aspect, or any implementation of the first aspect above, the first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module and the receiving circuit are connected; wherein, the first electronic device is used to turn on the current coupling type human body communication receiving circuit and disconnect the capacitive coupling type human body communication receiving circuit, including: the first electronic device is used to connect the first port of the receiving circuit to the third port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit is connected to the fourth port of the current / capacitive coupling type human body communication composite module; the first electronic device is used to turn on the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode through the electrode switching module, turn on the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnect the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnect the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode.
[0018] According to the first aspect, or any implementation method of the first aspect above, the first electronic device and the second electronic device are both in the first state; the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: when the type of the human body communication mode currently turned on by the second electronic device is a capacitive coupling human body communication mode, the second electronic device is used to switch the human body communication mode from the capacitive coupling human body communication mode to the current coupling human body communication mode, and transmit a current coupling human body communication signal to the first electronic device; when the type of the human body communication mode currently turned on by the second electronic device is the current coupling human body communication mode, the second electronic device is used to maintain the current coupling human body communication mode and transmit a current coupling human body communication signal to the first electronic device.
[0019] According to the first aspect, or any implementation method of the first aspect above, the first state is a wearing state or a holding state; wherein the first electronic device and the second electronic device are both in the first state, including: the first electronic device and the second electronic device are respectively worn or held by different limbs of the user; wherein, when the first electronic device and the second electronic device are respectively worn or held by different limbs of the user, the first electronic device is used to: match the obtained current reception signal strength change waveform with the first preset change waveform in the preset change waveform, the first preset change waveform is a waveform of the current reception signal strength corresponding to the sliding approach operation gesture made in the first scenario with the actual change, the first scenario is the first electronic device and the second electronic device are worn or held by different limbs of the user, and the first electronic device and the second electronic device are in the current coupling human body communication mode; when the current reception signal strength change waveform matches the first preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, determine that the target gesture corresponding to the current reception signal strength change waveform is the sliding approach operation gesture; When the current received signal strength change waveform does not match the first preset change waveform, the current received signal strength change waveform is matched with the second preset change waveform in the preset change waveform, and the second preset change waveform is a waveform of the current received signal strength corresponding to the slide away operation gesture made in the first scenario with actual change; when the current received signal strength change waveform matches the second preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, it is determined that the target gesture corresponding to the current received signal strength change waveform is the slide away operation gesture; when the current received signal strength change waveform does not match the second preset change waveform, the current received signal strength change waveform is matched with the third preset change waveform in the preset change waveform, and the third preset change waveform is a waveform of the current received signal strength corresponding to the click operation gesture made in the first scenario with actual change; when the current received signal strength change waveform matches the third preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, it is determined that the target gesture corresponding to the current received signal strength change waveform is the click operation gesture.
[0020] According to the first aspect, or any implementation method of the first aspect above, the first state is a wearing state or a holding state; wherein, the first electronic device and the second electronic device are both in the first state, including: the first electronic device and the second electronic device are respectively worn or held by the same limb of the user; wherein, when the first electronic device and the second electronic device are worn or held by the same limb of the user, the first electronic device is used to: match the obtained current reception signal strength change waveform with the fourth preset change waveform in the preset change waveform, the fourth preset change waveform is the waveform of the current reception signal strength corresponding to the click operation gesture made in the second scenario with the actual change, the second scenario is the first electronic device and the second electronic device are worn or held by the same limb of the user, and the first electronic device and the second electronic device are in the current coupling human body communication mode; when the current reception signal strength change waveform matches the fourth preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, determine that the target gesture corresponding to the current reception signal strength change waveform is the click operation gesture.
[0021] According to the first aspect, or any implementation method of the first aspect above, the first electronic device and the second electronic device are in a first state and a second state, respectively, and the first state and the second state are different states; the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: when the type of the human body communication mode currently turned on by the second electronic device is a current-coupled human body communication mode, the second electronic device is used to switch the human body communication mode from the current-coupled human body communication mode to the capacitive-coupled human body communication mode, and transmit a capacitive-coupled human body communication signal to the first electronic device; when the type of the human body communication mode currently turned on by the second electronic device is a capacitive-coupled human body communication mode, the second electronic device is used to maintain the capacitive-current-coupled human body communication mode and transmit a capacitive-coupled human body communication signal to the first electronic device.
[0022] According to the first aspect, or any implementation method of the first aspect above, the first state is a wearing state or a holding state, and the second state is a state of being placed on an object; wherein, the first electronic device and the second electronic device are in the first state and the second state, respectively, including: the first electronic device is in the second state, and the second electronic device is in the first state; wherein, when the first electronic device is in the second state and the second electronic device is in the first state, the first electronic device is used to: match the obtained capacitance receiving signal strength change waveform with the fifth preset change waveform in the preset change waveform, the fifth preset change waveform is a waveform of the capacitance receiving signal strength corresponding to the sliding approach operation gesture made in the third scenario with the actual change, the third scenario is the first electronic device in the second state, the second electronic device in the first state, and the first electronic device and the second electronic device are in the capacitive coupling human body communication mode; when the capacitance receiving signal strength change waveform matches the fifth preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, determine that the target gesture corresponding to the capacitance receiving signal strength change waveform is Slide closer operation gesture; when the capacitor received signal strength change waveform does not match the fifth preset change waveform, match the capacitor received signal strength change waveform with the sixth preset change waveform in the preset change waveform, and the sixth preset change waveform is the waveform of the capacitor received signal strength corresponding to the slide away operation gesture made in the third scenario with actual change; when the capacitor received signal strength change waveform matches the sixth preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, determine that the target gesture corresponding to the capacitor received signal strength change waveform is the slide away operation gesture; when the capacitor received signal strength change waveform does not match the sixth preset change waveform, match the capacitor received signal strength change waveform with the seventh preset change waveform in the preset change waveform, and the seventh preset change waveform is the waveform of the capacitor received signal strength corresponding to the click operation gesture made in the third scenario with actual change; when the capacitor received signal strength change waveform matches the seventh preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, determine that the target gesture corresponding to the capacitor received signal strength change waveform is the click operation gesture.
[0023] The object on which the electronic device is placed is, for example, a desktop.
[0024] According to the first aspect, or any implementation method of the first aspect above, the first electronic device is also used to: when a received signal strength change waveform is obtained, send a received signal strength change waveform to a second electronic device; the second electronic device is also used to: receive the received signal strength change waveform sent by the first electronic device; when the received signal strength change waveform matches any preset change waveform among the preset change waveforms, determine the target operation gesture corresponding to the received signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; send a control instruction corresponding to the target operation gesture to the first electronic device; the first electronic device is also used to: receive an operation instruction corresponding to the target operation gesture sent by the second electronic device; and execute the control instruction corresponding to the target operation gesture.
[0025] According to the first aspect, or any implementation of the first aspect above, the first somatosensory operation device integrated in the first electronic device also includes a human body communication transmitting circuit for transmitting a human body communication signal, and the human body communication transmitting circuit includes a capacitive coupling type human body communication transmitting circuit and a current coupling type human body communication transmitting circuit; the second somatosensory operation device integrated in the second electronic device also includes a human body communication transmitting circuit for receiving a human body communication signal, and the human body communication receiving circuit includes a capacitive coupling type human body communication receiving circuit and a current coupling type human body communication receiving circuit; the first electronic device is also used for: when the current coupling type human body communication transmitting circuit is turned on, the capacitive coupling type human body communication transmitting circuit, the current coupling type human body communication receiving circuit, and the capacitive coupling type human body communication receiving circuit are disconnected, Transmitting a current-coupled human body communication signal to a second electronic device; the second electronic device is also used to: receive the current-coupled human body communication signal transmitted by the first electronic device when the current-coupled human body receiving circuit is turned on and the current-coupled human body communication transmitting circuit, the capacitive coupling human body transmitting circuit, and the capacitive coupling human body communication receiving circuit are disconnected, and record the received signal strength corresponding to the current-coupled human body communication signal received at each moment to obtain a current received signal strength change waveform; when the current received signal strength change waveform matches any of the preset change waveforms, determine the target operation gesture corresponding to the current received signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; and execute the control instruction corresponding to the target operation gesture.
[0026] Therefore, by integrating both the human body communication transmitting circuit and the human body communication receiving circuit in the first electronic device and the second electronic device, the two electronic devices can switch identities and realize body sensing operation.
[0027] According to the first aspect, or any implementation method of the first aspect above, the second electronic device is also used to: when the current reception signal strength change waveform is obtained, send the current reception signal strength change waveform to the first electronic device; the first electronic device is also used to: receive the current reception signal strength change waveform sent by the second electronic device; when the current reception signal strength change waveform matches any preset change waveform among the preset change waveforms, determine the target operation gesture corresponding to the current reception signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; send the control instruction corresponding to the target operation gesture to the second electronic device; the second electronic device is also used to: receive the operation instruction corresponding to the target operation gesture sent by the first electronic device; and execute the control instruction corresponding to the target operation gesture.
[0028] According to the first aspect, or any implementation method of the first aspect above, the first electronic device is also used to: when the capacitive coupling human body communication transmitting circuit is turned on, the current coupling human body communication transmitting circuit, the current coupling human body communication receiving circuit, and the capacitive coupling human body communication receiving circuit are disconnected, transmit a capacitive coupling human body communication signal to the second electronic device; the second electronic device is also used to: when the capacitive coupling human body receiving circuit is turned on, the current coupling human body communication transmitting circuit, the capacitive coupling human body communication transmitting circuit, and the current coupling human body communication receiving circuit are disconnected, receive the capacitive coupling human body communication signal transmitted by the first electronic device, and record the received signal strength corresponding to the capacitive coupling human body communication signal received at each moment to obtain a capacitive receiving signal strength change waveform; when the capacitive receiving signal strength change waveform matches any preset change waveform in the preset change waveforms, determine the target operation gesture corresponding to the capacitive receiving signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; and execute the control instruction corresponding to the target operation gesture.
[0029] According to the first aspect, or any implementation method of the first aspect above, the second electronic device is also used to: when obtaining the capacitance received signal strength change waveform, send the capacitance received signal strength change waveform to the first electronic device; the first electronic device is also used to: receive the capacitance received signal strength change waveform sent by the second electronic device; when the capacitance received signal strength change waveform matches any preset change waveform among the preset change waveforms, determine the target operation gesture corresponding to the capacitance received signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; send the control instruction corresponding to the target operation gesture to the second electronic device; the second electronic device is also used to: receive the operation instruction corresponding to the target operation gesture sent by the first electronic device; and execute the control instruction corresponding to the target operation gesture.
[0030] In the second aspect, the present application provides a somatosensory operation method, which is applied to a somatosensory operating system, and the system includes: a first electronic device and a second electronic device, and the first electronic device and the second electronic device have human body communication mode turned on. The method includes: the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently turned-on human body communication mode; the first electronic device receives the human body communication signal transmitted by the second electronic device, and records the received signal strength corresponding to the human body communication signal received at each moment, and obtains a received signal strength change waveform; when the received signal strength change waveform of the first electronic device matches any preset change waveform in the preset change waveform, the first electronic device determines the target operation gesture corresponding to the received signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; the first electronic device executes the control instruction corresponding to the target operation gesture.
[0031] According to the second aspect, the human body communication mode includes a capacitive coupling human body communication mode and a current coupling human body communication mode; wherein, when the type of the human body communication mode currently turned on by the second electronic device is the capacitive coupling human body communication mode, the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: the second electronic device transmits a capacitive coupling human body communication signal to the first electronic device; wherein the first electronic device receives the human body communication signal transmitted by the second electronic device, and records the received signal strength corresponding to the human body communication signal received at each moment, and obtains a received signal strength change waveform, including: the first electronic device receives the capacitive coupling human body communication signal transmitted by the second electronic device, and records the capacitive receiving signal strength corresponding to the capacitive coupling human body communication signal received at each moment Signal strength, obtaining a waveform of a change in capacitance received signal strength; wherein, when the type of human body communication mode currently turned on by the second electronic device is a current-coupled human body communication mode, the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: the second electronic device transmits a current-coupled human body communication signal to the first electronic device; wherein, the first electronic device receives the human body communication signal transmitted by the second electronic device, and records the received signal strength corresponding to the human body communication signal received at each moment, to obtain a waveform of a change in received signal strength, including: the first electronic device receives the current-coupled human body communication signal transmitted by the second electronic device, and records the current received signal strength corresponding to the current-coupled human body communication signal received at each moment, to obtain a waveform of a change in current received signal strength.
[0032] According to the second aspect, or any implementation method of the second aspect above, a second somatosensory operation device is integrated in the second electronic device, and the second somatosensory operation device includes a human body communication transmitting circuit for transmitting a human body communication signal, and the human body communication transmitting circuit includes a capacitive coupling human body communication transmitting circuit and a current coupling human body communication transmitting circuit; wherein, the second electronic device transmits a capacitive coupling human body communication signal to the first electronic device, including: the second electronic device turns on the capacitive coupling human body communication transmitting circuit and turns off the current coupling human body communication transmitting circuit; the second electronic device transmits a capacitive coupling human body communication signal to the first electronic device through the capacitive coupling human body communication transmitting circuit; wherein, the second electronic device transmits a current coupling human body communication signal to the first electronic device, including: the second electronic device turns on the current coupling human body communication transmitting circuit and turns off the capacitive coupling human body communication transmitting circuit; the second electronic device transmits a current coupling human body communication signal to the first electronic device through the current coupling human body communication transmitting circuit.
[0033] According to the second aspect, or any implementation method of the second aspect above, the second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling human body communication composite module, the current / capacitive coupling human body communication composite module includes a human body communication module, a circuit switching switch, a voltage-driven amplifier and a current-driven amplifier; wherein the second electronic device turns on the capacitive coupling human body communication transmitting circuit and disconnects the current-coupled human body communication transmitting circuit, including: the second electronic device turns on the connection between the human body communication module and the voltage-driven amplifier through the circuit switching switch, and disconnects the connection between the human body communication module and the current-driven amplifier; the second electronic device connects the first port of the voltage-driven amplifier to the first port of the current / capacitive coupling human body communication composite module, and the current / capacitive coupling human body communication composite module is electrically connected. The second electronic device connects the second port of the voltage driving amplifier to the second port of the current / capacitive coupling type human body communication composite module; the second electronic device disconnects the first port of the current driving amplifier from the third port of the current / capacitive coupling type human body communication composite module, and disconnects the second port of the current driving amplifier from the fourth port of the current / capacitive coupling type human body communication composite module; the second electronic device conducts the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, conducts the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnects the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnects the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode through the electrode switching module.
[0034] According to the second aspect, or any implementation method of the second aspect above, the second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling human body communication composite module, the current / capacitive coupling human body communication composite module includes a human body communication module, a circuit switching switch, a voltage-driven amplifier and a current-driven amplifier; wherein the second electronic device turns on the current-coupled human body communication transmitting circuit and disconnects the capacitive coupling human body communication transmitting circuit, including: the second electronic device turns on the connection between the human body communication module and the current-driven amplifier through the circuit switching switch, and disconnects the connection between the human body communication module and the voltage-driven amplifier; the second electronic device connects the first port of the current-driven amplifier to the third port of the current / capacitive coupling human body communication composite module, and the current drives the amplifier. The second port of the current driving amplifier is connected to the fourth port of the current / capacitive coupling type human body communication composite module; the second electronic device disconnects the first port of the voltage driving amplifier from the first port of the current / capacitive coupling type human body communication composite module, and disconnects the second port of the voltage driving amplifier from the second port of the current / capacitive coupling type human body communication composite module; the second electronic device conducts the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, conducts the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnects the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnects the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode through the electrode switching module.
[0035] According to the second aspect, or any implementation method of the second aspect above, a first somatosensory operation device is integrated in the first electronic device, and the first somatosensory operation device includes a human body communication receiving circuit for receiving a human body communication signal, and the human body communication receiving circuit includes a capacitive coupling human body communication receiving circuit and a current coupling human body communication receiving circuit; wherein, the first electronic device receives the capacitive coupling human body communication signal transmitted by the second electronic device, including: the first electronic device turns on the capacitive coupling human body communication receiving circuit and turns off the current coupling human body communication receiving circuit; the first electronic device receives the capacitive coupling human body communication signal transmitted by the second electronic device through the capacitive coupling human body communication receiving circuit; wherein, the first electronic device receives the current coupling human body communication signal transmitted by the second electronic device, including: the first electronic device is used to turn on the current coupling human body communication receiving circuit and turns off the capacitive coupling human body communication receiving circuit; the first electronic device receives the current coupling human body communication signal transmitted by the second electronic device through the current coupling human body communication receiving circuit.
[0036] According to the second aspect, or any implementation of the second aspect above, the first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module and the receiving circuit are connected; wherein, the first electronic device turns on the capacitive coupling type human body communication receiving circuit and disconnects the current coupling type human body communication receiving circuit, including: the first electronic device connects the first port of the receiving circuit to the first port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit to the second port of the current / capacitive coupling type human body communication composite module; the first electronic device turns on the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, turns on the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnects the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnects the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode through the electrode switching module.
[0037] According to the second aspect, or any implementation of the second aspect above, the first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module and the receiving circuit are connected; wherein, the first electronic device turns on the current coupling type human body communication receiving circuit and disconnects the capacitive coupling type human body communication receiving circuit, including: the first electronic device connects the first port of the receiving circuit to the third port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit to the fourth port of the current / capacitive coupling type human body communication composite module; the first electronic device turns on the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode through the electrode switching module, turns on the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnects the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnects the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode.
[0038] According to the second aspect, or any implementation method of the second aspect above, the first electronic device and the second electronic device are both in the first state; the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: when the type of the human body communication mode currently turned on by the second electronic device is a capacitive coupling human body communication mode, the second electronic device switches the human body communication mode from the capacitive coupling human body communication mode to the current coupling human body communication mode, and transmits a current coupling human body communication signal to the first electronic device; when the type of the human body communication mode currently turned on by the second electronic device is the current coupling human body communication mode, the second electronic device maintains the current coupling human body communication mode and transmits a current coupling human body communication signal to the first electronic device.
[0039] According to the second aspect, or any implementation of the second aspect above, the first state is a wearing state or a holding state; wherein the first electronic device and the second electronic device are both in the first state, including: the first electronic device and the second electronic device are respectively worn or held by different limbs of the user; wherein, when the first electronic device and the second electronic device are respectively worn or held by different limbs of the user, the method also includes: the first electronic device matches the obtained current receiving signal strength change waveform with the first preset change waveform in the preset change waveform, the first preset change waveform is the waveform of the current receiving signal strength corresponding to the sliding approach operation gesture made in the first scenario with the actual change, the first scenario is the first electronic device and the second electronic device are worn or held by different limbs of the user, and the first electronic device and the second electronic device are in the current coupling human body communication mode; when the current receiving signal strength change waveform of the first electronic device matches the first preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, it is determined that the target gesture corresponding to the current receiving signal strength change waveform is the sliding approach operation gesture; the first electronic device is When the current received signal strength change waveform does not match the first preset change waveform, the current received signal strength change waveform is matched with the second preset change waveform in the preset change waveform, and the second preset change waveform is a waveform of the current received signal strength corresponding to the slide away operation gesture made in the first scenario with actual change; when the current received signal strength change waveform of the first electronic device matches the second preset change waveform, the target gesture corresponding to the current received signal strength change waveform is determined to be the slide away operation gesture according to the mapping relationship between the preset change waveform and the operation gesture; when the current received signal strength change waveform of the first electronic device does not match the second preset change waveform, the current received signal strength change waveform is matched with the third preset change waveform in the preset change waveform, and the third preset change waveform is a waveform of the current received signal strength corresponding to the click operation gesture made in the first scenario with actual change; when the current received signal strength change waveform of the first electronic device matches the third preset change waveform, the target gesture corresponding to the current received signal strength change waveform is determined to be the click operation gesture according to the mapping relationship between the preset change waveform and the operation gesture.
[0040] According to the second aspect, or any implementation method of the second aspect above, the first state is a wearing state or a holding state; wherein, the first electronic device and the second electronic device are both in the first state, including: the first electronic device and the second electronic device are respectively worn or held by the same limb of the user; wherein, when the first electronic device and the second electronic device are worn or held by the same limb of the user, the method also includes: the first electronic device matches the obtained current receiving signal strength change waveform with the fourth preset change waveform in the preset change waveform, and the fourth preset change waveform is a waveform of the current receiving signal strength corresponding to the click operation gesture made in the second scenario with the actual change, and the second scenario is the first electronic device and the second electronic device are worn or held by the same limb of the user, and the first electronic device and the second electronic device are in the current coupling human body communication mode; when the current receiving signal strength change waveform of the first electronic device matches the fourth preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, the target gesture corresponding to the current receiving signal strength change waveform is determined as the click operation gesture.
[0041] According to the second aspect, or any implementation method of the second aspect above, the first electronic device and the second electronic device are in a first state and a second state respectively, and the first state and the second state are different states; the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: when the type of the human body communication mode currently turned on by the second electronic device is a current-coupled human body communication mode, the second electronic device switches the human body communication mode from the current-coupled human body communication mode to the capacitive-coupled human body communication mode, and transmits a capacitive-coupled human body communication signal to the first electronic device; when the type of the human body communication mode currently turned on by the second electronic device is a capacitive-coupled human body communication mode, the second electronic device maintains the capacitive-current-coupled human body communication mode and transmits a capacitive-coupled human body communication signal to the first electronic device.
[0042] According to the second aspect, or any implementation method of the second aspect above, the first state is a wearing state or a holding state, and the second state is a state of being placed on an object; wherein, the first electronic device and the second electronic device are in the first state and the second state, respectively, including: the first electronic device is in the second state, and the second electronic device is in the first state; wherein, when the first electronic device is in the second state and the second electronic device is in the first state, the method further includes: the first electronic device matches the obtained capacitance receiving signal strength change waveform with the fifth preset change waveform in the preset change waveform, and the fifth preset change waveform is a waveform of the capacitance receiving signal strength corresponding to the sliding approach operation gesture made in the third scenario with the actual change, and the third scenario is a scenario in which the first electronic device is in the second state, the second electronic device is in the first state, and the first electronic device and the second electronic device are in a capacitive coupling human body communication mode; when the capacitance receiving signal strength change waveform of the first electronic device matches the fifth preset change waveform, according to the mapping relationship between the preset change waveform and the operation gesture, the target gesture corresponding to the capacitance receiving signal strength change waveform is determined as the sliding approach operation gesture. ; When the capacitance received signal strength change waveform does not match the fifth preset change waveform, the first electronic device matches the capacitance received signal strength change waveform with the sixth preset change waveform in the preset change waveforms, and the sixth preset change waveform is a waveform of the capacitance received signal strength corresponding to the slide away operation gesture made in the third scenario with actual change; when the capacitance received signal strength change waveform matches the sixth preset change waveform, the first electronic device determines that the target gesture corresponding to the capacitance received signal strength change waveform is the slide away operation gesture according to the mapping relationship between the preset change waveform and the operation gesture; when the capacitance received signal strength change waveform does not match the sixth preset change waveform, the first electronic device matches the capacitance received signal strength change waveform with the seventh preset change waveform in the preset change waveforms, and the seventh preset change waveform is a waveform of the capacitance received signal strength corresponding to the click operation gesture made in the third scenario with actual change; when the capacitance received signal strength change waveform matches the seventh preset change waveform, the first electronic device determines that the target gesture corresponding to the capacitance received signal strength change waveform is the click operation gesture according to the mapping relationship between the preset change waveform and the operation gesture.
[0043] According to the second aspect, or any implementation of the second aspect above, the method also includes: when the first electronic device obtains the received signal strength change waveform, the first electronic device sends the received signal strength change waveform to the second electronic device; the second electronic device receives the received signal strength change waveform sent by the first electronic device; when the received signal strength change waveform matches any preset change waveform in the preset change waveforms, the second electronic device determines the target operation gesture corresponding to the received signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; the second electronic device sends a control instruction corresponding to the target operation gesture to the first electronic device; the first electronic device receives the operation instruction corresponding to the target operation gesture sent by the second electronic device; the first electronic device executes the control instruction corresponding to the target operation gesture.
[0044] According to the second aspect, or any implementation of the second aspect above, the first somatosensory operation device integrated in the first electronic device also includes a human body communication transmitting circuit for transmitting a human body communication signal, and the human body communication transmitting circuit includes a capacitive coupling type human body communication transmitting circuit and a current coupling type human body communication transmitting circuit; the second somatosensory operation device integrated in the second electronic device also includes a human body communication transmitting circuit for receiving a human body communication signal, and the human body communication receiving circuit includes a capacitive coupling type human body communication receiving circuit and a current coupling type human body communication receiving circuit; the method also includes: when the current coupling type human body communication transmitting circuit is turned on, the capacitive coupling type human body communication transmitting circuit, the current coupling type human body communication receiving circuit, and the capacitive coupling type human body communication receiving circuit are disconnected, the first electronic device sends a signal to the second electronic device. An electronic device transmits a current-coupled human body communication signal; a second electronic device receives the current-coupled human body communication signal transmitted by the first electronic device when a current-coupled human body receiving circuit is turned on and a current-coupled human body communication transmitting circuit, a capacitive-coupled human body transmitting circuit and a capacitive-coupled human body communication receiving circuit are disconnected, and records the received signal strength corresponding to the current-coupled human body communication signal received at each moment to obtain a current received signal strength change waveform; when the current received signal strength change waveform matches any of the preset change waveforms, the second electronic device determines a target operation gesture corresponding to the current received signal strength change waveform according to a mapping relationship between the preset change waveform and the operation gesture; the second electronic device executes a control instruction corresponding to the target operation gesture.
[0045] According to the second aspect, or any implementation of the second aspect above, the method also includes: when the second electronic device obtains the current reception signal strength change waveform, the second electronic device sends the current reception signal strength change waveform to the first electronic device; the first electronic device receives the current reception signal strength change waveform sent by the second electronic device; when the current reception signal strength change waveform matches any preset change waveform in the preset change waveforms, the first electronic device determines the target operation gesture corresponding to the current reception signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; the first electronic device sends a control instruction corresponding to the target operation gesture to the second electronic device; the second electronic device receives the operation instruction corresponding to the target operation gesture sent by the first electronic device; the second electronic device executes the control instruction corresponding to the target operation gesture.
[0046] According to the second aspect, or any implementation of the second aspect above, the method also includes: the first electronic device transmits a capacitive coupling human body communication signal to the second electronic device when the capacitive coupling human body communication transmitting circuit is turned on and the current coupling human body communication transmitting circuit, the current coupling human body communication receiving circuit, and the capacitive coupling human body communication receiving circuit are disconnected; the second electronic device receives the capacitive coupling human body communication signal transmitted by the first electronic device when the capacitive coupling human body receiving circuit is turned on and the current coupling human body communication transmitting circuit, the capacitive coupling human body communication transmitting circuit, and the current coupling human body communication receiving circuit are disconnected, and records the received signal strength corresponding to the capacitive coupling human body communication signal received at each moment to obtain a capacitive receiving signal strength change waveform; when the capacitive receiving signal strength change waveform of the second electronic device matches any preset change waveform in the preset change waveforms, the target operation gesture corresponding to the capacitive receiving signal strength change waveform is determined according to the mapping relationship between the preset change waveform and the operation gesture; the second electronic device executes the control instruction corresponding to the target operation gesture.
[0047] According to the second aspect, or any implementation of the second aspect above, the method also includes: when the second electronic device obtains the capacitance received signal strength change waveform, the capacitance received signal strength change waveform is sent to the first electronic device; the first electronic device receives the capacitance received signal strength change waveform sent by the second electronic device; when the capacitance received signal strength change waveform matches any preset change waveform in the preset change waveforms, the first electronic device determines the target operation gesture corresponding to the capacitance received signal strength change waveform according to the mapping relationship between the preset change waveform and the operation gesture; the first electronic device sends a control instruction corresponding to the target operation gesture to the second electronic device; the second electronic device receives the operation instruction corresponding to the target operation gesture sent by the first electronic device; the second electronic device executes the control instruction corresponding to the target operation gesture.
[0048] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, which will not be repeated here.
[0049] In a third aspect, the present application provides an electronic device. The electronic device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the method instructions executed by the first electronic device in the second aspect or any possible implementation of the second aspect, or the method instructions executed by the second electronic device.
[0050] In a fourth aspect, the present application provides a computer-readable medium for storing a computer program, wherein the computer program includes instructions for executing the method in the second aspect or any possible implementation of the second aspect.
[0051] In a fifth aspect, the present application provides a computer program comprising instructions for executing the method in the second aspect or any possible implementation of the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0052] Figure 1A A schematic diagram showing the relationship between transmission distance and transmission loss when a current-coupled human body communication signal and a capacitive-coupled human body communication signal are transmitted in the body;
[0053] Figure 1B Schematic diagram showing the relationship between transmission distance and transmission loss when a capacitive coupling human body communication signal is transmitted outside the body;
[0054] Figure 1C A schematic diagram of a scenario for transmitting a current-coupled human body communication signal is shown as an example;
[0055] Figure 1D A schematic diagram of a scenario for transmitting a capacitive coupling type human body communication signal is shown as an example;
[0056] Figure 2 A somatosensory transmission device provided by an embodiment of the present application is exemplarily shown;
[0057] Figure 3A For example, Figure 2 A schematic diagram of the internal structure of a current / capacitive coupling type human body communication composite module in the somatosensory transmission device shown;
[0058] Figure 3B For example, Figure 2A schematic diagram of another internal structure of the current / capacitive coupling type human body communication composite module in the somatosensory transmission device shown;
[0059] Figure 4 For example, Figure 2 A schematic diagram of the internal structure of a current / capacitive coupling type human body communication composite module in the body sensing transmission device shown;
[0060] Figure 5A For example, the integration Figure 2 The electronic device of the somatosensory operating device shown is a schematic diagram of a current-coupled human body communication circuit composed of a current / capacitive-coupled human body communication composite module when working in a current-coupled human body communication mode and serving as a signal transmitting end (control end);
[0061] Figure 5B For example, the integration Figure 2 The electronic device of the somatosensory operating device shown is a schematic diagram of a current-coupled human body communication circuit composed of a current / capacitive-coupled human body communication composite module when working in a current-coupled human body communication mode and serving as a signal receiving end (controlled end);
[0062] Figure 5C For example, the integration Figure 2 The electronic device of the somatosensory operating device shown is a schematic diagram of a capacitive coupling human body communication circuit composed of a current / capacitive coupling human body communication composite module when working in a capacitive coupling human body communication mode and serving as a signal transmitting end (control end);
[0063] Figure 5D For example, the integration Figure 2 The electronic device of the somatosensory operating device shown is a schematic diagram of a capacitive coupling human body communication circuit composed of a current / capacitive coupling human body communication composite module when working in a capacitive coupling human body communication mode and serving as a signal receiving end (controlled end);
[0064] Figure 6 An example of an integrated Figure 2 A schematic diagram of the hardware structure of the electronic device of the somatosensory operating device shown;
[0065] Figure 7 Another example of an integrated Figure 2 A schematic diagram of the hardware structure of the electronic device of the somatosensory operating device shown;
[0066] Figure 8 To illustrate the ability to Figure 2 The somatosensory operating device shown is a schematic diagram of the software structure of an electronic device that realizes human body operation;
[0067] Fig. 9 The setting range shown for example integrates Figure 2 A schematic diagram of the environment of the electronic device of the somatosensory operating device shown;
[0068] FIG. 10A to FIG. 10E This is a schematic diagram of a user interface for exemplarily showing the activation of a somatosensory operation function;
[0069] Fig.11 The setting range shown for example integrates Figure 2 A schematic diagram of establishing a somatosensory operation connection between any two electronic devices in the somatosensory operation device;
[0070] Fig. 12A A schematic diagram of a scenario applicable to the somatosensory operation method provided in the present application is exemplified;
[0071] Fig. 12B A schematic diagram of another scenario applicable to the somatosensory operation method provided in the present application is exemplified;
[0072] Fig.13 For example, Fig. 12A , Fig. 12B A schematic diagram of a waveform of received signal strength changing over time corresponding to a sliding approach operation gesture made in the illustrated scenario;
[0073] Fig.14A A schematic diagram of another scenario applicable to the somatosensory operation method provided in the present application is exemplified;
[0074] Fig. 14B A schematic diagram of another scenario applicable to the somatosensory operation method provided in the present application is exemplified;
[0075] Fig.15 For example, Fig.14A , Fig. 14B A schematic diagram of a waveform of received signal strength changing over time corresponding to a slide away operation gesture made in the illustrated scenario;
[0076] Fig.16A A schematic diagram of another scenario applicable to the somatosensory operation method provided in the present application is exemplified;
[0077] Fig. 16B A schematic diagram of another scenario applicable to the somatosensory operation method provided in the present application is exemplified;
[0078] Fig.17 For example, Fig.16A , Fig. 16B A schematic diagram of a waveform of received signal strength changing over time corresponding to a click operation gesture made in the illustrated scenario;
[0079] Fig.18 A schematic diagram of another scenario applicable to the somatosensory operation method provided in the present application is exemplified;
[0080] Fig.19 For example, Fig.18 A schematic diagram of a waveform of received signal strength changing over time corresponding to a click operation gesture made in the illustrated scenario;
[0081] Fig. 20 A schematic diagram of another scenario applicable to the somatosensory operation method provided in the present application is exemplified;
[0082] Fig.21 For example, Fig. 20 A schematic diagram of a waveform of received signal strength changing over time corresponding to a sliding approach operation gesture made in the illustrated scenario;
[0083] Fig. 22 A schematic diagram of another scenario applicable to the somatosensory operation method provided in the present application is exemplified;
[0084] Fig.23 For example, Fig. 22 A schematic diagram of a waveform of received signal strength changing over time corresponding to a slide away operation gesture made in the illustrated scenario;
[0085] Fig.24 A schematic diagram of another scenario applicable to the somatosensory operation method provided in the present application is exemplified;
[0086] Fig.25 For example, Fig.24 A schematic diagram of a waveform of received signal strength changing over time corresponding to a click operation gesture made in the illustrated scenario;
[0087] Fig.26 The figure is a schematic diagram for exemplarily illustrating a method for implementing a somatosensory operation provided in an embodiment of the present application. DETAILED DESCRIPTION
[0088] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0089] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.
[0090] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.
[0091] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.
[0092] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.
[0093] At present, gesture operation has become one of the common operation methods of smart devices. For electronic devices with touch screens, touch operations can be performed by gestures such as clicking and sliding on the screen to achieve human-computer interaction.
[0094] However, for electronic devices with smaller screens, such as smart watches and smart bracelets, when using fingers for touch operations, the area of the screen blocked by the fingers occupies a larger area of the screen, resulting in the content displayed on the screen being blocked, affecting the user experience.
[0095] In addition, the operation of devices such as headphones / smart glasses currently requires precise touching of specific areas of the device, so the user experience is not good.
[0096] In addition, in some implementation scenarios, for example, when a user places an electronic device with a touch screen (mobile phone, tablet, etc.) on a desktop to read or watch a short video, it is necessary to frequently switch and turn pages. If a user slides directly on the screen with a finger, the screen may be dirty due to water stains, oil stains, etc. on the finger, thus affecting the user experience.
[0097] In order to improve the human-computer interaction experience, some possible implementations currently use optical devices such as laser sensors or cameras to capture and process gestures. However, optical devices are limited by the fact that light travels in a straight line, so the hand must be within the working range of the optical device. For example, when operating a mobile phone, the hand needs to be a certain distance away from the screen of the mobile phone to use the front camera to perform gesture operations.
[0098] In addition, gesture operation based on optical devices requires the hand to be suspended in the air, which is tiring. Moreover, gesture operation based on optical devices is usually achieved through a front camera, so this method is not applicable to electronic devices that do not have a front camera.
[0099] In addition, for gesture operations implemented based on optical devices, the camera needs to work all the time, so the power consumption of the device is relatively high.
[0100] For example, in some other possible implementations, there are also schemes that use electromagnetic wave signals for gesture operations. However, gesture operations based on electromagnetic wave signals require users to stick / wear special ultra-wideband (UWB) tags or devices on their hands. This not only has high implementation costs, but also poor user experience.
[0101] In view of this, the present application provides an operation method, which aims to realize simple gesture operations such as clicking and sliding based on human body communication technology without contacting the screen of the electronic device, thereby improving the human-computer interaction experience.
[0102] Specifically, Intra-Body Communication (IBC) is a non-RF wireless communication technology. Its biggest feature is that it uses the human body as a transmission medium for electrical signals to achieve data transmission and sharing between various electronic devices on the surface and inside of the human body. Compared with current short-range wireless communication technologies such as Bluetooth, ZigBee, etc., this technology has the advantages of low power consumption, anti-interference, and high speed.
[0103] At present, human body communication mainly includes two modes: current coupling type human body communication and capacitive coupling type human body communication.
[0104] Among them, the current-coupled human body communication mode simply uses the human body as a medium to achieve differential signal transmission. That is, the current-coupled human body communication signal transmitted in the current-coupled human body communication mode can only be transmitted in the human body and basically cannot be transmitted outside the body.
[0105] In addition, it should be noted that in the current-coupled human communication mode, the conductivity o of human skin, fat and muscle is much greater than the product of its operating angular frequency ω and dielectric constant e (σ>>e) relative to the air medium. Therefore, when the current-coupled human communication signal is transmitted in the body, it is not easily affected by electromagnetic interference from the surrounding environment, and its transmission loss is mainly related to the distance. Figure 1A The schematic diagram of in-body transmission distance and transmission loss shows that the current-coupled human body communication signal will lose about 6 to 9 dB every 5 cm during the human body transmission process. However, the wireless signals currently transmitted in free space, such as Bluetooth and ZigBee, have a small change in spatial loss caused by distance differences (which is difficult to be used as judgment input for gesture recognition). As shown in Table 1, the loss is about 3 dB every 5 cm.
[0106] Table 1 Transmission loss of wireless signals transmitted in free space
[0107] Frequency 2.4GHz Space transmission loss Transmitting and receiving distance: 10cm -20dB Transmitting and receiving distance: 15cm -23.6dB Transmitting and receiving distance: 20cm -26dB
[0108] Among them, the capacitive coupling human body communication mode determines the loop by capacitive coupling between the two electrodes at the transmitting end or the receiving end and the human body and the ground respectively. Compared with the current coupling human body communication mode, the ground electrode at the transmitting end of the capacitive coupling human body communication mode is not in direct contact with the human body, and the coupling loop between it and the signal electrode is relatively weak. Therefore, its signal attenuation is relatively small. That is, the capacitive coupling human body communication signal transmitted in the capacitive coupling human body communication mode has a small transmission loss in the human body, and only after it leaves the human body / electrode will the transmission loss be affected by the distance. Figure 1A As shown in the figure, during the transmission of capacitive coupling human body communication signals in the human body, the loss within 25cm does not exceed 5dB, that is, the loss within every 5cm is no more than 1dB. During the transmission of capacitive coupling human body communication signals outside the body, the loss per 5cm is about 20dB, as shown in the figure. Figure 1B shown.
[0109] From the above description of the transmission principle of the current-coupled human body communication signal, it can be known that the current-coupled human body communication signal can be transmitted inside the body / on the surface of the human body, such as Figure 1C As shown, the current-coupled human body communication signal emitted by device B will be transmitted on the left arm touched by the right hand finger of the person wearing device B, and then be received by device A worn on the left arm.
[0110] Based on this, the transmission principle of the current-coupled human body communication signal can be used to take the current-coupled human body communication signal as the judgment input of gesture recognition in the body / body surface somatosensory operation scenario.
[0111] It should be understood that in order to implement gesture operations based on human body communication, at least two electronic devices are required in the specific implementation. That is, one of them serves as the receiving end (controlled end) of the signal, and the other serves as the transmitting end (controlling end) of the signal. Therefore, in the human body surface somatosensory operation scenario, in some possible implementations, the two electronic devices may be located on different limbs of the user, such as the left hand, left arm, right hand, right arm, left leg, right leg, left ear, right ear, head, etc. Any two limbs.
[0112] Exemplarily, in some other possible implementations, the two electronic devices may be located on the same limb of the user, such as any of the limbs mentioned above.
[0113] For ease of explanation, the embodiment of the present application takes the use of two electronic devices to implement gesture operations based on human body communication as an example, and the scenario in which the two electronic devices are located on different limbs of the user is called scenario 1, and the scenario in which the two electronic devices are located on the same limb of the user is called scenario 2.
[0114] In addition, through the above description of the transmission principle of the capacitive coupling type human body communication signal, it can be known that the capacitive coupling type human body communication signal can be transmitted outside the body, such as Figure 1D As shown, the capacitive coupling human body communication signal emitted by device B will be transmitted on the desktop touched by the right hand finger of the person wearing device B, and then received by device D placed on the desktop.
[0115] Based on this, the transmission principle of capacitive coupling human body communication signals can be used to take the capacitive coupling human body communication signals as judgment input for gesture recognition in an external body sensing operation scenario.
[0116] For the external somatosensory operation scenario, for example, the electronic device as the controlled end is placed on the desktop plane, and the electronic device as the controlling end is located on the user, such as worn on the hand. For the sake of convenience, this embodiment of the application refers to this scenario as scenario 3.
[0117] In order to realize gesture recognition in the above-mentioned scenarios 1, 2 and 3 based on human body communication technology, and then perform human-computer interaction based on the recognized gestures, an embodiment of the present application provides a somatosensory operation device. The device can be integrated in electronic devices such as smart watches, smart bracelets, smart rings, mobile phones, tablet computers, smart TVs, personal computers, etc., which are not listed here and are not limited by the present application.
[0118] See also Figure 2 Exemplarily, the body sensing operation device may include a current / capacitive coupling type human body communication composite module, an electrode switching module, a first electrode, a second electrode and a third electrode.
[0119] It is understandable that since the electronic device as the signal transmitting end and the electronic device as the signal receiving end can both integrate the device. Therefore, for the electronic device as the signal transmitting end, the current / capacitive coupling human body communication composite module in the device is used to transmit a capacitive coupling human body communication signal of a specific frequency in the capacitive coupling human body communication mode, and to transmit a current coupling human body communication signal of a specific frequency in the current coupling human body communication mode. For the electronic device as the signal receiving end, the current / capacitive coupling human body communication composite module in the device is used to receive a capacitive coupling human body communication signal of a specific frequency in the capacitive coupling human body communication mode, and to receive a current coupling human body communication signal of a specific frequency in the current coupling human body communication mode.
[0120] Regarding the specific frequency mentioned above, for the capacitive coupling human body communication mode, a frequency with lower loss in the capacitive coupling human body communication mode is selected. Correspondingly, for the current coupling human body communication mode, a frequency with lower loss in the current coupling human body communication mode is selected.
[0121] The electrode switching module is used to connect the circuit between the first electrode and the second electrode, so that the somatosensory operation device works in the capacitive coupling human body communication mode. And, it is used to connect the circuit between the second electrode and the third electrode, so that the somatosensory operation device works in the current coupling human body communication mode.
[0122] The first electrode and the second electrode are used in a capacitive coupling human body communication mode, and the second electrode and the third electrode are used in a current coupling human body communication mode.
[0123] Continue to see Figure 2 Exemplarily, when the somatosensory operation device operates in the capacitive coupling human body communication mode, it is necessary for the OUT1 port of the current / capacitive coupling human body communication composite module to be connected to the P1 port of the electrode switching module, the P1 port of the electrode switching module to be connected to the P5 port of the electrode switching module, and the P5 port of the electrode switching module to be connected to the first electrode, and the OUT2 port of the current / capacitive coupling human body communication composite module to be connected to the P2 port of the electrode switching module, the P2 port of the electrode switching module to be connected to the P6 port of the electrode switching module, and the P6 port of the electrode switching module to be connected to the second electrode, thereby forming a coupling loop corresponding to the capacitive coupling human body communication mode.
[0124] Continue to see Figure 2Exemplarily, when the somatosensory operation device operates in the current-coupled human body communication mode, it is necessary for the OUT3 port of the current / capacitive coupling human body communication composite module to be connected to the P3 port of the electrode switching module, the P3 port of the electrode switching module to be connected to the P6 port of the electrode switching module, and the P6 port of the electrode switching module to be connected to the second electrode, and the OUT4 port of the current / capacitive coupling human body communication composite module to be connected to the P4 port of the electrode switching module, the P4 port of the electrode switching module to be connected to the P7 port of the electrode switching module, and the P7 port of the electrode switching module to be connected to the third electrode, thereby forming a coupling loop corresponding to the current-coupled human body communication mode.
[0125] Continue to see Figure 2 For example, in order to distinguish the current-type signal electrodes, the current-type signal electrode corresponding to the OUT3 port, that is, the second electrode, can be represented as the current-type signal electrode 1. Accordingly, the current-type signal electrode corresponding to the OUT4 port, that is, the third electrode, can be represented as the current-type signal electrode 2.
[0126] Since the above-mentioned current / capacitive coupling human body communication composite module can work in both capacitive coupling human body communication mode and current coupling human body communication mode, when the current / capacitive coupling human body communication composite module works in the capacitive coupling human body communication mode and the current coupling human body communication mode, it can be divided into a transmitting end for transmitting signals and a receiving end for receiving signals.
[0127] Therefore, in a possible implementation, the internal structure of the current / capacitive coupling type human body communication composite module can be as follows: Figure 3A and Figure 3B shown.
[0128] See also Figure 3A , exemplarily showing the internal structure of a current / capacitive coupling type human body communication composite module of a somatosensory operation device integrated in an electronic device for transmitting human body communication signals.
[0129] like Figure 3A As shown, the current / capacitive coupling type human body communication composite module may include a human body communication module, a circuit switching switch, a voltage driving amplifier, and a current driving amplifier.
[0130] Among them, for the transmitting end, the human body communication module can be used to transmit signals.
[0131] The circuit switching switch may be a single-pole multi-throw switch. Figure 3A As shown, the circuit switching switch is a single-pole double-throw switch. The circuit switching switch is connected to the human body communication module, the voltage drive amplifier and the current drive amplifier respectively.
[0132] The voltage-driven amplifier is used to amplify the signal transmitted by the human body communication module to a specific frequency corresponding to the capacitive coupling human body communication mode, thereby obtaining a capacitive coupling human body communication signal.
[0133] Among them, the current driving amplifier is used to amplify the signal transmitted by the human body communication module to a specific frequency corresponding to the current-coupled human body communication mode, and then obtain a current-coupled human body communication signal.
[0134] based on Figure 3A The structure of the circuit / capacitive coupling human body communication composite module shown is that when the electronic device serving as the transmitting end operates in the current coupling human body communication mode, the moving end (end a) in the circuit switching switch will be connected to the fixed end (end d), thereby realizing the conduction of the line between the human body communication module and the current driving amplifier, so that the signal transmitted by the human body communication module can be amplified by the current driving amplifier to the specific frequency corresponding to the current coupling human body communication mode, that is, the current coupling human body communication signal that needs to be transmitted is obtained.
[0135] Continue to see Figure 3A For example, when the electronic device as the transmitting end works in the current coupling human body communication mode, the I1 port of the current driving amplifier will be connected to the OUT3 port, and the I2 port of the current driving amplifier will be connected to the OUT4 port. Thus, the current coupling human body communication signal will be output to the second electrode through the OUT3 port, the P3 port, and the P6 port, and output to the third electrode through the OUT4 port, the P4 port, and the P7 port, and finally transmitted through the antenna in the electronic device, thereby realizing the transmission of the current coupling human body communication signal.
[0136] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0137] Continue to see Figure 3A For example, when the electronic device serving as the transmitting end operates in the capacitive coupling human body communication mode, the moving end (end a) in the circuit switching switch will be connected to the fixed end (end b), thereby realizing the conduction of the line between the human body communication module and the voltage-driven amplifier, so that the signal transmitted by the human body communication module can be amplified by the voltage-driven amplifier to the specific frequency corresponding to the capacitive coupling human body communication mode, thereby obtaining the capacitive coupling human body communication signal that needs to be transmitted.
[0138] Continue to see Figure 3AFor example, when the electronic device as the transmitting end works in the capacitive coupling human body communication mode, the V1 port of the voltage-driven amplifier will be connected to the OUT1 port, and the V2 port of the voltage-driven amplifier will be connected to the OUT2 port. Thus, the capacitive coupling human body communication signal will be output to the first electrode through the OUT1 port, the P1 port, and the P5 port, and output to the second electrode through the OUT2 port, the P2 port, and the P6 port, and finally transmitted through the antenna in the electronic device, thereby realizing the transmission of the capacitive coupling human body communication signal.
[0139] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0140] See also Figure 3B , exemplarily showing the internal structure of a current / capacitive coupling type human body communication composite module of a somatosensory operation device integrated in an electronic device for receiving human body communication signals.
[0141] like Figure 3B As shown, the current / capacitive coupling type human body communication composite module may include a human body communication module and a receiving circuit.
[0142] Among them, for the receiving end, the human body communication module can be used to receive signals.
[0143] Among them, the receiving circuit is used to receive the capacitive coupling human body communication signal, and transmit the received capacitive coupling human body communication signal to the human body communication module through the circuit switching switch for recognition and processing, so as to determine the current gesture.
[0144] Among them, the receiving circuit is also used to receive the current-coupled human body communication signal, and transmit the received current-coupled human body communication signal to the human body communication module through the circuit switching switch for identification and processing, so as to determine the current gesture.
[0145] based on Figure 3B The structure of the circuit / capacitive coupling human body communication composite module shown in the figure, when the electronic device as the receiving end works in the current coupling human body communication mode, the human body communication module is directly connected to the receiving circuit to achieve the conduction of the line between the human body communication module and the receiving circuit. The R1 port of the receiving circuit will be connected to the OUT3 port, and the R2 port of the receiving circuit will be connected to the OUT4 port. In this way, the current coupling human body communication signal transmitted by the transmitting end can be received.
[0146] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0147] Continue to see Figure 3B,,Exemplarily, when the electronic device as the receiving end works in the capacitive coupling human body communication mode, the human body communication module is directly connected to the receiving circuit to achieve the conduction of the line between the human body communication module and the receiving circuit. The R1 port of the receiving circuit will be connected to the OUT1 port, and the R2 port of the receiving circuit will be connected to the OUT2 port. In this way, the capacitive coupling human body communication signal transmitted by the transmitting end can be received.
[0148] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0149] In addition, in another possible implementation, the internal structure of the current / capacitive coupling type human body communication composite module can be as follows: Figure 4 shown.
[0150] See also Figure 4 Exemplarily, the current / capacitive coupling human body communication composite module may include a human body communication module, a circuit switching switch, a voltage driving amplifier, a receiving circuit, and a current driving amplifier.
[0151] Wherein, for the transmitting end, the human body communication module can be used to transmit signals. For the receiving end, the human body communication module can be used to receive signals.
[0152] The circuit switching switch may be a single-pole multi-throw switch. Figure 4 As shown, the circuit switching switch is a single-pole triple-throw switch, wherein the circuit switching switch is respectively connected to the human body communication module, the voltage drive amplifier, the receiving circuit and the current drive amplifier.
[0153] The voltage-driven amplifier is used to amplify the signal transmitted by the human body communication module to a specific frequency corresponding to the capacitive coupling human body communication mode, thereby obtaining a capacitive coupling human body communication signal.
[0154] Among them, the receiving circuit is used to receive the capacitive coupling human body communication signal, and transmit the received capacitive coupling human body communication signal to the human body communication module through the circuit switching switch for recognition and processing, so as to determine the current gesture.
[0155] Among them, the receiving circuit is also used to receive the current-coupled human body communication signal, and transmit the received current-coupled human body communication signal to the human body communication module through the circuit switching switch for identification and processing, so as to determine the current gesture.
[0156] Among them, the current driving amplifier is used to amplify the signal transmitted by the human body communication module to a specific frequency corresponding to the current-coupled human body communication mode, and then obtain a current-coupled human body communication signal.
[0157] To better illustrate Figure 4 When the current / capacitive coupling human body communication composite module works in the current coupling human body communication mode, the internal current coupling human body communication circuit is formed; and when the current / capacitive coupling human body communication mode is worked, the internal capacitive coupling human body communication circuit is formed. Figure 5A , Figure 5B , Figure 5C and Figure 5D Provide specific instructions.
[0158] See also Figure 5A , exemplarily showing a current-coupled human body communication circuit in an electronic device acting at a transmitting end.
[0159] See also Figure 5A For example, when the electronic device serving as the transmitting end operates in the current-coupled human body communication mode, the moving end (end a) in the circuit switching switch will be connected to the fixed end (end d), thereby realizing the conduction of the line between the human body communication module and the current-driven amplifier, so that the signal transmitted by the human body communication module can be amplified by the current-driven amplifier to the specific frequency corresponding to the current-coupled human body communication mode, thereby obtaining the current-coupled human body communication signal that needs to be transmitted.
[0160] Continue to see Figure 5A For example, when the electronic device as the transmitting end works in the current coupling human body communication mode, the I1 port of the current driving amplifier will be connected to the OUT3 port, and the I2 port of the current driving amplifier will be connected to the OUT4 port. Thus, the current coupling human body communication signal will be output to the second electrode through the OUT3 port, the P3 port, and the P6 port, and output to the third electrode through the OUT4 port, the P4 port, and the P7 port, and finally transmitted through the antenna in the electronic device, thereby realizing the transmission of the current coupling human body communication signal.
[0161] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0162] See also Figure 5B , exemplarily showing a current-coupled human body communication circuit in an electronic device acting on a receiving end.
[0163] See also Figure 5BFor example, when the electronic device as the receiving end works in the current coupling human body communication mode, the moving end (end a) in the circuit switching switch will be connected to the fixed end (end c) to achieve the conduction of the line between the human body communication module and the receiving circuit. The R1 port of the receiving circuit will be connected to the OUT3 port, and the R2 port of the receiving circuit will be connected to the OUT4 port. In this way, the current coupling human body communication signal transmitted by the transmitting end can be received.
[0164] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0165] See also Figure 5C , exemplarily showing a capacitive coupling human body communication circuit in an electronic device acting at the transmitting end.
[0166] See also Figure 5C For example, when the electronic device serving as the transmitting end operates in the capacitive coupling human body communication mode, the moving end (end a) in the circuit switching switch will be connected to the fixed end (end b), thereby realizing the conduction of the line between the human body communication module and the voltage-driven amplifier, so that the signal transmitted by the human body communication module can be amplified by the voltage-driven amplifier to the specific frequency corresponding to the capacitive coupling human body communication mode, thereby obtaining the capacitive coupling human body communication signal that needs to be transmitted.
[0167] Continue to see Figure 5C For example, when the electronic device as the transmitting end works in the capacitive coupling human body communication mode, the V1 port of the voltage-driven amplifier will be connected to the OUT1 port, and the V2 port of the voltage-driven amplifier will be connected to the OUT2 port. Thus, the capacitive coupling human body communication signal will be output to the first electrode through the OUT1 port, the P1 port, and the P5 port, and output to the second electrode through the OUT2 port, the P2 port, and the P6 port, and finally transmitted through the antenna in the electronic device, thereby realizing the transmission of the capacitive coupling human body communication signal.
[0168] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0169] See also Figure 5D , exemplarily showing a capacitive coupling human body communication circuit in an electronic device acting at the receiving end.
[0170] See also Figure 5DFor example, when the electronic device as the receiving end works in the capacitive coupling human body communication mode, the moving end (end a) in the circuit switching switch will be connected to the fixed end (end c), so as to realize the conduction of the line between the human body communication module and the receiving circuit. The R1 port of the receiving circuit will be connected to the OUT1 port, and the R2 port of the receiving circuit will be connected to the OUT2 port. In this way, the capacitive coupling human body communication signal transmitted by the transmitting end can be received.
[0171] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0172] For example, in some possible implementations, for an electronic device that only needs to work in a capacitive coupling human body communication mode, the body sensing operation device may only include the first electrode and the second electrode, but not the third electrode. Figure 3A ,or Figure 4 The current driver amplifier is shown.
[0173] For example, in some other possible implementations, for an electronic device that only needs to work in a capacitive coupling human body communication mode and the electronic device only needs to serve as a transmitter, the body sensing operation device may only include the first electrode and the second electrode, but not the third electrode. Figure 4 The current driving amplifier and receiving circuit shown, or Figure 3A The current driver amplifier in the
[0174] For example, in some other possible implementations, for an electronic device that only needs to work in a capacitive coupling human body communication mode and the electronic device only needs to serve as a receiving end, the body sensing operation device may only include the first electrode and the second electrode, but not the third electrode. Figure 4 The current drive amplifier and the voltage drive amplifier shown, that is, the current / capacitive coupling type human body communication composite module is Figure 3B The structure shown.
[0175] In addition, it should be noted that for such electronic devices that only need to work in capacitive coupling human body communication mode, the electrode switching module may not be provided in the somatosensory operation device, that is, the first electrode is directly connected to the OUT1 port, and the second electrode is directly connected to the OUT2 port.
[0176] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0177] For example, in some possible implementations, for an electronic device that only needs to work in a current-coupled human body communication mode, the body sensing operation device may only include the second electrode and the third electrode, but not the first electrode. Figure 3A ,or Figure 4 The voltage driver amplifier is shown.
[0178] For example, in some other possible implementations, for an electronic device that only needs to work in a current-coupled human body communication mode and the electronic device only needs to serve as a transmitter, the body sensing operation device may only include the second electrode and the third electrode, but not the first electrode. Figure 4 The voltage driver amplifier and receiving circuit shown, or Figure 3A The voltage driver amplifier in the.
[0179] For example, in some other possible implementations, for an electronic device that only needs to work in a current-coupled human body communication mode and the electronic device only needs to serve as a receiving end, the body sensing operation device may only include the second electrode and the third electrode, but not the first electrode. Figure 4 The current drive amplifier and the voltage drive amplifier shown, that is, the current / capacitive coupling type human body communication composite module is Figure 3B The structure shown.
[0180] In addition, it should be noted that for such electronic devices that only need to work in the current-coupled human body communication mode, the electrode switching module may not be provided in the somatosensory operation device, that is, the second electrode is directly connected to the OUT3 port, and the third electrode is directly connected to the OUT4 port.
[0181] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0182] In order to better understand the technical solution provided by the embodiment of the present application, before describing the technical solution of the embodiment of the present application, firstly, in conjunction with the accompanying drawings, an electronic device applicable to the embodiment of the present application is described, for example, an integrated Figure 2 and Figure 4 The hardware structure of the electronic device of the somatosensory operation device shown will be described.
[0183] See also Figure 6, exemplarily showing a hardware structure of an electronic device 100. The electronic device 100 may be, for example, a mobile phone, a tablet computer, a smart TV, a smart watch, etc., which are not listed one by one here, and the present application does not limit this.
[0184] like Figure 6 As shown, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0185] Among them, the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor (Modem), a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural-network processing unit (neural-network processing unit, NPU), etc., which are not listed one by one here and the present application does not limit this.
[0186] It is understandable that, with respect to the processor 110 including the above-mentioned processing units, in some implementations, different processing units may be independent devices. That is, each processing unit may be regarded as a processor. In other implementations, different processing units may also be integrated into one or more processors. For example, in some implementations, the modem processor may be an independent device. In other implementations, the modem processor may be independent of the processor 110 and be arranged in the same device as the mobile communication module 150 or other functional modules.
[0187] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0188] The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 .
[0189] Among them, the internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, and the somatosensory operation function mentioned in the embodiment of the present application, etc.). The data storage area can store data created during the use of the electronic device 100, such as the parameter information configured when the somatosensory operation function is turned on, as follows Fig. 10C (2) parameter information configured in window 10c-6. For example, the change curve / relationship between the received signal strength and time corresponding to different gestures in the current coupling human body communication mode and the capacitive coupling human body communication mode. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0190] The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.
[0191] Continue to see Figure 6 The wireless communication function of the electronic device 100 can be realized through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0192] It should be noted that antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other implementations, the antenna can be used in combination with a tuning switch.
[0193] Continue to see Figure 6The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The wireless communication module 160 can provide solutions for wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), and the embodiments of the present application based on Figure 2 and Figure 4 The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify the signal, and convert it into electromagnetic waves for radiation through the antenna 2.
[0194] Specifically in this embodiment, the somatosensory operation can be realized directly through Figure 2 and Figure 4 The somatosensory operation device of the structure shown is implemented in cooperation with the antenna 2 .
[0195] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0196] The audio module 170 may include a speaker 170A, a receiver 170B, a microphone 170C, an earphone jack 170D, etc., which are not listed here one by one and are not limited in this application.
[0197] Among them, the sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc., which are not listed here one by one and the present application does not impose any limitation on this.
[0198] Among them, the button 190 may include a power button, a volume button, etc. The motor 191 may generate a vibration prompt. The motor 191 may be used for an incoming call vibration prompt, or for touch vibration feedback. The indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, message, missed call, notification, etc.
[0199] The camera 193 is used to capture static images or videos. In some implementations, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0200] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some implementations, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
[0201] The hardware structure of the electronic device 100 is introduced here. It should be understood that: Figure 6 The electronic device 100 shown is only an example. In a specific implementation, the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have a different component configuration. Figure 6 The various components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.
[0202] See also Figure 7 , exemplarily showing a hardware structure of an electronic device 200. The electronic device 200 may be, for example, a smart ring without hardware structures such as a display screen and a camera, that is, a wearable device for monitoring the user's behavior and living habits.
[0203] like Figure 7 As shown, the electronic device 200 may include: a processor 210, a body sensing operation device 220, a memory 230, an antenna 240, and the like.
[0204] The processor 210 may be the nerve center and command center of the electronic device 200. The processor 210 may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions. A memory may also be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory.
[0205] Among them, the memory 230 can be used to store computer executable program code, and the executable program code includes instructions. The memory 230 can be a volatile memory or a persistent memory. The computer executable program code stored in the memory 230 may include one or more modules, each of which may include a series of instruction operations in the somatosensory operation device. The memory 230 may include a program storage area and a data storage area.
[0206] Furthermore, the processor 210 may be configured to communicate with the memory 230 to execute a series of instruction operations in the memory 230 on the electronic device 200. The processor 210 executes various functions and data processing of the electronic device 200 by running computer program instructions stored in the memory 230.
[0207] Among them, the somatosensory operation device 220 is used to enable the electronic device 200 to establish a somatosensory operation connection with the electronic device 100, and then work in a current-coupled human body communication mode or a capacitive-coupled human body communication mode to realize the transmission and reception of current-coupled human body communication signals, or the transmission and reception of capacitive-coupled human body communication signals.
[0208] The antenna 240 is used to transmit the capacitive coupling human body communication signal or the current coupling human body communication signal transmitted by the somatosensory operation device 220 , and to receive the capacitive coupling human body communication signal or the current coupling human body communication signal transmitted by the electronic device 100 .
[0209] The hardware structure of the electronic device 200 is introduced here. It should be understood that: Figure 7 The electronic device 200 shown is only an example. In a specific implementation, the electronic device 200 may have more or fewer components than those shown in the figure, may combine two or more components, or may have a different component configuration. Figure 7 The various components shown in the drawings may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.
[0210] In addition, it should be noted that the somatosensory operation method provided in the embodiment of the present application, whether it is an electronic device as a transmitter or an electronic device as a receiver, must integrate the somatosensory operation device mentioned in the above embodiment. Figure 8 The software structure of the electronic device integrated with the somatosensory operation device is specifically described.
[0211] Before describing the software structure of the electronic device, the architecture that can be adopted by the software system of the electronic device is described first.
[0212] Specifically, in practical applications, the software system of the electronic device may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
[0213] In addition, it is understandable that the software systems currently used by mainstream electronic devices include but are not limited to Windows systems, Android systems, and iOS systems. For ease of explanation, the present application embodiment takes the layered Android system as an example to exemplify the software structure of the electronic device.
[0214] In addition, it should be understood that the subsequent somatosensory operation solutions provided in the embodiments of the present application are also applicable to other systems in specific implementations.
[0215] See also Figure 8 , which is a software structure block diagram of the electronic device according to an embodiment of the present application.
[0216] like Figure 8 As shown in FIG. 1 , the layered architecture of the electronic device divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some implementations, the Android system is divided into five layers, from top to bottom, namely, the application layer / application layer (Applications) belonging to the application part, the framework layer / application framework layer (Application Framework, FWK) belonging to the core part, the runtime (Runtime) and the system library, and the hardware abstraction layer (HAL) and the Linux kernel (Linux Kernel) layer belonging to the bottom layer.
[0217] The application layer can include a series of application packages. Figure 8 As shown, the application package may include camera, game, somatosensory operation, setting and other applications, which are not listed here one by one and are not limited in this application.
[0218] Among them, the somatosensory operation application can be a specially provided application for turning on the somatosensory operation function, searching for electronic devices with the somatosensory operation function turned on around, establishing a somatosensory operation connection with the searched electronic devices, and configuring parameter information.
[0219] Specifically in practical applications, the above functions implemented by the somatosensory operation application can also be integrated into the setting application.
[0220] For operations based on the entrances provided by the somatosensory operation application or the setting application, see FIG. 10A to FIG. 10E , I will not go into details this time.
[0221] The framework layer can provide application programming interfaces (APIs) and programming frameworks for applications in the application layer. In some implementations, these programming interfaces and programming frameworks can be described as functions. Figure 8 As shown, the framework layer may include functions such as content provider, window manager, view system, resource manager, etc., which are not listed here one by one and are not limited in this application.
[0222] It should be noted that the window manager located in the framework layer is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0223] In addition, it should be noted that the content provider located in the framework layer is used to store and obtain data and make the data accessible to the application. The data may include video, images, audio, dialed and received calls, browsing history and bookmarks, phone book, etc., which are not listed here one by one and are not limited by this application.
[0224] In addition, it should be noted that the view system located in the framework layer includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying pictures.
[0225] In addition, it should be noted that the resource manager located in the framework layer is used to provide various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc., which are not listed here one by one and this application does not impose any restrictions on this.
[0226] Continue to see Figure 8 , exemplarily, the runtime, specifically the Android runtime (Android Runtime) may include a core library and a virtual machine, which is mainly responsible for the scheduling and management of the Android system.
[0227] The core library consists of two parts: one is the function that the Java language needs to call, and the other is the Android core library. The application layer and the framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0228] Continue to see Figure 8Exemplarily, the system library may include multiple functional modules, such as a surface manager, a media library, a three-dimensional (3D) graphics processing library (such as OpenGL ES), a two-dimensional (2D) graphics engine (such as SGL), etc.
[0229] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The media library supports multiple commonly used audio and video format playback and recording, as well as static image files. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PnG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing.
[0230] In addition, it can be understood that the 2D graphics engine mentioned above is a drawing engine for 2D drawing.
[0231] Continue to see Figure 8 For example, the HAL layer is an interface layer between the operating system kernel (kernel layer) and the hardware circuit. Its purpose is to isolate the FWK from the kernel so that Android does not rely too much on the kernel, so that the development of FWK can be carried out without considering the driver.
[0232] Continue to see Figure 8 For example, the HAL layer may include various interfaces, such as audio and video interface, GPS interface, call interface, WiFi interface, etc., which are not listed here one by one and are not limited in this application.
[0233] Continue to see Figure 8 , exemplary, the kernel layer in the Android system is a layer between hardware and software. The kernel layer may include various processes / threads, power management, various drivers, such as WiFi drivers, etc.
[0234] This is the end of the introduction to the software structure of electronic devices. It can be understood that: Figure 8 The layers in the software structure shown and the components contained in each layer do not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer layers than shown in the figure, and each layer may include more or fewer components, which is not limited by the present application.
[0235] Based on the above hardware and software structures, the following Fig. 9 , FIG. 10A to FIG. 10E ,as well as Fig.11 , the configuration of the prerequisites for implementing the somatosensory operation solution provided in the embodiment of the present application is explained.
[0236] See also Fig. 9 For example, device A (such as a smart watch), device B (such as a smart ring), device C (such as wearable smart glasses) and device D (mobile phone) are in the same space and can search for each other when the somatosensory function is turned on.
[0237] Based on the above prerequisites, taking the entry of the configuration information of the somatosensory operation function provided in the setting application as an example, when the user uses device D to configure the somatosensory operation function, in a possible implementation method, the user can first click Fig. 10A 1 and 2. The icon 10a-1 corresponding to the setting application in the interface 10a shown in (1) is shown.
[0238] Accordingly, in response to the operation, device D starts the settings application. Fig. 10A The interface 10a shown in (1) will switch to Fig. 10A Interface 10b shown in (2).
[0239] See also Fig. 10A In (2), for example, specifically in the technical solution provided in this embodiment, the interface 10b needs to include a setting entry corresponding to the somatosensory operation function.
[0240] For example, in a possible implementation, the user can click on the area where the setting entry corresponding to the somatosensory operation function is located in the interface 10b, such as Fig. 10A The area 10b-1 shown in (2) is shown in FIG. Accordingly, in response to the operation behavior, the device D will change from Fig. 10A The interface 10b shown in (2) jumps to Fig. 10B Interface 10c shown in (1).
[0241] See also Fig. 10B In (1), the interface 10c may include one or more controls, for example, a control 10c-1 for returning to the interface 10c, and a control for turning on or off the somatosensory operation function.
[0242] For example, in this embodiment, the control corresponding to the somatosensory operation function is in Fig. 10B When the style of the control 10c-2 shown in (1) is shown, it means that the somatosensory operation function is not turned on. Fig. 10B When the style of the control 10c-2' shown in (2) is displayed, it indicates that the somatosensory operation function is turned on.
[0243] Based on this, the controls corresponding to the somatosensory operation function are in Fig. 10BWhen the style of the control 10c-2 is shown in (1), when the user clicks on the control 10c-2, the device D will respond to the operation by turning on the somatosensory operation function and automatically search for nearby electronic devices that have turned on the somatosensory operation function. At the same time, the control 10c-2 will switch to the control 10c-2'.
[0244] For example, in order to improve the user experience, the user is informed that a search is currently underway for nearby electronic devices that have enabled the somatosensory operation function. In a feasible implementation, the following may be displayed in the interface 10c: Fig. 10B Control 10c-3 shown in (2).
[0245] For example, in a possible implementation, after the device D turns on the somatosensory operation function, it can automatically search for Fig. 9 Device A, device B, and device C all have the motion sensing function enabled.
[0246] For example, in a possible implementation, after searching for nearby electronic devices that have activated the somatosensory operation function, the interface 10c may display the following: Fig. 10C (1) shows a list of devices.
[0247] See also Fig. 10C In (1), illustratively, the device list may display the device name of each device searched, such as device A, device B, and device C shown in the figure.
[0248] Continue to see Fig. 10C In (1), illustratively, the interface 10c may also include a control 10c-5 for allowing the user to manually add other somatosensory devices.
[0249] Exemplarily, in a possible implementation, if device D does not search for other nearby electronic devices that have activated the somatosensory operation function, or the searched electronic device is not the electronic device expected by the user, the user may click control 10c-5.
[0250] Exemplarily, in a possible implementation, in response to the operation behavior, device D may Fig. 10C The interface 10c shown in (1) jumps to Fig. 10C Interface 10d shown in (2).
[0251] See also Fig. 10C In (2), the interface 10d may include one or more functional controls. For example, Fig. 10C The control 10d-1 of the interface 10c shown in (1) is used to trigger the manual addition of the desired electronic device, and the control 10d-3 is used to trigger the addition by scanning a code, etc.
[0252] For example, in a possible implementation, the user clicks on the control 10d-2, and in response to the operation, the device D may pop up a window or interface for the user to manually input device information of the device to be added, such as IMEI, MEID, etc., so that the user can manually add the desired electronic device. The present application does not limit the style of the window or interface.
[0253] For example, in another possible implementation, the user clicks on the control 10d-3, and the device D responds to the operation behavior, and can jump from the interface 10d to the code scanning interface, and call the rear camera of the device D. In this way, by scanning the QR code information or barcode information provided on the electronic device to be added, the electronic device can be added. The present application does not limit the style of the code scanning interface.
[0254] In addition, it should be noted that when Fig. 10C The interface 10c shown in (1) jumps to Fig. 10C When the interface 10d shown in (2) is displayed, the device D will automatically trigger an automatic scan to scan for available somatosensory devices nearby.
[0255] Continue to see Fig. 10C In (1), illustratively, if the user desires to establish a somatosensory operation connection with the searched device A, in a possible implementation, the user may click on area 10c-4 of the row where device A is located in the device list.
[0256] Exemplarily, in response to the operation behavior, device D may pop up a pop-up message on interface 10c in a possible implementation manner. Fig. 10D Window 10c-6 shown in (1).
[0257] See also Fig. 10D In (1), illustratively, the window 10c-6 may include one or more functional options, such as controls 10c-61 and 10c-62 for the user to select an input method, controls 10c-63 and 10c-64 for the user to select a device identity, controls 10c-65 and 10c-66 for the user to select a processing method, and controls 10c-67 for returning (closing the window 10c-6) and controls 10c-68 for initiating a somatosensory operation connection request to device A.
[0258] Continue to see Fig. 10DIn (1), illustratively, the input mode corresponding to the control 10c-61 is the body surface input mode, that is, the current coupling type human body communication signal input mode applicable to scenes 1 and 2 in the above-mentioned embodiments. The input mode corresponding to the control 10c-62 is the external body input mode, that is, the capacitive coupling type human body communication signal input mode applicable to scene 3 in the above-mentioned embodiments.
[0259] Specifically in this embodiment, the input mode defaults to the body surface input mode, that is, the control 10c-61 is in the selected state ( Fig. 10D (1)), the control 10c-62 is in the unselected state ( Fig. 10D (shown in (1)).
[0260] In addition, it should be noted that when the input mode corresponding to device A is configured as a body surface input mode or an external body input mode, in order to enable device D and device A to implement the somatosensory operation method provided in this application, the input mode corresponding to device D will be automatically configured as the input mode corresponding to device A.
[0261] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0262] Continue to see Fig. 10D In (1), illustratively, the identity corresponding to the control 10c-63 is the controlled end mentioned in the above embodiment, and the identity corresponding to the control 10c-64 is the controlling end mentioned in the above embodiment.
[0263] It is understandable that the controlled end in this embodiment is an electronic device for responding to gestures recognized based on human body communication technology. The control end is an electronic device that transmits the current coupling human body communication signal or the capacitive coupling human body communication signal in the above embodiment.
[0264] Specifically in this embodiment, the identity set for device A is the control end by default, that is, the control 10c-64 is in an unselected state ( Fig. 10D (1)), control 10c-65 is in the selected state ( Fig. 10D (shown in (1)).
[0265] In addition, it should be noted that when the identity corresponding to device A is configured as a control terminal, in order to enable device D and device A to implement the somatosensory operation method provided by the present application, the identity corresponding to device D will be automatically configured as a controlled terminal.
[0266] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0267] Continue to see Fig. 10D In (1), for example, the processing mode corresponding to the control 10c-65 is processed by the control end by default, that is, the control 10c-65 is in the selected state ( Fig. 10D (1)), the control 10c-66 is in the unselected state ( Fig. 10D (shown in (1)).
[0268] It should be noted that the processing method of the controlled end in this embodiment refers to that the signal transmitting end (control end) is only used to transmit a current-coupled human body communication signal or a capacitive-coupled human body communication signal of a specific frequency. After the controlled end (receiving end) receives the current-coupled human body communication signal or the capacitive-coupled human body communication signal transmitted by the transmitting end, it processes the signal to determine the received signal strength and time relationship corresponding to the signal, and then according to the set gestures, such as the received signal strength and time relationship corresponding to the gestures such as sliding, clicking, etc., the current gesture can be accurately determined.
[0269] In addition, the control end processes this processing method, which means that the signal transmitting end (control end) not only needs to transmit a current-coupled human body communication signal or a capacitive-coupled human body communication signal of a specific frequency, but also needs to match the current gesture from the received signal strength and time relationship corresponding to the transmitted signal from the set gestures, such as sliding, clicking, etc., and then transmit signal instructions corresponding to different gestures to the controlled end, so that the controlled end can respond to the current gesture.
[0270] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0271] Continue to see Fig. 10D In (1), for example, when the user follows Fig. 10D After completing the setting of the somatosensory operation of device A according to the parameter information configured in window 10c-6 shown in (1), control 10c-68 is clicked. In response to the operation, device D closes window 10c-6 and generates a somatosensory operation connection request according to the parameter information configured in window 10c-6, and waits for the response of device A to establish the somatosensory operation connection between the two.
[0272] Exemplarily, after device A responds and completes the somatosensory operation connection with device D, the window 10c-68 will be closed, and a connected mark will be displayed in the area 10c-4 corresponding to device A in the device list in the interface 10c, such as Fig. 10D As shown in (2).
[0273] See also Fig. 10D In (2), for example, when the connected mark is displayed in the area 10c-4 corresponding to the device A in the device list in the interface 10c, if the user clicks the area 10c-4 again, the device D responds to the operation behavior, and in a possible implementation, the following may be displayed: Fig. 10E Window 10c-7 is shown.
[0274] See also Fig. 10E , exemplarily, window 10c-7 displays configuration information of device A and controls for modifying the configuration information. Among them, the functions corresponding to controls 10c-71 to 10c-76 are the same as those of controls 10c-61 to 10c-66, and will not be repeated here.
[0275] In addition, the control 10c-77 in the window 10c-7 is used to cancel the current modification, and the control 10c-8 is used to save the current modification.
[0276] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0277] Thus, through Figures 10A to 10E The processing method realizes the establishment of the somatosensory operation connection between device D and device A, such as Fig.11 As shown. In this way, the user can use device A to perform somatosensory operations on device D. Regarding the control of the user using device A to perform somatosensory operations on device D, please refer to the description of scenario 3 in the following embodiment, which will not be repeated here.
[0278] In addition, it should be noted that in some possible implementations, for example, for electronic devices that do not have a display screen, or cannot install the somatosensory operation application or setting application mentioned in the above embodiments, the somatosensory function of such devices can be configured through a third-party electronic device. For example, a user can use device D to configure the configuration information of the somatosensory function for device A, device B, device C, etc. respectively. For such devices that are configured with the configuration information of the somatosensory function by device D, in some possible implementations, the somatosensory operation function can be enabled by colliding with each other in a designated area. Accordingly, after the somatosensory operation function is turned on, such electronic devices will operate according to the configuration information configured by device D.
[0279] In addition, in some other possible implementations, the electronic device that first initiates the touch or somatosensory operation connection request can be set by default as the controlled end, the processing method is processed by the controlled end, and the body surface input method is adopted by default.
[0280] In addition, in some other possible implementations, two electronic devices configured to use the body surface input mode can automatically switch to the external input mode for detection according to a set period or when the input and output of the current coupling type human body communication signal are not detected within a set time. Correspondingly, according to a set period or when the input and output of the capacitive coupling type human body communication signal are not detected within a set time, the body surface input mode is automatically switched to for detection.
[0281] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0282] In combination with the accompanying drawings, the following takes two electronic devices that integrate the somatosensory operation device provided by the above embodiment, turn on the somatosensory operation function, and complete relevant configurations such as input method, identity, processing method, etc. as an example to specifically describe the scenarios 1, 2, and 3 mentioned in the above implementation.
[0283] Before describing scenes 1, 2, and 3, the operation gestures that can realize the somatosensory operation in scenes 1, 2, and 3 are first described.
[0284] Specifically, for scenario 1, since the two electronic devices are located on different limbs of the user, the received signal strength will change during the sliding operation (sliding away, sliding closer) and clicking operation. Therefore, the operation gestures that can realize the somatosensory operation in scenario 1 may include the sliding away operation gesture, the sliding closer operation gesture, and the clicking operation gesture.
[0285] Specifically, for scenario 2, since the two electronic devices are located on the same limb of the user, sliding a limb that is not wearing an integrated somatosensory operating device and has not turned on the somatosensory operating function on the limb wearing two electronic devices will not affect the received signal strength. Only when the user clicks and touches the ground electrode of the controlled end on the limb, such as the first electrode mentioned above, will the received signal strength change. Therefore, the operating gestures that can realize somatosensory operation in scenario 2 may include click operating gestures.
[0286] Specifically, for scenario 3, since one electronic device is placed on the desktop and the other electronic device is configured on the user, when the user uses the limb wearing one of the electronic devices to slide on the desktop where the other electronic device is placed, and clicks, the received signal strength will change. Therefore, the operation gestures that can realize the somatosensory operation in scenario 3 may include the operation gesture of sliding away, the operation gesture of sliding close, and the operation gesture of clicking.
[0287] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0288] Based on the operation gestures applicable to the above different scenarios, scenario 1, scenario 2 and scenario 3 are explained.
[0289] Scenario 1: Two electronic devices are located on different limbs of the user
[0290] (1) Slide-to-approach gesture scenario
[0291] See also Fig. 12A For example, in one possible scenario, the user wears device A on his left arm (integrating the somatosensory operation device provided in the above embodiment, turning on the somatosensory operation function, the input mode is configured as body surface input, the identity is configured as the controlled end, and the processing mode is configured as being processed by the controlled end), and the user wears device B on his right hand (integrating the somatosensory operation device provided in the above embodiment, turning on the somatosensory operation function, the input mode is configured as body surface input, the identity is configured as the controlled end, and the processing mode is configured as being processed by the controlled end).
[0292] See also Fig. 12B For example, in another possible scenario, the user wears device C on his head (integrating the somatosensory operation device provided in the above embodiment, turning on the somatosensory operation function, the input mode is configured as body surface input, the identity is configured as the controlled end, and the processing mode is configured as being processed by the controlled end), and the user wears device B on his right hand (integrating the somatosensory operation device provided in the above embodiment, turning on the somatosensory operation function, the input mode is configured as body surface input, the identity is configured as the controlled end, and the processing mode is configured as being processed by the controlled end).
[0293] For example, Fig. 12A and Fig. 12B In the scenario shown in the figure, the user uses the finger wearing device B to make a sliding gesture, that is, the finger wearing device B touches the controlled end, such as device A or device C, and then moves along Fig. 12A and Fig. 12B The sliding direction 1 shown is to gradually move toward the controlled end from a position away from the controlled end, such as device A or device C, and after staying close to the controlled end for a set time, lift the finger wearing device B from the staying position and gradually move away from the controlled end. In the process, device B will emit a current-coupled human body communication signal of a specific frequency.
[0294] Correspondingly, the controlled end will receive the current-coupled human body communication signal emitted by device B during the process, and record the signal strength of the received current-coupled human body communication signal (hereinafter referred to as received signal strength).
[0295] Since the processing method is configured to be processed by the controlled end, the controlled end, such as device A or device C, receives the current-coupled human body communication signal and obtains the received signal strength corresponding to the current-coupled human body communication signal. It will then determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength changing with time corresponding to the current-coupled human body communication signal) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform is used as the currently recognized target gesture, and then a corresponding operation is performed in response to the target gesture.
[0296] It should be noted that the current-coupled human body communication mode can be applied to both scene 1 and scene 2. In scene 1, based on the current-coupled human body communication signal, operation gestures such as sliding away, sliding closer, and clicking can be identified. In scene 2, the operation gesture of clicking can be identified based on the current-coupled human body communication signal. Therefore, the preset change waveforms preset in the internal memory of the controlled end mentioned above may include the waveform corresponding to the operation gesture of sliding away in scene 1, the waveform corresponding to the operation gesture of sliding closer, the waveform corresponding to the operation gesture of clicking, and the waveform corresponding to the operation gesture of clicking in scene 2.
[0297] Regarding the waveform corresponding to the sliding gesture in scene 1, it can be seen as follows Fig.13 See Fig.13 For example, at time T0_N1, the fingers of the person wearing device B or other controlling end (such as the fingers of the right hand) have not yet come into contact with the limbs wearing or holding the controlled end, such as the left arm or head. At this time, the corresponding received signal strength is, for example, S2.
[0298] Continue to see Fig.13 , for example, from time T0_N1 to time T1_N1, the fingers of the right hand of the person wearing the device B gradually approach the limb where the controlled terminal is located (such as Fig. 12A left arm, or Fig. 12B During this process, the received signal strength changes with time, gradually increasing from S2 to S3.
[0299] Continue to see Fig.13 For example, as the right hand finger wearing device B gets closer to the limb where the controlled end is located, the received signal strength will become stronger and stronger, and when the right hand finger touches the limb where the controlled end is located, the received signal strength will increase instantaneously. For example, when the right hand finger touches the limb where the controlled end is located at time T2_N1, the received signal strength will increase to S4.
[0300] Continue to see Fig.13 For example, at time T2_N1, after the finger of the right hand wearing device B contacts the support where the controlled terminal is located, as the user slides along the sliding direction 1 on the limb wearing the controlled terminal, the received signal strength gradually becomes stronger. For example, from time T2_N1 to time T3_N1, the received signal strength gradually increases from S4 to S5 as time changes.
[0301] Continue to see Fig.13 For example, when the fingers of the right hand are in contact with the limb where the controlled end is located and stay close to the controlled end for a set time (such as from time T3_N1 to time T4_N1), since the distance between device B and the controlled end has not changed, the received signal strength will remain unchanged (or the received signal strength will fluctuate slightly) from time T3_N1 to time T4_N1, that is, remain at S5.
[0302] Continue to see Fig.13 For example, when the right hand finger is lifted from the position in contact with the limb where the controlled end is located, the received signal strength will decrease rapidly. For example, from time T4_N1 to time T5_N1, the received signal strength will decrease rapidly from S5 to S1.
[0303] Continue to see Fig.13 For example, when the fingers of the right hand are lifted and moved away from the limb where the controlled end is located, the received signal strength will continue to decrease. For example, from time T5_N1 to time T6_N1, the received signal strength will drop from S1 to S0.
[0304] It can be seen that for the sliding gesture in scenario 1, when the user performs the gesture, the received signal strength changes over time as shown in the following figure: Fig.13That is, before the first moment (such as T1_N1), the limb wearing the control end is not in contact with the limb wearing the controlled end, and the received signal strength is weak. However, as the limb wearing the control end gradually approaches the limb wearing the controlled end, the received signal strength will gradually become stronger. At the second moment (such as T2_N1), when the limb wearing the control end contacts the limb wearing the controlled end, the received signal strength will become significantly stronger. During the time when the limb wearing the control end is in contact with the limb wearing the controlled end, as the limb wearing the control end slides on the limb wearing the controlled end toward the controlled end, such as during the time from T2_N1 to T3_N1, the received signal strength continues to increase, and after reaching a certain value, it is maintained at this value before the limb wearing the control end is separated from the limb wearing the controlled end (such as T4_N1), and then as the limb wearing the control end is separated from the limb wearing the controlled end, the received signal strength will decrease rapidly, such as during the time from T4_N1 to T5_N1, the received signal strength will decrease rapidly from S5 to S1. Afterwards, as the limb wearing the control end moves away from the limb wearing the controlled end, the received signal strength will slowly decrease.
[0305] Therefore, in practical applications, when the waveform obtained based on the current received signal strength and the actual change is different from the preset Fig.13 When the preset change waveforms shown match, it can be determined that the operation gesture currently made by the user is the sliding closer operation gesture.
[0306] Exemplarily, in some possible implementations, if the agreed sliding gesture operation is used to control the current interface of the controlled end to implement a swipe up operation, or a swipe right to turn the page, the controlled end, such as device A or device C, will swipe up or swipe right to turn the page of the current interface in response to the currently recognized operation gesture.
[0307] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0308] (2) Slide away operation gesture scenario:
[0309] See also Fig.14A , exemplary, Fig.14A Preconditions, configuration locations and Fig. 12A The same as above, no further description is given here.
[0310] See also Fig. 14B , exemplary, Fig. 14B Preconditions, configuration locations and Fig. 12B The same as above, no further description is given here.
[0311] For example, Fig.14A and Fig. 14B In the scenario shown in the figure, the user uses the finger wearing the device B to make a sliding gesture, that is, the finger wearing the device B is in contact with the controlled end, such as the device A and the device C, and then moves along Fig.14A and Fig. 14B The sliding direction 2 shown is to move from a position close to the controlled end, such as device A or device C, gradually away from the controlled end, and after staying at a certain distance (such as 5 cm) away from the controlled end for a set time, lift the finger wearing device B from the staying position, and gradually move away from the controlled end. In the process, device B will emit a current-coupled human body communication signal of a specific frequency.
[0312] Correspondingly, the controlled end will receive the current-coupled human body communication signal emitted by device B during the process, and record the signal strength of the received current-coupled human body communication signal (hereinafter referred to as received signal strength).
[0313] Since the processing method is configured to be processed by the controlled end, the controlled end, such as device A or device C, receives the current-coupled human body communication signal and obtains the received signal strength corresponding to the current-coupled human body communication signal. It will then determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength changing with time corresponding to the current-coupled human body communication signal) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform is used as the currently recognized target gesture, and then a corresponding operation is performed in response to the target gesture.
[0314] Regarding the waveform corresponding to the sliding away operation gesture in scene 1, it can be seen as follows Fig.15 See Fig.15 For example, at time T0_F1, the fingers of the person wearing device B or other controlling end (such as the fingers of the right hand) have not yet come into contact with the limbs wearing or holding the controlled end, such as the left arm or head. At this time, the corresponding received signal strength is, for example, S1.
[0315] Continue to see Fig.15 , for example, from time T0_F1 to time T1_F1, the fingers of the right hand of the person wearing the device B gradually approach the limb where the controlled terminal is located (such as Fig.14A left arm, or Fig. 14B During this process, the received signal strength changes with time, gradually increasing from S1 to S2.
[0316] Continue to see Fig.15For example, as the right hand finger wearing device B gets closer to the limb where the controlled end is located, the received signal strength will become stronger and stronger, and when the right hand finger touches the limb where the controlled end is located, the received signal strength will increase instantaneously. For example, when the right hand finger touches the limb where the controlled end is located at time T2_F1, the received signal strength will increase to S4.
[0317] Continue to see Fig.15 For example, at time T2_F1, after the finger of the right hand wearing device B contacts the support where the controlled end is located, as the user slides along the sliding direction 2 on the limb wearing the controlled end, the received signal strength gradually weakens as the user gradually moves away from the controlled end. For example, from time T2_F1 to time T3_F1, the received signal strength gradually decreases from S4 to S3 over time.
[0318] Continue to see Fig.15 For example, when the finger of the right hand touches the limb where the controlled end is located and stays at a position away from the controlled end for a set time (such as from time T3_F1 to time T4_F1), since the distance between device B and the controlled end has not changed, the received signal strength will remain unchanged (or the received signal strength fluctuates slightly) from time T3_F1 to time T4_F1, that is, it will remain at S3.
[0319] Continue to see Fig.15 For example, when the right hand finger is lifted from the position in contact with the limb where the controlled end is located, the received signal strength will decrease rapidly. For example, from time T4_F1 to time T5_F1, the received signal strength will decrease rapidly from S3 to S1.
[0320] Continue to see Fig.15 For example, when the right hand fingers are lifted and moved away from the limb where the controlled end is located, the received signal strength will continue to decrease. For example, from time T5_F1 to time T6_F1, the received signal strength will drop from S1 to S0.
[0321] It can be seen that for the sliding away operation gesture in scenario 1, when the user performs the operation gesture, the received signal strength will change over time as shown below: Fig.15That is, before the first moment (such as T1_F1), the limb wearing the control end is not in contact with the limb wearing the controlled end, and the received signal strength is weak. However, as the limb wearing the control end gradually approaches the limb wearing the controlled end, the received signal strength will gradually become stronger. At the second moment (such as T2_F1), when the limb wearing the control end contacts the limb wearing the controlled end, the received signal strength will become significantly stronger. During the time when the limb wearing the control end is in contact with the limb wearing the controlled end, as the limb wearing the control end slides on the limb wearing the controlled end and moves away from the controlled end, such as during the time from T2_F1 to T3_F1, the received signal strength gradually decreases, and after reaching a certain value, it is maintained at this value before the limb wearing the control end is separated from the limb wearing the controlled end (such as T4_F1), and then as the limb wearing the control end is separated from the limb wearing the controlled end, the received signal strength will decrease rapidly, such as during the time from T4_F1 to T5_F1, the received signal strength will decrease rapidly from S3 to S1. Afterwards, as the limb wearing the control end moves away from the limb wearing the controlled end, the received signal strength will slowly decrease.
[0322] Therefore, in practical applications, when the waveform obtained based on the current received signal strength and the actual change is different from the preset Fig.15 When the preset change waveforms shown match, it can be determined that the operation gesture currently made by the user is the slide away operation gesture.
[0323] Exemplarily, in some possible implementations, if the agreed sliding away gesture operation is used to control the current interface of the controlled end to implement a sliding operation, or a swiping left operation to turn the page, the controlled end, such as device A, device C, will slide down or swipe left to turn the page of the current interface in response to the currently recognized operation gesture.
[0324] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0325] (3) Click operation gesture scenario
[0326] See also Fig.16A , exemplary, Fig.16A Preconditions, configuration locations and Fig. 12A The same as above, no further description is given here.
[0327] See also Fig. 16B , exemplary, Fig. 16B Preconditions, configuration locations and Fig. 12B The same as above, no further description is given here.
[0328] For example, Fig.16A and Fig. 16B In the scenario shown in FIG. 1 , the user uses the finger wearing device B to make a click operation gesture, that is, the finger wearing device B makes physical contact with the controlled end, such as device A or device C, such as the finger of the right hand moving from Fig.16A Medium (1) or Fig. 16B Move the position of (1) to Fig.16A Medium (2) or Fig. 16B Then, the controlled end stays for a set time when receiving the limb where the controlled end is located. Fig.16A Medium (2) or Fig. 16B After staying at the position (2) for a set time, lift the finger wearing device B from the resting position and gradually move away from the controlled end, that is, the right hand finger moves away from the controlled end. Fig.16A Medium (2) or Fig. 16B Move the position of (2) to Fig.16A Medium (3) or Fig. 16B During the process of being in position (3), device B will emit a current-coupled human body communication signal of a specific frequency.
[0329] Correspondingly, the controlled end will receive the current-coupled human body communication signal emitted by device B during the process, and record the signal strength of the received current-coupled human body communication signal (hereinafter referred to as received signal strength).
[0330] Since the processing method is configured to be processed by the controlled end, the controlled end, such as device A or device C, receives the current-coupled human body communication signal and obtains the received signal strength corresponding to the current-coupled human body communication signal. It will then determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength changing with time corresponding to the current-coupled human body communication signal) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform is used as the currently recognized target gesture, and then a corresponding operation is performed in response to the target gesture.
[0331] The waveform corresponding to the click gesture in scene 1 can be seen as follows Fig.17 See Fig.17 For example, at time T0_C1, the fingers of the person wearing device B or other controlling end (such as the fingers of the right hand) have not yet come into contact with the limbs wearing or holding the controlled end, such as the left arm or head, and the corresponding received signal strength is, for example, S2.
[0332] Continue to see Fig.17 , for example, from time T0_C1 to time T1_C1, the fingers of the right hand of the person wearing the device B gradually approach the limb where the controlled end is located (such as Fig.16Aleft arm, or Fig. 16B During this process, the received signal strength changes with time, gradually increasing from S2 to S3.
[0333] Continue to see Fig.17 For example, as the right hand finger wearing device B gets closer to the limb where the controlled end is located, the received signal strength will become stronger and stronger, and when the right hand finger touches the limb where the controlled end is located, the received signal strength will increase instantaneously. For example, when the right hand finger touches the limb where the controlled end is located at time T2_C1, the received signal strength will increase to S4.
[0334] Continue to see Fig.17 For example, at time T2_C1, after the right finger of the person wearing device B contacts the support where the controlled terminal is located, the right finger continues to press the contact position for a set time, such as from time T2_C1 to time T3_C1. Since the distance between the right finger and the controlled terminal does not change during this time period, the received signal strength will remain unchanged (or the received signal strength fluctuates slightly) from time T2_C1 to time T3_C1, that is, remain at S4, or increase to S5 which is slightly greater than S4.
[0335] Continue to see Fig.17 For example, when the right hand fingers are lifted from the position in contact with the limb where the controlled end is located, the received signal strength will decrease rapidly. For example, from time T3_C1 to time T4_C1, the received signal strength will decrease rapidly from S4 / S5 to S1.
[0336] Continue to see Fig.17 For example, when the right hand fingers are lifted and away from the limb where the controlled end is located, the received signal strength will continue to decrease. For example, from time T4_C1 to time T5_C1, the received signal strength will decrease from S1 to S0.
[0337] It can be seen that for the click operation gesture in scenario 1, when the user performs the operation gesture, the received signal strength changes over time as shown in the following figure: Fig.17The changes shown in the figure are shown in the figure. That is, before the first moment (such as moment T1_C1), the limb wearing the control end is not in contact with the limb wearing the controlled end, and the received signal strength is weak. However, as the limb wearing the control end gradually approaches the limb wearing the controlled end, the received signal strength will gradually become stronger. At the second moment (such as moment T2_C1), when the limb wearing the control end contacts the limb wearing the controlled end, the received signal strength will become significantly stronger. During the time when the limb wearing the control end contacts the limb wearing the controlled end, the received signal strength will remain unchanged, or the fluctuation will be less than the threshold (negligible), such as from moment T2_C1 to moment T3_C1, it will remain at S3~S4. After that, as the limb wearing the control end separates from the limb wearing the controlled end, the received signal strength will decrease rapidly, such as from moment T3_C1 to moment T4_C1, the received signal strength will decrease rapidly from S4 to S1. After that, as the limb wearing the control end moves away from the limb wearing the controlled end, the received signal strength will slowly decrease.
[0338] Therefore, in practical applications, when the waveform obtained based on the current received signal strength and the actual change is different from the preset Fig.17 When the preset change waveforms shown match, it can be determined that the operation gesture currently made by the user is a click operation gesture.
[0339] Exemplarily, in some possible implementations, when the controlled end determines that the current operation gesture is a click operation gesture, in response to the operation gesture, it will click on the current interface, or click on the control in the interface, thereby switching the interface, or pausing the current business, etc.
[0340] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0341] Scenario 2: Two electronic devices are located on the same limb of the user
[0342] See also Fig.18 For example, in one possible scenario, the user wears device A on his left arm (integrating the somatosensory operation device provided in the above embodiment, turning on the somatosensory operation function, the input mode is configured as body surface input, the identity is configured as the controlled end, and the processing mode is configured as being processed by the controlled end), and wears device B on his left hand (integrating the somatosensory operation device provided in the above embodiment, turning on the somatosensory operation function, the input mode is configured as body surface input, the identity is configured as the controlled end, and the processing mode is configured as being processed by the controlled end).
[0343] It should be noted that the left hand and arm can be regarded as the same limb, and the right hand and right arm can be regarded as the same limb.
[0344] For example, Fig.18 In the scenario shown, when a user is not wearing any electronic device, or the electronic device he is wearing does not integrate the somatosensory operation device in the above embodiment, or the somatosensory operation function is not turned on, a limb such as the right hand finger makes a clicking gesture, such as using the right hand finger to touch the ground electrode (such as the first electrode in the above embodiment) area of device A located on the side frame, that is, not in contact with the left arm, and after the right hand finger is in contact with the ground electrode in this area for a set period of time, the right hand finger is lifted up and gradually moves away from the controlled end. In the process, device B will emit a current-coupled human body communication signal of a specific frequency.
[0345] Correspondingly, the controlled end, such as device A, will receive the current-coupled human body communication signal emitted by device B during the process, and record the signal strength of the received current-coupled human body communication signal (hereinafter referred to as received signal strength).
[0346] Since the processing method is configured to be processed by the controlled end, the controlled end, such as a device, receives a current-coupled human body communication signal and obtains the received signal strength corresponding to the current-coupled human body communication signal. It will determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength changing with time corresponding to the current-coupled human body communication signal) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform is used as the currently recognized target gesture, and then the corresponding operation is performed in response to the target gesture.
[0347] The waveform corresponding to the click gesture in scene 1 can be seen as follows Fig.19 See Fig.19 For example, at time T0_C2, the fingers of the right hand that is not wearing any electronic device have not yet come into contact with the limb that is wearing or holding device A, such as the left arm, and the corresponding received signal strength at this time is, for example, S1.
[0348] It should be noted that, since the distance between device B worn on the left finger and device A worn on the left arm is relatively close, the value of the received signal strength S1 corresponding to time T0_C2 is higher than Fig.13 , Fig.15 , the value corresponding to S1 in the waveform diagram shown in Figure 16.
[0349] Continue to see Fig.19 , for example, from time T0_C2 to time T1_C2, the fingers of the right hand of the person wearing the device B gradually approach the limb where the controlled end is located (such as Fig.18 In this process, the received signal strength changes with time, gradually increasing from S1 to S3.
[0350] Understandably, when the right hand finger without any electronic device touches the ground electrode area of device A, the right hand finger will block the current-coupled human body communication signal emitted by device B, so the received signal strength will be reduced. Fig.19 As shown, exemplarily, when the right hand finger touches the ground electrode area of device A at time T1_C2, the received signal strength will instantly drop from S3 to S0, and during the time when the right hand finger touches the ground electrode area of device A, such as time T1_C2 to time T2_C2, the received signal strength will remain unchanged (or the received signal strength fluctuates slightly), that is, remain at S0.
[0351] Continue to see Fig.19 For example, during the process of lifting the right finger from the ground electrode area of device A, as the right finger moves away from device A, the received signal strength will increase rapidly. For example, from time T2_C2 to time T3_C2, the received signal strength will increase rapidly from S0 to S2.
[0352] Continue to see Fig.19 For example, when the right hand finger is lifted and away from the limb where the device A is located, since the distance between the device A and the device B is basically fixed, the received signal strength will be maintained between S1 and S3, such as Fig.19 S2 shown in FIG.
[0353] It can be seen that for the click operation gesture in scenario 1, when the user performs the operation gesture, the received signal strength changes over time as shown in the following figure: Fig.19 That is, before the first moment (such as moment T1_C2), when the limb (limb 1) that is not wearing the electronic device with the somatosensory operation function turned on gradually approaches the limb (limb 2) wearing the controlled end and the controlling end, the received signal strength will fluctuate, and may increase or decrease in a small range. Fig.19 Take enhancement as an example. When limb 1 contacts limb 2 at the second moment (such as moment T1_C2), the received signal strength will decrease rapidly. During the time that limb 1 contacts limb 2, the received signal strength will remain unchanged, or the fluctuation will be less than the threshold (negligible), such as maintaining at S0 from moment T1_C2 to moment T2_C1. Afterwards, as the limb wearing the controlling end separates from the limb wearing the controlled end, the received signal strength will increase rapidly, such as from moment T2_C2 to moment T3_C2, the received signal strength will increase rapidly from S0 to S3. Afterwards, as the limb wearing the controlling end moves away from the limb wearing the controlled end, the received signal strength will remain unchanged, or basically remain at S3.
[0354] Therefore, in practical applications, when the waveform obtained based on the current received signal strength and the actual change is different from the preset Fig.19 When the preset change waveforms shown match, it can be determined that the operation gesture currently made by the user is a click operation gesture.
[0355] Exemplarily, in some possible implementations, when the controlled end determines that the current operation gesture is a click operation gesture, in response to the operation gesture, it will click on the current interface, or click on the control in the interface, thereby switching the interface, or pausing the current business, etc.
[0356] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0357] Scenario 3: One electronic device is placed on the table and one electronic device is placed on the user
[0358] (1) Slide-to-approach gesture scenario
[0359] See also Fig. 20 , exemplarily, in a possible scenario, device D (integrating the somatosensory operation device provided by the above embodiment, turning on the somatosensory operation function, the input mode is configured as body surface input, the identity is configured as the controlled end, and the processing mode is configured as being processed by the controlled end) is placed on the desktop, and device B (integrating the somatosensory operation device provided by the above embodiment, turning on the somatosensory operation function, the input mode is configured as body surface input, the identity is configured as the controlled end, and the processing mode is configured as being processed by the controlled end) is configured on the user's right hand.
[0360] For example, Fig. 20 In the scenario shown in FIG. 1 , the user uses the finger wearing device B to make a sliding gesture, that is, the finger wearing device B is placed on the desktop where device D is placed. Fig. 20 The position shown in (1) is along Fig. 20 The sliding direction 1 shown in (1) moves toward the signal electrode area (such as the second electrode and the third electrode in the above embodiment) provided in the device D, and contacts the signal electrode when moving to the signal electrode area, that is, the finger wearing the device B moves from Fig. 20 The position shown in (1) moves to Fig. 20 After the finger of the device B is in contact with the signal electrode for a set time, it is lifted from the signal electrode area of the device D and gradually moves away from the device D, that is, the finger of the device B is lifted from the signal electrode area of the device D. Fig. 20 The position shown in (2) changes to Fig. 20 During the process of being at the position shown in (3), device B will emit a capacitive coupling human body communication signal of a specific frequency.
[0361] Correspondingly, device D will receive the capacitive coupling human body communication signal transmitted by device B during the process, and record the signal strength of the received capacitive coupling human body communication signal (hereinafter also represented as received signal strength).
[0362] Since the processing method is configured to be processed by the controlled end, the controlled end, such as device D, receives the capacitive coupling type human body communication signal and obtains the received signal strength corresponding to the capacitive coupling type human body communication signal. It will determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength changing with time corresponding to the capacitive coupling type human body communication signal) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform is used as the currently recognized target gesture, and then the corresponding operation is performed in response to the target gesture.
[0363] It should be noted that the capacitive coupling human body communication mode can be applied to scenario 3. In scenario 3, based on the capacitive coupling human body communication signal, operation gestures such as sliding away, sliding closer, and clicking can be realized. Therefore, the preset change waveforms preset in the internal memory of the controlled terminal mentioned above may include the waveform corresponding to the sliding away operation gesture, the waveform corresponding to the sliding closer operation gesture, and the waveform corresponding to the clicking operation gesture in scenario 3.
[0364] The waveform corresponding to the sliding gesture in scene 3 can be seen as follows: Fig.21 See Fig.21 For example, at time T0_N2, the finger of the right hand wearing device B is not in contact with the desktop on which device D is placed, and is away from the signal electrode of device D. At this time, the corresponding received signal strength is, for example, S1.
[0365] Continue to see Fig.21 , for example, from time T0_N2 to time T1_N2, the finger of the right hand of the person wearing device B slides along the sliding direction 1 on the desktop where device D is placed, gradually approaching the signal electrode area of device D. In this process, the finger of the right hand of the person wearing device B moves from Fig. 20 (1) Move to Fig. 20 During the process of being at the position in (2), the received signal strength will gradually increase from S2 to S4.
[0366] Continue to see Fig.21 For example, at time T2_N2, the finger of the right hand wearing device B touches the signal electrode area of device D, and the received signal strength increases instantly from S4 to S5.
[0367] It should be noted that in order to avoid erroneous behavior, it can be agreed that in a sliding operation (sliding closer and sliding away), the finger of the right hand wearing device B contacts the signal electrode of device D for a set period of time and then moves away from the signal electrode, which is then judged as a sliding operation.
[0368] In addition, it should be noted that since both the sliding operation and the clicking operation in scenario 3 require the right finger of the person wearing device B to contact the signal electrode of device D, in order to distinguish between the sliding operation and the clicking operation, the time (maintenance time t) that the right finger of the person wearing device B contacts the signal electrode of device D during the sliding operation can be pre-set to be less than the pre-set contact time (t_click).
[0369] Continue to see Fig.21 For example, after the finger of the right hand wearing device B contacts the signal electrode of device D, if the finger of the right hand continues to contact the signal electrode of device D from moment T2_N2 to moment T3_N2, that is, within the maintenance time t, and the duration from moment T2_N2 to moment T3_N2 is less than the preset t_click, the received signal strength received by device D will be maintained at S5.
[0370] Continue to see Fig.21 For example, after maintaining time t, the finger of the right hand wearing device B will gradually separate from the signal electrode of device D from time T3_N2 to time T5_N2. During this process, the corresponding received signal strength will gradually decrease from S5 to S3 corresponding to time T4_N2, and then from S3 corresponding to time T4_N2 to S2 corresponding to time T5_N2.
[0371] Continue to see Fig.21 For example, after the finger of the right hand wearing device B is separated from the signal electrode of device D, if the finger of the right hand quickly moves away from the signal electrode of device D, for example, quickly moves away from the signal electrode of device D from time T5_N2 to time T6_N2, the received signal strength obtained by device D will quickly drop from S2 to S0.
[0372] It can be seen that for the sliding gesture in scenario 3, when the user performs the gesture, the received signal strength changes over time as shown in the following figure: Fig.21The changes shown. That is, before the first moment (such as moment T1_N2), the limb wearing the control end is in contact with the object on which the controlled end is placed, such as a desktop, but before contacting the controlled end, the received signal strength is weak. As the limb wearing the control end slides toward the controlled end on the object on which the controlled end is placed, the received signal strength will become significantly stronger, and when the limb wearing the control end is in contact with the controlled end, the received signal strength will increase rapidly, such as changing from S4 to S5 at moment T2_N2. During the time when the limb wearing the control end is in contact with the object on which the controlled end is placed, such as from moment T2_N2 to moment T3_N2, the received signal strength is maintained at this value, and then as the limb wearing the control end is separated from the controlled end, the received signal strength will decrease rapidly, such as from moment T4_N1 to moment T5_N1, the received signal strength will decrease rapidly from S5 to S1. Afterwards, as the limb wearing the control end moves away from the controlled end and leaves the object on which the controlled end is placed, the received signal strength will gradually decrease.
[0373] Therefore, in practical applications, when the waveform obtained based on the current received signal strength and the actual change is different from the preset Fig.21 When the preset change waveforms shown match, it can be determined that the operation gesture currently made by the user is the sliding closer operation gesture.
[0374] Exemplarily, in some possible implementations, if the agreed sliding gesture operation is used to control the current interface of the controlled end to implement a swipe up operation, or a swipe right to turn the page, the controlled end, such as device D, will swipe up or swipe right to turn the page of the current interface in response to the currently recognized operation gesture.
[0375] by Fig. 20 The scene 3 shown in FIG. 3 is a scene in which device D is placed on a desktop and reads a novel. For example, before the user performs the sliding gesture, the current interface of device D displays the second page of the novel. Fig. 20 As shown in (1). Fig. 20 Medium (1) to Fig. 20 After completing the sliding gesture in scene 3, device D can return the novel currently displayed on the interface of device D to page 1 in response to the recognized operation gesture.
[0376] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0377] (2) Slide away operation gesture scenario:
[0378] See also Fig. 22 , exemplary, Fig. 22The prerequisites, placement, and configuration of devices D and B in Fig. 20 The same as above, no further description is given here.
[0379] For example, Fig. 22 In the scenario shown, the user uses the finger wearing device B to perform a sliding gesture, that is, the finger of the right hand wearing device B moves from a position away from the signal electrode area of device D to the signal electrode area of device D, and after being in contact with the signal electrode of device D for a set time, it slides along the sliding direction 2 on the desktop, gradually moving away from the signal electrode of device D. For example, the finger of the right hand wearing device B moves from Fig. 22 Move the position of (1) to Fig. 22 (2) in the middle and Fig. 22 After staying at position (2) for a set time, Fig. 22 The position of (2) gradually moves along the sliding direction 2 to Fig. 22 The process of position (3) in the middle.
[0380] It is understandable that during this process, device B will emit a capacitive coupling human body communication signal of a specific frequency. Correspondingly, device D will receive the capacitive coupling human body communication signal emitted by device B during this process, and record the signal strength of the received capacitive coupling human body communication signal (hereinafter also represented as received signal strength).
[0381] Since the processing method is configured to be processed by the controlled end, the controlled end, such as device D, receives the capacitive coupling type human body communication signal and obtains the received signal strength corresponding to the capacitive coupling type human body communication signal. It will determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength changing with time corresponding to the capacitive coupling type human body communication signal) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform is used as the currently recognized target gesture, and then the corresponding operation is performed in response to the target gesture.
[0382] Regarding the waveform corresponding to the sliding away operation gesture in scene 3, it can be seen as follows Fig.23 See Fig.23 For example, at time T0_F2, the finger of the right hand wearing device B is not in contact with the signal electrode of device D, and the corresponding received signal strength is, for example, S0.
[0383] Continue to see Fig.23 For example, from time T0_F2 to time T1_F2, the finger of the right hand wearing device B gradually approaches the signal electrode of device D, and during this process the received signal strength will gradually increase from S0 to S1.
[0384] Continue to see Fig.23 For example, if the finger of the right hand of the person wearing device B quickly touches the signal electrode of device D at time T2_F2, the received signal strength will increase rapidly from S1 to S3 from time T1_F2 to time T2_F2. Fig. 22 The scene shown in (1) Fig. 22 In the scenario shown in (2), the position of the fingers on the right hand of the person wearing device B changes.
[0385] Continue to see Fig.23 For example, after the finger of the right hand wearing device B contacts the signal electrode of device D, if the finger of the right hand contacts the signal electrode of device D from moment T2_F2 to moment T3_F2, that is, for a period of time t, and the duration from moment T2_F2 to moment T3_F2 is less than the preset t_click, the received signal strength received by device D will be maintained at S3.
[0386] Continue to see Fig.23 For example, after maintaining time t, the finger of the right hand wearing device B will gradually separate from the signal electrode of device D from time T3_F2 to time T5_F2, and slide along the sliding direction 2, that is, from Fig. 22 Move the position shown in (2) to Fig. 22 At the position shown in (3), the corresponding received signal strength will gradually decrease from S3 to S2 corresponding to time T4_F2, and then decrease from S2 corresponding to time T4_F2 to S1 corresponding to time T5_F2.
[0387] It can be seen that for the sliding away operation gesture in scenario 3, when the user performs the operation gesture, the received signal strength will change over time as shown in the following figure: Fig.23 The changes shown. That is, before the first moment (such as moment T1_F2), the limb wearing the controlling end has not yet come into contact with the object on which the controlled end is placed, such as a desktop, and the received signal strength is weak. As the limb wearing the controlling end gradually approaches the controlled end, the received signal strength will become significantly stronger, and reach the highest value when the limb wearing the controlling end comes into contact with the controlled end, such as S3 corresponding to moment T2_F2. During the time when the limb wearing the controlling end is in contact with the object on which the controlled end is placed, such as during the time from moment T2_N2 to moment T3_N2, the received signal strength is maintained at this value, and then as the limb wearing the controlling end slides away from the controlled end on the object on which the controlled end is placed, the received signal strength will decrease rapidly. Afterwards, as the limb wearing the controlling end leaves the object on which the controlled end is placed, the received signal strength will gradually decrease.
[0388] Therefore, in practical applications, when the waveform obtained based on the current received signal strength and the actual change is different from the preset Fig.23 When the preset change waveforms shown match, it can be determined that the operation gesture currently made by the user is the sliding closer operation gesture.
[0389] Exemplarily, in some possible implementations, if the agreed sliding away gesture operation is used to control the current interface of the controlled end to implement a sliding operation, or a swiping left to turn the page, the controlled end, such as device D, will slide down or swipe left to turn the page of the current interface in response to the currently recognized operation gesture.
[0390] by Fig. 22 The scene 3 shown in FIG. 3 is a scene in which device D is placed on a desktop and reads a novel. For example, before the user slides away from the operation gesture, the current interface of device D displays page 2 of the novel. Fig. 22 As shown in (1). Fig. 22 Medium (1) to Fig. 22 After the sliding away operation gesture is completed in scene 3 (3), device D can turn the novel displayed on the current interface of device D to page 3 in response to the recognized operation gesture.
[0391] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0392] (3) Click operation gesture scenario
[0393] See also Fig.24 , exemplary, Fig.24 The prerequisites, placement, and configuration of devices D and B in Fig. 20 The same as above, no further description is given here.
[0394] For example, Fig.24 In the scenario shown, the user uses the right finger wearing device B to make a click gesture, that is, the right finger wearing device B moves from a position away from the signal electrode area of device D to the signal electrode area of device D, and after being in contact with the signal electrode of device D for a set time, the right finger is lifted and gradually moves away from the signal electrode of device D. Fig.24 Move the position of (1) to Fig.24 (2) in the middle and Fig.24 After staying at position (2) for a set time, Fig.24 Lift your right hand and move your fingers to the middle (2) position. Fig.24 The process of position (3) in the middle.
[0395] It is understandable that during this process, device B will emit a capacitive coupling human body communication signal of a specific frequency. Correspondingly, device D will receive the capacitive coupling human body communication signal emitted by device B during this process, and record the signal strength of the received capacitive coupling human body communication signal (hereinafter also represented as received signal strength).
[0396] Since the processing method is configured to be processed by the controlled end, the controlled end, such as device D, receives the capacitive coupling type human body communication signal and obtains the received signal strength corresponding to the capacitive coupling type human body communication signal. It will determine the waveform of the received signal strength changing with time, and finally match the currently determined waveform with the preset change waveform (the waveform of the received signal strength changing with time corresponding to the capacitive coupling type human body communication signal) preset in the storage area of the controlled end (such as the internal memory). If there is a matching preset change waveform, the gesture corresponding to the matching preset change waveform is used as the currently recognized target gesture, and then the corresponding operation is performed in response to the target gesture.
[0397] The waveform corresponding to the click gesture in scene 3 can be seen as follows Fig.25 See Fig.25 For example, at time T0_C3, the finger of the right hand wearing device B is not in contact with the signal electrode of device D, and the corresponding received signal strength is, for example, S0.
[0398] Continue to see Fig.25 For example, from time T0_C3 to time T1_C3, the finger of the right hand wearing device B gradually approaches the signal electrode of device D, and during this process the received signal strength will gradually increase from S0 to S2.
[0399] Continue to see Fig.25 For example, from time T1_C3 to time T2_C3, the finger of the right hand wearing device B continues to approach the signal electrode of device D. As the distance between the finger of the right hand wearing device B and the signal electrode of device D gets closer, the received signal strength will gradually increase from S2 to S4.
[0400] Continue to see Fig.25 For example, at time T3_C3, the finger of the right hand of the person wearing device B quickly touches the signal electrode of device D, and then from time T2_C3 to time T3_C3, the received signal strength will instantly increase from S4 to S5. Fig.24 The scene shown in (1) Fig.24 In the scenario shown in (2), the position of the fingers on the right hand of the person wearing device B changes.
[0401] Continue to see Fig.25For example, after the finger of the right hand wearing device B contacts the signal electrode of device D, if the finger of the right hand continues to contact the signal electrode of device D from moment T3_C3 to moment T4_C3, that is, for a period of time t, and the duration from moment T3_C3 to moment T4_C3 is greater than or equal to, that is, not less than the preset t_click, the received signal strength received by device D will be maintained at S5.
[0402] Continue to see Fig.25 For example, after maintaining time t, the finger of the right hand wearing device B will be separated from the signal electrode of device D from time T4_C3 to time T5_C3. During this process, the corresponding received signal strength will quickly decrease from S5 to S3 corresponding to time T4_F2.
[0403] Continue to see Fig.25 For example, after the finger of the right hand wearing device B leaves the signal electrode of device D and continues to move away from device D, the corresponding received signal strength will gradually decrease from S3 to S1 corresponding to time T6_C3. If the finger of the right hand wearing device B continues to move away from the signal electrode of device D, the received signal strength will continue to decrease from S1 corresponding to time T6_C3 to S0 corresponding to time T7_C3. In this way, Fig.24 The scene shown in (2) Fig.24 In the scenario shown in (3), the position of the fingers on the right hand of the person wearing device B changes.
[0404] It can be seen that for the click operation gesture in scenario 3, when the user performs the operation gesture, the received signal strength will change over time as shown in the following figure: Fig.25 The changes shown. That is, before the first moment (such as moment T1_C3), before the limb wearing the controlling end contacts the signal electrode of the controlled end, the received signal strength is weak. As the limb wearing the controlling end gradually approaches the controlled end, the received signal strength will become significantly stronger, and reach the highest value when the limb wearing the controlling end contacts the controlled end, such as S5 corresponding to moment T3_C3. During the time when the limb wearing the controlling end contacts the object on which the controlled end is placed, such as from moment T3_C3 to moment T4_C3, the received signal strength is maintained at this value, and then as the limb wearing the controlling end moves away from the controlled end, the received signal strength will gradually decrease.
[0405] Therefore, in practical applications, when the waveform obtained based on the current received signal strength and the actual change is different from the preset Fig.25 When the preset change waveforms shown match, it can be determined that the operation gesture currently made by the user is the sliding closer operation gesture.
[0406] Exemplarily, in some possible implementations, when device D determines that the current operation gesture is a click operation gesture, in response to the operation gesture, it will click on the current interface, or click on the control in the interface, thereby switching the interface, or pausing the current business, or displaying the taskbar on the current interface, etc.
[0407] by Fig.24 The scene 3 shown in FIG. 3 is a scene in which device D is placed on a desktop to read a novel. For example, if the user performs a click operation gesture, the current interface of device D displays page 2 of the novel. Fig.24 As shown in (1). Fig.24 Medium (1) to Fig.24 After completing the click operation gesture in scenario 3, device D can cancel the page number displayed in the interface, such as "-2-", in response to the recognized operation gesture, and display a task bar at the bottom of the current interface. For example, the task bar can display function options for editing the content displayed in the current interface, such as viewing the chapter of the novel currently being viewed, adjusting the font of the novel currently being displayed, and adjusting the reading position.
[0408] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0409] Through the above description of gesture operations in scenes 1 and 2 corresponding to the current coupling type human body communication mode, the states (locations) of electronic devices serving as the controlled end and the controlling end in scenes 1 and 2, and the description of operation gestures in scene 3 corresponding to the capacitive coupling type human body communication mode, and the states (locations) of electronic devices serving as the controlled end and the controlling end in scene 3, it can be seen that there is a relationship between the state of the electronic device, the human body communication mode, the scene, and the operation gesture as shown in Table 2.
[0410] Table 2 Correspondence between states, modes, scenes and gestures
[0411]
[0412] Among them, when the controlled terminal and the controlling terminal are both in the wearing / holding state, when the controlled terminal and the controlling terminal are in different limbs of the user, as in the above embodiment Fig. 12A , Fig. 12B ,or Fig.14A , Fig. 14B ,or Fig.16A , Fig. 16B When the limbs shown are shown, the scene currently in which the controlled terminal and the controlling terminal are located is scene 1, and the corresponding operation gestures include presenting Fig.13 , Fig.15 , Fig.17The preset waveforms shown are slide-to-approach, slide-to-leave, and click operation gestures.
[0413] Among them, when the controlled terminal and the controlling terminal are both in the wearing / holding state, when the controlled terminal and the controlling terminal are in the same limb of the user, as in the above embodiment Fig.18 When the limbs shown are shown, the scene currently in which the controlled terminal and the controlling terminal are located is scene 2, and the corresponding operation gestures include presenting Fig.19 The tapping gesture of the preset waveform is shown.
[0414] Wherein, the controlled terminal is placed on the desktop and the control terminal is in a wearing / holding state, as in the above embodiment. Fig. 20 , Fig. 22 , Fig.24 As shown, the scene currently in which the controlled terminal and the controlling terminal are located is scene 3, and the corresponding operation gestures include presenting Fig.21 , Fig.23 , Fig.25 The preset waveforms shown are slide-to-approach, slide-to-leave, and click operation gestures.
[0415] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0416] It can be seen from the description of the above embodiments that the somatosensory operation based on the human body communication technology requires at least two electronic devices integrated with the somatosensory operation devices described in the above embodiments. In the somatosensory operating system composed of at least two electronic devices integrated with the somatosensory operation devices described in the above embodiments, the specific recognition and processing process of the operation gestures that can be realized in the above scenarios 1, 2 and 3, and the somatosensory operation based on the recognized operation gestures can be as follows: Fig.26 The illustrated embodiment.
[0417] See also Fig.26 , exemplarily illustrating a somatosensory operation method, specifically comprising:
[0418] 101. The first electronic device and the second electronic device meet a set trigger condition and start a somatosensory operation function.
[0419] The first electronic device and the second electronic device may be any one of a mobile phone, a tablet computer, a smart watch, a smart bracelet, a smart ring, a smart TV, and a personal computer.
[0420] Illustratively, in a possible implementation manner, the first electronic device is, for example, device A or device D in the above embodiment; the second electronic device is, for example, device B in the above embodiment.
[0421] Regarding the first electronic device and the second electronic device satisfying the set triggering condition, in some possible implementations, for example, the designated areas of the two devices collide. In other possible implementations, for example, the user taps / touches the designated areas of the two devices respectively. In other possible implementations, for example, the somatosensory operation function entrance provided by the installed setting application is triggered, or the control for turning on the somatosensory operation function in a dedicated somatosensory operation application, such as FIG. 10A to FIG. 10E shown.
[0422] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation to this embodiment.
[0423] 102. The first electronic device and the second electronic device establish a somatosensory operation connection based on human body communication technology (operating in a current coupling human body communication mode or a capacitive coupling human body communication mode).
[0424] by FIG. 10A to FIG. 10E Taking the implementation shown as an example, when establishing a somatosensory operation connection between a first electronic device and a second electronic device based on human body communication technology, the first electronic device and the second electronic device can be configured through the window 10c-6 displayed on the interface 10c in the above embodiment. In this way, when a somatosensory operation connection request is initiated from the first electronic device to the second electronic device, the human body communication mode, the role played in the somatosensory operation, and the object for performing gesture recognition processing can be set for the first electronic device and the second electronic device according to the configuration information configured in the window 10c-6.
[0425] Regarding the configurations implemented based on the controls 10c-61 to 10c-66 provided in the window 10c-6, and the human body communication mode indicated to the first electronic device and the second electronic device based on the configuration information generated based on the corresponding configuration, as well as the roles played in the somatosensory operation and the objects performing the gesture recognition processing, please refer to the Fig. 10D The description part will not be repeated here.
[0426] In addition, it can be seen from the description of the above embodiments that the human body communication mode can include a current coupling human body communication mode and a capacitive coupling human body communication mode. Among them, in the current coupling human body communication mode, the human body communication signal exchanged between electronic devices is specifically a current coupling human body communication signal. In the capacitive coupling human body communication mode, the human body communication signal exchanged between electronic devices is specifically a capacitive coupling human body communication signal.
[0427] In addition, it should be noted that for current-coupled human body communication signals, the reception and transmission are realized by current-coupled human body communication circuits, and for capacitive-coupled human body communication signals, the reception and transmission are realized by capacitive-coupled human body communication circuits.
[0428] In this embodiment, the specific structure of the somatosensory operation device integrated into the first electronic device and the second electronic device can be as follows: Figure 2 and Figure 4 As shown, the body sensing operation device includes a current coupling type human body communication circuit ( Figure 2 + Figure 5A The current-coupled human body communication circuit (hereinafter referred to as the first current-coupled human body communication circuit) is used to receive the current-coupled human body communication signal. Figure 2 + Figure 5B The capacitive coupling type human body communication circuit (hereinafter referred to as the second current coupling type human body communication circuit) is used to transmit the capacitive coupling type human body communication signal. Figure 2 + Figure 5C The capacitive coupling type human body communication circuit (hereinafter referred to as the first capacitive coupling type human body communication circuit) is used to receive the capacitive coupling type human body communication signal. Figure 2 + Figure 5D The structure is composed of a capacitive coupling type human body communication circuit, which will be referred to as the second capacitive coupling type human body communication circuit later).
[0429] Among them, the first current-coupled human body communication circuit and the second current-coupled human body communication circuit are used in combination, that is, when the first current-coupled human body communication circuit is turned on in the first electronic device, if you want to realize somatosensory operation based on human body communication technology, the second electronic device needs to turn on the second current-coupled human body communication circuit.
[0430] Correspondingly, the first capacitive coupling type human body communication circuit and the second capacitive coupling type human body communication circuit are used in combination, that is, when the first capacitive coupling type human body communication circuit is turned on in the first electronic device, if you want to realize somatosensory operation based on human body communication technology, the second electronic device needs to turn on the second capacitive coupling type human body communication circuit.
[0431] For the conduction and switching of the above four circuits, please refer to Figure 5A , Figure 5B , Figure 5C and Figure 5D The embodiment part will not be repeated here.
[0432] Therefore, based on the structure of the above-mentioned somatosensory operation device, when the first electronic device and the second electronic device establish a somatosensory operation connection between them, they can select a suitable input method and role from window 10c-6 according to the current usage scenario, such as scene 1, scene 2 and scene 3 mentioned in the above-mentioned embodiments, so that the first electronic device and the second electronic device can conduct a suitable human body communication circuit.
[0433] For the correspondence between scenario 1, scenario 2 and scenario 3 and the surface input mode and the external input mode, the correspondence between the surface input mode and the external input mode and the current coupling type human body communication mode and the capacitive coupling type human body communication mode, and the correspondence between the roles played and the above four types of human body communication circuits, please refer to Figure 5A , Figure 5B , Figure 5C and Figure 5D ,as well as Fig. 10D The embodiments part will not be described in detail here.
[0434] 103: Whether the first electronic device and the second electronic device are both in the first state.
[0435] The first state refers to a state of being worn or held, that is, the first electronic device and the second electronic device are both in the first state, which means that the first electronic device and the second electronic device are both on the user.
[0436] Exemplarily, when the first electronic device and the second electronic device are both in the first state, in some possible implementations, for example, the first electronic device and the second electronic device are in scenario 1 described in the above embodiment, that is, the two electronic devices are located on different limbs of the user.
[0437] Exemplarily, when the first electronic device and the second electronic device are both in the first state, in some other possible implementations, for example, the first electronic device and the second electronic device are in scenario 2 mentioned in the above embodiment, that is, the two electronic devices are located in the same limb.
[0438] It should be noted that after the user configures the human body communication mode of the first electronic device and the second electronic device in step 102, the scene may be switched during use, for example, from scene 1 or scene 2 to scene 3; or from scene 3 to scene 1 or scene 2. If the user does not switch to the human body communication mode after the scene is changed, Fig. 10EIf the configuration information of window 10c-7 in the middle interface 10c is changed, the first electronic device and the second electronic device may still be in the human body communication mode corresponding to scene 1 or scene 2, or the human body communication mode corresponding to scene 3. When the first electronic device and the second electronic device are in the human body communication mode corresponding to scene 1 or scene 2, somatosensory operations cannot be performed in scene 3 (current-coupled human body communication signals cannot be transmitted outside the body). Accordingly, when the first electronic device and the second electronic device are in the human body communication mode corresponding to scene 3, somatosensory operations cannot be performed in scene 1 or scene 2 (capacitive-coupled human body communication signals have less loss inside the body).
[0439] Therefore, in practical applications, the status of the first electronic device and the second electronic device may be determined once according to a set time or after completing a set number of gesture recognitions.
[0440] It is understandable that when the electronic device is on the user's body or placed on a desktop, the data collected by the internal sensors is different. Therefore, in some possible implementations, the current location of the electronic device can be determined through sensors in the electronic device, such as a gyroscope.
[0441] Exemplarily, through the judgment in step 103, when it is determined that both the first electronic device and the second electronic device are in the first state, step 104 may be executed. Otherwise, step 108 may be executed.
[0442] 104, if the first electronic device and the second electronic device are currently in the current coupling human body communication mode, remain unchanged; if the first electronic device and the second electronic device are currently in the capacitive coupling human body communication mode, switch to the current coupling human body communication mode.
[0443] It can be understood that the switching between the current coupling human body communication mode and the capacitive coupling human body communication mode is specifically achieved by switching the current coupling human body communication circuit and the capacitive coupling human body communication circuit in the current / capacitive coupling human body communication composite module in the somatosensory operation device. For specific switching details, please refer to Figure 5A , Figure 5B , Figure 5C and Figure 5D The embodiment part will not be repeated here.
[0444] 105. The second electronic device serving as the control end transmits a human body communication signal (a current-coupled human body communication signal or a capacitive-coupled human body communication signal), and the first electronic device serving as the controlled end receives the human body communication signal transmitted by the first electronic device, and records the received signal strength of the human body communication signal received at each moment to obtain a received signal strength waveform.
[0445] It should be noted that, when the electronic device as the controlled end turns on the somatosensory operation function and works in the human body communication mode (current coupling human body communication mode or capacitive coupling human body communication mode), the human body communication signal it transmits can be periodic, such as transmitting for a duration of t2 every t1. It can also be transmitted all the time. This embodiment does not limit this.
[0446] 106. Whether the received signal waveform matches the preset change waveform.
[0447] Among them, the preset change waveform is, for example, Fig.13 , Fig.15 , Fig.17 , Fig.19 , Fig.21 , Fig.23 , Fig.25 The waveform showing the received signal strength changing with time.
[0448] Therefore, the operation of step 106 in this embodiment is specifically to determine whether the waveform of the current received received signal strength changing with time is consistent with Fig.13 , Fig.15 , Fig.17 , Fig.19 , Fig.21 , Fig.23 , Fig.25 matches any of the waveforms shown.
[0449] Exemplarily, if the received signal waveform matches the preset variation waveform, step 107 is performed. Otherwise, the received signal strength may continue to be recorded until the waveform of the recorded received signal strength varying with time matches the preset variation waveform, or the human body communication mode is switched, or the somatosensory operation is exited.
[0450] In addition, it should be noted that the matching mentioned in this embodiment is not limited to the same corresponding received signal strengths of the two at each time point, but requires that the change of the current received signal waveform is the same as the change of the preset change waveform.
[0451] 107 , determining that the user has performed a somatosensory operation, and executing a control instruction of the operation gesture corresponding to the received signal waveform.
[0452] Among them, the recognized operation gestures are, for example, the sliding closer, sliding away, clicking and other operation gestures in scene 1 in the above embodiment, or the clicking operation gesture in scene 2, or the sliding closer, sliding away, clicking and other operation gestures in scene 3.
[0453] 108 , whether the first electronic device is in the first state / second state, and whether the second electronic device is in the second state / first state.
[0454] The second state is, for example, the state of being placed on the desktop as described in scenario 3 in the above embodiment.
[0455] It can be seen from the description of the above embodiments that when two electronic devices that establish a somatosensory operation connection, one is located on the user and the other is located on the desktop, the corresponding scenario is scenario 3. In scenario 3, the first electronic device and the second electronic device need to be in a capacitive coupling human body communication mode, that is, gesture recognition can be achieved based on the capacitive coupling human body communication signal, thereby achieving control of the first electronic device or the second electronic device as the controlled end. When both electronic devices are placed on the desktop, somatosensory operation cannot be achieved based on human body communication technology.
[0456] Therefore, when the first electronic device and the second electronic device are not in the first state at the same time, it is necessary to perform the determination in step 108 .
[0457] Exemplarily, through the judgment of step 108, when it is determined that the first electronic device is in the first state and the second electronic device is in the second state; or the first electronic device is in the second state and the second electronic device is in the first state, step 109 can be executed. Otherwise, it is determined that it does not fall within the scope of the somatosensory operation solution provided in the embodiment of the present application.
[0458] Exemplarily, in one possible implementation, when it is determined that the first electronic device and the second electronic device do not fall within the scope of the somatosensory operation solution provided in the embodiment of the present application, in order to further reduce device power consumption, the first electronic device and the second electronic device can be controlled to automatically exit the somatosensory operation, such as disconnecting the somatosensory operation connection and turning off the somatosensory operation function.
[0459] Exemplarily, in another possible implementation, a somatosensory operation connection between the two may also be maintained.
[0460] 109, if the first electronic device and the second electronic device are currently in the capacitive coupling human body communication mode, remain unchanged; if the first electronic device and the second electronic device are currently in the current coupling human body communication mode, switch to the capacitive coupling human body communication mode.
[0461] It can be understood that the switching between the current coupling human body communication mode and the capacitive coupling human body communication mode is specifically achieved by switching the current coupling human body communication circuit and the capacitive coupling human body communication circuit in the current / capacitive coupling human body communication composite module in the somatosensory operation device. For specific switching details, please refer to Figure 5A , Figure 5B , Figure 5C and Figure 5D The embodiment part will not be repeated here.
[0462] 110, exit the somatosensory operation.
[0463] It should be understood that the above description is only an example listed for a better understanding of the technical solution of this embodiment, and is not the only limitation to this embodiment. For the parts not described in detail in this embodiment, please refer to the above embodiment, and no further description will be given here.
[0464] Therefore, by integrating a somatosensory operation device of a human body communication circuit that can realize the transmission and reception of different human body communication signals in the first electronic device and the second electronic device, and realizing the somatosensory operation function based on the integrated somatosensory operation device, a somatosensory operation connection between the two is established, so that the human body communication mode can be configured for the first electronic device and the second electronic device according to the usage scenario, and then based on the human body communication technology, simple gesture operations such as clicking and sliding can be realized on the first electronic device or the second electronic device without contacting the screen of the first electronic device or the second electronic device, thereby improving the human-computer interaction experience.
[0465] In addition, in order to ensure that the operation gestures made by the user can be accurately identified when the somatosensory operation is realized based on the human body communication technology, the operation gestures supported in the above-mentioned scenes 1, 2 and 3 can be guided when the somatosensory operation function is turned on, so that the user can perform a gesture operation according to the guidance. In this way, the electronic device can know in advance the style of the received signal waveform corresponding to the various gestures made by the user, and then calibrate the preset change waveform based on the received signal waveform corresponding to the various gestures obtained at this stage, so that the preset change waveform in the current electronic device can be better suitable for the user.
[0466] In addition, it should be noted that, in practical applications, as the controlled end, that is, the electronic device for receiving the human body communication signal (current coupling type human body communication signal, or capacitive coupling type human body communication signal), the internal structure of the current / capacitive coupling type human body communication composite module of the somatosensory operation device integrated therein can be as follows: Figure 3B As shown, it can also be Figure 4 As shown, this application does not limit this.
[0467] Accordingly, as the control end, that is, the electronic device for transmitting and receiving human body communication signals (current coupling human body communication signals, or capacitive coupling human body communication signals), the internal structure of the current / capacitive coupling human body communication composite module of the somatosensory operation device integrated therein can be as follows: Figure 3A As shown, it can also be Figure 4 As shown, this application does not limit this.
[0468] In addition, it is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.
[0469] In addition, it should be noted that the somatosensory operation methods provided by the above embodiments implemented by electronic devices in actual application scenarios can also be performed by a chip system included in the electronic device, wherein the chip system may include a processor. The chip system can be coupled to a memory so that the chip system calls a computer program stored in the memory when it is running to implement the steps performed by the above electronic device. The processor in the chip system can be an application processor or a processor other than an application processor.
[0470] In addition, an embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the somatosensory operation method in the above-mentioned embodiment.
[0471] In addition, an embodiment of the present application further provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the above-mentioned related steps to implement the somatosensory operation method in the above-mentioned embodiment.
[0472] In addition, an embodiment of the present application also provides a chip (which may also be a component or module), which may include one or more processing circuits and one or more transceiver pins; wherein the transceiver pins and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the above-mentioned related method steps to implement the somatosensory operation method in the above-mentioned embodiment, so as to control the receiving pin to receive the signal, so as to control the sending pin to send the signal.
[0473] In addition, it can be seen from the above description that the electronic device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0474] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A somatosensory operating system, characterized in that: include: A first electronic device and a second electronic device, wherein the first electronic device and the second electronic device start a human body communication mode; The second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently turned on human body communication mode; The first electronic device is used to receive the human body communication signal transmitted by the second electronic device, and record the received signal strength corresponding to the human body communication signal received at each moment to obtain a received signal strength variation waveform; The first electronic device is used to determine the target operation gesture corresponding to the received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture when the received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms; The first electronic device is used to execute the control instruction corresponding to the target operation gesture.
2. The system according to claim 1, characterized in that The human body communication mode includes a capacitive coupling type human body communication mode and a current coupling type human body communication mode; Wherein, when the type of the human body communication mode currently turned on by the second electronic device is the capacitive coupling human body communication mode, the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: The second electronic device is used to transmit the capacitive coupling human body communication signal to the first electronic device; The first electronic device is used to receive the human body communication signal transmitted by the second electronic device, and record the received signal strength corresponding to the human body communication signal received at each moment, to obtain a received signal strength change waveform, including: The first electronic device is used to receive the capacitive coupling human body communication signal transmitted by the second electronic device, and record the capacitance receiving signal strength corresponding to the capacitive coupling human body communication signal received at each moment, to obtain a capacitance receiving signal strength variation waveform; Wherein, when the type of the human body communication mode currently turned on by the second electronic device is the current coupling type human body communication mode, the second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: The second electronic device is used to transmit the current-coupled human body communication signal to the first electronic device; The first electronic device is used to receive the human body communication signal transmitted by the second electronic device, and record the received signal strength corresponding to the human body communication signal received at each moment, to obtain a received signal strength change waveform, including: The first electronic device is used to receive the current-coupled human body communication signal transmitted by the second electronic device, and record the current receiving signal strength corresponding to the current-coupled human body communication signal received at each moment to obtain a current receiving signal strength variation waveform.
3. The system according to claim 2, characterized in that A second somatosensory operation device is integrated in the second electronic device, the second somatosensory operation device includes a human body communication transmitting circuit for transmitting a human body communication signal, the human body communication transmitting circuit includes a capacitive coupling type human body communication transmitting circuit and a current coupling type human body communication transmitting circuit; The second electronic device is used to transmit the capacitive coupling human body communication signal to the first electronic device, including: The second electronic device turns on the capacitive coupling type human body communication transmitting circuit and turns off the current coupling type human body communication transmitting circuit; The second electronic device is used to transmit the capacitive coupling type human body communication signal to the first electronic device through the capacitive coupling type human body communication transmitting circuit; Wherein, the second electronic device is used to transmit the current-coupled human body communication signal to the first electronic device, including: The second electronic device is used to turn on the current coupling type human body communication transmitting circuit and turn off the capacitive coupling type human body communication transmitting circuit; The second electronic device is used to transmit the current-coupled human body communication signal to the first electronic device through the current-coupled human body communication transmitting circuit.
4. The system according to claim 3, characterized in that The second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, wherein the current / capacitive coupling type human body communication composite module includes a human body communication module, a circuit switching switch, a voltage drive amplifier and a current drive amplifier; The second electronic device is used to turn on the capacitive coupling type human body communication transmitting circuit and turn off the current coupling type human body communication transmitting circuit, and includes: The second electronic device is used to switch the circuit switch to connect the human body communication module to the voltage drive amplifier and disconnect the human body communication module from the current drive amplifier; The second electronic device is used to connect the first port of the voltage-driven amplifier to the first port of the current / capacitive coupling type human body communication composite module, and the second port of the voltage-driven amplifier to the second port of the current / capacitive coupling type human body communication composite module; The second electronic device is used to disconnect the first port of the current drive amplifier from the third port of the current / capacitive coupling type human body communication composite module, and disconnect the second port of the current drive amplifier from the fourth port of the current / capacitive coupling type human body communication composite module; The second electronic device is used to conduct the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, conduct the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnect the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnect the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode through the electrode switching module.
5. The system according to claim 3, characterized in that The second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, wherein the current / capacitive coupling type human body communication composite module includes a human body communication module, a circuit switching switch, a voltage drive amplifier and a current drive amplifier; The second electronic device is used to turn on the current coupling type human body communication transmitting circuit and disconnect the capacitive coupling type human body communication transmitting circuit, and includes: The second electronic device is used to switch the circuit switch to connect the human body communication module to the current drive amplifier and disconnect the human body communication module from the voltage drive amplifier; The second electronic device is used to connect the first port of the current drive amplifier to the third port of the current / capacitive coupling type human body communication composite module, and the second port of the current drive amplifier to the fourth port of the current / capacitive coupling type human body communication composite module; The second electronic device is used to disconnect the first port of the voltage-driven amplifier from the first port of the current / capacitive coupling type human body communication composite module, and disconnect the second port of the voltage-driven amplifier from the second port of the current / capacitive coupling type human body communication composite module; The second electronic device is used to conduct the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, conduct the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnect the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnect the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode through the electrode switching module.
6. The system according to claim 2, characterized in that The first electronic device is integrated with a first somatosensory operation device, the first somatosensory operation device includes a human body communication receiving circuit for receiving a human body communication signal, the human body communication receiving circuit includes a capacitive coupling type human body communication receiving circuit and a current coupling type human body communication receiving circuit; The first electronic device is used to receive the capacitive coupling human body communication signal transmitted by the second electronic device, including: The first electronic device is used to turn on the capacitive coupling type human body communication receiving circuit and turn off the current coupling type human body communication receiving circuit; The first electronic device is used to receive the capacitive coupling type human body communication signal transmitted by the second electronic device through the capacitive coupling type human body communication receiving circuit; Wherein, the first electronic device is used to receive the current-coupled human body communication signal transmitted by the second electronic device, including: The first electronic device is used to turn on the current coupling type human body communication receiving circuit and turn off the capacitive coupling type human body communication receiving circuit; The first electronic device is used to receive the current-coupled human body communication signal transmitted by the second electronic device through the current-coupled human body communication receiving circuit.
7. The system according to claim 6, characterized in that The first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module is connected to the receiving circuit; The first electronic device is used to turn on the capacitive coupling type human body communication receiving circuit and turn off the current coupling type human body communication receiving circuit, and includes: The first electronic device is used to connect the first port of the receiving circuit to the first port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit to the second port of the current / capacitive coupling type human body communication composite module; The first electronic device is used to conduct the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, conduct the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnect the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnect the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode through the electrode switching module.
8. The system according to claim 6, characterized in that The first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module is connected to the receiving circuit; The first electronic device is used to turn on the current coupling type human body communication receiving circuit and turn off the capacitive coupling type human body communication receiving circuit, and includes: The first electronic device is used to connect the first port of the receiving circuit to the third port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit to the fourth port of the current / capacitive coupling type human body communication composite module; The first electronic device is used to conduct the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, conduct the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnect the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnect the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode through the electrode switching module.
9. The system according to any one of claims 1 to 8, characterized in that: The first electronic device and the second electronic device are both in a first state; The second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently enabled human body communication mode, including: When the type of the human body communication mode currently turned on by the second electronic device is a capacitive coupling human body communication mode, the second electronic device is used to switch the human body communication mode from the capacitive coupling human body communication mode to the current coupling human body communication mode, and transmit a current coupling human body communication signal to the first electronic device; When the type of the human body communication mode currently turned on by the second electronic device is the current coupling type human body communication mode, the second electronic device is used to maintain the current coupling type human body communication mode and transmit the current coupling type human body communication signal to the first electronic device.
10. The system according to claim 9, characterized in that The first state is a wearing state or a holding state; The first electronic device and the second electronic device are both in a first state, including: The first electronic device and the second electronic device are respectively worn or held by different limbs of the user; When the first electronic device and the second electronic device are respectively worn or held by different limbs of the user, the first electronic device is used to: Matching the obtained current received signal strength variation waveform with a first preset variation waveform in the preset variation waveforms, wherein the first preset variation waveform is a waveform of the current received signal strength corresponding to the sliding approach operation gesture made in a first scenario with actual variation, wherein the first scenario is a scenario in which the first electronic device and the second electronic device are worn or held by different limbs of the user, and the first electronic device and the second electronic device are in a current coupled human body communication mode; When the current received signal strength variation waveform matches the first preset variation waveform, determining, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the current received signal strength variation waveform is a sliding approach operation gesture; When the current received signal strength change waveform does not match the first preset change waveform, matching the current received signal strength change waveform with a second preset change waveform in the preset change waveforms, where the second preset change waveform is a waveform of the current received signal strength corresponding to the slide away operation gesture made in the first scenario with actual change; When the current received signal strength variation waveform matches the second preset variation waveform, determining, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the current received signal strength variation waveform is a slide away operation gesture; When the current received signal strength change waveform does not match the second preset change waveform, matching the current received signal strength change waveform with a third preset change waveform in the preset change waveforms, wherein the third preset change waveform is a waveform of the current received signal strength corresponding to the click operation gesture made in the first scenario with actual change; When the current received signal strength variation waveform matches the third preset variation waveform, the target gesture corresponding to the current received signal strength variation waveform is determined to be a click operation gesture according to a mapping relationship between the preset variation waveform and the operation gesture.
11. The system according to claim 9, characterized in that The first state is a wearing state or a holding state; The first electronic device and the second electronic device are both in a first state, including: The first electronic device and the second electronic device are respectively worn or held by the same limb of the user; Wherein, when the first electronic device and the second electronic device are worn or held by the same limb of the user, the first electronic device is used to: Matching the obtained current receiving signal strength variation waveform with a fourth preset variation waveform in the preset variation waveforms, wherein the fourth preset variation waveform is a waveform of the current receiving signal strength corresponding to the click operation gesture made in a second scenario with actual variation, wherein the second scenario is a scenario in which the first electronic device and the second electronic device are worn or held by the same limb of the user, and the first electronic device and the second electronic device are in a current coupling human body communication mode; When the current received signal strength variation waveform matches the fourth preset variation waveform, the target gesture corresponding to the current received signal strength variation waveform is determined to be a click operation gesture according to a mapping relationship between the preset variation waveform and the operation gesture.
12. The system according to any one of claims 1 to 8, characterized in that: One of the first electronic device and the second electronic device is in a first state and the other is in a second state, and the first state and the second state are different states; The second electronic device is used to transmit a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently enabled human body communication mode, including: When the type of the human body communication mode currently turned on by the second electronic device is the current coupling human body communication mode, the second electronic device is used to switch the human body communication mode from the current coupling human body communication mode to the capacitive coupling human body communication mode, and transmit a capacitive coupling human body communication signal to the first electronic device; When the type of the human body communication mode currently turned on by the second electronic device is the capacitive coupling human body communication mode, the second electronic device is used to maintain the capacitive coupling human body communication mode and transmit the capacitive coupling human body communication signal to the first electronic device.
13. The system according to claim 12, characterized in that The first state is a wearing state or a holding state, and the second state is a state of being placed on an object; The first electronic device and the second electronic device are in a first state and a second state, respectively, including: The first electronic device is in the second state, and the second electronic device is in the first state; When the first electronic device is in the second state and the second electronic device is in the first state, the first electronic device is used to: Matching the obtained capacitance received signal strength change waveform with a fifth preset change waveform in the preset change waveforms, where the fifth preset change waveform is a waveform of capacitance received signal strength corresponding to a sliding approach operation gesture made in a third scenario with actual change, where the third scenario is a scenario where the first electronic device is in the second state, the second electronic device is in the first state, and the first electronic device and the second electronic device are in a capacitive coupling human body communication mode; When the capacitance received signal strength variation waveform matches the fifth preset variation waveform, determining, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the capacitance received signal strength variation waveform is a sliding approach operation gesture; When the capacitance received signal strength change waveform does not match the fifth preset change waveform, matching the capacitance received signal strength change waveform with a sixth preset change waveform in the preset change waveforms, where the sixth preset change waveform is a waveform of the capacitance received signal strength corresponding to the sliding away operation gesture made in the third scenario with actual change; When the capacitance received signal strength variation waveform matches the sixth preset variation waveform, determining, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the capacitance received signal strength variation waveform is a slide away operation gesture; When the capacitance received signal strength change waveform does not match the sixth preset change waveform, matching the capacitance received signal strength change waveform with a seventh preset change waveform in the preset change waveforms, where the seventh preset change waveform is a waveform of the capacitance received signal strength corresponding to the click operation gesture made in the third scenario with actual change; When the capacitance received signal strength variation waveform matches the seventh preset variation waveform, the target gesture corresponding to the capacitance received signal strength variation waveform is determined to be a click operation gesture according to a mapping relationship between the preset variation waveform and the operation gesture.
14. The system according to any one of claims 1 to 13, characterized in that: The first electronic device is further used for: When the received signal strength variation waveform is obtained, sending the received signal strength variation waveform to the second electronic device; The second electronic device is further used for: receiving the received signal strength change waveform sent by the first electronic device; When the received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms, determining the target operation gesture corresponding to the received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; Sending a control instruction corresponding to the target operation gesture to the first electronic device; The first electronic device is further used for: Receiving an operation instruction corresponding to the target operation gesture sent by the second electronic device; Execute the control instruction corresponding to the target operation gesture.
15. The system according to any one of claims 1 to 13, characterized in that: The first somatosensory operation device integrated in the first electronic device further includes a human body communication transmitting circuit for transmitting a human body communication signal, wherein the human body communication transmitting circuit includes a capacitive coupling type human body communication transmitting circuit and a current coupling type human body communication transmitting circuit; The second body operating device integrated in the second electronic device further includes a human body communication transmitting circuit for receiving a human body communication signal, and the human body communication receiving circuit includes a capacitive coupling type human body communication receiving circuit and a current coupling type human body communication receiving circuit; The first electronic device is further used for: When the current-coupled human body communication transmitting circuit is turned on and the capacitive-coupled human body communication transmitting circuit, the current-coupled human body communication receiving circuit and the capacitive-coupled human body communication receiving circuit are turned off, transmitting the current-coupled human body communication signal to the second electronic device; The second electronic device is further used for: When the current-coupled human body receiving circuit is turned on and the current-coupled human body communication transmitting circuit, the capacitive-coupled human body transmitting circuit, and the capacitive-coupled human body communication receiving circuit are turned off, the current-coupled human body communication signal transmitted by the first electronic device is received, and the received signal strength corresponding to the current-coupled human body communication signal received at each moment is recorded to obtain a current received signal strength variation waveform; When the current received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms, determining a target operation gesture corresponding to the current received signal strength variation waveform according to a mapping relationship between the preset variation waveform and the operation gesture; Execute the control instruction corresponding to the target operation gesture.
16. The system according to claim 15, characterized in that The second electronic device is further used for: When the current received signal strength variation waveform is obtained, sending the current received signal strength variation waveform to the first electronic device; The first electronic device is further used for: receiving the current receiving signal strength change waveform sent by the second electronic device; When the current received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms, determining a target operation gesture corresponding to the current received signal strength variation waveform according to a mapping relationship between the preset variation waveform and the operation gesture; Sending a control instruction corresponding to the target operation gesture to the second electronic device; The second electronic device is further used for: Receiving an operation instruction corresponding to the target operation gesture sent by the first electronic device; Execute the control instruction corresponding to the target operation gesture.
17. The system according to claim 15, characterized in that The first electronic device is further used for: When the capacitive coupling type human body communication transmitting circuit is turned on, and the current coupling type human body communication transmitting circuit, the current coupling type human body communication receiving circuit, and the capacitive coupling type human body communication receiving circuit are turned off, transmitting the capacitive coupling type human body communication signal to the second electronic device; The second electronic device is further used for: When the capacitive coupling type human body receiving circuit is turned on and the current coupling type human body communication transmitting circuit, the capacitive coupling type human body transmitting circuit and the current coupling type human body communication receiving circuit are turned off, the capacitive coupling type human body communication signal transmitted by the first electronic device is received, and the received signal strength corresponding to the capacitive coupling type human body communication signal received at each moment is recorded to obtain a capacitive received signal strength variation waveform; When the capacitance received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms, determining the target operation gesture corresponding to the capacitance received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; Execute the control instruction corresponding to the target operation gesture.
18. The system according to claim 17, characterized in that The second electronic device is further used for: When the capacitance received signal strength variation waveform is obtained, sending the capacitance received signal strength variation waveform to the first electronic device; The first electronic device is further used for: receiving the capacitance receiving signal strength change waveform sent by the second electronic device; When the capacitance received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms, determining the target operation gesture corresponding to the capacitance received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; Sending a control instruction corresponding to the target operation gesture to the second electronic device; The second electronic device is further used for: Receiving an operation instruction corresponding to the target operation gesture sent by the first electronic device; Execute the control instruction corresponding to the target operation gesture.
19. A somatosensory operation method, characterized in that: Applied to a somatosensory operating system, the system comprises: a first electronic device and a second electronic device, wherein the first electronic device and the second electronic device are in a human body communication mode; The method comprises: The second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently enabled human body communication mode; The first electronic device receives the human body communication signal transmitted by the second electronic device, and records the received signal strength corresponding to the human body communication signal received at each moment, to obtain a received signal strength variation waveform; When the received signal strength variation waveform matches any preset variation waveform, the first electronic device determines the target operation gesture corresponding to the received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; The first electronic device executes the control instruction corresponding to the target operation gesture.
20. The method according to claim 19, characterized in that The human body communication mode includes a capacitive coupling type human body communication mode and a current coupling type human body communication mode; Wherein, when the type of the human body communication mode currently turned on by the second electronic device is the capacitive coupling human body communication mode, the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: The second electronic device transmits the capacitive coupling human body communication signal to the first electronic device; The first electronic device receives the human body communication signal transmitted by the second electronic device, and records the received signal strength corresponding to the human body communication signal received at each moment, to obtain a received signal strength variation waveform, including: The first electronic device receives the capacitive coupling human body communication signal transmitted by the second electronic device, and records the capacitance receiving signal strength corresponding to the capacitive coupling human body communication signal received at each moment, to obtain a capacitance receiving signal strength variation waveform; Wherein, when the type of the human body communication mode currently turned on by the second electronic device is the current coupling type human body communication mode, the second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the human body communication mode currently turned on, including: The second electronic device transmits the current-coupled human body communication signal to the first electronic device; The first electronic device receives the human body communication signal transmitted by the second electronic device, and records the received signal strength corresponding to the human body communication signal received at each moment, to obtain a received signal strength variation waveform, including: The first electronic device receives the current-coupled human body communication signal transmitted by the second electronic device, and records the current receiving signal strength corresponding to the current-coupled human body communication signal received at each moment, to obtain a current receiving signal strength variation waveform.
21. The method according to claim 20, characterized in that A second somatosensory operation device is integrated in the second electronic device, the second somatosensory operation device includes a human body communication transmitting circuit for transmitting a human body communication signal, the human body communication transmitting circuit includes a capacitive coupling type human body communication transmitting circuit and a current coupling type human body communication transmitting circuit; The second electronic device transmitting the capacitive coupling human body communication signal to the first electronic device includes: The second electronic device turns on the capacitive coupling type human body communication transmitting circuit and turns off the current coupling type human body communication transmitting circuit; The second electronic device transmits the capacitive coupling type human body communication signal to the first electronic device through the capacitive coupling type human body communication transmitting circuit; The second electronic device transmitting the current-coupled human body communication signal to the first electronic device includes: The second electronic device turns on the current coupling type human body communication transmitting circuit and turns off the capacitive coupling type human body communication transmitting circuit; The second electronic device transmits the current-coupled human body communication signal to the first electronic device through the current-coupled human body communication transmitting circuit.
22. The method according to claim 21, characterized in that The second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, wherein the current / capacitive coupling type human body communication composite module includes a human body communication module, a circuit switching switch, a voltage drive amplifier and a current drive amplifier; The second electronic device turns on the capacitive coupling type human body communication transmitting circuit and turns off the current coupling type human body communication transmitting circuit, including: The second electronic device switches on the connection between the human body communication module and the voltage drive amplifier and disconnects the connection between the human body communication module and the current drive amplifier through the circuit switching switch; The second electronic device connects the first port of the voltage-driven amplifier to the first port of the current / capacitive coupling type human body communication composite module, and the second port of the voltage-driven amplifier to the second port of the current / capacitive coupling type human body communication composite module; The second electronic device disconnects the first port of the current drive amplifier from the third port of the current / capacitive coupling type human body communication composite module, and disconnects the second port of the current drive amplifier from the fourth port of the current / capacitive coupling type human body communication composite module; The second electronic device, through the electrode switching module, conducts the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, conducts the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnects the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnects the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode.
23. The method according to claim 21, characterized in that The second somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, wherein the current / capacitive coupling type human body communication composite module includes a human body communication module, a circuit switching switch, a voltage drive amplifier and a current drive amplifier; The second electronic device turns on the current coupling type human body communication transmitting circuit and turns off the capacitive coupling type human body communication transmitting circuit, including: The second electronic device switches on the connection between the human body communication module and the current drive amplifier and disconnects the connection between the human body communication module and the voltage drive amplifier through the circuit switching switch; The second electronic device connects the first port of the current drive amplifier to the third port of the current / capacitive coupling type human body communication composite module, and the second port of the current drive amplifier to the fourth port of the current / capacitive coupling type human body communication composite module; The second electronic device disconnects the first port of the voltage-driven amplifier from the first port of the current / capacitive coupling type human body communication composite module, and disconnects the second port of the voltage-driven amplifier from the second port of the current / capacitive coupling type human body communication composite module; The second electronic device, through the electrode switching module, conducts the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, conducts the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnects the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnects the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode.
24. The method according to claim 20, characterized in that The first electronic device is integrated with a first somatosensory operation device, the first somatosensory operation device includes a human body communication receiving circuit for receiving a human body communication signal, the human body communication receiving circuit includes a capacitive coupling type human body communication receiving circuit and a current coupling type human body communication receiving circuit; The first electronic device receives the capacitive coupling human body communication signal transmitted by the second electronic device, including: The first electronic device turns on the capacitive coupling type human body communication receiving circuit and turns off the current coupling type human body communication receiving circuit; The first electronic device receives the capacitive coupling type human body communication signal transmitted by the second electronic device through the capacitive coupling type human body communication receiving circuit; The first electronic device receives the current-coupled human body communication signal transmitted by the second electronic device, including: The first electronic device is used to turn on the current coupling type human body communication receiving circuit and turn off the capacitive coupling type human body communication receiving circuit; The first electronic device receives the current-coupled human body communication signal transmitted by the second electronic device through the current-coupled human body communication receiving circuit.
25. The method according to claim 24, characterized in that The first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module is connected to the receiving circuit; The first electronic device turns on the capacitive coupling type human body communication receiving circuit and turns off the current coupling type human body communication receiving circuit, including: The first electronic device connects the first port of the receiving circuit to the first port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit to the second port of the current / capacitive coupling type human body communication composite module; The first electronic device, through the electrode switching module, conducts the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, conducts the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode, disconnects the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, and disconnects the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode.
26. The method according to claim 24, characterized in that The first somatosensory operation device includes a first electrode, a second electrode, a third electrode, an electrode switching module and a current / capacitive coupling type human body communication composite module, the current / capacitive coupling type human body communication composite module includes a human body communication module and a receiving circuit, and the human body communication module is connected to the receiving circuit; The first electronic device turns on the current coupling type human body communication receiving circuit and turns off the capacitive coupling type human body communication receiving circuit, including: The first electronic device connects the first port of the receiving circuit to the third port of the current / capacitive coupling type human body communication composite module, and the second port of the receiving circuit to the fourth port of the current / capacitive coupling type human body communication composite module; The first electronic device, through the electrode switching module, conducts the connection between the third port of the current / capacitive coupling type human body communication composite module and the second electrode, conducts the connection between the fourth port of the current / capacitive coupling type human body communication composite module and the third electrode, disconnects the connection between the first port of the current / capacitive coupling type human body communication composite module and the first electrode, and disconnects the connection between the second port of the current / capacitive coupling type human body communication composite module and the second electrode.
27. The method according to any one of claims 19 to 26, characterized in that The first electronic device and the second electronic device are both in a first state; The second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently enabled human body communication mode, including: When the type of the human body communication mode currently turned on by the second electronic device is a capacitive coupling human body communication mode, the second electronic device switches the human body communication mode from the capacitive coupling human body communication mode to a current coupling human body communication mode, and transmits a current coupling human body communication signal to the first electronic device; When the type of the human body communication mode currently turned on by the second electronic device is the current coupling type human body communication mode, the second electronic device maintains the current coupling type human body communication mode and transmits the current coupling type human body communication signal to the first electronic device.
28. The method according to claim 27, characterized in that The first state is a wearing state or a holding state; The first electronic device and the second electronic device are both in a first state, including: The first electronic device and the second electronic device are respectively worn or held by different limbs of the user; Wherein, when the first electronic device and the second electronic device are respectively worn or held by different limbs of the user, the method further includes: The first electronic device matches the obtained current receiving signal strength variation waveform with a first preset variation waveform in the preset variation waveforms, where the first preset variation waveform is a waveform of the current receiving signal strength corresponding to the sliding approach operation gesture made in a first scenario with actual variation, where the first scenario is a scenario where the first electronic device and the second electronic device are worn or held by different limbs of the user, and the first electronic device and the second electronic device are in a current coupling human body communication mode; When the current received signal strength variation waveform matches the first preset variation waveform, the first electronic device determines, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the current received signal strength variation waveform is a sliding approach operation gesture; When the current received signal strength variation waveform does not match the first preset variation waveform, the first electronic device matches the current received signal strength variation waveform with a second preset variation waveform in the preset variation waveforms, where the second preset variation waveform is a waveform of the current received signal strength corresponding to the slide away operation gesture made in the first scenario with actual variation; When the current received signal strength variation waveform matches the second preset variation waveform, the first electronic device determines, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the current received signal strength variation waveform is a slide away operation gesture; When the current received signal strength variation waveform does not match the second preset variation waveform, the first electronic device matches the current received signal strength variation waveform with a third preset variation waveform among the preset variation waveforms, wherein the third preset variation waveform is a waveform of the current received signal strength corresponding to the click operation gesture made in the first scenario with actual variation; When the current received signal strength variation waveform matches the third preset variation waveform, the first electronic device determines that the target gesture corresponding to the current received signal strength variation waveform is a click operation gesture according to a mapping relationship between the preset variation waveform and the operation gesture.
29. The method according to claim 27, characterized in that The first state is a wearing state or a holding state; The first electronic device and the second electronic device are both in a first state, including: The first electronic device and the second electronic device are respectively worn or held by the same limb of the user; Wherein, when the first electronic device and the second electronic device are worn or held by the same limb of the user, the method further includes: The first electronic device matches the obtained current receiving signal strength variation waveform with a fourth preset variation waveform in the preset variation waveforms, where the fourth preset variation waveform is a waveform of the current receiving signal strength corresponding to the click operation gesture made in a second scenario with actual variation, where the second scenario is a scenario in which the first electronic device and the second electronic device are worn or held by the same limb of the user, and the first electronic device and the second electronic device are in a current coupling human body communication mode; When the current received signal strength variation waveform matches the fourth preset variation waveform, the first electronic device determines that the target gesture corresponding to the current received signal strength variation waveform is a click operation gesture according to a mapping relationship between the preset variation waveform and the operation gesture.
30. The method according to any one of claims 19 to 26, characterized in that One of the first electronic device and the second electronic device is in a first state and the other is in a second state, and the first state and the second state are different states; The second electronic device transmits a human body communication signal corresponding to the human body communication mode to the first electronic device according to the type of the currently enabled human body communication mode, including: When the type of the human body communication mode currently turned on by the second electronic device is the current coupling human body communication mode, the second electronic device switches the human body communication mode from the current coupling human body communication mode to the capacitive coupling human body communication mode, and transmits a capacitive coupling human body communication signal to the first electronic device; When the type of the human body communication mode currently turned on by the second electronic device is the capacitive coupling human body communication mode, the second electronic device maintains the capacitive coupling human body communication mode and transmits the capacitive coupling human body communication signal to the first electronic device.
31. The method according to claim 30, characterized in that The first state is a wearing state or a holding state, and the second state is a state of being placed on an object; The first electronic device and the second electronic device are in a first state and a second state, respectively, including: The first electronic device is in the second state, and the second electronic device is in the first state; Wherein, when the first electronic device is in the second state and the second electronic device is in the first state, the method further includes: The first electronic device matches the obtained capacitance received signal strength variation waveform with a fifth preset variation waveform in the preset variation waveforms, where the fifth preset variation waveform is a waveform of capacitance received signal strength corresponding to a sliding approach operation gesture made in a third scenario with actual variation, where the third scenario is a scenario where the first electronic device is in the second state, the second electronic device is in the first state, and the first electronic device and the second electronic device are in a capacitive coupling human body communication mode; When the capacitance received signal strength variation waveform matches the fifth preset variation waveform, the first electronic device determines, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the capacitance received signal strength variation waveform is a sliding approach operation gesture; When the capacitance received signal strength variation waveform does not match the fifth preset variation waveform, the first electronic device matches the capacitance received signal strength variation waveform with a sixth preset variation waveform among the preset variation waveforms, where the sixth preset variation waveform is a waveform of the capacitance received signal strength corresponding to the sliding away operation gesture made in the third scenario with actual variation; When the capacitance received signal strength variation waveform matches the sixth preset variation waveform, the first electronic device determines, according to a mapping relationship between the preset variation waveform and the operation gesture, that the target gesture corresponding to the capacitance received signal strength variation waveform is a slide away operation gesture; When the capacitance received signal strength variation waveform does not match the sixth preset variation waveform, the first electronic device matches the capacitance received signal strength variation waveform with a seventh preset variation waveform among the preset variation waveforms, where the seventh preset variation waveform is a waveform of the capacitance received signal strength corresponding to the click operation gesture made in the third scenario with actual variation; When the capacitance received signal strength variation waveform matches the seventh preset variation waveform, the first electronic device determines that the target gesture corresponding to the capacitance received signal strength variation waveform is a click operation gesture according to a mapping relationship between the preset variation waveform and the operation gesture.
32. The method according to any one of claims 19 to 31, characterized in that The method further comprises: When the first electronic device obtains the received signal strength variation waveform, the first electronic device sends the received signal strength variation waveform to the second electronic device; The second electronic device receives the received signal strength change waveform sent by the first electronic device; When the received signal strength variation waveform matches any preset variation waveform, the second electronic device determines the target operation gesture corresponding to the received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; The second electronic device sends a control instruction corresponding to the target operation gesture to the first electronic device; The first electronic device receives an operation instruction corresponding to the target operation gesture sent by the second electronic device; The first electronic device executes the control instruction corresponding to the target operation gesture.
33. The method according to any one of claims 19 to 31, characterized in that The first somatosensory operation device integrated in the first electronic device further includes a human body communication transmitting circuit for transmitting a human body communication signal, wherein the human body communication transmitting circuit includes a capacitive coupling type human body communication transmitting circuit and a current coupling type human body communication transmitting circuit; The second body operating device integrated in the second electronic device further includes a human body communication transmitting circuit for receiving a human body communication signal, and the human body communication receiving circuit includes a capacitive coupling type human body communication receiving circuit and a current coupling type human body communication receiving circuit; The method further comprises: The first electronic device transmits the current-coupled human body communication signal to the second electronic device when the current-coupled human body communication transmitting circuit is turned on and the capacitive-coupled human body communication transmitting circuit, the current-coupled human body communication receiving circuit and the capacitive-coupled human body communication receiving circuit are turned off; The second electronic device receives the current-coupled human body communication signal transmitted by the first electronic device when the current-coupled human body receiving circuit is turned on and the current-coupled human body communication transmitting circuit, the capacitive-coupled human body transmitting circuit and the capacitive-coupled human body communication receiving circuit are turned off, and records the received signal strength corresponding to the current-coupled human body communication signal received at each moment to obtain a current received signal strength variation waveform; When the current received signal strength variation waveform matches any preset variation waveform, the second electronic device determines the target operation gesture corresponding to the current received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; The second electronic device executes the control instruction corresponding to the target operation gesture.
34. The method according to claim 33, characterized in that The method further comprises: When the second electronic device obtains the current received signal strength variation waveform, the second electronic device sends the current received signal strength variation waveform to the first electronic device; The first electronic device receives the current receiving signal strength variation waveform sent by the second electronic device; When the current received signal strength variation waveform matches any preset variation waveform, the first electronic device determines the target operation gesture corresponding to the current received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; The first electronic device sends a control instruction corresponding to the target operation gesture to the second electronic device; The second electronic device receives the operation instruction corresponding to the target operation gesture sent by the first electronic device; The second electronic device executes the control instruction corresponding to the target operation gesture.
35. The method according to claim 33, characterized in that The method further comprises: The first electronic device transmits the capacitive coupling type human body communication signal to the second electronic device when the capacitive coupling type human body communication transmitting circuit is turned on and the current coupling type human body transmitting circuit, the current coupling type human body communication receiving circuit and the capacitive coupling type human body communication receiving circuit are turned off; The second electronic device receives the capacitive coupling type human body communication signal transmitted by the first electronic device when the capacitive coupling type human body receiving circuit is turned on and the current coupling type human body communication transmitting circuit, the capacitive coupling type human body transmitting circuit and the current coupling type human body communication receiving circuit are turned off, and records the received signal strength corresponding to the capacitive coupling type human body communication signal received at each moment to obtain a capacitive received signal strength variation waveform; When the capacitance receiving signal strength variation waveform matches any preset variation waveform, the second electronic device determines the target operation gesture corresponding to the capacitance receiving signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; The second electronic device executes the control instruction corresponding to the target operation gesture.
36. The method according to claim 35, characterized in that The method further comprises: When the second electronic device obtains the capacitance received signal strength variation waveform, the second electronic device sends the capacitance received signal strength variation waveform to the first electronic device; The first electronic device receives the capacitance receiving signal strength variation waveform sent by the second electronic device; When the capacitance received signal strength variation waveform matches any preset variation waveform among the preset variation waveforms, the first electronic device determines the target operation gesture corresponding to the capacitance received signal strength variation waveform according to the mapping relationship between the preset variation waveform and the operation gesture; The first electronic device sends a control instruction corresponding to the target operation gesture to the second electronic device; The second electronic device receives the operation instruction corresponding to the target operation gesture sent by the first electronic device; The second electronic device executes the control instruction corresponding to the target operation gesture.
37. An electronic device, characterized in that: The electronic device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the somatosensory operation method as described in any one of claims 19 to 36.
38. A computer-readable storage medium, characterized in that: It includes a computer program, which, when running on an electronic device, enables the electronic device to execute the somatosensory operation method as described in any one of claims 19 to 36.
Citation Information
Patent Citations
Digital multimedia broadcast receiver and receiving method using human body antenna
CN101208950A
Transmitter, receiver and method thereof in human body communicatoin system
CN102695047A
Composite electrode suitable for current / capacitance coupling type human body communication
CN110932793A
Detection circuit, wearable device detection method and wearable device
CN112568906A
Gesture interaction method, device and system, wearable equipment and storage medium
CN114661161A