Man-machine interaction method, electronic equipment and communication system

Abstract

The invention discloses a man-machine interaction method, electronic equipment and a communication system, relates to the technical field of terminals, and can provide more convenient, low-power-consumption and humanized man-machine interaction experience for a user. According to the scheme, the man-machine interaction instruction of the user can be automatically obtained based on the multiple wearable devices worn by the user without additional control equipment. For example, a first wearable device can send out an electric signal, the electric signal can be transmitted to a second wearable device through one or more channels of a human body, and the second wearable device can identify the limb movement of a user when the first wearable device sends out the electric signal by analyzing the signal characteristics of the received signal transmitted by the one or more channels. And further responding to the limb movement.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a human-computer interaction method, electronic equipment and communication system. Background Art

[0002] With the rapid development of hardware and software of terminal electronic products, the ways in which users interact with electronic devices are becoming more and more diverse, including traditional interaction methods through mouse and keyboard, or touch interaction, button interaction, voice interaction, gesture interaction, body interaction and other interaction methods.

[0003] However, the existing human-computer interaction methods all have certain shortcomings to a greater or lesser extent. For example, the touch interaction method requires the user to hold an electronic device including a touch screen, so the hands cannot be freed; for another example, the key interaction method requires the user to hold an electronic device including keys, so the hands cannot be freed; for another example, in a noisy environment, the voice commands of the voice interaction method are easily disturbed by the surrounding environment, and there will be privacy issues or problems of disturbing others in public places. Therefore, the existing human-computer interaction methods do not provide a good experience for users. Summary of the invention

[0004] The present application provides a human-computer interaction method, an electronic device, and a communication system, which can realize human-computer interaction through more convenient, low-power, and humanized bare-hand operation, thereby improving user experience.

[0005] In order to achieve the above objectives, this application adopts the following technical solutions:

[0006] In a first aspect, a human-computer interaction method is provided, which is applied to a second wearable device, and the method includes: the second wearable device receives one or more received signals corresponding to a first electrical signal from a first wearable device; the second wearable device obtains signal characteristics of the one or more received signals corresponding to the first electrical signal; the second wearable device determines a first action of the user when the first wearable device sends a first electrical signal based on the signal characteristics of the one or more received signals corresponding to the first electrical signal.

[0007] As an example, the second wearable device may be provided with a communication electrode, and when the first electrical signal emitted by the first wearable device is transmitted to the location of the second wearable device, the communication electrode may detect one or more received signals corresponding to the first electrical signal from the first wearable device. The first wearable device may also be provided with a communication electrode, and the first electrical signal may be emitted by the first wearable device through the communication electrode.

[0008] As an example, the signal characteristics of the received signal may include but are not limited to signal strength and / or signal transmission duration, wherein the signal strength indicates the signal strength of the received signal received by the second wearable device, and the signal transmission duration refers to the time taken for the first electrical signal to be transmitted from the first wearable device to the second wearable device and detected as a received signal by the second wearable device.

[0009] As an example, the first wearable device or the second wearable device may include but is not limited to any of the following: a smart bracelet, a phone watch, a smart ring, a smart necklace, a smart earring, an in-ear headset, a headset, or a wearable augmented reality (AR) / virtual reality (VR) device.

[0010] In the solution provided by the first aspect above, the first wearable device can send out an electrical signal (such as a pulse signal, a level signal, etc.), and the second wearable device can identify the user's body movements when the first wearable device sends out the electrical signal by analyzing the measured signal characteristics (such as signal strength and / or signal transmission duration) of the electrical signal from the first wearable device when passing through different paths of the human body, and then perform the operation corresponding to the body movement. This method does not require the user to carry an additional control device, so it can provide convenience for the user, facilitate the user to use it anytime and anywhere, and save costs. In addition, the method can realize any operation of the device instantly based on the user's bare-handed operation, thereby greatly simplifying the user's operation complexity. Moreover, the method is based on the user's body movements identified by the signal characteristics of the received signal, and the analysis technology of the signal characteristics is quite mature, so the accuracy of the analysis results will be relatively high, and the human-computer interaction process realized based on this will also be very accurate. In summary, the human-computer interaction method provided by the embodiment of the present application can provide users with a more convenient, low-power, and humanized human-computer interaction experience, and the user experience is high.

[0011] As a possible implementation, the second wearable device receives one or more receiving signals corresponding to the first electrical signal from the first wearable device, including: the second wearable device receives the first receiving signal and the second receiving signal of the first electrical signal from the first wearable device at a first moment and a second moment respectively, wherein the first moment is different from the second moment; the second wearable device obtains the signal characteristics of the one or more receiving signals corresponding to the first electrical signal, including: the second wearable device obtains the first characteristic of the first receiving signal corresponding to the first electrical signal received at the first moment, and the second characteristic of the second receiving signal corresponding to the first electrical signal received at the second moment; the second wearable device determines the first action of the user when the first wearable device sends the first electrical signal according to the signal characteristics of the one or more receiving signals corresponding to the first electrical signal, including: the second wearable device determines the first action according to the first characteristic and the second characteristic. In this way, the user's body movements can be identified by analyzing different signal characteristics of the same electrical signal from different paths.

[0012] As a possible implementation, the second wearable device determines the first action of the user when the first wearable device sends the first electrical signal according to the signal characteristics of one or more received signals corresponding to the first electrical signal, including: the second wearable device determines the first action according to the signal characteristics of one or more received signals corresponding to the first electrical signal and the first relationship, wherein the first relationship is used to indicate the correspondence between the signal characteristics and the body movement. For example, the first relationship can be pre-set in the second wearable device or other devices. In this way, the body movement of the user can be determined simply and quickly according to the signal characteristics of one or more received signals corresponding to the first electrical signal.

[0013] As a possible implementation, the second wearable device determines the first action of the user when the first wearable device sends the first electrical signal according to the signal characteristics of one or more received signals corresponding to the first electrical signal, including: the second wearable device determines one or more paths for transmitting the first electrical signal according to the signal characteristics of one or more received signals corresponding to the first electrical signal; the second wearable device determines the first action according to the one or more paths. It can be understood that this solution does not limit the specific method and process of determining the user's body movements according to the signal characteristics of one or more received signals corresponding to the first electrical signal. For example, the user's body movements can be determined according to the correspondence between multiple body movements and signal characteristics as described above, or the path for transmitting the first electrical signal can be determined according to the signal characteristics of one or more received signals corresponding to the first electrical signal, and then the user's body movements are determined according to the path.

[0014] As a possible implementation, the second wearable device determines the first action of the user when the first wearable device sends the first electrical signal according to the signal characteristic path of one or more received signals corresponding to the first electrical signal, including: the second wearable device determines one or more paths for transmitting the first electrical signal according to the signal characteristics of one or more received signals corresponding to the first electrical signal and the second relationship, wherein the second relationship is used to indicate the correspondence between the signal characteristics and the paths; the second wearable device determines the first action according to the determined one or more paths and the third relationship, wherein the second relationship is used to indicate the correspondence between the signal characteristics and the paths. For example, the second relationship and / or the third relationship can be pre-set in the second wearable device or other devices. In this way, the user's body movements can be determined simply and quickly according to the signal characteristics of one or more received signals corresponding to the first electrical signal.

[0015] As a possible implementation, the method further includes one or more of the following: the second wearable device performs the corresponding first operation according to the first action; the second wearable device instructs the first wearable device to perform the second operation corresponding to the first action; the second wearable device instructs the first device to perform the third operation corresponding to the first action; wherein a communication connection is established between the second wearable device and the first device. In this way, the solution provided by the present application can be applied to a variety of usage scenarios, has strong versatility, is easy for users to use, and has a high user experience.

[0016] As an example, the first device may include but is not limited to one or more of the following: a smart phone, a tablet computer, a personal computer, a wearable device, and a smart home device, wherein the smart home device includes but is not limited to one or more of the following: a smart speaker, a smart TV, a smart sweeping robot, a smart air conditioner, a smart curtain, and a smart light.

[0017] As a possible implementation manner, the operation purpose of the above-mentioned first action is one or more of the following: starting the first application, closing the first application, turning on the first function, turning off the first function, and adjusting the first function.

[0018] As an example, the first application is a music application, and the purpose of the first action is to play music, pause music, increase the volume, or decrease the volume; or, the first application is a call application, and the purpose of the first action is to answer a call, hang up a call, or initiate a call; or, the first application is a voice assistant application, and the purpose of the first action is to turn on the voice assistant or turn off the voice assistant; or, the first application is a health management application, and the purpose of the first action is to turn on blood oxygen detection, end blood oxygen detection, turn on heart rate detection, or end heart rate detection; or, the first application is a game application, and the purpose of the first action is to start the game, end the game, move forward / backward / left / right, change clothes, or get equipment.

[0019] In this way, the solution provided by the present application can be applicable to a variety of usage scenarios, and can realize a variety of user device control needs at most. It has strong versatility and is easy for users to use, and has a high user experience.

[0020] As a possible implementation, the method further includes: the second wearable device sends a second electrical signal; the second wearable device receives information about a second action from the first wearable device, wherein the second action is a body movement of the user when the second wearable device sends the second electrical signal, determined by the first wearable device based on one or more received signals corresponding to the received second electrical signal; the second wearable device determines a third action based on the second action and the first action. In this way, the solution of body movement recognition based on the measurement results of multiple wearable devices can further improve the accuracy and fault tolerance of body movement recognition and improve the reliability of human-computer interaction.

[0021] As a possible implementation, the method further includes one or more of the following: the second wearable device performs a fourth operation corresponding to the third action; the second wearable device instructs the first wearable device to perform a fifth operation corresponding to the third action; the second wearable device instructs the first device to perform a sixth operation corresponding to the third action; wherein a communication connection is established between the second wearable device and the first device. In this way, the solution provided by the present application can be applied to a variety of usage scenarios, has strong versatility, is easy for users to use, and has a high user experience.

[0022] As a possible implementation, the method further includes: the second wearable device sends a second electrical signal; the second wearable device sends information about the first action to the first wearable device, wherein the information about the first action is used by the first wearable device to determine the fourth action; or, sends information about the first action to the third wearable device, wherein the information about the first action is used by the third wearable device to determine the fourth action. In this way, the solution of body action recognition based on the measurement results of multiple wearable devices can further improve the accuracy and fault tolerance of body action recognition and improve the reliability of human-computer interaction.

[0023] It can be understood that this solution does not limit the final decision-maker in the implementation method of multiple wearable devices sending and receiving electrical signals to each other to determine the user's body movements. For example, it can be the first wearable device or the second wearable device, or when other wearable devices are involved, the decision-maker can also be other wearable devices, which can be determined according to actual usage.

[0024] As a possible implementation, the method further includes one or more of the following: the second wearable device performs the seventh operation corresponding to the fourth action; the second wearable device instructs the first wearable device to perform the eighth operation corresponding to the fourth action; the second wearable device instructs the first device to perform the ninth operation corresponding to the fourth action; wherein a communication connection is established between the second wearable device and the first device. In this way, the solution provided by the present application can be applied to a variety of usage scenarios, has strong versatility, is easy for users to use, and has a high user experience.

[0025] As a possible implementation, the method further includes: the second wearable device receives one or more received signals corresponding to the third electrical signal from the third wearable device; the second wearable device obtains the signal characteristics of the one or more received signals corresponding to the third electrical signal; the second wearable device determines the fifth action of the user when the third wearable device sends the third electrical signal according to the signal characteristics of the one or more received signals corresponding to the third electrical signal; the second wearable device determines the sixth action according to the first action and the fifth action. In this way, the solution of body motion recognition based on the measurement results of multiple wearable devices can further improve the accuracy and fault tolerance of body motion recognition and improve the reliability of human-computer interaction.

[0026] As a possible implementation, the method further includes one or more of the following: the second wearable device performs the tenth operation corresponding to the sixth action; the second wearable device instructs the first wearable device to perform the eleventh operation corresponding to the sixth action; the second wearable device instructs the first device to perform the twelfth operation corresponding to the sixth action; wherein a communication connection is established between the second wearable device and the first device. In this way, the solution provided by the present application can be applied to a variety of usage scenarios, has strong versatility, is easy for users to use, and has a high user experience.

[0027] As a possible implementation, the method further includes: the second wearable device negotiates with the first wearable device to determine the electric signal receiving and sending strategy, and the electric signal receiving and sending strategy includes one or more of the following: the sender of the electric signal, the receiver of the electric signal, the time of sending the electric signal, the receiving and sending clock of the electric signal, the sending frequency of the electric signal, and the decision-maker. In this way, the second wearable device and the first wearable device can perform subsequent electric signal sending, receiving, signal feature recognition, and body movement recognition according to the negotiated electric signal receiving and sending strategy, thereby ensuring the high efficiency and reliability of this solution.

[0028] In a second aspect, a wearable device is provided, which may include: a communication electrode for sending and / or receiving electrical signals; a memory for storing computer program instructions; and a processor for executing the computer program instructions to support the wearable device to implement a method as in any possible implementation of the first aspect.

[0029] In a third aspect, a communication system is provided, which includes multiple wearable devices, the multiple wearable devices include a first wearable device and a second wearable device, and the multiple wearable devices are used to work together to implement a method as in any possible implementation of the first aspect.

[0030] According to a fourth aspect, a readable storage medium is provided, on which program instructions are stored. When the program instructions are executed by a processor, the method in any possible implementation of the first aspect is implemented.

[0031] According to a fifth aspect, a computer program product comprising instructions is provided. When the computer program product is run on a computer, the computer implements the method in any possible implementation of the first aspect.

[0032] In a sixth aspect, a chip system is provided, the chip system comprising a processing circuit and a storage medium, wherein the storage medium stores program instructions; when the program instructions are executed by the processor, the method in any possible implementation of the first aspect is implemented. The chip system may be composed of a chip, or may include a chip and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 Schematic diagram of two scenarios in which users wear wearable devices provided in the embodiments of the present application;

[0034] Figure 2 A schematic diagram of the structure of a wearable device provided in an embodiment of the present application;

[0035] Figure 3A A schematic diagram of the structure of a smart watch and smart glasses provided in an embodiment of the present application;

[0036] Figure 3B A schematic diagram of the structure of another smart watch and smart glasses provided in an embodiment of the present application;

[0037] Figure 4 A schematic diagram of a principle for identifying a user's body movements provided in an embodiment of the present application;

[0038] Figure 5 A flow chart of a method for identifying body movements provided in an embodiment of the present application;

[0039] Figure 6 Schematic diagram of multiple transmission paths provided in the embodiments of the present application Figure 1 ;

[0040] Figure 7 Schematic diagram of multiple transmission paths provided in the embodiments of the present application Figure 2 ;

[0041] Figure 8 A flow chart of a human-computer interaction method provided in an embodiment of the present application;

[0042] Fig. 9 Another flow chart of a human-computer interaction method provided in an embodiment of the present application;

[0043] Fig.10 A flowchart of another human-computer interaction method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0044] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0045] In the following, the terms "first", "second", etc. are only used to distinguish different description objects, and have no limiting effect on the position, order, priority, quantity or content of the described objects. For example, if the described object is a "field", the ordinal number before the "field" in the "first field" and the "second field" does not limit the position or order between the "fields", and the "first" and "second" do not limit whether the "fields" they modify are in the same message, nor do they limit the order of the "first field" and the "second field". For another example, if the described object is a "level", the ordinal number before the "level" in the "first level" and the "second level" does not limit the priority between the "levels". For another example, the number of described objects is not limited by the ordinal number, and can be one or more. Taking the "first device" as an example, the number of "devices" can be one or more. In addition, the objects modified by different prefixes can be the same or different. For example, if the described object is a "device", the "first device" and the "second device" can be the same type of device or different types of devices. For another example, if the described object is "information", the "first information" and the "second information" can be information of the same content or information of different contents. In summary, the use of prefixes such as ordinal numbers to distinguish the described objects in the embodiments of the present application does not constitute a limitation on the described objects. For the statement of the described objects, please refer to the description in the context of the claims or embodiments, and no unnecessary limitation should be constituted due to the use of such prefixes.

[0046] Furthermore, in the embodiments of the present application, "connection" may be a direct connection or an indirect connection; in addition, it may refer to an electrical connection or a communication connection; for example, the connection between two electrical components A and B may refer to a direct connection between A and B, or may refer to an indirect connection between A and B through other electrical components or connecting media, or may refer to an indirect connection between A and B through other communication devices or communication media, as long as communication between A and B can be achieved.

[0047] In order to provide users with a more convenient, low-power, and humanized human-computer interaction experience during the human-computer interaction process, an embodiment of the present application provides a human-computer interaction method. This method does not require the user to hold a remote control device. The user's human-computer interaction instructions can be automatically obtained through multiple wearable devices worn by the user or worn (hereinafter uniformly referred to as "worn" for related introduction).

[0048] As an example, a user can wear a first wearable device and a second wearable device, wherein a first communication electrode is provided at a position of the first wearable device close to the user's body, and a second communication electrode is provided at a position of the second wearable device close to the user's body. The first wearable device can send an electrical signal (such as a pulse signal) through the first communication electrode, and the electrical signal can be conducted through the human body to the position of the second wearable device and measured by the second communication electrode of the second wearable device. Based on this principle, when the limbs of the user wearing the wearable device make contact with a certain part of the user's body, the second wearable device can identify the user's limb movement based on the signal characteristics of one or more received signals corresponding to the measured electrical signal from the first wearable device (such as signal strength and / or signal transmission duration), and then perform the operation corresponding to the limb movement.

[0049] Among them, in an embodiment of the present application, after identifying the user's body movement, the operation corresponding to the body movement can be performed by the second wearable device, or by the first wearable device, or by other devices (such as the first device), or by one or more wearable devices and multiple other devices (such as the first device) can collaboratively perform the operation corresponding to the body movement. The embodiment of the present application does not make specific limitations and can depend on the specific device functions and usage scenarios.

[0050] As an example, see Figure 1 (a) in Figure 1 (a) in the figure takes a smart watch as an example, and shows a schematic diagram of a scenario in which a user wears a wearable device provided by an embodiment of the present application. Figure 1 As shown in (a), the user wears a smart watch 1 and a smart watch 2 on the left wrist and the right wrist respectively, wherein the smart watch 1 and the smart watch 2 have the function of sending and / or receiving electrical signals.

[0051] In some examples, Figure 1 The smart watch 2 shown in (a) can be used when the user makes a first action ( Figure 1 In (a) (taking the example of a user touching his right wrist with his left hand), the user's body movement is identified by detecting signal characteristics of one or more received signals corresponding to the electrical signal from the smart watch 1 (such as signal strength and / or signal transmission duration) and then performing the operation corresponding to the body movement.

[0052] Or, in some examples, Figure 1 The smart watch 1 shown in (a) can be used when the user makes a first action ( Figure 1 In (a) (taking the example of a user touching his right wrist with his left hand), the user's body movement is identified by detecting signal characteristics of one or more received signals corresponding to the electrical signal from the smart watch 2 (such as signal strength and / or signal transmission duration) and then performing the operation corresponding to the body movement.

[0053] Or, in some examples, Figure 1 The smart watch 2 shown in (a) can be used when the user makes a first action ( Figure 1 In (a) of the figure, when the user touches the right wrist with the left hand as an example), the user's body movement is recognized by detecting the signal characteristics of one or more received signals corresponding to the electrical signal from the smart watch 1 (such as signal strength and / or signal transmission duration), and the smart watch 1 can recognize the user's body movement when the user makes the first action ( Figure 1 In (a) above, when the user touches his right wrist with his left hand as an example), the user's body movements are identified by detecting signal characteristics of one or more received signals corresponding to the electrical signal from smart watch 2 (such as signal strength and / or signal transmission duration). Finally, the user's body movements can be ultimately determined based on the body movements identified by smart watch 1 and smart watch 2, and then the operation corresponding to the body movement is performed.

[0054] As another example, see Figure 1 (b) in Figure 1 (b) in FIG. 1 takes a smart watch and smart glasses as an example of a wearable device, and shows another scenario schematic diagram of a user wearing a wearable device provided by an embodiment of the present application. Figure 1 As shown in (b), the user wears a smart watch on the left wrist and smart glasses on the head, wherein the smart watch and the smart glasses have the function of sending and / or receiving electrical signals.

[0055] In some examples, Figure 1 The smart glasses shown in (b) can be used when the user makes a first action ( Figure 1In (b) (taking the example of a user touching his left ear with his left hand), the user's body movement is identified by detecting signal characteristics of one or more received signals corresponding to the electrical signal from the smart watch (such as signal strength and / or signal transmission duration) and then performing the operation corresponding to the body movement.

[0056] Or, in some examples, Figure 1 The smartwatch shown in (b) can be used when the user makes a first action ( Figure 1 In (b) (taking the example of a user touching his left ear with his left hand), the user's body movement is identified by detecting signal characteristics of one or more received signals corresponding to the electrical signal from the smart glasses (such as signal strength and / or signal transmission duration) and then performing the operation corresponding to the body movement.

[0057] Or, in some examples, Figure 1 The smart glasses shown in (b) can be used when the user makes a first action ( Figure 1 (b) in the figure takes the example of a user touching his left ear with his left hand), the user's body movement is identified by detecting one or more signal characteristics of the received signal corresponding to the electrical signal from the smart watch (such as signal strength and / or signal transmission duration), and the smart watch can recognize the user's body movement when the user makes the first action ( Figure 1 In (b) (taking the example of a user touching his left ear with his left hand), the user's body movements are identified by detecting signal characteristics of one or more received signals corresponding to the electrical signals from the smart glasses (such as signal strength and / or signal transmission duration). Finally, the user's body movements can be ultimately determined based on the body movements identified by the smart glasses and the smart watch, and then the operation corresponding to the body movement is performed.

[0058] It should be noted that the wearable device described in the embodiment of the present application can be Figure 1 (a) or Figure 1 The smart glasses or smart watches shown in (b) may also be wearable devices of other types or structures. The wearable devices described in the embodiments of the present application may also include but are not limited to smart bracelets, phone watches, smart rings, smart necklaces, smart earrings, in-ear headphones, headphones or wearable AR / VR devices, etc., which are not limited in the embodiments of the present application.

[0059] For example, please refer to Figure 2 , showing a schematic diagram of the structure of a wearable device provided in an embodiment of the present application.

[0060] like Figure 2As shown, the wearable device may include a processor 201, an external memory interface 202, an internal memory 203, a universal serial bus (USB) interface 204, a charging management module 205, a power management module 206, a battery 207, a wireless communication module 208, a display screen 209, a touch sensor 210, an audio module 211, a button 212, etc.

[0061] It is understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the wearable device. In other embodiments of the present application, the wearable device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0062] The processor 201 includes one or more processing units, for example, the processor 201 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0063] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0064] The processor 201 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 201 is a cache memory. The memory may store instructions or data that the processor 201 has just used or cyclically used. If the processor 201 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 201, and thus improves the efficiency of the system.

[0065] In some embodiments, the processor 201 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0066] It is understandable that the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration and does not constitute a structural limitation on the wearable device. In other embodiments of the present application, the wearable device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0067] The display screen 209 is used to display corresponding images, etc. The display screen 209 may include a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), MiniLED, MicroLED, Micro-OLED, a quantum dot light emitting diode (QLED), etc.

[0068] The touch sensor 210 is also called a "touch panel". The touch sensor 210 can be set on the display screen 209. The touch sensor 210 and the display screen 209 form a touch screen, also called a "touch screen". The touch sensor 210 is used to detect a touch operation acting on or near it. The touch sensor 210 can pass the detected touch operation to the application processor to determine the type of touch event. Optionally, a visual output related to the touch operation can also be provided through the display screen 209.

[0069] The charging management module 205 is used to receive charging input from the charger. The power management module 206 is used to connect the battery 207, the charging management module 205 and the processor 201. The power management module 206 can receive input from the battery 207 and / or the charging management module 205 to power the processor 201, the internal memory 203, the wireless communication module 208 and the display screen 209.

[0070] The wireless communication module 208 can provide wireless communication solutions for wearable devices, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 208 can be one or more devices integrating at least one communication processing module.

[0071] like Figure 2 As shown, communication electrodes are provided on the wireless communication module 208. In some embodiments of the present application, the wireless communication module 208 can also provide communication of electrical signals (such as pulse signals) applied to wearable devices. For example, the wireless communication module 208 can be used to receive a signal to be sent (such as a default pulse waveform) from the processor 201, frequency modulate it, amplify it, and convert it into a pulse signal and send it through the communication electrodes close to the user's body. For another example, the wireless communication module 208 can receive a pulse signal via a communication electrode close to the user's body, frequency modulate the pulse signal and filter it, and send the processed signal to the processor 201, so that the processor 201 can recognize the user's body movements based on the signal characteristics of the received signal and perform operations corresponding to the body movements.

[0072] The external memory interface 202 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the wearable device. The external memory card communicates with the processor 201 through the external memory interface 202 to implement a data storage function. For example, files such as phone books and pictures are stored in the external memory card.

[0073] Among them, the modulation method of the pulse signal may include but is not limited to amplitude shift keying (ASK), frequency-shift keying (FSK), phase shift keying (PSK) and quadrature amplitude modulation (QAM).

[0074] The internal memory 203 can be used to store computer executable program codes, which include instructions. The internal memory 203 may include a program storage area and a data storage area. The program storage area may store an operating system, an application required for at least one function (such as a call function, a time setting function, etc.), etc. The data storage area may store data created during the use of the wearable device, etc. The processor 201 executes various functional applications and data processing of the wearable device by running instructions stored in the internal memory 203 and / or instructions stored in a memory provided in the processor 201.

[0075] In some embodiments of the present application, the internal memory 203 or the memory provided in the processor 201 can be used to store a pre-set default waveform (such as a default pulse waveform), and / or signal characteristics corresponding to multiple paths, limb movements corresponding to multiple paths, operation instructions corresponding to limb movements, etc.

[0076] The wearable device can implement audio functions through the audio module 211 and the application processor, such as music playing and making calls.

[0077] The button 212 includes a power button, a volume button, etc. The button 212 may be a mechanical button or a touch button. The wearable device may receive the button 212 input and generate a key signal input related to the user settings and function control of the wearable device.

[0078] It is understandable that this application Figure 2The illustrated structure does not constitute a specific limitation on the wearable device. In other embodiments of the present application, the wearable device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The illustrated components can be implemented in hardware, software, or a combination of software and hardware. For example, in some examples, the wearable device may also include a motor, an indicator (such as an indicator light), etc. For another example, in some examples, the communication electrode may also be independent of the wireless communication module 208, as a separate module located at a position where the wearable device is close to the user's body, or the communication electrode may also be located in other related modules.

[0079] It should be noted that the embodiments of the present application do not limit the specific form of the electrical signal. For example, the electrical signal can be a pulse signal or a level signal, depending on the actual device module structure, function and specific working principle. For this, reference can be made to conventional technologies. As an example, taking the wearable device as a smart watch, please refer to Figure 3A (a) in Figure 3A (a) shows a schematic diagram of the structure of a smart watch provided in an embodiment of the present application. Figure 3A As shown in (a) of the figure, the side of the smartwatch close to the user's body (such as Figure 3A The back side of the wearable device (as shown in (a)) is provided with communication electrodes a and communication electrodes b, which can be used to send out electrical signals and / or receive electrical signals from other wearable devices. For example, communication electrode a can be used to send out electrical signals, and communication electrode b can be used to receive electrical signals; for another example, communication electrode a can be used to receive electrical signals, and communication electrode b can be used to send out electrical signals; for another example, communication electrode a and communication electrode b can both be used to send out electrical signals and to receive electrical signals, without specific limitation.

[0080] As an example, taking the wearable device as smart glasses, please refer to Figure 3A (b) in Figure 3A (b) shows a schematic diagram of the structure of a smart glasses provided by an embodiment of the present application. Figure 3A As shown in (b) in the figure, the position of the smart glasses close to the user's face (such as Figure 3A As shown in (b) of the figure, the glasses leg is provided with a communication electrode c and a communication electrode d, which can be used to send out electrical signals and / or receive electrical signals from other wearable devices. For example, the communication electrode c can be used to send out electrical signals, and the communication electrode d can be used to receive electrical signals; for another example, the communication electrode c can be used to receive electrical signals, and the communication electrode d can be used to send out electrical signals; for another example, the communication electrode c and the communication electrode d can both be used to send out electrical signals and to receive electrical signals, without specific limitation.

[0081] It should be noted that Figure 3A (a) and Figure 3A (b) in the figure only takes two communication electrodes provided on the wearable device as an example, and the embodiment of the present application does not specifically limit the number of communication electrodes included in the wearable device. For example, the wearable device may also include a communication electrode, which can be used to send electrical signals and receive electrical signals, such as Figure 3B The communication electrode A of the smart watch shown in (a) can be used to send out electrical signals as well as receive electrical signals, and Figure 3B The communication electrode B of the smart glasses shown in (b) can be used to send out electrical signals as well as receive electrical signals. Figure 3B The communication electrode A of the smart watch shown in (a) can be used to send an electrical signal. Figure 3B The communication electrode B of the smart glasses shown in (b) can be used to receive electrical signals. Figure 3B The communication electrode A of the smart watch shown in (a) can be used to receive electrical signals. Figure 3B The communication electrode B of the smart glasses shown in (b) can be used to send electrical signals.

[0082] And, it should be noted that Figure 3A (a) and Figure 3A (b) in the figure only focuses on the structure of the wearable device related to the embodiment of the present application, and the embodiment of the present application does not specifically limit other components of the wearable device, such as Figure 3A The smart glasses shown in (a) may also include one or more components such as a camera, a processor (such as a CPU, etc.), a wireless communication module, a sensor, a display screen (such as a micro display screen), an optical module, etc., and conventional technologies may be referred to.

[0083] As described above, the principle of the human-computer interaction method provided in the embodiment of the present application is: when the limb of the user wearing the wearable device makes a contact action with a certain part of the user's body, the second wearable device can recognize the user's limb action based on the signal characteristics (such as signal strength and / or signal transmission duration) of the received signal corresponding to the electrical signal from the first wearable device, and then perform the operation corresponding to the limb action. Among them, recognizing the user's limb action is the key to human-computer interaction.

[0084] Please refer to Figure 4 , Figure 4 FIG. 1 is a schematic diagram showing a principle of recognizing a user's body movements provided by an embodiment of the present application. Figure 4As shown, when the first wearable device sends an electrical signal through the first communication electrode, the electrical signal can be transmitted to the location of the second wearable device through one or more conductive human body pathways according to different body movements made by the user and measured by the second communication electrode of the second wearable device.

[0085] Figure 4 Take the example that the electrical signal is transmitted to the location of the second wearable device through three conductive human body paths and is measured by the communication electrode of the second wearable device. Figure 4 As shown, when the user makes a first action to enable the first path, the second path, and the third path to be turned on, the electrical signal can be transmitted to the second communication electrode through the first path, and can also be transmitted to the second communication electrode through the second path and the third path. In this case, the electrical signal transmitted by the first path has a first feature, the electrical signal transmitted by the second path has a second feature, and the electrical signal transmitted by the third path has a third feature. Based on this, the body movements of the one or more paths can be determined by analyzing the signal characteristics of the received signals corresponding to the electrical signals received from multiple paths. For example, the body movements of the user can be identified based on the signal characteristics of one or more received signals corresponding to the first electrical signal and the first relationship, wherein the first relationship is used to indicate the corresponding relationship between the signal characteristics and the body movements. For another example, one or more paths for transmitting the first electrical signal can be determined based on the signal characteristics of one or more received signals corresponding to the first electrical signal and the second relationship, and then the body movements of the user can be identified based on the determined one or more paths and the third relationship, wherein the second relationship is used to indicate the corresponding relationship between the signal characteristics and the path, and the third relationship is used to indicate the corresponding relationship between the path and the body movement.

[0086] Need to explain, Figure 4 Taking the first action that can make the first path, the second path, and the third path conductive as an example, in actual applications, the embodiments of the present application do not limit the number of paths through which the first electrical signal is transmitted from the first wearable device to the second wearable device, which depends on the user's specific body movements, the wearing position of the wearable device, etc.

[0087] As an example, see Figure 5 , Figure 5 Taking the case where a user wears a first wearable device and a second wearable device as an example, a flow chart of a method for identifying body movements provided by an embodiment of the present application is shown. Figure 5 S501-S504 shown determine the user's body movements:

[0088] S501: The first wearable device sends a first electrical signal.

[0089] In some embodiments, the first wearable device may send the first electrical signal according to the electrical signal sending and receiving strategy. As an example, the electrical signal sending and receiving strategy may include but is not limited to one or more of the following: the sender of the electrical signal, the receiver of the electrical signal, the sending time of the electrical signal, the sending and receiving clock of the electrical signal, the sending frequency of the electrical signal, the decision-maker, etc.

[0090] Among them, the sender of the electric signal in the electric signal receiving and sending strategy represents a wearable device for sending the electric signal, for example, the sender can be the first wearable device or the second wearable device; the receiver of the electric signal represents a wearable device for receiving the electric signal, for example, the receiver can be the first wearable device or the second wearable device. For example, for the same electric signal, when the sender is the first wearable device, the receiver is the second wearable device, and when the sender is the second wearable device, the receiver is the first wearable device; for different electric signals, the first wearable device can be the sender of one electric signal and the receiver of another electric signal at the same time, and similarly, the second wearable device can be the receiver of one electric signal and the sender of another electric signal at the same time. The sending time of the electric signal is used for the receiver of the electric signal to successfully receive the receiving signal corresponding to the electric signal, and the receiver of the electric signal can obtain the signal transmission duration of the electric signal based on this. The receiving and sending clock of the electric signal and the sending frequency of the electric signal are used for the sender of the electric signal and the receiver of the electric signal to synchronize the clock to achieve receiving and sending synchronization, so that the receiver can successfully receive the receiving signal corresponding to the electric signal, and obtain the signal transmission duration of the electric signal based on this. Specifically, when the sender and the receiver synchronize their clocks, the sender and the receiver can synchronously send and receive electrical signals at the same frequency. The decision-maker represents a wearable device used to ultimately determine the user's body movement, for example, the decision-maker can be the first wearable device or the second wearable device.

[0091] Among them, one or more communication electrodes may be provided at a position of the first wearable device close to the user's body, and the one or more communication electrodes include a first communication electrode, and when the user wears the first wearable device, the one or more communication electrodes are in contact with the user's body. Taking the first wearable device as a smart watch / smart bracelet as an example, when the user wears the first wearable device, the one or more communication electrodes are in contact with the user's wrist; taking the first wearable device as smart glasses as an example, when the user wears the first wearable device, the one or more communication electrodes are in contact with the user's face; taking the first wearable device as a smart necklace as an example, when the user wears the first wearable device, the one or more communication electrodes are in contact with the user's neck; taking the first wearable device as an earphone as an example, when the user wears the first wearable device, the one or more communication electrodes are in contact with the user's ear; taking the first wearable device as a smart ring as an example, when the user wears the first wearable device, the one or more communication electrodes are in contact with the user's fingers.

[0092] Taking the case where the sender of the electrical signal is the first wearable device and the receiver of the electrical signal is the second wearable device as an example, the first wearable device can send the first electrical signal through the first communication electrode according to the electrical signal sending and receiving strategy.

[0093] In some embodiments, the first wearable device may send an electrical signal, such as a first electrical signal, through the first communication electrode at the negotiated sending time of the electrical signal, for example, the voltage of the first electrical signal is less than 3 V. Exemplarily, the first electrical signal may include but is not limited to a pulse signal, a level signal, and the like.

[0094] In some embodiments, the first wearable device can send an electrical signal, such as a first electrical signal, through the first communication electrode at a sending frequency.

[0095] In some embodiments, the first electrical signal may be a preset default waveform (eg, a default pulse waveform).

[0096] In some embodiments, the first electrical signal may be a preset characteristic waveform or the like.

[0097] In some embodiments, the electric signal receiving and sending strategy can be determined by negotiation between the first wearable device and the second wearable device. Wherein, a communication connection is established between the first wearable device and the second wearable device, such as a Bluetooth connection, a WiFi P2P connection, or a connection to the same local area network, and the first wearable device and the second wearable device can negotiate and determine the electric signal receiving and sending strategy based on the established communication connection. Of course, information communication can also be achieved between the first wearable device and the second wearable device through electric signals, such as determining the electric signal receiving and sending strategy through electric signal negotiation. The embodiments of the present application are not specifically limited.

[0098] Of course, the embodiments of the present application do not limit the communication connection method between the first wearable device and the second wearable device. For example, the first wearable device and the second wearable device can also negotiate the electric signal receiving and sending strategy and exchange other information through the communication path formed by each communication electrode. The specific method and specific process of establishing a communication connection between the first wearable device and the second wearable device are not specifically limited in the embodiments of the present application, and conventional technologies can be referred to.

[0099] Among them, the first wearable device and the second wearable device negotiate the sender of the electrical signal to negotiate and determine the wearable device that sends the electrical signal. For example, the first wearable device and the second wearable device can negotiate that the first wearable device is responsible for sending the electrical signal or the second wearable device is responsible for sending the electrical signal. The first wearable device and the second wearable device negotiate the receiver of the electrical signal to negotiate and determine the wearable device that receives the electrical signal. For example, the first wearable device and the second wearable device can negotiate that the first wearable device is responsible for receiving the electrical signal or the second wearable device is responsible for receiving the electrical signal. The first wearable device and the second wearable device negotiate the sending time of the electrical signal so that the second wearable device used for the electrical signal can successfully receive the receiving signal corresponding to the electrical signal sent by the first wearable device, and the second wearable device can obtain the signal transmission duration of the electrical signal based on this. The first wearable device and the second wearable device negotiate the receiving and transmitting clock of the electrical signal and the sending frequency of the electrical signal for the first wearable device and the second wearable device to synchronize the transmission and reception. For example, the first wearable device and the second wearable device can synchronize the clocks to achieve synchronization of transmission and reception according to the synchronized clocks, so that the second wearable device can successfully receive the receiving signal corresponding to the electrical signal from the first wearable device, and the signal transmission time of the electrical signal from the first wearable device to the first wearable device can be obtained based on this. The first wearable device and the second wearable device negotiate the decision-making party to negotiate and determine the wearable device used to finally determine the user's body movements. For example, when the first wearable device and the second wearable device both send and receive electrical signals, the first wearable device and the second wearable device can negotiate who will finally determine the user's body movements based on the preliminary recognition results of the body movements of the first wearable device and the second wearable device.

[0100] S502: The second wearable device receives one or more reception signals corresponding to the first electrical signal.

[0101] The one or more received signals include a first received signal.

[0102] In some embodiments, one or more communication electrodes may be provided at a position of the second wearable device close to the user's body, and the one or more communication electrodes include a second communication electrode, and when the user wears the second wearable device, the one or more communication electrodes are in contact with the user's body. Taking the second wearable device as a smart watch / smart bracelet as an example, when the user wears the second wearable device, the one or more communication electrodes are in contact with the user's wrist; taking the second wearable device as smart glasses as an example, when the user wears the second wearable device, the one or more communication electrodes are in contact with the user's face; taking the second wearable device as a smart necklace as an example, when the user wears the second wearable device, the one or more communication electrodes are in contact with the user's neck; taking the second wearable device as an earphone as an example, when the user wears the second wearable device, the one or more communication electrodes are in contact with the user's ear; taking the second wearable device as a smart ring as an example, when the user wears the second wearable device, the one or more communication electrodes are in contact with the user's fingers.

[0103] For example, the sender of the electrical signal is the first wearable device, and the receiver of the electrical signal is the second wearable device. The second wearable device can detect the electrical signal through the second communication electrode according to the electrical signal transmission and reception strategy. Based on this, when the first electrical signal reaches the location of the second communication electrode through the transmission path, the received signal corresponding to the first electrical signal can be detected by the second communication electrode. We know that after the first electrical signal passes through the transmission path, changes such as attenuation of the signal strength may occur. Therefore, compared with the first electrical signal, the received signal corresponding to the first electrical signal will have a phenomenon such as reduced signal strength.

[0104] In some embodiments, the second wearable device can continuously detect the electrical signal through the second communication electrode in a corresponding time window according to the negotiated sending time of the electrical signal.

[0105] In some embodiments, the second wearable device can continuously detect the electrical signal through the second communication electrode according to the negotiated transmit and receive clock and emission frequency of the electrical signal. Since the transmit and receive clocks of the first wearable device and the second wearable device are synchronized, when the first electrical signal reaches the location of the second communication electrode, the received signal corresponding to the first electrical signal can be detected by the second communication electrode.

[0106] In some embodiments of the present application, one or more received signals corresponding to the first electrical signal received by the second wearable device may include the first received signal. For example, in the case where there is a path between the first wearable device and the second wearable device, if the user does not make a contact action with a certain part of the user's body, and therefore there is a path between the first wearable device and the second wearable device, in this case, a received signal corresponding to the first electrical signal received by the second wearable device is a received signal corresponding to the first electrical signal transmitted from the path.

[0107] As an example, assuming that the user wears the first wearable device on the right wrist and the second wearable device on the left wrist, please refer to Figure 6 , Figure 6 A schematic diagram of various transmission paths provided in an embodiment of the present application is shown.

[0108] like Figure 6 As shown, when the user makes Figure 6 In the case of action 1 (both hands naturally hanging down) shown in (a), the first electrical signal emitted by the first wearable device (such as a smart watch) on the user's right wrist will be transmitted sequentially through the right arm, the human body, the left arm, and finally to the second wearable device (such as a smart watch) on the left wrist, wherein Figure 6 The transmission path of right wrist→right arm→human torso→left arm→left wrist shown in (a) is recorded as path 1, and the second wearable device can receive a receiving signal corresponding to the first electrical signal from path 1.

[0109] As an example, assuming that the user wears the first wearable device on the eye and the second wearable device on the left wrist, please refer to Figure 7 , Figure 7 Another schematic diagram of multiple transmission paths provided in an embodiment of the present application is shown.

[0110] like Figure 7 As shown, when the user makes Figure 7 When performing action 1 (both hands hang naturally) as shown in (a) in the figure, the first electrical signal emitted by the first wearable device (such as smart glasses) located at the user's eyes will be transmitted in sequence through the face, neck, human torso, left arm and finally to the second wearable device (such as a smart watch) located on the left wrist, wherein the transmission path of face→neck→human torso→left arm→left wrist is recorded as path 6, and the second wearable device can receive the receiving signal corresponding to the first electrical signal from path 6.

[0111] In some embodiments of the present application, the one or more received signals corresponding to the first electrical signal received by the second wearable device may include a first received signal and a second received signal. For example, in the case where there are M (M is a positive integer and M>1) paths between the first wearable device and the second wearable device, if the user makes a contact action with a certain part of the user's body so that there are multiple paths between the first wearable device and the second wearable device, in this case, the M received signals corresponding to the first electrical signal received by the second wearable device are the M received signals corresponding to the first electrical signal transmitted from the M paths.

[0112] For example, when a user makes Figure 6When action 2 (left hand touching right wrist) is performed as shown in (b) in the figure, the first electrical signal emitted by the first wearable device on the user's right wrist can be transmitted to the second wearable device on the left wrist through path 2 of right wrist → right arm → human trunk → left arm → left wrist, and can also be transmitted to the second wearable device on the left wrist through the right palm and right fingers in sequence, where the transmission path of right wrist → right palm → right finger → left wrist is recorded as path 3, and the second wearable device can receive two reception signals corresponding to the first electrical signals from path 2 and path 3 respectively.

[0113] For example, when a user makes Figure 6 When performing action 3 (left hand touching left ear) as shown in (c) in the figure, the first electrical signal emitted by the first wearable device on the user's right wrist can be transmitted to the second wearable device on the left wrist through path 4 of right wrist → right arm → human torso → left arm → left wrist, and can also be transmitted to the second wearable device on the left wrist through the right arm, human torso, neck, face, left ear, left finger, and left palm in sequence, wherein the transmission path of right wrist → right arm → human torso → neck → face → left ear → left finger → left palm → left wrist is recorded as path 5, and the second wearable device can receive two reception signals corresponding to the first electrical signal from path 4 and path 5 respectively.

[0114] For example, when a user makes Figure 7 When action 2 (left hand touching left ear) is performed as shown in (b) in the figure, the first electrical signal emitted by the first wearable device located at the user's glasses can be transmitted to the second wearable device located on the left wrist through path 7 of face→neck→human trunk→left arm→left wrist, and can also be transmitted to the second wearable device located on the left wrist through face, left ear, left finger, and left palm in sequence, where the transmission path of face→left ear→left finger→left palm→left wrist is recorded as path 8, and the second wearable device can receive two reception signals corresponding to the first electrical signals from path 7 and path 8 respectively.

[0115] Among them, for the case where the second wearable device receives M received signals corresponding to the first electrical signal, the M received signals may be received by the second wearable device at different times, or may be received by the second wearable device at the same time; for the case where M>3, the M received signals may also include electrical signals received by multiple second wearable devices at the same time, which is not specifically limited in the embodiments of the present application.

[0116] It should be noted that Figure 6 and Figure 7As examples of several transmission paths, the embodiments of the present application do not specifically limit the number, type, wearing position, and body movements of wearable devices worn by users, which can be determined according to the actual usage scenario. For example, the user can also wear 3 or more wearable devices; for another example, the user can also wear other types of wearable devices such as smart necklaces, smart earrings, headphones, smart rings, etc. in other positions; for another example, the user can also make a finger touch the nose, finger touch the cheek, finger touch the elbow, finger touch the neck, etc.

[0117] S503: The second wearable device obtains signal characteristics of one or more received signals.

[0118] The signal characteristics may include but are not limited to one or more of signal strength, signal transmission duration, etc.

[0119] It can be understood that when the first electrical signal is transmitted from the first wearable device to the second wearable device through different paths, the length of the path and / or the composition of the medium through which each path passes are different, which will cause the transmission time of the first electrical signal from the first wearable device to the second wearable device to be different. In addition, since the electrical signal will attenuate during the transmission process, when the first electrical signal is transmitted from the first wearable device to the second wearable device through different paths, the attenuation of the signal strength of the first electrical signal will be different. Based on this, in an embodiment of the present application, the second wearable device can identify the user's first action when the first wearable device sends the first electrical signal by analyzing the signal characteristics of the received signal corresponding to the first electrical signal.

[0120] As a possible implementation method, the second wearable device can obtain the signal transmission duration of one or more received signals based on an electric signal transmission time detection algorithm, such as an electric signal time of flight (TOF) detection algorithm. For example, the second wearable device can obtain the signal transmission duration of the received signal based on the negotiated emission time of the electric signal and the reception time when the second wearable device detects the received signal corresponding to the electric signal based on the electric signal transmission time detection algorithm. For another example, the second wearable device can obtain the signal transmission duration of the received signal based on the negotiated synchronization clock, emission frequency, and the reception time when the second wearable device detects the received signal corresponding to the electric signal based on the electric signal transmission time detection algorithm.

[0121] It should be noted that the embodiments of the present application only use signal characteristics including signal strength and / or signal transmission duration as an example for identifying the transmission path of the received signal, and do not provide specific examples for specific signal characteristics. Other characteristics of the signal caused by different paths can also be used as the signal characteristics described in the embodiments of the present application to determine the first action.

[0122] In some embodiments, after receiving one or more received signals corresponding to the first electrical signal, the second wearable device may also perform other preset processing on the one or more received signals, such as filtering, timing detection, etc. Among them, filtering the received signal is used to filter out the noise signal therein, and timing detection of the received signal is used to evaluate the stability of the time series of the received signal. The preset processing process of the second wearable device for one or more received signals can refer to conventional technology, and the embodiments of the present application do not make specific limitations.

[0123] S504: The second wearable device determines, based on signal characteristics of one or more received signals, a first action of the user when the first wearable device sends a first electrical signal.

[0124] Among them, the user's first action can represent the user's contact action, such as the left hand touching the right wrist, the left hand touching the left ear, etc.

[0125] In some embodiments, a first relationship may be pre-set in the second wearable device, wherein the first relationship is used to indicate the correspondence between the signal feature and the body movement. For example, the first relationship is used to indicate the correspondence between the signal transmission duration and the body movement; for another example, the first relationship is used to indicate the correspondence between the signal strength attenuation degree and the body movement; for another example, the first relationship is used to indicate the correspondence between the signal strength attenuation degree and the signal transmission duration and the body movement. Based on this, the second wearable device can determine the first action of the user when the first wearable device sends the first electrical signal by matching the signal feature in the first relationship.

[0126] As an example, the first relationship may be as shown in Table 1 below:

[0127] Table 1

[0128] Signal transmission time Signal strength attenuation Body movements T1 A1％ Action 1 T1 A1％ Action 2 …… …… ……

[0129] As a possible implementation method, when the user customizes the human-computer interaction action, the second wearable device can prompt the user to make the corresponding body movement and detect and record the corresponding relationship between the body movement and the signal characteristics of the received signal received by the second wearable device when the user makes the body movement. Based on this, when the second wearable device subsequently detects a received signal with the same signal characteristics, it can identify the corresponding body movement.

[0130] In some embodiments, the second wearable device may be pre-set with a second relationship and a third relationship, wherein the second relationship is used to indicate the correspondence between the signal feature and the path, and the third relationship is used to indicate the correspondence between the path and the body movement. For example, the second relationship is used to indicate the correspondence between the signal transmission duration and the path; as another example, the second relationship is used to indicate the correspondence between the signal strength attenuation degree and the path; as another example, the second relationship is used to indicate the correspondence between the signal strength attenuation degree and the signal transmission duration and the path. Based on this, the second wearable device can identify one or more paths for transmitting the first electrical signal by matching the signal features in the second relationship, and then determine the user's first action when the first wearable device sends the first electrical signal by matching the path in the third relationship.

[0131] As an example, the first relationship and the second relationship may be shown in Table 2 and Table 3 below respectively:

[0132] Table 2

[0133] Signal transmission time Signal strength attenuation path T1 A1％ Path 1 T1 A1％ Path 2 …… …… ……

[0134] Table 3

[0135] path Body movements Path 1 Action 1 Path 2 Action 2 …… ……

[0136] As a possible implementation method, when the user customizes the human-computer interaction action, the second wearable device can prompt the user to make the corresponding body movement and detect and record the corresponding relationship between the signal characteristics and the path of the received signal received when the user makes the body movement, as well as the corresponding relationship between the body movement and the path. Based on this, when the second wearable device subsequently detects a received signal with the same signal characteristics, it can identify the path of the received signal and then identify the corresponding body movement.

[0137] For example, from Figure 6 As can be seen from (a) in the figure, when the user's hands hang naturally, the second wearable device located on the left wrist receives a first receiving signal corresponding to the first electrical signal from the first wearable device at a moment (such as moment 1). Based on the signal characteristics such as the transmission duration and / or signal strength of the receiving signal detected by the second wearable device, the second wearable device can determine that the first receiving signal received at moment 1 comes from path 1, and then recognize that the user did not make any contact with a certain part of the user's body when the first wearable device sent the first electrical signal.

[0138] For example, from Figure 6As can be seen from (b), when the user's left hand touches the right wrist, the second wearable device located on the left wrist can receive the first reception signal and the second reception signal corresponding to the first electrical signal from the first wearable device at two moments (such as moment 2 and moment 3, where moment 2 is earlier than moment 3), such as receiving the first reception signal transmitted from path 3 at moment 2 and receiving the second reception signal transmitted from path 2 at moment 3. Based on the analysis of signal characteristics such as the transmission duration and / or signal strength of the detected first reception signal and the second reception signal, the second wearable device can determine that the first reception signal received at moment 2 comes from path 3, and the first and second reception signals received at moment 3 come from path 2, and then recognize that the user made a physical action of touching the right wrist with the left hand when the first wearable device sent the first electrical signal.

[0139] For example, from Figure 6 As can be seen from (c) in the figure, when the user touches the left ear with his left hand, the second wearable device located on the left wrist can receive the first reception signal and the second reception signal corresponding to the first electrical signal from the first wearable device at two moments (such as moment 4 and moment 5, where moment 4 is earlier than moment 5), such as receiving the first reception signal transmitted from path 5 at moment 4 and receiving the second reception signal transmitted from path 4 at moment 5. Based on the analysis of the signal characteristics such as the transmission duration and / or signal strength of the detected first reception signal and the second reception signal, the second wearable device can determine that the first reception signal received at moment 4 comes from path 5, and the second reception signal received at moment 5 comes from path 4, and then recognize that the user made a physical action of touching the left ear with his left hand when the first wearable device sent the first electrical signal.

[0140] For example, from Figure 7 As can be seen from (a) in the figure, when the user's hands hang naturally, the second wearable device located on the left wrist receives a first reception signal corresponding to the first electrical signal from the first wearable device at a time (such as time 6). Based on the signal characteristics such as the transmission duration and / or signal strength of the first reception signal detected by the second wearable device, the second wearable device can determine that the first reception signal received at time 6 comes from path 6, and then recognize that the user did not make any contact with a certain part of the user's body when the first wearable device sent the first electrical signal.

[0141] For example, from Figure 7As can be seen from (b) in the figure, when the user touches the left ear with his left hand, the second wearable device located on the left wrist can receive the first reception signal and the second reception signal corresponding to the first electrical signal from the first wearable device at two moments (such as moment 7 and moment 8, where moment 7 is earlier than moment 8), such as receiving the first reception signal transmitted from path 8 at moment 7 and receiving the second reception signal transmitted from path 7 at moment 8. Based on the analysis of signal characteristics such as the transmission duration and / or signal strength of the first reception signal and the second reception signal detected by the second wearable device, the second wearable device can determine that the first reception signal received at moment 7 comes from path 8, and the second reception signal received at moment 8 comes from path 7, and then recognize that the user made a physical action of touching the left ear with his left hand when the first wearable device sent the first electrical signal.

[0142] After the second wearable device determines the user's first action when the first wearable device sends the first electrical signal, the second wearable device can further map the first action and the body movements detected within the historical preset time period into corresponding operation instructions, and then respond to the operation instructions. As an example, the historical preset time period can be a pre-set fixed time period (such as 10 seconds). As another example, the historical preset time period can also be related to the cumulative duration of continuous body movements detected within a fixed time period (such as 10 seconds). For example, assuming that a continuous body movement is detected within a fixed time period (such as 10 seconds), and the starting time of the body movement is earlier than the starting time corresponding to the above fixed time period, the starting time of the historical preset time period is the starting time of the body movement. Regarding the setting principles and basis of the historical preset time period, the embodiments of the present application do not make specific limitations.

[0143] For example, Figure 5 As shown, a human-computer interaction method provided in an embodiment of the present application further includes S505:

[0144] S505: The second wearable device performs a corresponding operation according to the first action.

[0145] In some embodiments, the second wearable device may first determine an operation instruction corresponding to the first action based on the first action and the body movements detected within a historical preset time period, and then perform a corresponding operation according to the operation instruction.

[0146] In some embodiments, in order to improve the convenience of user operation, the user's physical movements for controlling the device can be set to be relatively simple, such as the left hand touching the right wrist once, the left hand touching the left ear once, etc.

[0147] For example, the first action indicates that the user's limbs make a contact action with a part of the user's body, and the second wearable device has not detected the limb action within a historical preset time period. In this case, the second wearable device can determine that the user has made a contact action with a part of the user's body based on the first action and the limb action detected within the historical preset time period.

[0148] In some embodiments, in order to prevent misoperation, the user's body movements for controlling the device can be set to be relatively complex, such as the left hand touching the right wrist multiple times, the left hand touching the left ear multiple times, the left hand touching the right wrist for more than a preset time, the left hand touching the left ear for more than a preset time, or the left hand quickly (such as 0.5 seconds) touching the right wrist twice and then touching it once after a longer time (such as 2 seconds), and other combined actions.

[0149] For example, the first action indicates that the user's limbs make one contact action with the first part of the user's body, and the second wearable device detects one contact action between the user's limbs and the first part of the user's body within a historical preset time period. In this case, the second wearable device can determine that the user has made two contact actions between the user's limbs and the first part of the user's body based on the first action and the limb actions detected within the historical preset time period.

[0150] For another example, the first action indicates that the user's limbs make one contact action with the first part of the user's body, and the second wearable device detects two contact actions between the user's limbs and the first part of the user's body within a historical preset time period. In this case, the second wearable device can determine that the user has made three contact actions between the user's limbs and the first part of the user's body based on the first action and the limb actions detected within the historical preset time period.

[0151] For another example, the first action indicates that a user's limbs make a contact action with a first part of the user's body that lasts for a first duration, and the second wearable device detects a contact action between the user's limbs and the first part of the user's body that lasts for a second duration within a historical preset time period. In this case, the second wearable device can determine, based on the first action and the limb actions detected within the historical preset time period, that the user has made a contact action between the limbs and the first part of the user's body that lasts for a third cumulative duration, where the third duration = first duration + second duration.

[0152] For another example, a first action indicates that a user's limb makes one contact action with a first part of the user's body, and a second wearable device detects two contact actions of the user's limb quickly (such as 0.5 seconds) contacting the first part of the user's body within a historical preset time period, and the interval between the first action and the most recent historical contact action is greater than a certain threshold (such as 2 seconds). In this case, the second wearable device can determine, based on the first action and the limb actions detected within the historical preset time period, that the user has made a contact action of quickly contacting the first part of the user's body with the limb twice (such as 0.5 seconds) and then contacting it once after a longer interval (such as 2 seconds).

[0153] In some embodiments, the second wearable device can map the first action and the limb movements detected within the historical preset time period, combined with the limb movements detected within the future preset time period, into corresponding operation instructions, and then respond to the operation instructions. For example, the second wearable device detects the first contact action between the user's limb and the first part of the user's body within the historical preset time period, the first action identifies the second contact action between the user's limb and the first part of the user's body, and the second wearable device detects the third contact action between the user's limb and the first part of the user's body within the future preset time period, wherein the time interval between the first contact action and the second contact action and the time interval between the second contact action and the third contact action both meet the preset value (such as 0.5 seconds). In this case, the second wearable device can determine that the user has made three consecutive contact actions between the limb and the first part of the user's body.

[0154] As an example, the future preset time period may be a preset fixed time period (such as 10 seconds). As another example, the future preset time period may also be related to the cumulative duration of the continuous limb motion detected within a fixed time period (such as 10 seconds). For example, assuming that a continuous limb motion is detected within a fixed time period (such as 10 seconds), and the end time of the limb motion is later than the end time corresponding to the above fixed time period, the end time of the future preset time period is the end time of the limb motion. Regarding the setting principle and basis of the future preset time period, the embodiment of the present application does not make specific restrictions. In some examples, the correspondence between the limb motion and the operation instruction can be pre-stored in the second wearable device. For example, the correspondence between the limb motion and the operation instruction can be a user-defined setting, a second wearable device pre-set in the second wearable device before leaving the factory, or updated during the use of the second wearable device, which is not specifically limited in the embodiment of the present application. Exemplarily, the second wearable device can determine the operation instruction corresponding to the first action according to the correspondence between the limb motion and the operation instruction pre-stored in the second wearable device.

[0155] Among them, the way in which the user customizes the correspondence between body movements and operation instructions may include but is not limited to setting it on a second wearable device, setting it on a first device connected to the second wearable device (such as a smart phone, tablet, personal computer (PC), etc.), and the embodiments of the present application do not make specific limitations.

[0156] In other examples, the correspondence between body movements and operating instructions can be managed or maintained by a third-party device (such as a third-party cloud device or a first device). In this case, the third-party device can assist the second wearable device in determining the operating instructions corresponding to the user's body movements. Exemplarily, the second wearable device can obtain the correspondence between body movements and operating instructions from the third-party device, and then determine the operating instructions corresponding to the first action based on the correspondence. In another possible implementation, the second wearable device can send the information of the body movement to the third-party device, the third-party device determines the corresponding operating instructions based on the information of the body movement, and sends the corresponding operating instructions to the second wearable device, and the second wearable device executes the corresponding instructions. The third-party device may be a server, or other device other than the first wearable device and the second wearable device.

[0157] In some embodiments, the operation purpose of the first action is one or more of the following: starting the first application, closing the first application, turning on the first function, turning off the first function, and adjusting the first function. Taking the first application as a music application as an example, the operation purpose of the first action may include but is not limited to playing music, pausing music, increasing the volume or decreasing the volume, etc.; taking the first application as a call application as an example, the operation purpose of the first action may include but is not limited to answering a call, hanging up a call, or initiating a call; taking the first application as a voice assistant application as an example, the operation purpose of the first action may include but is not limited to turning on the voice assistant or turning off the voice assistant; taking the first application as a health management application as an example, the operation purpose of the first action may include but is not limited to turning on blood oxygen detection, ending blood oxygen detection, turning on heart rate detection, or ending heart rate detection; taking the first application as a game application as an example, the operation purpose of the first action may include but is not limited to starting a game, ending a game, moving forward / backward / left / right, changing clothes, obtaining equipment, etc.

[0158] In some embodiments, the second wearable device can perform one or more of the following according to the first action: perform the first operation according to the corresponding action, instruct the first wearable device to perform the second operation corresponding to the first action, and instruct the first device to perform the third operation corresponding to the first action.

[0159] As an example, the operation instruction corresponding to the user's first action is used to control the second wearable device itself. In this case, S505 specifically includes: the second wearable device performs the first operation corresponding to the first action. For example, the second wearable device can determine the operation instruction corresponding to the user's first action and perform the corresponding first operation by itself. Assuming that the operation instruction corresponding to the user's first action is to play music, the second wearable device can start playing music according to the operation instruction.

[0160] As an example, the operation instruction corresponding to the first action of the user is used to control the first wearable device. In this case, S505 specifically includes: the second wearable device instructs the first wearable device to perform a second operation corresponding to the first action according to the first action.

[0161] As an example, the operation instruction corresponding to the user's first action is used to control the first device that has a communication connection with the second wearable device, such as a smart phone, a tablet computer, a PC, a wearable device, a smart home device (such as a smart speaker, a smart TV, a smart sweeping robot, a smart air conditioner, a smart curtain, a smart light, etc.). In this case, S505 specifically includes: the second wearable device instructs the first device to perform a third operation corresponding to the first action according to the first action. Assuming that the operation instruction corresponding to the user's first action is to reduce the cooling temperature of the smart air conditioner by 1°, the second wearable device can instruct the smart air conditioner to reduce the cooling temperature by 1° according to the operation instruction. As an example, the operation instruction corresponding to the user's first action is used to control multiple devices to collaboratively perform a task.

[0162] For example, the operation instruction corresponding to the user's first action is used to control the second wearable device to collaboratively perform a task with the first wearable device. For example, the operation instruction corresponding to the user's first action is used to instruct the first wearable device and the second wearable device to collaboratively complete tasks such as blood oxygen detection and heart rate detection. In this case, S505 specifically includes: the second wearable device performs the first operation corresponding to the first action and instructs the first wearable device to perform the second operation corresponding to the first action. Assuming that the operation instruction corresponding to the user's first action is used to instruct the first wearable device and the second wearable device to collaboratively complete blood oxygen detection, the second wearable device can turn on blood oxygen detection according to the operation instruction and instruct the first wearable device and the second wearable device to synchronously perform blood oxygen detection.

[0163] As another example, the operation instruction corresponding to the user's first action is used to control the second wearable device to collaborate with the first device to perform a task. For example, the operation instruction corresponding to the user's first action is used to instruct the second wearable device to collaborate with the first device to perform audio and video playback, sports management, etc. In this case, S505 specifically includes: the second wearable device performs the first operation corresponding to the first action and instructs the first device to perform the third operation corresponding to the first action. Assuming that the operation instruction corresponding to the user's first action is used to instruct the second wearable device to collaborate with the smart TV to play audio and video, the second wearable device can play audio and instruct the smart TV to synchronously play the video corresponding to the audio. Assuming that the operation instruction corresponding to the user's first action is used to instruct the second wearable device to collaborate with the smart phone to manage sports, the second wearable device measures the user's sports data and instructs the smart phone to synchronously display the user's sports data through the interface.

[0164] As an example, the operation instruction corresponding to the user's first action is used to control multiple devices to collaboratively perform a task. The second wearable device can directly send relevant instructions to the device that collaborates with it to perform the operation (such as the first wearable device or the first device), such as sending relevant instructions to the device that collaborates with it to perform the operation through a Bluetooth connection or a WiFi P2P connection, or forwarding relevant instructions through other transfer devices (such as routers, etc.). The embodiments of the present application do not make specific limitations and depend on the specific usage scenarios, network architecture and device capabilities.

[0165] It should be noted that the above-mentioned several examples of the second wearable device responding to the operation instructions corresponding to the user's first action are only examples. The embodiments of the present application do not limit the specific method and process of the second wearable device responding to the operation instructions, such as who responds, how to respond, how to respond collaboratively, etc. The embodiments of the present application do not limit them, depending on the specific device functions, device connection management or usage scenarios, etc.

[0166] In addition, it should be noted that the above-mentioned embodiment in which the second wearable device is used to determine the first action of the user when the first wearable device sends the first electrical signal based on the signal characteristics of one or more received signals is only an example, and the embodiment of the present application does not limit the decision-making party that ultimately determines the user's physical action. For example, in the above-mentioned embodiment, the second wearable device can also send the determined signal characteristics of one or more received signals to the first wearable device, so that the first wearable device can determine the first action of the user when the first wearable device sends the first electrical signal based on the signal characteristics of one or more received signals.

[0167] It can be understood that based on the human-computer interaction method provided in the embodiment of the present application, the human-computer interaction instructions of the user can be automatically obtained based on multiple wearable devices worn by the user without the aid of additional control devices. For example, the first wearable device can send an electrical signal (such as a pulse signal, a level signal, etc.) through a communication electrode close to the user's body, and the second wearable device can analyze the measured signal characteristics (such as signal strength and / or signal transmission duration) of the electrical signal from the first wearable device when passing through different paths of the human body to identify the user's body movements when the first wearable device sends the electrical signal, and then perform the operation corresponding to the body movement. This method does not require the user to carry additional control devices, so it can provide convenience for the user, facilitate the user to use it anytime, anywhere, and save costs. In addition, the method can realize any operation of the device instantly based on the user's bare-handed operation, thereby greatly simplifying the user's operation complexity. In addition, the method is based on the user's body movements identified by the signal characteristics of the received signal, and the analysis technology of the signal characteristics is quite mature, so the accuracy of the analysis result will be relatively high, and the human-computer interaction process realized based on this will also be very accurate. In summary, the human-computer interaction method provided in the embodiment of the present application can provide users with a more convenient, low-power, and user-friendly human-computer interaction experience with a high user experience.

[0168] It should be noted that the above embodiment only takes the first wearable device sending out a first electrical signal, the second wearable device receiving one or more received signals corresponding to the first electrical signal and performing subsequent signal feature analysis and body movement determination as an example, however, the embodiment of the present application does not limit who sends out the electrical signal, who receives the signal, and who performs the final signal feature analysis and body movement.

[0169] For example, in some embodiments, when the first wearable device and the second wearable device negotiate to determine that the second wearable device sends an electrical signal and the first wearable device receives the electrical signal, the second wearable device can send an electrical signal according to the negotiated electrical signal receiving and sending strategy, and the electrical signal can be transmitted to the location of the first wearable device through one or more paths. After receiving one or more received signals corresponding to the electrical signal from one or more paths, the first wearable device can determine the user's body movement when the second wearable device sends the electrical signal by analyzing the signal characteristics of the one or more received signals and finally perform the operation corresponding to the body movement.

[0170] For example, in some embodiments, when the first wearable device and the second wearable device negotiate to determine that both the first wearable device and the second wearable device send and receive electrical signals and the decision-maker (taking the first wearable device as an example) makes a decision and responds, the first wearable device and the second wearable device can respectively send electrical signals according to the negotiated electrical signal sending and receiving strategy and receive one or more received signals corresponding to the electrical signals transmitted from the other party through one or more paths. After receiving one or more received signals from the other party, the first wearable device and the second wearable device can obtain the signal characteristics of one or more received signals from the other party by analyzing and then preliminarily determining the body movements of the user when the other party's device sends the electrical signal. Finally, the first wearable device analyzes the body movements preliminarily determined by the first wearable device and the second wearable device, finally determines the body movements of the user and performs the operation corresponding to the body movements; or the second wearable device analyzes the body movements preliminarily determined by the first wearable device and the second wearable device, finally determines the body movements of the user and performs the operation corresponding to the body movements, or performs the operation corresponding to the body movements based on the body movements preliminarily determined by the first wearable device, or performs the operation corresponding to the body movements based on the body movements preliminarily determined by the second wearable device.

[0171] As an example, take the decision-making party as the first wearable device, such as Figure 8 As shown, the human-computer interaction method provided in the embodiment of the present application may include S501-S504, S801-S807:

[0172] S501: The first wearable device sends a first electrical signal.

[0173] S502: The second wearable device receives one or more reception signals corresponding to the first electrical signal.

[0174] S503: The second wearable device obtains signal characteristics of one or more received signals corresponding to the received first electrical signal.

[0175] S504: The second wearable device determines, according to signal characteristics of one or more received signals corresponding to the first electrical signal, a first action of the user when the first wearable device sends the first electrical signal.

[0176] S801: The second wearable device sends a second electrical signal.

[0177] S802: The first wearable device receives one or more reception signals corresponding to the second electrical signal.

[0178] S803: The first wearable device obtains signal characteristics of one or more received signals corresponding to the received second electrical signal.

[0179] S804: The first wearable device determines, based on signal characteristics of one or more received signals corresponding to the second electrical signal, a second action of the user when the second wearable device sends the second electrical signal.

[0180] For the detailed introduction of S801-S804, please refer to the above description of S501-S504, which will not be elaborated here.

[0181] It should be noted that the embodiments of the present application do not make any specific limitations on the specific execution timing of S501-S504 and S801-S904. For example, S501 and S801 can be executed synchronously or staggered with a small time difference. For example, S502-S504 and S802-S804 can be executed synchronously or staggered with a small time difference. The embodiments of the present application do not make any specific limitations.

[0182] S805: The second wearable device sends information about the first action to the first wearable device.

[0183] In some embodiments, the second wearable device can directly send the information of the first action to the first wearable device through a communication connection (such as a Bluetooth connection, a WiFi P2P connection, etc.) between the second wearable device and the first wearable device.

[0184] In some embodiments, the second wearable device may forward the information of the first action to the first wearable device via other transfer devices (such as a router, etc.).

[0185] The specific manner and process of the second wearable device sending the information of the first action to the first wearable device may depend on the specific usage scenario, network architecture, device capabilities, etc.

[0186] S806: The first wearable device determines a fourth action according to the first action and the second action.

[0187] In some embodiments, the first wearable device can analyze the first action and the second action, such as obtaining a first contact position between a first part and a second part of the user according to the first action, obtaining a second contact position between the first part and the second part of the user according to the second action, and then finally determining the contact position between the first part and the second part of the user based on the first contact position and the second contact position, and then determining a fourth action.

[0188] As an example, the first wearable device may use the middle position between the first contact position and the second contact position as the contact position between the first part and the second part of the user.

[0189] In some embodiments, when the second wearable device determines the first action of the user when the first wearable device sends the first electrical signal based on the signal characteristics of one or more received signals corresponding to the first electrical signal, the confidence corresponding to the first action can also be obtained; similarly, when the first wearable device determines the second action of the user when the second wearable device sends the second electrical signal based on the signal characteristics of one or more received signals corresponding to the second electrical signal, the confidence corresponding to the second action can also be obtained. Based on this, when the second wearable device sends the information of the first action to the first wearable device, the confidence corresponding to the first action can also be sent to the first wearable device, so that the first wearable device can use the contact position corresponding to the limb action with a higher confidence value as the contact position between the first part and the second part of the user based on the confidence of the results of the first action and the second action.

[0190] Of course, the embodiments of the present application do not limit the actual method and process by which the wearable device finally determines the limb motion based on multiple initially determined limb motions, and conventional technologies may be referred to.

[0191] S807: The first wearable device performs a corresponding operation according to the fourth action.

[0192] and Figure 5 The applicable scenario of the second wearable device performing the corresponding operation according to the first action is similar. The first wearable device can also first determine the operation instruction corresponding to the fourth action according to the fourth action and the body movements detected in the historical preset time period, and then perform the corresponding operation according to the operation instruction. In addition, the operation instruction corresponding to the fourth action of the user can be used to control the first wearable device itself, and can also be used to control the second wearable device or the first device that has a communication connection with the first wearable device, such as a smart phone, a tablet computer, a PC, a wearable device, a smart home device (such as a smart speaker, a smart TV, a smart sweeping robot, a smart air conditioner, a smart curtain, a smart light, etc.), and can also be used to control multiple devices (such as a first wearable device and a second wearable device, a first wearable device and a first device, a second wearable device and other devices, etc.) to collaboratively perform a task. For example, the first wearable device can perform one or more of the following according to the fourth action: perform the seventh operation corresponding to the fourth action, instruct the first wearable device to perform the eighth operation corresponding to the fourth action, and instruct the first device to perform the ninth operation corresponding to the fourth action. For the relevant introduction of S807, please refer to the introduction of S505 above, which will not be repeated here.

[0193] Of course, the above-mentioned first wearable device is used to finally determine the fourth action according to the first action preliminarily determined by the second wearable device and the second action preliminarily determined by the first wearable device. The embodiment is only an example, and the embodiment of the present application does not limit the decision-maker who finally determines the user's body movements. For example, in the above-mentioned embodiment, the first wearable device can also send the preliminarily determined second action (in some cases, it can also include the confidence corresponding to the second action) to the second wearable device, so that the second wearable device can finally determine the user's third action according to the second action and the first action preliminarily determined by the second wearable device, and then perform one or more of the following: perform the corresponding fourth operation according to the third action, instruct the first wearable device to perform the fifth operation corresponding to the third action, and instruct the first device to perform the sixth operation corresponding to the third action. It should be noted that the above-mentioned embodiment only takes multiple wearable devices each obtaining signal features according to the received received signal and preliminarily determining the corresponding body movements according to the signal features, and then the decision-maker finally determines the user's body movements according to the body movements preliminarily determined by multiple wearable devices as an example. Regarding the specific implementation process, the embodiment of the present application does not limit it. For example, in some embodiments, after multiple wearable devices obtain signal features according to the received received signal, the decision-maker can also determine the user's body movements according to multiple received signal features obtained by multiple wearable devices. As an example, after multiple wearable devices obtain signal features based on the received signals, the non-decision-making party can send the signal features obtained by each party to the decision-making party, and the decision-making party can finally determine the user's body movements after one or more steps such as comparison, deduplication, and correction of multiple signal features. Among them, comparison is used to determine the difference between the signal features preliminarily determined by multiple wearable devices, deduplication is used to avoid the interference of redundant information on the analysis results, and correction is used to reduce the error of the signal features finally determined.

[0194] In addition, it should be noted that the above embodiments only take the case where the user wears two wearable devices (such as the first wearable device and the second wearable device) as an example, and the embodiments of the present application do not specifically limit the number of wearable devices worn by the user. For example, the user can also wear three or more wearable devices. For example, the user wears three wearable devices, namely a smart watch, smart glasses and a smart necklace, wherein the smart watch, smart glasses and smart necklace are each provided with one or more communication electrodes, and the smart watch can send an electrical signal and / or receive a receiving signal corresponding to the electrical signal from the smart glasses / smart necklace through the communication electrodes provided thereon, and the smart glasses can send an electrical signal and / or receive a receiving signal corresponding to the electrical signal from the smart watch / smart necklace through the communication electrodes provided thereon, and the smart necklace can send an electrical signal and / or receive a receiving signal corresponding to the electrical signal from the smart watch / smart necklace through the communication electrodes provided thereon. Based on the sending and receiving of electrical signals between the smart watch, smart glasses and smart necklace, it can be identified whether the user makes contact actions between the hand and the face, the hand and the neck, the hand and the chest, etc.

[0195] For example, a user wears three wearable devices (such as a first wearable device, a second wearable device, and a third wearable device). Fig. 9 As shown, the first wearable device and the third wearable device can respectively send out the first electrical signal and the third electrical signal according to the electrical signal receiving and sending strategy, and the first electrical signal and the third electrical signal can be transmitted to the second wearable device through one or more paths.

[0196] In one possible implementation, after receiving one or more received signals corresponding to the first electrical signal from the first wearable device, and one or more received signals corresponding to the third electrical signal from the third wearable device, the second wearable device can obtain the signal characteristics of each received signal and determine the corresponding body movements (such as the first movement and the fifth movement) according to the signal characteristics of each received signal; then, the second wearable device can determine the sixth movement according to the first movement and the fifth movement; finally, the second wearable device can perform one or more of the following according to the sixth movement: perform the corresponding tenth operation according to the sixth movement, instruct the first wearable device to perform the eleventh operation corresponding to the sixth movement, and instruct the first device to perform the twelfth operation corresponding to the sixth movement. In another possible implementation, after receiving one or more received signals corresponding to the first electrical signal from the first wearable device, and one or more received signals corresponding to the third electrical signal from the third wearable device, the second wearable device can obtain the signal characteristics of each received signal and determine the sixth movement according to the signal characteristics of each received signal.

[0197] certainly, Fig. 9As an example of three wearable devices identifying user body movements by sending and receiving electrical signals, in some embodiments, the first wearable device and the second wearable device can also send out the first electrical signal and the second electrical signal respectively according to the electrical signal sending and receiving strategy, and the first electrical signal and the second electrical signal can be transmitted to the third wearable device through one or more paths. After receiving one or more received signals corresponding to the first electrical signal from the first wearable device and one or more received signals corresponding to the second electrical signal from the second wearable device, the third wearable device can obtain the signal characteristics of each received signal to determine the final body movement. Specifically, the third wearable device can preliminarily determine the corresponding body movement according to the signal characteristics of each received signal; then the body movement can be finally determined according to the above-mentioned multiple body movements preliminarily determined; finally, the third wearable device can perform the corresponding operation according to the finally determined body movement, or the third wearable device can cooperate with one or more other devices (such as one or more of the first wearable device, the second wearable device and the first device) to perform the corresponding operation according to the finally determined body movement, or the third wearable device can instruct one or more other devices (such as one or more of the first wearable device, the second wearable device and the first device) with which a communication connection is established to perform the operation corresponding to the finally determined body movement.

[0198] In other embodiments, the second wearable device and the third wearable device may also send out the second electrical signal and the third electrical signal respectively according to the electrical signal receiving and sending strategy, and the second electrical signal and the third electrical signal may be transmitted to the first wearable device through one or more paths, and after receiving one or more received signals corresponding to the second electrical signal from the second wearable device and one or more received signals of the third electrical signal from the third wearable device, the first wearable device may obtain the signal characteristics of each received signal to determine the final limb movement. Specifically, the third wearable device may preliminarily determine the corresponding limb movement according to the signal characteristics of each received signal; then the limb movement may be finally determined according to the above-mentioned multiple limb movements preliminarily determined; finally, the first wearable device may perform the corresponding operation according to the final determined limb movement, or the first wearable device may cooperate with one or more other devices (such as one or more of the second wearable device, the third wearable device and the first device) to perform the corresponding operation according to the final determined limb movement, or the first wearable device may instruct one or more other devices (such as one or more of the second wearable device, the third wearable device and the first device) that have established a communication connection with the first wearable device to perform the operation corresponding to the final determined limb movement.

[0199] In some embodiments, when a user wears three wearable devices (such as a first wearable device, a second wearable device, and a third wearable device), at least two of the three wearable devices can also send electrical signals to each other and receive one or more receiving signals corresponding to the electrical signals, so as to finally determine the limb movements based on the limb movements preliminarily identified by each wearable device according to the signal characteristics of the received signals, thereby improving the accuracy and fault tolerance of limb movement recognition and improving the reliability of human-computer interaction.

[0200] For example, the first wearable device, the second wearable device, and the third wearable device all send and receive electrical signals to each other. Fig.10 As shown, the first wearable device, the second wearable device and the third wearable device can respectively send out the first electrical signal, the second electrical signal and the third electrical signal according to the electrical signal sending and receiving strategy and receive one or more receiving signals corresponding to the electrical signals transmitted from the other two parties through one or more paths. Fig.10As shown, the first wearable device sends out a first electrical signal, the second wearable device sends out a second electrical signal, and the third wearable device sends out a third electrical signal, wherein the first electrical signal can be transmitted to the second wearable device through one or more paths and to the third wearable device through one or more paths, the second electrical signal can be transmitted to the first wearable device through one or more paths and to the third wearable device through one or more paths, and the third electrical signal can be transmitted to the first wearable device through one or more paths and to the second wearable device through one or more paths. After receiving one or more received signals corresponding to the second electrical signal (recorded as electrical signal 21) and one or more received signals corresponding to the third electrical signal (recorded as electrical signal 31), the first wearable device can obtain the signal characteristics of electrical signal 21 and the signal characteristics of electrical signal 31, and preliminarily determine the user's body movement (such as action 1) based on the obtained signal characteristics; similarly, the second wearable device can obtain the signal characteristics of one or more received signals corresponding to the first electrical signal (recorded as electrical signal 11) and the signal characteristics of one or more received signals corresponding to the third electrical signal (recorded as electrical signal 32), and preliminarily determine the user's body movement (such as action 2) based on the signal characteristics of electrical signal 11 and the signal characteristics of electrical signal 32; the third wearable device can obtain the signal characteristics of one or more received signals corresponding to the first electrical signal (recorded as electrical signal 12) and the signal characteristics of one or more received signals corresponding to the second electrical signal (recorded as electrical signal 22), and preliminarily determine the user's body movement (such as action 3) based on the signal characteristics of electrical signal 12 and the signal characteristics of electrical signal 22. Then, taking the decision-maker as the first wearable device as an example, the second wearable device and the third wearable device respectively send their preliminarily determined user's actions 2 and 3 to the decision-maker (i.e., the first wearable device), so that the first wearable device can finally determine the user's body movements (such as action 4) according to actions 2 and 3. Finally, the first wearable device can perform corresponding operations according to the final determination of the user's body movements (such as action 4), or the first wearable device can cooperate with one or more other devices (such as one or more of the second wearable device, the third wearable device, and the first device) to perform corresponding operations according to the final determination of the body movements, or the first wearable device can instruct one or more other devices (such as one or more of the second wearable device, the third wearable device, and the first device) that have established communication connections with the first wearable device to perform operations corresponding to the final determination of the body movements.

[0201] Of course, a similar processing method can also be used in the case where the decision-maker is the second wearable device or the third wearable device.

[0202] For example, assuming that the decision-maker is the second wearable device, the first wearable device and the third wearable device respectively send their respective preliminarily determined user's action 1 and action 3 to the second wearable device, so that the second wearable device can finally determine the user's action 4 based on the final determined user's action 4, or the second wearable device can cooperate with one or more other devices (such as the first wearable device, the third wearable device and one or more of the first device) to perform the corresponding operation according to the final determined body movement, or the second wearable device can instruct one or more other devices (such as the first wearable device, the third wearable device and one or more of the first device) that have established a communication connection with the second wearable device to perform the operation corresponding to the final determined body movement.

[0203] For another example, assuming that the decision-maker is a third wearable device, the first wearable device and the second wearable device respectively send their respective preliminarily determined user's action 1 and action 2 to the third wearable device, so that the third wearable device can finally determine the user's action 4 based on action 1 and action 2; finally, the third wearable device can perform a corresponding operation based on the finally determined user's action 4, or the third wearable device can cooperate with one or more other devices (such as one or more of the first wearable device, the second wearable device and the first device) to perform a corresponding operation based on the finally determined body motion, or the third wearable device can instruct one or more other devices (such as one or more of the first wearable device, the second wearable device and the first device) that have established a communication connection with the third wearable device to perform the operation corresponding to the finally determined body motion.

[0204] It should be noted that the above embodiment only takes the example that multiple wearable devices each obtain signal characteristics based on the received received signal and preliminarily determine the corresponding body movements based on the signal characteristics, and then the decision-maker finally determines the user's body movements based on the body movements preliminarily determined by the multiple wearable devices. The embodiments of this application do not limit the specific implementation process. For example, in some embodiments, after multiple wearable devices obtain signal characteristics based on the received received signal, the decision-maker can also determine the user's body movements based on multiple received signal characteristics obtained by multiple wearable devices.

[0205] based on Fig. 9 or Fig.10 The solution shown in the figure for performing body motion recognition based on the measurement results of multiple wearable devices can further improve the accuracy and fault tolerance of body motion recognition and improve the reliability of human-computer interaction.

[0206] It can be understood that the embodiment of the present application provides a human-computer interaction method that can be applied to the human-computer interaction process in any scenario, such as the scenario in which the body motion recognition technology based on a wearable device interacts with a certain wearable device, the scenario in which the body motion recognition technology based on a wearable device interacts with multiple wearable devices, the scenario in which the body motion recognition technology based on a wearable device interacts with a first device, the scenario in which the body motion recognition technology based on a wearable device interacts with a first device and one or more wearable devices, etc.

[0207] As an example, assuming that the user has customized action 1 in advance to turn on the smart speaker, or the user already knows in advance that the trigger action for turning on the smart speaker is action 1, then when the user needs to turn on the smart speaker, the user can perform action 1. When the user performs action 1, the electrical signal emitted by the wearable device 1 worn by the user reaches the wearable device 2 worn by the user through path 1 and path 2 of the human body respectively, such as reaching the wearable device 2 at the first moment and the second moment respectively. Wearable device 2 obtains its signal characteristics by analyzing the electrical signals arriving at the first moment and the second moment respectively, and then determines that the user's body movement is action 1 according to the signal characteristics of the received signals detected at the first moment and the second moment respectively, and determines that the operation corresponding to action 1 is to turn on the smart speaker. Based on this, wearable device 2 can instruct the smart speaker to turn on.

[0208] As an example, assuming that the user has customized action 2 in advance to turn on the heart rate measurement function of wearable device 2, or the user already knows in advance that the trigger action of the heart rate measurement function of wearable device 2 is action 2, then when the user needs to turn on the heart rate measurement function, the user can perform action 2. When the user performs action 2, the electrical signal emitted by wearable device 1 worn by the user reaches wearable device 2 worn by the user through path 3 and path 4 of the human body respectively, such as reaching wearable device 2 at the fourth moment and the fourth moment respectively. Wearable device 2 obtains its signal characteristics by analyzing the electrical signals arriving at the third moment and the fourth moment respectively, and then determines that the user's body movement is action 2 according to the signal characteristics of the received signals detected at the third moment and the fourth moment respectively, and determines that the operation corresponding to action 2 is to turn on the heart rate measurement function of wearable device 2. Based on this, wearable device 2 can turn on the heart rate measurement function.

[0209] As an example, assuming that the user has customized action 3 in advance to trigger the smart speaker and smart TV to play the audio and video of the program in collaboration, or the user already knows that the trigger action for the smart speaker and smart TV to play the audio and video of the program in collaboration is action 3, then when the user has the need to play program 1 in collaboration through the smart speaker and smart TV, the user can make body action 3. When the user makes action 3, the electrical signal emitted by the wearable device 1 worn by the user reaches the wearable device 2 worn by the user through the path 4 and path 5 of the human body respectively, such as reaching the wearable device 2 at the fifth moment and the sixth moment respectively. The wearable device 2 obtains its signal characteristics by analyzing the electrical signals arriving at the fifth moment and the sixth moment respectively, and then determines that the user's body action is action 3 according to the signal characteristics of the received signals detected at the fifth moment and the sixth moment respectively, and determines that the operation corresponding to action 3 is to trigger the smart speaker and smart TV to play the audio and video of the program in collaboration. Based on this, the wearable device 2 can instruct the smart TV to play the video of program 1 and instruct the smart speaker and smart TV to play the audio of program 1 in collaboration.

[0210] It should be understood that the various schemes of the embodiments of the present application can be used in reasonable combination, and the explanations or descriptions of the various terms appearing in the embodiments can be mutually referenced or explained in the various embodiments, without limitation.

[0211] It should also be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0212] It is understandable that, in order to implement the functions of any of the above-mentioned embodiments, the electronic device (such as a wearable device or a first device) includes a hardware structure and / or software module corresponding to each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0213] The embodiments of the present application can divide the electronic device into functional modules. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0214] It should also be understood that each module in the electronic device can be implemented in software and / or hardware form, without specific limitation. In other words, the electronic device is presented in the form of functional modules. The "module" here can refer to a specific application integrated circuit ASIC, a circuit, a processor and a memory that executes one or more software or firmware programs, an integrated logic circuit, and / or other devices that can provide the above functions.

[0215] In an optional manner, when data transmission is implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is implemented in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a readable storage medium, or transmitted from one readable storage medium to another readable storage medium. For example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The readable storage medium may be any available medium that can be accessed by a device or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disk (DVD)), or a semiconductor medium (e.g., a solid state disk (SSD)).

[0216] The steps of the method or algorithm described in conjunction with the embodiments of the present application can be implemented in hardware or by executing software instructions by a processor. The software instructions can be composed of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable read-only memory (EEPROM) memory, register, hard disk, mobile hard disk, compact disc read-only memory (CD-ROM) or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC). In addition, the ASIC can be located in an electronic device. Of course, the processor and the storage medium can also exist as discrete components.

[0217] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

Claims

1. A human-computer interaction method, characterized in that: The method comprises: Receiving one or more reception signals corresponding to the first electrical signal from the first wearable device; Acquire signal characteristics of one or more received signals corresponding to the first electrical signal; A first action of a user when the first wearable device sends the first electrical signal is determined according to signal characteristics of one or more received signals corresponding to the first electrical signal.

2. The method according to claim 1, characterized in that: The signal characteristics include signal strength and / or signal transmission duration.

3. The method according to claim 1 or 2, characterized in that: The receiving one or more reception signals corresponding to the first electrical signal from the first wearable device includes: receiving a first reception signal and a second reception signal of the first electrical signal from the first wearable device at a first moment and a second moment, respectively, the first moment and the second moment being different; The acquiring signal characteristics of one or more received signals corresponding to the first electrical signal includes: acquiring a first characteristic of a first received signal corresponding to the first electrical signal received at the first moment, and a second characteristic of a second received signal corresponding to the first electrical signal received at the second moment; The determining, based on signal characteristics of one or more received signals corresponding to the first electrical signal, a first action of a user when the first wearable device sends the first electrical signal includes: determining the first action based on the first characteristic and the second characteristic.

4. The method according to any one of claims 1 to 3, characterized in that The determining, according to signal characteristics of one or more received signals corresponding to the first electrical signal, a first action of the user when the first wearable device sends the first electrical signal includes: The first action is determined based on signal characteristics of one or more received signals corresponding to the first electrical signal and a first relationship; the first relationship is used to indicate the correspondence between the signal characteristics and the limb action.

5. The method according to any one of claims 1 to 3, characterized in that: The determining, according to signal characteristics of one or more received signals corresponding to the first electrical signal, a first action of the user when the first wearable device sends the first electrical signal includes: determining one or more paths for transmitting the first electrical signal according to signal characteristics of one or more received signals corresponding to the first electrical signal; The first action is determined based on the one or more paths.

6. The method according to claim 5, characterized in that The determining, according to signal characteristics of one or more received signals corresponding to the first electrical signal, a first action of the user when the first wearable device sends the first electrical signal includes: determining one or more paths for transmitting the first electrical signal according to signal characteristics of one or more received signals corresponding to the first electrical signal and a second relationship, wherein the second relationship is used to indicate a corresponding relationship between the signal characteristics and the paths; The first action is determined according to the one or more paths and a third relationship, where the third relationship is used to indicate a correspondence between the path and the limb action.

7. The method according to claim 6, characterized in that The method may further include one or more of the following: Execute a corresponding first operation according to the first action; Instructing the first wearable device to perform a second operation corresponding to the first action; Instructing the first device to perform a third operation corresponding to the first action; Wherein, a communication connection is established between the second wearable device and the first device.

8. The method according to claim 7, characterized in that The operation purpose of the first action is one or more of the following: starting the first application, closing the first application, starting the first function, closing the first function, and adjusting the first function.

9. The method according to claim 8, characterized in that The first application is a music application, and the operation purpose of the first action is to play music, pause music, increase the volume, or decrease the volume; or The first application is a call application, and the operation purpose of the first action is to answer a call, hang up a call, or initiate a call; or The first application is a voice assistant application, and the operation purpose of the first action is to turn on or off the voice assistant; or, The first application is a health management application, and the operation purpose of the first action is to start blood oxygen detection, end blood oxygen detection, start heart rate detection, or end heart rate detection; or, The first application is a game application, and the operation purpose of the first action is to start a game, end a game, move forward / backward / left / right, change clothes, or obtain equipment.

10. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: sending a second electrical signal; receiving information about a second action from the first wearable device, where the second action is a body movement of a user when the second wearable device sends the second electrical signal, determined by the first wearable device according to one or more received signals corresponding to the received second electrical signal; A third action is determined according to the second action and the first action.

11. The method according to claim 10, characterized in that The method may further include one or more of the following: Perform a corresponding fourth operation according to the third action; Instructing the first wearable device to perform a fifth operation corresponding to the third action; instructing the first device to perform a sixth operation corresponding to the third action; Wherein, a communication connection is established between the second wearable device and the first device.

12. The method according to any one of claims 1 to 6, characterized in that The method further comprises: sending a second electrical signal; Sending information about the first action to the first wearable device, where the information about the first action is used by the first wearable device to determine a fourth action; or sending information about the first action to a third wearable device, where the information about the first action is used by the third wearable device to determine a fourth action.

13. The method according to claim 12, characterized in that The method may further include one or more of the following: Perform a corresponding seventh operation according to the fourth action; Instructing the first wearable device to execute the fourth action to perform an eighth operation corresponding to the fourth action; instructing the first device to perform a ninth operation corresponding to the fourth action; or Wherein, a communication connection is established between the second wearable device and the first device.

14. The method according to any one of claims 1 to 6, characterized in that The method further comprises: receiving one or more reception signals corresponding to the third electrical signal from the third wearable device; Acquire signal characteristics of one or more received signals corresponding to the third electrical signal; determining a fifth action of the user when the third wearable device sends the third electrical signal according to signal characteristics of one or more received signals corresponding to the third electrical signal; A sixth action is determined according to the first action and the fifth action.

15. The method according to claim 14, characterized in that The method may further include one or more of the following: Perform a corresponding tenth operation according to the sixth action; instructing the first wearable device to perform an eleventh operation corresponding to the sixth action; instructing the first device to perform a twelfth operation corresponding to the sixth action; Wherein, a communication connection is established between the second wearable device and the first device.

16. The method according to any one of claims 7, 11, 13 or 15, characterized in that The first device includes one or more of the following: a smart phone, a tablet computer, a personal computer, a wearable device, and a smart home device, wherein the smart home device includes one or more of the following: a smart speaker, a smart TV, a smart sweeping robot, a smart air conditioner, a smart curtain, and a smart light.

17. The method according to any one of claims 1 to 16, characterized in that The first wearable device or the second wearable device includes any one of the following: a smart bracelet, a phone watch, a smart ring, a smart necklace, a smart earring, an in-ear headset, a headset, or a wearable augmented reality / virtual reality device.

18. A wearable device, characterized in that: The wearable device comprises: Communication electrodes for sending and / or receiving electrical signals; memory for storing computer program instructions; A processor, configured to execute the computer program instructions to support the wearable device to implement the method as described in any one of claims 1-17.

19. A communication system, characterized in that: The communication system includes multiple wearable devices, the multiple wearable devices include a first wearable device and a second wearable device, the first wearable device is used to implement the method as described in any one of claims 1-17, and the second wearable device is used to implement the method as described in any one of claims 1-17.

20. A readable storage medium, characterized in that: The readable storage medium stores program instructions, and when the program instructions are executed by the processing circuit, the method according to any one of claims 1 to 17 is implemented.

21. A chip system, characterized in that: The chip system includes a processing circuit and a storage medium, wherein the storage medium stores program instructions; when the program instructions are executed by the processing circuit, the method according to any one of claims 1 to 17 is implemented.

Images