Terminal control system and method

Abstract

Embodiments of the present application disclose a system and method, the system including at least one storage device that stores computer instructions, and at least one processor in communication with the at least one storage device, wherein the at least one processor, when executing the stored computer instructions, causes the system to acquire sensor signals of at least one sensor device, identify signal features of the sensor signals, and determine, based on the signal features, a motion of a target object associated with the at least one sensor device.

Description

[Technical Field]

[0001] The present disclosure relates to the field of sensors, and more particularly to a system and method for controlling a terminal device based on sensor signals collected by a sensor device. [Background technology]

[0002] As more and more smart terminal devices appear in daily life, efficient and easy control of smart terminal devices is beneficial to improving user experience. Commonly used human-computer interaction is achieved by voice interaction or by manually operating entity structures installed on the terminal device. However, in some cases, such as high noise, low environmental brightness, or inconvenient operation for users, operating a terminal device by voice interaction or manual operation on a panel may encounter certain difficulties and problems.

[0003] The present specification provides a method for determining the behavior of a target object, thereby improving the accuracy of the determined behavior of the target object, thereby enabling the behavior of the target object to be more in line with the user's wishes. Summary of the Invention

[0004] A system according to some embodiments of the present application includes a storage device configured to store computer instructions and a processor in communication with the storage device, which, when executing the stored computer instructions, causes the system to acquire sensor signals of at least one sensor device, identify signal features of the sensor signals, and determine, based on the signal features, a motion of a target object associated with the at least one sensor device.

[0005] In some embodiments, the at least one sensor device includes a vibration sensor device.

[0006] In some embodiments, the signal features include a combination of one or more of the following: number of vibration peaks, signal strength, time interval between adjacent vibration peaks, frequency content, and signal duration.

[0007] In some embodiments, the vibration sensor device is connected to a vibration receiving area via a solid medium and receives a vibration signal input to the vibration receiving area.

[0008] In some embodiments, the vibration signal is input to the vibration receiving area by hitting, tapping or rubbing the vibration receiving area.

[0009] In some embodiments, the vibration sensor device may be fixedly connected to the solid medium by at least one of adhesive, fitting, welding, riveting, and screw connection.

[0010] In some embodiments, the vibration sensor device is placed at a location in the solid medium where the vibration amplitude is large.

[0011] In some embodiments, determining a movement of a target object associated with the at least one sensor device based on the signal feature comprises: determining whether the signal feature satisfies a preset feature; and, in response to the signal feature satisfying the preset feature, determining a movement of the target object corresponding to the preset feature.

[0012] In some embodiments, determining whether the signal feature satisfies a preset characteristic includes determining whether the signal feature satisfies a preset characteristic based on a preset characteristic condition identification model that is a machine learning model.

[0013] In some embodiments, the action of the target object includes switching the terminal device from a first state to a second state.

[0014] In some embodiments, acquiring the sensor signal of the at least one sensor device includes acquiring a first sensor signal of the at least one sensor device, determining whether the first sensor signal is greater than a signal threshold, and in response to the first sensor signal being greater than the signal threshold, acquiring as the sensor signal a signal within a threshold time range after the first sensor signal.

[0015] In some embodiments, the vibration sensor device is installed in a wearable device that is in close contact with a body part of the user, and the wearable device receives vibration signals resulting from the user's physical activity.

[0016] In some embodiments, the vibration sensor device is in close contact with a body part of the user and receives vibration signals resulting from the user's physical activity.

[0017] In some embodiments, the physical activity comprises coughing, sneezing, snoring, yawning or falling.

[0018] In some embodiments, determining a motion of a target object associated with the at least one sensor device based on the signal features comprises determining a physiological state of the user based on the signal features, and determining a motion of the target object corresponding to the physiological state based on the physiological state of the user.

[0019] In some embodiments, determining the physiological condition of the user based on the signal feature comprises determining whether the signal feature satisfies a preset characteristic; and, in response to the signal feature satisfying the preset characteristic, determining the physiological condition corresponding to the preset characteristic.

[0020] In some embodiments, the target object action includes the mobile terminal recording a health status or issuing an early warning.

[0021] In some embodiments, the vibration sensor device has a response frequency of 2 KHz to 4.5 KHz.

[0022] In some embodiments, the sensitivity of the vibration sensor device is -35 dBV / (m / s 2 )~-15dBV / (m / s 2 )

[0023] In some embodiments, the at least one sensor device further comprises a motion sensor device.

[0024] In some embodiments, determining a movement of a target object associated with the at least one sensor device based on the signal features comprises determining whether the user has fallen and a body posture based on the signal features, and determining a corresponding movement of the target object based on whether the user has fallen and a body posture.

[0025] In some embodiments, determining the corresponding action of the target object based on whether the user has fallen and their body posture includes determining that the user is in danger when it is determined that the user has fallen and their body posture is stationary, and determining an action for the mobile terminal to perform a rescue call.

[0026] In some embodiments, the at least one sensor device further comprises a physiological parameter sensor device.

[0027] In some embodiments, determining a movement of a target object associated with the at least one sensor device based on the signal features comprises determining whether the user has fallen and their body posture and physiological parameters based on the signal features, and determining a corresponding movement of the target object based on whether the user has fallen and their body posture and physiological parameters.

[0028] In some embodiments, determining a corresponding action of the target object based on whether the user has fallen and the body posture and physiological parameters includes determining that the user is in danger when it is determined that the user has fallen and the body posture is in a stationary state or the physiological parameters exceed a preset threshold, and determining an action for the mobile terminal to execute a rescue call.

[0029] In some embodiments, the physiological parameter comprises at least one of heart rate, blood pressure, or blood glucose.

[0030] In some embodiments, the physical activity comprises dental impaction.

[0031] In some embodiments, the at least one sensor device includes a vibration sensor device installed at a specific location.

[0032] In some embodiments, identifying signal characteristics of the sensor signal includes identifying a number of vibration peaks, a time interval between adjacent vibration peaks, and a signal duration of the sensor signal.

[0033] In some embodiments, the at least one sensor device includes vibration sensor devices installed at different locations.

[0034] In some embodiments, the signal characteristics further comprise a phase difference of the sensor signals of the vibration sensor devices at the different locations, the phase difference of the sensor signals being used to identify the location of the vibration signal.

[0035] In some embodiments, identifying signal features of the sensor signal includes identifying a number of vibration peaks of the sensor signal, a time interval between adjacent vibration peaks, a signal duration, and a phase difference of the vibration signal.

[0036] In some embodiments, the action of the target object includes switching the terminal device from a first state to a second state.

[0037] In some embodiments, acquiring the sensor signal of the at least one sensor device includes acquiring a second sensor signal of the at least one sensor device; determining whether a frequency of the second sensor signal is lower than a preset frequency threshold; and determining that the second sensor signal is a false trigger signal in response to the frequency of the second sensor signal being lower than the preset frequency threshold.

[0038] In some embodiments, the at least one sensor device includes an audio input device, and acquiring the sensor signal of the at least one sensor device includes acquiring a third sensor signal of the at least one sensor device, determining whether the audio input device simultaneously receives user voice information, and determining that the third sensor signal is a false trigger signal in response to the audio input device receiving the user voice information.

[0039] In some embodiments, acquiring the sensor signal of the at least one sensor device includes acquiring a fourth sensor signal of the at least one sensor device; determining whether the fourth sensor signal is a false trigger signal based on a false trigger identification model; and in response to the fourth sensor signal not being a false trigger signal, acquiring a signal within a threshold time range after the fourth sensor signal as the sensor signal.

[0040] In some embodiments, the false trigger identification model is a machine learning model.

[0041] A method according to some embodiments of the present application includes acquiring a sensor signal of at least one sensor device, identifying signal features of the sensor signal, and determining a motion of a target object associated with the at least one sensor device based on the signal features.

[0042] A non-transitory computer-readable medium according to some embodiments of the present application includes computer instructions that, when executed by at least one processor, cause the at least one processor to acquire sensor signals of at least one sensor device, identify signal features of the sensor signals, and determine, based on the signal features, a motion of a target object associated with the at least one sensor device.

[0043] The present specification will be further described by way of illustrative examples, which are illustrated in more detail in the figures, which are not limiting and in which like numbers represent similar structures. [Brief explanation of the drawings]

[0044] [Figure 1] 1 is a schematic diagram of an application scene of a target object control system according to some embodiments of the present application; [Figure 2] 1 is an exemplary flowchart of a method for controlling a target object according to some embodiments of the present application; [Figure 3] FIG. 1 is an exemplary block diagram of a target object control system according to some embodiments of the present application. [Figure 4] 1 is an exemplary flowchart of a method for controlling a target object according to some embodiments of the present application; [Figure 5A] 10A and 10B are signal feature spectra of vibration signals due to various user operations according to some embodiments of the present application; [Figure 5B] 10A and 10B are signal feature spectra of vibration signals due to various user operations according to some embodiments of the present application; [Figure 5C] 10A and 10B are signal feature spectra of vibration signals due to various user operations according to some embodiments of the present application; [Figure 5D] 10A and 10B are signal feature spectra of vibration signals due to various user operations according to some embodiments of the present application; [Figure 6] 1 is a schematic diagram of an indoor environment in which a terminal device is installed, according to some embodiments of the present application. [Figure 7] 1 is an exemplary flowchart for controlling a lamp in an indoor environment, according to some embodiments of the present application. [Figure 8] 1 is a schematic diagram of an in-vehicle environment in which a terminal device is installed, according to some embodiments of the present application. [Figure 9] 1 is an exemplary flowchart for controlling a terminal device in a vehicle according to some embodiments of the present application. [Figure 10] FIG. 1 is a schematic diagram of a tabletop environment with a terminal device installed, in accordance with some embodiments of the present application. [Figure 11] 1 is an exemplary flowchart of a method for controlling a target object according to some embodiments of the present application; [Figure 12A] 1A-1C are schematic diagrams of signal feature spectra of vibration sensor signals corresponding to different physical activities, according to some embodiments of the present application; [Figure 12B] 1A-1C are schematic diagrams of signal feature spectra of vibration sensor signals corresponding to different physical activities, according to some embodiments of the present application; [Figure 12C] 1A-1C are schematic diagrams of signal feature spectra of vibration sensor signals corresponding to different physical activities, according to some embodiments of the present application; [Figure 12D] 1A-1C are schematic diagrams of signal feature spectra of vibration sensor signals corresponding to different physical activities, according to some embodiments of the present application; [Figure 12E] 1A-1C are schematic diagrams of signal feature spectra of vibration sensor signals corresponding to different physical activities, according to some embodiments of the present application; [Figure 13] FIG. 1 is a schematic diagram of a frequency curve of a vibration sensor signal of a user's physical activity according to some embodiments of the present application. [Figure 14] FIG. 1 is a schematic diagram of a target object control system applied to a wearable device, according to some embodiments of the present application. [Figure 15] 1 is an exemplary flowchart for determining a motion of a target object based on vibration signals due to a user's physical activity, according to some embodiments of the present application; [Figure 16] FIG. 1 is a schematic diagram of a target object control system applied to a wearable device, according to some embodiments of the present application. [Figure 17] 10 is an exemplary flowchart for determining a motion of a target object based on a vibration signal due to a user's physical activity. [Figure 18] 10 is an exemplary flowchart for determining a motion of a target object based on a vibration signal due to a user's physical activity. [Figure 19] FIG. 1 is a schematic diagram of a target object control system applied to a wearable device, according to some embodiments of the present application. [Figure 20] 1 is an exemplary flowchart of a method for controlling a target object according to some embodiments of the present application; [Figure 21] 1 is a schematic diagram of vibration signal transmission according to some embodiments of the present application; [Figure 22] FIG. 1 is a schematic diagram of a target object control system applied to a wearable device, according to some embodiments of the present application. [Figure 23] 10 is a signal feature spectrum of a sensor signal corresponding to a user's teeth impact, according to some embodiments of the present application. [Figure 24] FIG. 1 is a schematic diagram of a target object control system applied to a wearable device, according to some embodiments of the present application. DETAILED DESCRIPTION OF THE INVENTION

[0045] In order to more clearly explain the technical solutions of the embodiments of the present specification, the drawings necessary for the description of the embodiments will be briefly described below. Obviously, the drawings described below are merely examples or parts of the embodiments of the present specification, and those skilled in the art can apply the present specification to other similar scenarios based on these drawings without any creative effort. It should be understood that these exemplary embodiments are merely intended to enable those skilled in the art to better understand and practice the present invention, and do not limit the scope of the present invention in any way. Unless otherwise apparent from the linguistic environment or specified, the same symbols in the drawings represent the same structures or operations.

[0046] As used herein and in the claims, terms such as "a," "one," "one," and / or "the" do not specifically refer to the singular and may include the plural, unless the context clearly dictates otherwise. Generally, the terms "comprise" and "containing" are intended to include only the explicitly identified steps and elements; these steps and elements are not an exclusive list; a method or apparatus may also include other steps or elements. The term "based on" means "based at least in part on." The term "in one embodiment" means "at least one embodiment," and the term "in another embodiment" means "at least one other embodiment." Relevant definitions of other terms are provided below.

[0047] Some embodiments of the present specification provide a method for determining the movement of a target object. The method includes acquiring a sensor signal by at least one sensor device, the sensor signal being generated after the sensor device acquires an external signal. In some embodiments, the external signal may include a vibration signal or a combination of a vibration signal and another type of signal. Other types of signals may include an acoustic signal, an optical signal, an electrical signal, etc. Because the vibration signal is transmitted through a solid medium, the vibration signal can still be accurately and effectively collected by the sensor device even in an environment with sound interference and therefore high noise. By identifying signal features of the sensor signal, the movement of the target object associated with the at least one sensor device can be determined based on the signal features, thereby making operation on the target object more accurate and convenient. The target object may refer to a terminal device that connects / communicates with the sensor device and performs various functions.

[0048] 1 is a schematic diagram of an application scenario of a target object control system according to some embodiments of the present application. For convenience of description, the target object control system 100 may be abbreviated as system 100. The system 100 may include a sensor device 110, a processing device 120, a terminal device 130 (also referred to as a target object), and a storage device 140. In some embodiments, the system 100 may identify signal features of a sensor signal collected by the sensor device 110 and determine an action to be performed by the terminal device based on the signal features. Each assembly of the system 100 may be connected to each other via wires or wirelessly.

[0049] In some embodiments, the wired connection includes, but is not limited to, a connection using metallic cable, optical cable, or a combination of metallic and optical cables, such as coaxial cable, communication cable, flexible cable, spiral cable, non-metallic sheath cable, metallic sheath cable, multi-core cable, twisted pair cable, flat cable, shielded cable, telecommunication cable, twin-ax cable, parallel twin-core cable, and twisted pair cable. The above examples are for ease of explanation only, and the medium of the wired connection may be other types of medium, such as transmission carriers of other electrical or optical signals.

[0050] Wireless connections include, but are not limited to, radio communication, free space optical communication, acoustic communication, electromagnetic induction, and the like. Wireless communications include, but are not limited to, IEEE 302.11 series standards, IEEE 302.15 series standards (e.g., Bluetooth technology and ZigBee technology), first generation mobile communications technologies, second generation mobile communications technologies (e.g., FDMA, TDMA, SDMA, CDMA, and SSMA), general packet radio service technologies, third generation mobile communications technologies (e.g., CDMA2000, WCDMA, TD-SCDMA, and WiMAX), fourth generation mobile communications technologies (e.g., TD-LTE and FDD-LTE), satellite communications (e.g., GPS technology), near field communication (NFC), and other technologies operating in the ISM band (e.g., 2.4 GHz). Free-space optical communications include, but are not limited to, visible light, infrared signals, etc. Acoustic communications include, but are not limited to, sound waves, ultrasonic signals, etc. Electromagnetic induction includes, but is not limited to, near field communication technologies, etc. The above examples are for ease of explanation only, and the medium of the wireless connection may be other types of medium, such as Z-wave technology, other paid civilian or military radio frequency bands, etc.

[0051] The sensor device 110 may collect an external signal and generate a sensor signal (e.g., an electrical signal) based on the external signal. The external signal may include a mechanical vibration signal (which may be referred to as a vibration signal), an acoustic signal, an optical signal, an electrical signal, etc. In some embodiments, the external signal originates from a user or is input by a user in a specific manner and may be referred to as a user signal. The sensor device 110 may include, but is not limited to, one or more of a pressure sensor device, a vibration sensor device, a tactile sensor device, an audio input device, an optical sensor device, etc. In some embodiments, the sensor device 110 may include at least a vibration sensor device for collecting a vibration signal. In some embodiments, when a user inputs a signal to the sensor device 110, the sensor device may generate a corresponding sensor signal. Illustratively, the sensor device 110 may collect a vibration signal input by a user (e.g., by knocking on a door, banging on a tooth, etc.). Because the vibration signal is hardly affected by environmental noise during transmission, it can be ensured that the vibration signal is accurately and effectively collected by the sensor device 110.

[0052] Processing unit 120 may process data and / or information obtained from sensor device 110, storage device 140, or other components of system 100. For example, processing unit 120 may process sensor signals obtained from sensor device 110 and determine signal characteristics of the sensor signals. In some embodiments, processing unit 120 may be a single server or a collection of servers. Servers may be centralized or distributed. In some embodiments, processing unit 120 may be local or remote. For example, processing unit 120 may access information and / or data from sensor device 110, terminal device 130, and / or storage device 140. Also, for example, processing unit 120 may be directly connected to sensor device 110, terminal device 130, and / or storage device 140 to access information and / or data. In some embodiments, processing unit 120 may include one or more sub-processors (e.g., a single-chip processor or a multi-core multi-chip processor). By way of example only, the processor may include a central processing unit (CPU), an application specific integrated circuit (ASIC), an application specific instruction set processor (ASIP), a graphics processor (GPU), a physical processor (PPU), a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic device (PLD), a controller, a microcontroller unit, a reduced instruction set computer (RISC), a microprocessor, etc., or any combination thereof. In some embodiments, the processing unit 120 may be a chip. The chip may be located within the sensor device 110. In some specific embodiments, the processing unit 120 may be a processor of the sensor device 110 itself (e.g., a chip of the sensor device 110) and may be capable of not only picking up and collecting vibration signals but also processing sensor signals generated by the sensor device 110.

[0053] Storage device 140 may store data, instructions, and / or any other information, such as the sensor signals and signal feature information of the sensor signals. In some embodiments, storage device 140 may store data acquired from sensor device 110 and / or processing device 120. In some embodiments, storage device 140 may store data and / or instructions for processing device 120 to execute or for processing device 120 to implement the example methods described herein. In some embodiments, storage device 140 may include mass memory, removable memory, volatile read / write memory, read-only memory (ROM), etc., or any combination thereof. In some embodiments, storage device 140 may be implemented in a cloud platform.

[0054] In some embodiments, storage device 140 may be in communication with at least one other assembly of system 100 (e.g., processing unit 120). At least one assembly of system 100 may access data (e.g., signal characteristics) stored in storage device 140. In some embodiments, storage device 140 may be part of processing unit 120.

[0055] In some embodiments, terminal device 130 may include one or any combination of a mobile device, a tablet computer, a laptop computer, an in-vehicle device, a smart home device, etc. In some embodiments, the mobile device may include a wearable device, a smart mobile device, a virtual reality device, an augmented reality device, a smart toy, a smart speaker, etc., or any combination thereof. In some embodiments, the wearable device may include a smart bracelet, smart footwear, smart glasses, a smart helmet, a smart watch, smart clothing, a smart backpack, a smart accessory, etc., or any combination thereof. In some embodiments, the smart mobile device may include a smartphone, a personal digital assistant (PDA), a gaming device, a navigation device, a point-of-sale device, etc., or any combination thereof. In some embodiments, the virtual reality device and / or the augmented reality device may include a virtual reality helmet, virtual reality glasses, a virtual reality eye mask, an augmented reality helmet, augmented reality glasses, an augmented reality eye mask, etc., or any combination of the above examples. In some embodiments, the in-vehicle device includes an in-car phone, in-car multimedia, Bluetooth, navigation, etc. In some examples, smart home devices may include smart lighting devices (e.g., lamps), smart appliance controls, smart surveillance devices, smart televisions, smart cameras, intercoms, etc., or any combination thereof.

[0056] FIG. 2 is an exemplary flowchart of a target object control method according to some embodiments of the present application. Specifically, the target object control method 200 may be executed by the target object control system 100 (e.g., the processing device 120). For example, the target object control method 200 may be stored in a storage device (e.g., an internal storage unit of the processing device 120 or the storage device 140) in the form of a program or instructions, and the target object control system 100 (e.g., the processing device 120) can execute the target object control method 200 when it executes the program or instructions. The operations in the flow chart shown below are for illustrative purposes only. In some embodiments, the method 200 may be executed by one or more additional operations not described and / or one or more operations not shown. Furthermore, the order of the operations of the method 200 shown in FIG. 2 and described below is not limited.

[0057] In step 210, the processing unit 120 may acquire a sensor signal of at least one sensor device 110. In some embodiments, step 210 is performed by the sensor signal acquisition module 310.

[0058] The sensor signal is a signal generated by the sensor device 110 based on an external signal received by the sensor device 110. For example, the sensor signal may be an electrical signal generated by the sensor device 110 based on a received vibration signal. In some embodiments, the external signal may include a mechanical vibration signal (also called a vibration signal) or a combination of a vibration signal and another type of signal. Other types of signals may include an optical signal, an acoustic signal, an electrical signal, etc. The sensor device 110 may include, but is not limited to, one or more of a vibration sensor device, a pressure sensor device, a tactile sensor device, an audio input device, an optical sensor device, etc. Illustratively, the sensor device 110 may include at least a vibration sensor device to collect vibration signals. In some embodiments, a vibration signal is generated by a user's physical activity, a user's teeth striking, or performing a specific operation (e.g., hitting, tapping, rubbing, etc.) on a specific area (e.g., a vibration receiving area). The sensor device 110 may receive the vibration signal and generate a corresponding sensor signal based on the vibration signal.

[0059] In step 220, the processing unit 120 may identify signal features of the sensor signal. In some embodiments, step 220 may be performed by the signal feature identification module 320.

[0060] The signal feature may refer to relevant information indicative of a signal characteristic. In some embodiments, the processing unit 120 may identify the signal feature of the sensor signal by performing time domain processing and / or frequency domain processing on the sensor signal. The signal feature of the sensor signal corresponding to the vibration signal may include, but is not limited to, one or more combinations of the number of vibration peaks, the signal strength, the interval time between adjacent vibration peaks, the frequency components, the signal duration, etc.

[0061] The number of vibration peaks refers to the number of vibration peaks whose amplitude is greater than a preset amplitude. The number of vibration peaks may indicate a numerical characteristic of the external signal (e.g., the number of times a user taps, strikes teeth, or engages in a specific physical activity). The signal strength refers to the strength of the signal. The signal strength may indicate an intensity characteristic of the external signal (e.g., the strength of the user's tapping or tapping). The greater the strength of the user's tapping or tapping, the greater the signal strength of the generated vibration signal. The interval time between adjacent vibration peaks refers to the time interval between two adjacent vibration peaks. In some embodiments, the interval time between adjacent vibration peaks may indicate a density characteristic of the external signal (e.g., the time interval between a user's tapping, tapping, or strikes teeth, the time interval between adjacent physical activities, etc.). The frequency components of the signal refer to information regarding the proportion of each frequency in the sensor signal. The information regarding the proportion of each frequency includes, for example, the proportion of high-frequency signals, mid-high-frequency signals, intermediate-frequency signals, mid-low-frequency signals, low-frequency signals, etc. The terms "high frequency," "medium frequency," "intermediate frequency," "medium-low frequency," and / or "low frequency" herein may be defined arbitrarily. For example, a high frequency signal may be a signal having a frequency greater than 4000 Hz. A medium frequency signal may be a signal having a frequency in the range of 2500 Hz to 5000 Hz. A medium frequency signal may be a signal having a frequency in the range of 1000 Hz to 4000 Hz. A medium-low frequency signal may be a signal having a frequency in the range of 600 Hz to 2000 Hz. A low frequency signal may be a signal having a frequency in the range of 20 Hz to 1000 Hz. The signal duration may refer to the duration of the entire sensor signal or the duration of a single vibration peak of the sensor signal. For example, the entire sensor signal may include three vibration peaks, and the duration of the entire sensor signal is 3 seconds.

[0062] In some embodiments, the processing unit 120 may determine the signal features of the sensor signal by performing time domain processing and / or frequency domain processing on the sensor signal to determine a signal feature spectrum of the sensor signal. For more details about identifying the signal features of the sensor signal, please refer to the embodiment of FIG. 4, and the description will be omitted here.

[0063] In step 230, the processing unit 120 may determine, based on the signal features, a motion of the target object associated with the at least one sensor device 110. In some embodiments, step 230 may be performed by a motion determination module 330.

[0064] The target object refers to a terminal device 130 for performing a specific function. For example, the target object may be a mobile device for making a phone call (e.g., a smartphone, a smart watch, etc.). Another example may be an audio device for playing music (e.g., headphones, car speakers, Bluetooth speakers, etc.). Another example may be a lighting device for lighting (e.g., an interior light bulb, a vehicle lamp, etc.). Note that the above-listed terminal devices 130 are merely exemplary, and the terminal device 130 may be any device that performs a function desired by a user. When a target object is associated with at least one sensor device 110, it may be understood that the terminal device 130 is used to perform a specific function in response to a specific signal characteristic of a sensor signal of the sensor device 110. In some embodiments, the target object may be communicatively connected to the processing device 120. In some embodiments, the communicative connection may include a wired connection or a wireless connection. For example, the terminal device 130 may be connected wired via a cable. For example, the terminal device 130 may be connected wirelessly via a Bluetooth device. The target object's action may refer to the functions of the terminal device 130, such as playing / pausing music, making / hanging up a phone call, turning on / off lights, etc. For more details about determining the target object's action based on signal features, please refer to the embodiments in Figures 4 to 10, and the description will be omitted here.

[0065] In some embodiments, the processing device 120 may determine the physiological state of the user based on the signal features. Furthermore, the processing device 120 may determine a motion of the target object corresponding to the physiological state of the user based on the physiological state of the user. In some embodiments, the processing device 120 may determine whether the user has fallen and their body posture based on the signal features, and determine a corresponding motion of the target object based on whether the user has fallen and their body posture. In some embodiments, the processing device 120 may determine whether the user has fallen and their body posture and physiological parameters based on the signal features, and determine a corresponding motion of the target object based on the determination of whether the user has fallen and their body posture and physiological parameters. For more details regarding determining the physiological state of the user based on the signal features, please refer to the embodiments of FIGS. 11 to 18, and further description will be omitted here.

[0066] In some embodiments, the processing device 120 may perform false trigger prevention processing when acquiring a sensor signal. Illustratively, the processing device 120 may acquire sensor signals of at least one sensor device 110 in real time or intermittently. When the processing device 120 acquires a sensor signal (also referred to as a first sensor signal), it may determine whether the signal strength of the first sensor signal is greater than a signal threshold. If the signal strength of the first sensor signal is less than the signal threshold, the processing device 120 may determine that the first sensor signal is a false trigger signal. If the signal strength of the first sensor signal is greater than the signal threshold, the processing device 120 may acquire a signal within a threshold time range after the first sensor signal as the sensor signal. For more details regarding acquiring sensor signals of at least one sensor device 110, please refer to descriptions elsewhere in this specification, and further description will be omitted here.

[0067] 3 is an example block diagram of a target object control system according to some embodiments of the present application. As shown in FIG. 3, the target object control system 300 may include a sensor signal acquisition module 310, a signal feature identification module 320, and an action determination module 330. In some embodiments, the target object control system 300 may be implemented by the target object control system 100 (e.g., processing unit 120) shown in FIG. 1.

[0068] In some embodiments, the sensor signal acquisition module 310 may be used to acquire the sensor signals of the vibration sensor device. In some embodiments, the sensor signal acquisition module 310 may also be used to acquire the sensor signals of at least one sensor device 110.

[0069] In some embodiments, the signal feature identification module 320 may be used to identify signal features of the vibration sensor signal. In some embodiments, the signal feature identification module 320 may also be used to identify signal features of the sensor signal.

[0070] In some embodiments, the motion determination module 330 may be used to determine a motion of a target object associated with the at least one sensor device 110 based on the signal features. In some embodiments, the motion determination module 330 may also be used to determine a physiological state of a user based on the signal features. In some embodiments, the motion determination module 330 may further be used to determine a motion of a target object associated with the at least one sensor device 110 based on the physiological state of the user.

[0071] It should be noted that the above description of the target object control system 300 and its devices / modules is for ease of explanation only and does not limit the scope of the present application to the enumerated embodiments. After understanding the principles of the system, those skilled in the art will understand that various devices / modules can be arbitrarily combined or connected to other devices / modules to form subsystems without departing from these principles. For example, the signal feature identification module 320 and the action determination module 330 shown in FIG. 3 may be different modules in a single device (e.g., the processing device 120), or may be a single module that realizes the functions of the two or more modules. For example, each module may have its own memory module. For example, each module may share a single memory module. All such modifications are within the scope of protection of the present application.

[0072] FIG. 4 is an exemplary flowchart of a target object control method according to some embodiments of the present application. Specifically, the target object control method 400 may be executed by the target object control system 100 (e.g., the processing device 120). For example, the target object control method 400 may be stored in a storage device (e.g., an internal storage unit of the processing device 120 or the storage device 140) in the form of a program or instructions. When the target object control system 100 (e.g., the processing device 120) executes the program or instructions, the target object control method 400 can be executed. The operations in the flow chart shown below are for illustrative purposes only. In some embodiments, the method 400 may be implemented by one or more additional operations not described and / or one or more operations not shown. Furthermore, the order of the operations of the method 400 shown in FIG. 4 and described below is not limited. In some embodiments, the method 400 may be applied to fields such as smart homes, smart cars, smart factories, smart speakers, and smart toys.

[0073] In step 410, the processing unit 120 may acquire a sensor signal of the vibration sensor device. In some embodiments, step 410 is performed by the sensor signal acquisition module 310.

[0074] The vibration sensor device may collect vibration signals. For example, the vibration sensor device may be a microphone that uses bone conduction as one of the main sound propagation methods (also called a bone conduction microphone), an accelerometer, etc. In some embodiments, the vibration sensor device may collect vibration signals from a specific area. The specific area is an artificially set area for receiving vibration signals and may be called a vibration receiving area. In some embodiments, the vibration sensor device may acquire vibration signals from the vibration receiving area and generate a corresponding sensor signal. The sensor signal generated by acquiring the vibration signal is also called a vibration sensor signal. The vibration sensor signal may be, for example, an electrical signal.

[0075] In some embodiments, the vibration sensor device may include a housing having a predetermined hardness to facilitate transmission of the vibration signal. For example, the housing of the vibration sensor device may be a vibration receiving area, and a specific vibration signal may be generated when a user performs a specific operation on the housing (e.g., one or more combinations of operations such as hitting, tapping, or rubbing). The specific vibration signal corresponds to a specific operation command.

[0076] Because mechanical vibrations propagate through solid objects with little loss, the vibration receiving area does not need to be located at a certain position of the vibration sensor device (e.g., on the housing of the vibration sensor device). In some embodiments, the vibration receiving area may be located at a position where mechanical vibrations can be effectively transmitted. In some embodiments, the vibration receiving area may be located in a solid medium. The solid medium may be a metal (e.g., stainless steel, aluminum alloy, etc.) or a non-metal (e.g., wood, plastic, etc.). The vibration sensor device is connected to the vibration receiving area through the solid medium and receives a vibration signal input to the vibration receiving area. The vibration signal input to the vibration receiving area may be transmitted to the vibration sensor device through the solid medium. In some embodiments, the vibration receiving area may be a selected area of the solid medium. For example, in the embodiment shown in FIG. 6, the vibration sensor device may be installed on the door 610 and / or the headboard 630. For example, in the embodiment shown in FIG. 8, the vibration sensor device may be installed on the steering wheel 820.

[0077] In some embodiments, the vibration sensor device may be fixedly connected to the solid medium. The fixed connection method may include, but is not limited to, adhesive bonding, fitting, welding, riveting, screw connection, snap connection, etc., to ensure good and strong contact between the vibration sensor device and the solid medium, thereby accurately and effectively transmitting the vibration signal from the solid medium to the vibration sensor device. For example, in the embodiment shown in FIG. 6, at least one vibration sensor device may be glued to the door 610, and at least one vibration sensor device may be glued to the headboard 630 or connected to the sidewall with screws. Also, for example, in the embodiment shown in FIG. 8, at least one vibration sensor device may be fitted into the steering wheel 820. In some specific embodiments, the vibration sensor device may be connected to the solid medium by an adhesive method, which is not only easy and fast to connect, but also easy to remove. In some cases, the vibration sensor device may be fitted or glued to the solid medium (e.g., the door 610 and sidewall in the interior environment 600, the steering wheel 820 in the vehicle interior environment 800, etc.). Because mechanical vibrations have low propagation loss in solid media and maintain a sufficiently strong signal strength even over long distances, the signal input area (i.e., the vibration receiving area) can be effectively expanded. Because vibration signals can be input within a wide range, users can avoid having to search for an operation panel or button, improving the user experience. In some cases, particularly in dark environments, this can avoid situations where users have to walk in the dark to operate the lamp 640 (e.g., in the indoor environment 600, the user needs to walk to the location where the switch is installed on the side wall to find the switch for the lamp 640) and bump into tables or chairs.

[0078] In some embodiments, the vibration sensor device may be installed at any location on the solid medium. Using the door 610 shown in FIG. 6 as an example, exemplary installation locations may include the door frame of the door 610, the door handle of the door 610, the bottom of the door 610, the center of the door 610, etc. In some embodiments, the vibration sensor device may be installed at a location where the amplitude of vibration in the solid medium is large. For example, when a user knocks on the door 610, the amplitude is generally large at locations close to the center of the door 610, and the vibration signal received by the vibration sensor device is stronger.

[0079] Illustratively, the vibration sensor device may be attached to the door 610, and the upper half region of the door 610 may be a vibration receiving region. A vibration signal generated when a user performs a specific operation on the upper half region of the door 610 (i.e., the vibration receiving region) may be transmitted through the door 610 to the vibration sensor device connected to the door 610.

[0080] In some embodiments, the vibration receiving area may be at least a portion of a solid medium. In some embodiments, the vibration receiving area may be located at a position that is easily manipulated by a user (e.g., struck, tapped, or rubbed). For example, in the indoor environment 600 shown in FIG. 6 , the solid medium may be a door 610, and the vibration receiving area may be a surface of the door 610 that faces away from the indoor environment 600. For example, in the indoor environment 600, the upper half of the door 610 may be the vibration receiving area. In some embodiments, the vibration receiving area may have any position, shape, and / or size. For example, the solid medium may be a headboard 630, and the vibration receiving area may be the headboard 630 or a specific area thereof (e.g., the right area, the left area, etc. of the headboard 630). For example, if the solid medium is the headboard 630, the entire surface of the headboard 630 facing the user may be the vibration receiving area.

[0081] In some embodiments, the vibration receiving area may be an independent structure mounted on a solid medium. For example, the vibration receiving area may be a vibration receiving surface mounted on the surface of door 610. The vibration receiving surface may be a rigid sheet or plate-like object, such as an iron piece or a steel plate. In some embodiments, the vibration receiving surface may be removably connected to the solid medium. In some embodiments, the vibration receiving surface may be attached to any position on the solid medium according to the user's needs. For example, in the embodiment shown in FIG. 6, the user is usually located on the right side of bed 620, so the vibration receiving surface may be mounted on the right side of headboard 630.

[0082] In some embodiments, the vibration receiving area may be a part of the vibration sensor device, and the housing of the vibration sensor device described in the above embodiments may be the vibration receiving area.

[0083] To prevent a user from being injured when performing a specific operation and inputting a vibration signal, in some embodiments, the external packaging of the vibration sensor device (e.g., the external case of the sensor device) and / or the vibration receiving area should be free of sharp corners. For example, the surface of the external packaging of the vibration sensor device may be configured as an arcuate surface. In some embodiments, the installation position of the vibration sensor device should avoid a position where a user constantly performs a specific operation. For example, a user sleeping on the right side of the bed 620 typically performs operations such as hitting, tapping, and / or rubbing against the right edge of the headboard 630. Therefore, the vibration sensor device should be fitted inside the headboard 630 or installed in a position away from the right side of the headboard 630 (e.g., the top region, right region, etc. of the headboard 630), so that the user does not come into contact with the external packaging of the vibration sensor device when performing a specific operation.

[0084] In some embodiments, the vibration sensor device may be powered by a battery installed therein. Exemplary battery types may include lithium batteries, hydrogen fuel cells, alkaline zinc manganese batteries, nickel cadmium batteries, nickel hydrogen batteries, etc. In some embodiments, the vibration sensor device may be powered by an external power source. For example, the vibration sensor device may be connected to the external power source using a power line or a wireless charging module and powered by the external power source. The external power source may be, for example, a mobile phone charger, household electricity, etc.

[0085] The vibration sensor device has a predetermined volume. In some embodiments, the volume of the vibration sensor device is less than 1 mm 3 ~10cm 3 In some embodiments, the volume of the vibration sensor device may be between 0.5 mm 3 ~20cm 3 In some embodiments, the volume of the vibration sensor device may be between 1.5 mm 3 ~5cm 3 In some embodiments, the volume of the vibration sensor device may be between 2 mm 3 ~1cm 3 It may be between.

[0086] In some embodiments, in order for the vibration sensor device to be able to completely and clearly collect the vibration signal input by the user, the sensitivity of the vibration sensor device also needs to meet certain requirements. Sensitivity may be understood as the magnitude of the response to a particular signal when the sensor device is operating. In some embodiments, the sensitivity of the vibration sensor device is less than -50 dBV / (m / s 2 )~-10dBV / (m / s 2 In some embodiments, the sensitivity of the vibration sensor device may be between -35 dBV / (m / s 2 )~-15dBV / (m / s 2 In some embodiments, the sensitivity of the vibration sensor device may be between -30 dBV / (m / s 2 )~-15dBV / (m / s 2In some embodiments, the sensitivity of the vibration sensor device may be between -25dBV / (m / s 2 )~-20dBV / (m / s 2 ) may be placed between

[0087] In step 420, the processing unit 120 may identify signal features of the vibration sensor signal. In some embodiments, step 420 may be performed by the signal feature identification module 320.

[0088] In some embodiments, the processing unit 120 may process the vibration sensor signal (e.g., time domain processing and / or frequency domain processing) and output the vibration sensor signal as a signal feature spectrum. The processing unit 120 may identify signal features of the sensor signal based on the signal feature spectrum. For example, the processing unit 120 may read related information such as the number of vibration peaks, the frequency components of the signal, etc. from the signal feature spectrum. In some embodiments, the processing unit 120 may directly identify signal features based on related data / information of the vibration signal collected by the vibration sensor device. For example, the processing unit 120 may calculate the interval time between two adjacent vibration peaks based on the time at which the two vibration peaks are acquired.

[0089] In some embodiments, the processing unit 120 may identify at least one signal feature of the sensor signal, such as at least one of the number of vibration peaks, signal strength, the time interval between adjacent vibration peaks, frequency components, and signal duration. For example, the processing unit 120 may identify three vibration peaks as a signal feature of the sensor signal. Alternatively, for example, the processing unit 120 may simultaneously identify the number of vibration peaks and the time interval between adjacent vibration peaks. Exemplarily, the processing unit 120 may identify three vibration peaks within 2 seconds, the first two vibration peaks having a short time interval (e.g., 0.1 seconds, 0.2 seconds, 0.3 seconds, 0.4 seconds, 0.5 seconds, etc.), and the last two vibration peaks having a long time interval (e.g., 1.1 seconds, 1.2 seconds, 1.3 seconds, 1.4 seconds, 1.5 seconds, etc.) as a signal feature of the sensor signal. Alternatively, for example, the processing unit 120 may simultaneously identify the frequency components, signal strength, and signal duration of the sensor signal. Illustratively, the processing unit 120 identifies the following signal characteristics of the sensor signal: a high amount of mid- to high-frequency signal components (e.g., the proportion of mid- to high-frequency signals is greater than 70%), a small vibration amplitude (i.e., signal strength), a short signal duration (e.g., the signal lasts for only 1 second), and sharp vibration peaks generated.

[0090] In some embodiments, the processing unit 120 may identify signal features of the vibration sensor signal based on a feature extraction model. The processing unit 120 may input the sensor signal into the feature extraction model. The output of the feature extraction model may include at least one signal feature of the vibration sensor signal (e.g., at least one of the number of vibration peaks, signal intensity, time interval between adjacent vibration peaks, frequency content, and signal duration). In some embodiments, the feature extraction model may be a machine learning model. The feature extraction model may be a trained machine learning model. The machine learning model may include various models and structures, such as, but not limited to, a deep neural network model, a recurrent neural network model, a custom model structure, etc.

[0091] In some embodiments, when training a feature extraction model, the parameters of the model may be learned by training using a common method such as gradient descent using a plurality of labeled (also called label) vibration sensor signals as training data. In some embodiments, the feature extraction model may be trained in a separate device or module.

[0092] In step 430, the processing unit 120 may determine, based on the signal features, a motion of the target object associated with the at least one sensor device 110. In some embodiments, step 430 may be performed by the motion determination module 330.

[0093] In some embodiments, the processing device 120 may further determine an action command for controlling the target object to perform the action. The action command may instruct the target object (e.g., the terminal device 130) to perform a corresponding action. For example, in the embodiment shown in FIG. 6, the action command may instruct the user to turn on or off the lamp 640. In this embodiment, a specific vibration signal may be generated when the user performs a specific action. The vibration sensor device may collect these vibration signals and generate a corresponding sensor signal to be processed by the processing device 120. The processing device 120 may control the target object by determining the action of the target object. Compared to a voice interaction method, the impact of environmental noise on the vibration signal is significantly smaller. Therefore, even in a noisy environment, the vibration signal can still be completely and effectively collected by the vibration sensor device. This makes the action or action command of the target object determined by the processing device 120 more accurate.

[0094] In some embodiments, the processing unit 120 may determine whether the identified signal feature satisfies at least one of a plurality of preset feature conditions. The preset feature condition may include one or a combination of multiple preset features. In some embodiments, the processing unit 120 may set a signal feature corresponding to a specific action of the target object as a preset feature condition. In some embodiments, each preset feature condition may correspond to one specific action of the target object and / or an instruction for controlling the target object to perform the specific action. For example, the preset feature condition may be that three vibration peaks appear within 1 second, and the interval times between adjacent vibration peaks are equal or nearly equal (e.g., the difference is within a threshold range, such as 0.3 seconds, 0.5 seconds, or 0.8 seconds). The preset feature condition indicates that the user hits or taps the vibration receiving area three times with the same or nearly equal time intervals within 1 second. Alternatively, for example, three vibration peaks may appear within 2 seconds (indicating that the user hits or taps three times within 3 seconds), with the first two vibration peaks having a short interval (e.g., 0.5 seconds) between them and the last two vibration peaks having a long interval (e.g., 2 seconds) between them, or the first two vibration peaks having a long interval (e.g., 2 seconds) between them and the last two vibration peaks having a short interval (e.g., 0.5 seconds). Each preset characteristic condition may correspond to a different action or action command of the target object. For example, a preset characteristic condition may be such that an action command corresponding to two vibration peaks appearing within 1 second is to turn on or off a lamp (e.g., lamp 640 shown in FIG. 6 ). For example, a preset characteristic condition may be such that an action command corresponding to three vibration peaks appearing within 3 seconds, with the first two vibration peaks having a short interval (e.g., 0.5 seconds) between them, is to change the lamp 640 to a warm light mode. The preset characteristic condition is that an operation command corresponding to three vibration peaks appearing within 3 seconds, with the interval between the first two vibration peaks being long and the interval between the last two vibration peaks being short, switches the mode of the lamp 640 to the cool light mode.

[0095] In some embodiments, a user may set preset characteristic conditions and corresponding actions or action commands for the corresponding target objects as needed. For example, a user may set a preset characteristic condition corresponding to a common action to a simplified preset characteristic condition (e.g., including fewer signal characteristics) for ease of implementation. For example, a user may set a preset characteristic condition corresponding to the action of turning on the lamp 640 to two vibration peaks within 1 second, thereby quickly turning on the lamp 640 every time the user enters the indoor environment 600.

[0096] In some embodiments, the preset characteristic condition may include only one signal characteristic to facilitate user memorization and operation. In some embodiments, the preset characteristic condition may be a combination of multiple signal characteristics to enable complex operations by combining different signal characteristics and to avoid incorrect operations. In some specific embodiments, the preset characteristic condition may include signal strength and the number of vibration peaks. For example, two vibration peaks appearing within 1 second, with the first vibration peak having a small peak value and the second vibration peak having a large peak value, and two vibration peaks having a large peak value and the second vibration peak having a small peak value, may respectively correspond to two different operation commands.

[0097] In some specific examples, when a user strikes or taps the solid medium at different locations, different vibration signals (e.g., vibration signals with different frequency components, durations, and / or signal intensities) are generated in the solid medium. Correspondingly, the vibration sensor signals generated by the vibration sensor device are also different (e.g., vibration sensor signals with different frequency components, durations, and / or signal intensities). In this case, the frequency components, durations, and / or signal intensities can be combined to form more preset characteristic conditions to accommodate more complex actions.

[0098] 5A to 5D show signal feature spectra of vibration signals generated by various user operations according to some embodiments of the present application. FIGS. 5A to 5D sequentially show exemplary signal feature spectra of vibration sensor signals generated by tapping with a fingernail, tapping with a single finger, tapping with multiple fingers, and tapping with a palm, respectively. As can be seen from the figures, the vibration sensor signals corresponding to tapping with a fingernail, tapping with a single finger, tapping with multiple fingers, and tapping with a palm are all different. For example, because nails are hard, the sensor signal contains a large amount of mid- to low-frequency signal components, the vibration amplitude is generally small, the duration of a single vibration peak is short, and the generated vibration peak is sharp. Furthermore, for example, tapping with a single finger is generally more powerful than tapping with a fingernail, and due to the cushioning of skin tissue, the sensor signal contains more low-frequency or mid-low frequency signal components and has a longer signal duration. Furthermore, for example, when tapping with multiple fingers, multiple phalanges generally do not contact the surface of a solid medium at the same time, resulting in multiple vibration peaks with very close spacing. Furthermore, for example, the palm of the hand has more muscle tissue than the phalanges, providing greater cushioning during tapping and a larger contact area with the surface of a solid medium. Therefore, the vibration signal generated by palm tapping has more mid- and low-frequency signal components and a longer signal duration. In some embodiments, a user may generate vibration sensor signals with different signal characteristics by tapping, tapping, and rubbing with different tools, corresponding to more operational commands and enabling more complex operations. For example, tapping a solid medium with an object such as a key, a cell phone, a cup, or a glove may generate vibration signals with different signal characteristics. In some cases, a user may use different tools to perform complex device operations while avoiding false triggers. For example, in the indoor environment 600 shown in FIG. 6 , a user may turn a lamp 640 on or off by tapping the door 610 three times within 1 second with a key, and may set the lamp 640 to warm light mode by tapping the door 610 three times within 1 second with a finger, effectively avoiding false triggers.

[0099] In some embodiments, the processing device 120 may determine whether the signal features of the sensor signal satisfy the preset feature condition based on the difference between the signal features of the sensor signal and the preset feature condition. For example, the preset feature condition may be that two vibration peaks appear within 1 second, and the intensity of the second vibration peak is lower than the intensity of the first vibration peak (i.e., two taps within 1 second, the former tap has a higher intensity, and the latter tap has a lower intensity). The processing device 120 may determine the number of vibration peaks appearing within 1 second of the collected sensor signal, and if there are not two vibration peaks, determine that the preset feature condition is not satisfied. If there are two vibration peaks, the processing device 120 may then determine the intensities of the two vibration peaks of the sensor signal and determine whether the signal intensity of the second vibration peak is lower than the signal intensity of the first vibration peak. If not, determine that the preset feature condition is not satisfied; if not, determine that the preset feature condition is satisfied.

[0100] In some embodiments, the processing unit 120 may determine whether the signal feature satisfies the preset feature condition based on the signal feature spectrum of the sensor signal and the signal feature spectrum of the preset feature condition. For example, the processing unit 120 may compare the signal feature spectrum of the sensor signal with the signal feature spectrum of the preset feature condition, and determine that the signal feature satisfies the preset feature condition if the signal curves in both signal feature spectra overlap or nearly overlap.

[0101] In some embodiments, the processing unit 120 may determine whether the signal feature satisfies a preset feature condition based on a preset feature condition identification model. If the signal feature satisfies the preset feature condition, the processing unit 120 may determine an action or action instruction corresponding to the signal feature.

[0102] In some embodiments, the preset feature condition identification model may be a machine learning model. In some embodiments, the processing unit 120 may use the signal feature spectrum of the sensor signal collected by the vibration sensor device as input data for the machine learning model. The machine learning model may obtain a result indicating whether the signal feature satisfies the preset feature condition. In some embodiments, the preset feature condition identification model may be a trained machine learning model. The training process for the preset feature condition identification model is the same as or similar to the training process for the feature extraction model.

[0103] The processing unit 120 may process the signal feature spectrum image of the sensor signal using a trained preset feature condition identification model to determine whether the signal features in the signal feature spectrum satisfy the preset feature condition. In some embodiments, the preset feature condition identification model may include a neural network model, a logistic regression model, a support vector machine, or the like. Illustratively, taking a neural network model as an example, the neural network model may include multiple layers, such as an input layer, one or more convolutional layers, one or more nonlinear activation layers, one or more pooling layers, one or more fully connected layers, and / or an output layer. The neural network model may acquire the signal feature spectrum at the input layer, extract visual features or styles using intermediate layers and / or distinguish visual features or styles from the image, and output the signal feature spectrum having the features or styles of the feature points at the output layer. For example, the identified feature points may be marked with feature identifiers or feature vectors. In some embodiments, the identified feature points may be representative signal feature points, such as the highest and lowest points of a vibration peak, the beginning and end points of a vibration peak, etc.

[0104] In some embodiments, when a signal feature satisfies a preset feature condition, the processing unit 120 may determine an action of the target object corresponding to the preset feature condition.

[0105] In some cases, a user may inadvertently or unavoidably perform a certain action, generating a vibration signal, causing the target object to perform an erroneous action (e.g., switching the terminal device 130 from a first state to a second state). For example, taking the indoor environment 600 shown in FIG. 6 as an example, while a user is lying on a bed 620, the user's hand or head may accidentally touch the headboard 630, generating a vibration signal. The vibration signal may be collected by a vibration sensor device installed on the headboard 630 to generate a corresponding sensor signal. Illustratively, if the signal feature of the sensor signal meets a preset feature condition in which the operation command is to turn on the lamp 640, the processing device 120 may operate to erroneously turn on the lamp 640, which may affect the user's sleep and, to a certain extent, degrade the user's usage experience.

[0106] Therefore, to avoid the occurrence of the above situation, in some embodiments, the processing device 120 may filter sensor signals acquired from the vibration sensor devices. The processing device 120 may acquire sensor signals from at least one vibration sensor device in real time or intermittently. When acquiring a sensor signal (also referred to as a first sensor signal), the processing device 120 may retain signals within a threshold time range (e.g., 1 s, 2 s, 3 s, 5 s, 10 s, 15 s, etc.) after the first sensor signal as the sensor signal. In some embodiments, the processing device 120 may determine whether the first sensor signal is greater than a signal threshold. The signal threshold may be a parameter for determining whether the sensor signal is generated by a user's accidental touch or an intentional action by the user. In some embodiments, the signal threshold may be a signal strength threshold. In some embodiments, the signal strength threshold may be in a range of 2 dB to 10 dB. In some embodiments, the signal strength threshold may be in a range of 4 dB to 8 dB. In some embodiments, the signal strength threshold may be 6 dB. Illustratively, if the first sensor signal is greater than a signal strength threshold, the first sensor signal may be considered to have been generated by an intended user action. Accordingly, the processing unit 120 may consider a signal within a predetermined time range (e.g., a threshold time range) after the first sensor signal as the sensor signal. If the signal strength is less than the signal strength threshold, the first sensor signal may not be processed because it is considered to have been generated by an accidental touch by the user.

[0107] In another application scenario, a user may have a pet cat, and the pet cat may scratch the door 610, generating a vibration signal. The vibration signal is collected by a vibration sensor device to generate a corresponding sensor signal. For example, if the signal characteristics of the sensor signal exactly meet a preset characteristic condition and the corresponding operation command is to turn on or off the lamp 640, the lamp 640 may be erroneously turned on or off. Therefore, in some embodiments, the processing device 120 may prevent erroneous operation by determining whether the object receiving the vibration signal is a user or a specific object designated by the user and capable of issuing an operation command. In some embodiments, the processing device 120 may determine whether the object receiving the vibration signal is a user or a specific object capable of issuing an operation command based on information related to the object receiving the vibration signal. For example, the processing device 120 may acquire a contour image of the object receiving the vibration signal using a camera and determine whether the object receiving the vibration signal is a user or a specific object capable of issuing an operation command based on the contour image. If the processing device 120 determines that the object receiving the vibration signal is not a user or a specific object capable of issuing an operation command, it may not take any action.

[0108] 6 is a schematic diagram of an indoor environment in which a terminal device is installed, according to some embodiments of the present application. Although the techniques described in the present embodiments are described with reference to a home, a residence, or a hotel, those skilled in the art will understand that the features, processes, algorithms, and mechanisms implemented by these techniques may be readily applied to other environments, such as an office, a warehouse, a garage, or other environments.

[0109] In some embodiments, the indoor environment 600 may be part of a house, a home environment, or a hotel. For example, the indoor environment 600 may be a bedroom or a living room in a user's house. For example, the indoor environment 600 may be a hotel room where a user has checked in. In some embodiments, one or more terminal devices 130 (e.g., lamps 640) may be disposed in the indoor environment 600. The one or more terminal devices 130 may be controlled by the processing device 120.

[0110] In some exemplary application scenarios, a door 610 is attached to the entrance of the indoor environment 600. A lamp 640 (e.g., a light bulb, a lighting fixture, a lamp, etc.) is attached to a side wall or top of the indoor environment 600. A switch for the lamp 640 is installed on a side wall adjacent to the lamp 640, and a user may use the switch to control turning the lamp 640 on or off. A bed 620 is attached to a connection point between the floor and the side wall of the indoor environment 600, and the bed 620 includes a headboard 630. In addition, a sensor device 110 (e.g., a vibration sensor device) is physically connected (e.g., glued) to both the door 610 and the headboard 630. The vibration sensor device may collect a vibration signal input by a user. The processing device 120 may identify a signal feature of the sensor signal and determine whether the signal feature satisfies a preset feature condition. When the processing unit 120 determines that the signal feature satisfies the preset feature condition, it can send an operation command to the target object (e.g., the switch of the lamp 640) to control the target object to perform a corresponding operation (e.g., turning the lamp 640 on or off, adjusting the color temperature, adjusting the brightness, etc.).

[0111] For example, when a user enters the indoor environment 600 at night (e.g., when the user leaves work and returns home to the living room or bedroom), the user may need to turn on the lamp 640. A vibration sensor device is installed on the door 610. The user can input a vibration signal by knocking, tapping, or rubbing the door 610. The lamp 640 is controlled (e.g., turned on) when the signal characteristics of the sensor signal generated based on the vibration signal satisfy a preset characteristic condition. This is more convenient and safer than walking to the side wall to turn on a switch. In some embodiments, a specific area on the door 610 may be the vibration receiving area. For example, the door handle may be the vibration receiving area, and the user may issue a lighting operation command by knocking, tapping, or rubbing the vibration receiving area when opening the door 610. For example, the surface of the door 610 may be the vibration receiving area. The vibration sensor device is connected to the vibration receiving area on the surface of the door 610 and receives the vibration signal input to the vibration receiving area. The vibration sensor device may be installed at a location such as the center of the door 610 or an edge of the door 610. In some embodiments, when a user strikes or taps, the amplitude is large at the center of the door 610, so the vibration sensor device may be installed (e.g., fitted or glued) at the center of the door 610.

[0112] In some embodiments, a specific area on the surface of the door 610 facing away from the indoor environment 600 may be set as a vibration receiving area. For example, by positioning the vibration receiving area on the upper side of the surface of the door 610 facing away from the indoor environment 600, a user may input a vibration signal by performing a specific operation with their hand. Alternatively, by positioning the vibration receiving area on the lower side of the surface of the door 610 facing away from the indoor environment 600, a user may input a vibration signal by kicking the door 610 with their foot.

[0113] FIG. 7 is an exemplary flowchart for controlling a lamp in an indoor environment according to some embodiments of the present application. In this embodiment, when a user hits the headboard 630 three times in succession, a vibration sensor device installed on or mechanically connected to the headboard 630 can receive the vibration signal and generate a corresponding sensor signal. The processing unit 120 (e.g., a chip of the vibration sensor device) can perform feature identification on the sensor signal to determine whether the sensor signal has three vibration peaks within 1 second with a time interval of less than 0.5 seconds. If so, it continues to determine the on / off state of the lamp 640 at this time. If the lamp 640 is in the on state (i.e., the first state), it issues a command to turn the lamp 640 off and adjusts the lamp 640 to the off state (i.e., the second state). If the lamp 640 is in the off state (i.e., the second state), it issues a command to turn the lamp 640 on and adjusts the lamp 640 to the on state (i.e., the first state). If the processing unit 120 determines that the sensor signal does not have three vibration peaks within 1 s or the time interval between adjacent vibration peaks exceeds 0.5 s, it takes no action.

[0114] If the switch is not installed next to the pillow when the user wakes up at night, they will have to search for the switch in the dark, which may put them at risk of falling or bumping into something. By attaching a vibration sensor device to the headboard 630, the lamp 640 can be operated by performing a specific operation on the headboard 630, which not only improves safety but also convenience.

[0115] In some embodiments, multiple switches and buttons are installed around the bed 620. For example, if the indoor environment 600 is a hotel room, multiple switches for controlling target objects (e.g., lamps 640) are typically installed near the headboard 630 of the bed 620. When a user wants to control a specific target object, they need to search for the specific switch. By attaching a vibration sensor device to the headboard 630, the target object can be controlled by a simple combination of hitting, tapping, or rubbing (e.g., turning off the lamp 640 with a specific action).

[0116] In some embodiments, the layout of the indoor environment 600 may not be limited to the layout shown in FIG. 6 . Illustratively, other target objects, such as a smart TV, curtains, and air conditioners, may be further arranged in the indoor environment 600. The user may control the other target objects using the system 100. For example, curtains may be installed on the side walls of the indoor environment 600, and the user may operate the curtains using the system 100. Illustratively, the opening and closing of the curtains may be controlled by tapping the headboard 630 at the same or approximately the same time intervals within 1 second.

[0117] 8 is a schematic diagram of an in-vehicle environment in which terminal devices are installed, according to some embodiments of the present application. In some embodiments, the in-vehicle environment 800 may include one or more terminal devices (e.g., an in-vehicle air conditioner, an in-vehicle speaker, a window, etc.). The one or more terminal devices may be controlled by the system 100.

[0118] In some exemplary application scenarios, a sensor unit (e.g., a vibration sensor device) is installed in the co-pilot storage box 810. The vibration sensor device may be associated with the passenger-side air conditioner. A user may control the passenger-side air conditioner through the system 100. For example, the user may continuously hit or tap the surface of the co-pilot storage box 810, and the vibration sensor device may receive a vibration signal from the hitting or tapping and then generate a sensor signal. The system 100 may identify a signal feature of the sensor signal and determine whether the signal feature satisfies a preset feature condition. For example, the preset feature condition corresponds to the operation of turning on / off the passenger-side air conditioner. If the signal feature satisfies the preset feature condition, the system 100 may control the on / off of the passenger-side air conditioner.

[0119] In some exemplary application scenarios, at least one sensor unit (e.g., a vibration sensor device) is physically connected to the steering wheel 820. The vibration sensor device may be associated with terminal devices such as an in-vehicle air conditioner, an in-vehicle speaker, a window, etc. Similarly, a user can control the in-vehicle air conditioner, an in-vehicle speaker, a window, etc. through the system 100.

[0120] FIG. 9 is an exemplary flowchart for controlling an in-vehicle terminal device according to some embodiments of the present application. In this embodiment, when a driver taps the steering wheel 820 three times in succession, a vibration sensor device installed on the steering wheel 820 may collect the vibration signal and generate a sensor signal. The system 100 may identify the signal characteristics of the sensor signal and determine whether the signal characteristics satisfy a preset characteristic condition. For example, the system 100 may identify whether the sensor signal has three vibration peaks with the same or approximately the same time interval within 2 seconds (i.e., the number of vibration peaks is three, and the time intervals between two adjacent vibration peaks are the same or approximately the same). If not (i.e., the signal characteristics of the sensor signal do not satisfy the preset characteristic condition), no operation is performed. If yes (i.e., the signal characteristics of the signal satisfy the preset characteristic condition), the current status of the vehicle air conditioner is obtained. If the vehicle air conditioner is in the on state (i.e., the first state), a command to turn off the vehicle air conditioner is issued, and the vehicle air conditioner is adjusted to the off state (i.e., the second state). If the vehicle air conditioner is in an off state, a command to turn on the vehicle air conditioner is issued, and the vehicle air conditioner is adjusted to an on state. As another example, the system 100 may identify whether the signal has three vibration peaks with unequal time intervals within 2 seconds (e.g., the time interval between the first and second vibration peaks is 1 second, and the time interval between the second and third vibration peaks is 2 seconds). If not (i.e., the signal features of the sensor signal do not satisfy the preset feature condition), no action is taken. If yes (i.e., the signal features of the signal satisfy the preset feature condition), the current status of the vehicle speaker is obtained. If the vehicle speaker is in an on state, a command to turn off the vehicle speaker is issued. If the vehicle speaker is in an off state, a command to turn on the vehicle speaker is issued.

[0121] In some embodiments, the layout of the vehicle interior environment 800 may not be limited to the layout shown in Fig. 8. Illustratively, the vehicle interior environment 800 may further include other target objects, such as a sunroof, seat heaters, etc. In some specific embodiments, a sunroof may be installed on the roof of the vehicle interior environment 800, and the user may control the sunroof using the system 100. For example, the user may control the opening and closing of the sunroof by tapping the steering wheel 820 four times at the same or approximately the same time intervals within 1 second.

[0122] While the vehicle is traveling, a user (e.g., the driver) may adjust the vehicle air conditioner or speakers, and operating vehicle buttons, switches, etc. may distract the driver, potentially causing a traffic accident. While voice interaction can avoid the above problems to some extent, tire noise, music, and dialogue significantly interfere with the voice interaction. Compared to voice interaction control methods, by installing a vibration sensor device at a specific position in the vehicle (e.g., the steering wheel 820), the driver can operate target objects such as the vehicle air conditioner, speakers, and sunroof by hitting, tapping, or rubbing a vibration-receiving area (e.g., any position on the steering wheel 820) without taking their eyes off the road, thereby improving vehicle driving safety.

[0123] 10 is a schematic diagram of a tabletop environment with a terminal device installed, according to some embodiments of the present application. The tabletop environment 1000 may include one or more terminal devices. The terminal devices may be one or more types of office or entertainment devices.

[0124] In some exemplary application scenarios, the table surface environment 1000 includes a table 1010 and a chair 1020. Sensor units (e.g., a first vibration sensor device installed on the table 1010 and a second vibration sensor device installed on the chair 1020) may be installed on the table 1010 and / or the chair 1020. Illustratively, the first vibration sensor device may be installed on the surface of the table 1010, and the second vibration sensor device may be installed on the armrest of the chair 1020. In some embodiments, a user may perform a specific operation on a vibration-receiving area (e.g., any position on the surface of the table 1010 and / or the armrest of the chair 1020) to input a specific vibration signal to the vibration sensor device, thereby determining the operation or operation command of one or more office or entertainment devices. For example, if a user taps the table surface of the table 1010 with a single finger and the corresponding vibration sensor signal satisfies a preset characteristic condition, the corresponding entertainment device (e.g., a musical instrument) may create a song in accordance with the rhythm of the user's finger tapping and play it through an external audio output device. In this way, the user's stress can be effectively relieved. Also, for example, when the user taps on the armrest of the chair 1020 and the corresponding vibration sensor signal satisfies the preset characteristic condition, the associated massage device may massage the user's back.

[0125] In some embodiments, the arrangement of the tabletop environment 1000 may not be limited to the arrangement shown in FIG. 10 . Illustratively, the tabletop environment 1000 may further include other terminal devices, such as a toy that the user can press. In some specific embodiments, the toy may include a vibration sensor device. When the user presses the toy, the vibration sensor device may collect vibration signals and generate haptic feedback. For example, pressing the toy three times within 1 second can cause the toy to vibrate continuously and massage the hand.

[0126] In some embodiments, system 100 may be applied to other usage scenarios, such as smart factories and smart audio devices. In some exemplary application scenarios, a smart factory may include sensor units (e.g., vibration sensor devices) attached to assembly line conveyance devices, robotic arms, and commonly used areas. Generally, factory environments are noisy and filled with severe noise. Compared to voice interaction, users can input vibration signals by performing specific operations such as hitting, tapping, or rubbing in areas that are easy to operate, thereby controlling devices such as assembly line conveyance devices and robotic arms or interacting with colleagues. This allows users to operate or interact with equipment and devices more conveniently without noise interference. For example, a user may tap at the same or approximately the same time interval within 3 seconds, and the resulting vibration signal corresponds to an operation command that controls the assembly line conveyance device to start a task. In some embodiments, the vibration sensor devices may be installed in areas away from the robotic arms and assembly line conveyance devices to prevent vibrations caused by the operation of the robotic arms and assembly line conveyance devices from affecting the vibration signals input by the user.

[0127] In some exemplary application scenarios, the system 100 may be applied to a smart audio device (e.g., a smart speaker). Illustratively, the smart speaker may include a vibration sensor device installed (e.g., glued) thereon. The smart speaker itself may communicate with the vibration sensor device (e.g., via Bluetooth connection) as a terminal device. In some embodiments, a user may operate the smart speaker by performing a specific action, such as hitting, tapping, or rubbing, on the smart speaker. For example, when a user taps the housing of the smart speaker with their palm, the vibration sensor device collects a vibration signal generated by the tapping with the palm to generate a sensor signal. The system 100 may identify the signal characteristics and then compare the signal characteristics with preset characteristic conditions. Based on the comparison result, it is determined that the action or action command corresponding to the sensor signal is to play the next song. Since the interaction method of a smart speaker is often voice interaction, the lack of tactile information may degrade the user's interaction experience. By installing a vibration sensor device on the housing of the smart speaker, a tactile interaction between the user and the smart speaker can be established, improving the interaction experience.

[0128] In some embodiments, the target object control system 100 may monitor and analyze the user's physical activity (e.g., coughing, sneezing, snoring, yawning, falling, etc.) to more accurately determine the user's physiological state. Illustratively, the system 100 can accurately and effectively collect signals of the user's physical activity using the sensor device 110 and generate a corresponding sensor signal based on the signals. The system 100 can identify signal features of the sensor signal, determine the user's physiological state based on the signal features, and finally more accurately determine the user's health state based on the user's physiological state. The sensor device 110 may be a vibration sensor device. In some embodiments, the sensor device 110 may further include a heart rate measuring element, a blood glucose measuring element, a blood pressure measuring element, a blood lipid measuring element, etc. In some embodiments, the system 100 may determine an operation or an operation command of a target object (e.g., the terminal device 130) based on the user's physiological state. The operation command may be used to provide the user with more comprehensive health protection by controlling the target object to perform a corresponding function. Exemplary functions may include recording a user's health status, issuing early health alerts, issuing help requests, and the like.

[0129] FIG. 11 is an exemplary flowchart of a target object control method according to some embodiments of the present application. Specifically, target object control method 1100 may be executed by target object control system 100 (e.g., processing device 120). For example, target object control method 1100 may be stored in a storage device (e.g., an internal storage unit of processing device 120 or storage device 140) in the form of a program or instructions, and target object control system 100 (e.g., processing device 120) may execute the program or instructions to perform target object control method 1100. The operations in the flow chart shown below are for illustrative purposes only. In some embodiments, method 1100 may be performed by one or more additional operations not described and / or one or more operations not shown. Also, the order of operations in method 1100 shown in FIG. 11 and described below is not limited. In some embodiments, method 1100 may be applied to fields such as human health monitoring.

[0130] In step 1110, the processing unit 120 may acquire a sensor signal of at least one sensor device. In some embodiments, step 1110 is performed by the sensor signal acquisition module 310.

[0131] The at least one sensor device may include a vibration sensor device. The vibration sensor device may collect vibration signals. For example, the vibration sensor device may be a microphone that uses bone conduction as one of the main sound propagation methods, an accelerometer, or the like. In some embodiments, the vibration sensor device may be installed in a wearable device. Exemplary wearable devices may include a smart bracelet, smart footwear, smart glasses, smart helmet, smart watch, smart clothing, smart backpack, smart accessory, or any combination thereof. When a user wears the wearable device, the wearable device may be in close contact with a body part of the user (e.g., head, neck, ear, etc.). The vibration sensor device receives a vibration signal caused by the user's physical activity through the wearable device. In some embodiments, the vibration sensor device may be an independent device. The vibration sensor device may be in direct contact with a body part of the user to receive a vibration signal caused by the user's physical activity.

[0132] The vibration sensor device may be in direct contact with a body part of the user, or indirect contact with the body part of the user via a wearable device. The user's physical activity, such as coughing, sneezing, snoring, yawning, shaking, bumping, falling, etc., may generate a vibration signal. The vibration signal is transmitted to the vibration sensor device via the user's skeleton or muscles. The vibration sensor device may acquire the vibration signal and generate a sensor signal. The vibration sensor device is connected to the processing device 120. The processing device 120 may acquire the sensor signal generated by the vibration sensor device.

[0133] In step 1120, processing unit 120 may identify signal features of the sensor signal. In some embodiments, step 1120 may be performed by signal feature identification module 320. In some embodiments, step 1120 may be the same as or similar to step 420 in flow 400.

[0134] In some embodiments, the processing unit 120 may process the vibration sensor signal (e.g., time domain processing and / or frequency domain processing) and output the vibration sensor signal as a signal feature spectrum. The processing unit 120 may identify signal features of the sensor signal based on the signal feature spectrum. For example, the processing unit 120 may read related information such as the number of vibration peaks, the frequency components of the signal, etc. from the signal feature spectrum. In some embodiments, the processing unit 120 may directly identify signal features based on related data / information of the vibration signal collected by the vibration sensor device. For example, the processing unit 120 may calculate the interval time between two adjacent vibration peaks based on the time at which the two vibration peaks are acquired.

[0135] In some embodiments, the processing device 120 may identify at least one signal feature of the sensor signal, such as at least one of the number of vibration peaks, signal strength, interval time between adjacent vibration peaks, frequency components, and signal duration. Different user physical activities, such as coughing, sneezing, snoring, yawning, shaking, bumping, and falling, generate different vibration signals (e.g., vibration signals with different frequency components, interval time between adjacent vibration peaks, duration, and / or signal strength). Correspondingly, the vibration sensor signals generated by the vibration sensor device also differ (e.g., vibration sensor signals with different frequency components, interval time between adjacent vibration peaks, duration, and / or signal strength). For example, when a user sneezes, the signal feature spectrum contains more high-frequency signal components and the duration of the vibration peaks is longer. When a user yawns, the signal feature spectrum contains more high-frequency signal components and generally no obvious vibration peaks are generated. For more details regarding the signal features of the sensor signal corresponding to different physical activities, please refer to other parts of this application, such as FIGS. 12A to 12E, and further description will be omitted here.

[0136] In step 1130, the processing unit 120 may determine the physiological state of the user based on the signal features. In some embodiments, step 1130 may be performed by the action determination module 330.

[0137] In this specification, the physiological state refers to the physical state of the user. Each physical activity of the user has a corresponding physiological state. The physiological state of the user may be divided into dangerous physiological states and non-dangerous physiological states. The non-dangerous physiological states may include coughing, sneezing, snoring, yawning, etc. The dangerous physiological states may include shaking, bumping, falling, etc. The processing device 120 may determine the signal features by analyzing and processing the sensor signal generated by the vibration sensor device, and then determine the physiological state of the user based on the signal features.

[0138] In some embodiments, the processing device 120 may determine whether the identified signal feature satisfies at least one of a plurality of preset feature conditions. The preset feature condition may include one or a combination of multiple preset features. In some embodiments, the processing device 120 may set a signal feature corresponding to a physiological condition as a preset feature condition. In some embodiments, each preset feature condition may correspond to one physiological condition of the user. For example, the preset feature condition may be that two or more closely spaced vibration peaks appear within a threshold time (e.g., 5 s, 8 s, 10 s, 15 s, etc.). Another preset feature condition may be that the signal feature spectrum contains many high-frequency signal components and no obvious vibration peaks. Another preset feature condition may be that the signal feature spectrum contains many mid- and low-frequency signal components. Each preset feature condition may correspond to a different physiological condition. For example, a physiological condition corresponding to the preset feature condition of two or more closely spaced vibration peaks appearing within 10 s is a coughing state. For example, a physiological state corresponding to a preset characteristic condition where the proportion of high-frequency signal components in the signal feature spectrum is 60% and there are no obvious vibration peaks is a yawning state, and for example, a physiological state corresponding to a preset characteristic condition where the proportion of mid- to low-frequency signal components in the signal feature spectrum is 70% is a falling state.

[0139] In some embodiments, the preset feature condition corresponding to each physiological state may be determined based on signal features of sensor signals due to actual physical activities of multiple users. For example, a preset feature condition corresponding to a yawning state may be determined by extracting signal features of vibration sensor signals generated by a vibration sensor device when multiple users yawn. In some embodiments, the processing unit 120 may use a preset feature condition determination model to determine the preset feature condition for each physiological state based on the extracted signal features. The preset feature condition determination model may be, for example, a machine learning model. In some embodiments, the preset feature condition determination model may be a trained machine learning model. The training process for the preset feature condition determination model is the same as or similar to the training process for the feature extraction model.

[0140] In some embodiments, the processing unit 120 may determine whether the signal features satisfy the preset feature conditions based on differences between the signal features of the sensor signal and the preset feature conditions. Illustratively, the preset feature conditions may include the appearance of three or more vibration peaks within 5 seconds. The processing unit 120 determines the number of vibration peaks that appear within 5 seconds in the collected sensor signal, and if only two vibration peaks appear, the preset feature conditions are not satisfied. In some embodiments, the processing unit 120 may determine whether the signal features satisfy the preset feature conditions based on the signal feature spectrum of the sensor signal and the signal feature spectrum of the preset feature conditions. For example, the processing unit 120 may compare the signal feature spectrum of the sensor signal with the signal feature spectrum of the preset feature conditions, and determine that the signal features satisfy the preset feature conditions if the signal curves in the two signal feature spectra overlap or nearly overlap. In some embodiments, the processing unit 120 may determine whether the signal features satisfy the preset feature conditions based on a preset feature condition identification model. If the signal features satisfy the preset feature conditions, the processing unit 120 may determine the physiological condition corresponding to the preset feature condition as the physiological condition of the user.

[0141] In step 1140, the processing device 120 may determine a motion of the target object associated with the at least one sensor device 110 based on the physiological state of the user. In some embodiments, step 1140 may be performed by the motion determination module 330. In some embodiments, the processing device 120 may further determine an action instruction for controlling the target object to perform the motion. The action instruction may instruct the target object (e.g., smart wearable device, terminal device 130, etc.) to perform a corresponding action.

[0142] In some embodiments, the processing device 120 may determine the motion of the target object based on whether the physiological state is a dangerous physiological state. In some embodiments, if the physiological state is a dangerous physiological state, for example, if the user is falling, the processing device 120 may control the terminal device 130 (e.g., a mobile terminal) to perform one or more of the following actions: a voice inquiry (e.g., "Are you in danger?", "Are you in need of help?"), an early warning (e.g., issuing an early warning to pre-stored contacts using the mobile terminal (e.g., a mobile phone)), or a request for external assistance (e.g., requesting assistance from a police agency or a hospital). In some embodiments, if the physiological state is a non-dangerous physiological state, for example, if the user is yawning, the processing device 120 may record information related to the sensor signal. The information related to the sensor signal may include the frequency at which the sensor signal appears (used to indicate the frequency of physical activity), signal characteristics of the sensor signal (used to indicate the type of physical activity), the time at which the sensor signal appears (used to indicate a specific time point or duration of physical activity), etc. In some embodiments, the processing device 120 may evaluate the user's health status based on the recorded signal characteristics. Illustratively, if the frequency of snoring exceeds a frequency threshold, the processing device 120 may determine that the user may have a throat ailment. If the frequency of the user's sniffling or sneezing exceeds a frequency threshold, the processing device 120 may determine that the user may have a cold. In some embodiments, the processing device 120 may record and / or transmit the evaluation of the user's health status to the terminal device 130 (e.g., a mobile phone) for viewing by the user.

[0143] In some embodiments, the processing device 120 may determine the operation of the target object based on user-related information. The user-related information may include the user's medical history, age, and physiological parameters (e.g., blood pressure, blood glucose, heart rate, etc.). In some embodiments, the user-related information may be input by the user through the terminal device 130 (e.g., through a mobile terminal communicating with the processing device 120). In some embodiments, the at least one sensor device may further include at least one of a heart rate measuring member, a blood pressure measuring member, a blood glucose measuring member, etc. The user's physiological parameters (e.g., blood pressure, blood glucose, heart rate, etc.) may be acquired by the at least one sensor device. For example, when the processing device 120 determines that the user's physiological condition is a fall state, the processing device 120 may acquire the user's age. For example, if the user's age is 80 years old, the processing device 120 may directly control the terminal device 130 (e.g., a mobile terminal) to issue an early warning. Also, for example, if the user's age is 20, the processing device 120 may control the terminal device 130 (e.g., a mobile terminal) to make a voice inquiry. In some cases, since middle-aged and elderly people may be at higher risk of health risks from falling than younger people, it may be necessary to immediately issue an early warning to family and friends to help the user.

[0144] 12A-12E are schematic diagrams of signal feature spectra of vibration sensor signals corresponding to different physical activities, according to some embodiments of the present application. FIGS. 12A-12E exemplarily illustrate signal feature spectra of vibration sensor signals generated when a user coughs, yawns, sneezes, snores, and falls, respectively. As can be seen from FIGS. 12A-12E, the vibration sensor signals resulting from different physical activities each have different signal features. As shown in FIG. 12A, when a user coughs, multiple closely spaced vibration peaks appear due to the user generally coughing several times. As shown in FIG. 12B, when a user yawns, the signal feature spectrum contains many high-frequency signal components, and no obvious vibration peaks generally occur. As shown in FIG. 12C, when a user sneezes, the signal feature spectrum contains many high-frequency signal components, and the vibration peaks last for a long time. As shown in FIG. 12D, when a user snores, the high-frequency signal components in the signal feature spectrum are numerous and concentrated. As shown in FIG. 12E, when a user falls, the signal feature spectrum contains more low-frequency signal components.

[0145] FIG. 13 is a schematic diagram of a frequency curve of a vibration sensor signal of a user's physical activity according to some embodiments of the present application. As shown in FIG. 13, in some embodiments, the frequency of the vibration signal generated by the user's physical activity (e.g., coughing, sneezing, etc.) is generally lower than 5 kHz (the frequency at f1 is 5 kHz). Therefore, the resonant frequency (i.e., natural frequency) of the vibration sensor device needs to be lower than 5 kHz. In some embodiments, the natural frequency of the vibration sensor device may be between 0.5 kHz and 5 kHz. In some embodiments, the natural frequency of the vibration sensor device may be between 0.8 kHz and 5 kHz. In some embodiments, the natural frequency of the vibration sensor device may be between 1 kHz and 5 kHz. In some embodiments, the natural frequency of the vibration sensor device may be between 1.25 kHz and 4.75 kHz. In some embodiments, the natural frequency of the vibration sensor device may be between 1.5 kHz and 4.5 kHz. In some embodiments, the natural frequency of the vibration sensor device may be between 2 kHz and 4.5 kHz. To ensure that the acquired vibration signal is more accurate, the sensitivity of the vibration sensor device needs to be as high as possible. In some embodiments, the sensitivity of the vibration sensor device is -50 dBV / (m / s 2 )~-10dBV / (m / s 2 In some embodiments, the sensitivity of the vibration sensor device may be between -35 dBV / (m / s 2 )~-15dBV / (m / s 2 In some embodiments, the sensitivity of the vibration sensor device may be between -30 dBV / (m / s 2 )~-15dBV / (m / s 2 In some embodiments, the sensitivity of the vibration sensor device may be between -25dBV / (m / s 2 )~-20dBV / (m / s 2 ) may be placed between

[0146] 14 is a schematic diagram of a target object control system applied to a wearable device according to some embodiments of the present application. Illustratively, the wearable device may be an earphone 1400. One or more components or units of the target object control system 100 may be integrated into the earphone 1400.

[0147] In some embodiments, earphone 1400 has only audio output capability, e.g., a speaker. In some embodiments, earphone 1400 has audio output and input capability, e.g., an earphone capable of audio input and output. In some embodiments, earphone 1400 may be a hearing aid. In some embodiments, earphone 1400 may be an earphone that uses bone conduction as one of the primary sound propagation methods or an earphone that uses air conduction as one of the primary sound propagation methods. In some embodiments, earphone 1400 may be a headphone (e.g., a monaural headphone, a binaural headphone), an ear-hook earphone, an in-ear earphone, etc.

[0148] In some embodiments, the earphones 1400 may be in-ear earphones. A sensor device 1410 is installed in the earphones 1400. The sensor device 1410 may be a vibration sensor device for collecting vibration signals due to a user's physical activity. In some embodiments, the vibration sensor device may be a microphone built into the earphones, with bone conduction being one of the main propagation methods for sound. In some embodiments, the vibration sensor device may be a microelectromechanical system (MEMS) accelerometer. The vibration sensor device 1410 may receive vibration signals due to a user's physical activity through the earphones 1400. When a user wears the earphones 1400, the earphones 1400 are in close contact with the user's body part (e.g., ear), and the vibration signals can be accurately transmitted to the vibration sensor device through the earphones 1400. In some embodiments, improving the connection rigidity between the vibration sensor device and the earphones 1400 reduces loss during transmission of the vibration signals, allowing the vibration signals to be accurately and completely collected by the vibration sensor device. In some embodiments, the vibration sensor device may be fixedly connected to a housing of the earphones 1400 that comes into contact with the user. The housing generally has a predetermined hardness, which can reduce loss during transmission of the vibration signal. The method of fixed connection may include, but is not limited to, fitting, screw connection, riveting, welding, adhesive bonding, etc. In some embodiments, the vibration sensor device may be adhesively connected to the earphone 1400 to facilitate removal of the vibration sensor device.

[0149] In some embodiments, the vibration sensor device may be in direct contact with a body part (e.g., an ear) of the user. For example, when the user wears the earphone 1400, the vibration sensor device may be installed on the housing of the earphone 1400 and be in direct contact with the user's ear. Vibration signals resulting from the user's physical activity may be collected directly by the vibration sensor device without requiring transmission through one or more parts (e.g., the housing) of the earphone 1400, thereby reducing losses during transmission of the vibration signals.

[0150] In some embodiments, to ensure that the wearable device (e.g., smart earphones, smart glasses, smart helmets, etc.) has reasonable overall dimensions, the volume of the vibration sensor device is also required to meet certain requirements. In some embodiments, the volume of the vibration sensor device is less than 1 mm 3 ~10cm 3 In some embodiments, the volume of the vibration sensor device may be between 0.5 mm 3 ~20cm 3 In some embodiments, the volume of the vibration sensor device may be between 1.5 mm 3 ~5cm 3 In some embodiments, the volume of the vibration sensor device may be between 2 mm 3 ~1cm 3 It may be between.

[0151] FIG. 15 is an exemplary flowchart for determining the motion of a target object based on a vibration signal generated by a user's physical activity, according to some embodiments of the present application. In this embodiment, a vibration signal generated by a user wearing earphones 1400 is transmitted to a vibration sensor device fixedly connected to earphones 1400. The vibration sensor device receives the vibration signal and generates a corresponding vibration sensor signal. Processing device 120 may acquire the sensor signal generated by the vibration sensor device and identify signal features of the sensor signal. In some embodiments, processing device 120 may determine whether the signal features satisfy at least one of a plurality of preset feature conditions. Illustratively, the preset feature condition may be one or a combination of signal features corresponding to a coughing state, a yawning state, a sneezing state, a sniffing state, a snoring state, a fall state, etc. In some embodiments, if the signal features of the sensor signal do not satisfy any of the preset feature conditions, processing device 120 will not operate. In some embodiments, when a signal feature of the sensor signal satisfies one of the preset feature conditions, processing unit 120 may determine a physiological condition corresponding to the preset feature condition. Processing unit 120 may further determine whether the physiological condition corresponding to the preset feature condition is a dangerous physiological condition, such as a fall or a bump. In some embodiments, if the physiological condition is a fall, processing unit 120 may determine an action corresponding to the dangerous physiological condition of the target object. For example, the target object may include earphone 1400 and another device communicating with earphone 1400. Illustratively, the other device communicating with earphone 1400 may be a mobile terminal, such as a mobile phone. In some embodiments, processing unit 120 may send an action command to earphone 1400, causing earphone 1400 to send a voice query to the user, such as, "Are you in danger? Do you need help?" or "Are you in danger?" The user may cause processing unit 120 to perform a subsequent action by responding to the voice query.For example, if the user replies with a voice message saying "I need help" (e.g., the earphone has a voice input function), the processing unit 120 may control the mobile terminal to issue an early warning to pre-stored contacts or to request external assistance. In some embodiments, if the processing unit 120 does not detect a user response within a predetermined time range (e.g., 10 seconds, 20 seconds, 30 seconds, etc.), it may issue an early warning to pre-stored contacts or to request external assistance. In some embodiments, if the physiological condition is a non-dangerous physiological condition (e.g., coughing, yawning, etc.), the processing unit 120 may record relevant information of the sensor signal for subsequent evaluation of the user's health condition.

[0152] 16 is a schematic diagram illustrating a target object control system applied to a wearable device according to some embodiments of the present application. Illustratively, the wearable device may include earphones 1600 (e.g., ear-hook earphones). One or more components or units of the target object control system 100 may be integrated into the earphones 1600 or may be communicatively connected to the earphones 1600.

[0153] In some exemplary application scenarios, the sensor device 1610 may be installed in the earphones 1600. The sensor device 1610 may include a vibration sensor device for collecting vibration signals due to physical activity of the user of the earphones 1600 (e.g., receiving an impact when falling). The exemplary vibration sensor device 1610 may be a MEMS accelerometer, a microphone using bone conduction as one of the primary sound propagation methods, etc. In some embodiments, the microphone using bone conduction as one of the primary sound propagation methods may be an element of the earphones 1600 itself. For example, the earphones 1600 may include a microphone using bone conduction as one of the primary sound propagation methods. In some embodiments, the processing device 120 (e.g., a signal processing unit of the earphones 1600) may determine a physiological state of the user based on the vibration sensor signal generated by the sensor device 1610. In some embodiments, the processing device 120 may determine a motion of a target object based on the physiological state of the user. The target object may represent the terminal device 130 of the system 100. In some embodiments, the target object may include earphones 1600 and a smart terminal in communication with earphones 1600. Exemplary smart terminals may be mobile phones, tablet computers, bracelets, etc.

[0154] In some other exemplary application scenarios, the sensor device 1610 may include a vibration sensor device and a motion sensor device. The motion sensor device may collect motion signals related to the user's body posture. Exemplary motion sensor devices may include, but are not limited to, a three-axis gyroscope, a three-axis accelerometer, a three-axis electronic compass, etc. Taking the three-axis gyroscope as an example, the three-axis gyroscope may collect information / data related to the attitude angle of the earphones 1600 (e.g., angular velocities of three orthogonal axes) and generate corresponding sensor signals. The attitude angles may include a pitch angle (i.e., the angle between the earphones 1600 and a horizontal plane), a yaw angle, and a roll angle. The processing unit 120 may process the sensor signals to determine their signal characteristics. The processing unit 120 may determine the user's body posture based on the signal characteristics. The body posture may include, for example, a static state, such as a prone position, a supine position, or a body tilted at a predetermined angle, or a moving state, such as slowly standing up. In some embodiments, a processor (e.g., a chip) of the three-axis gyroscope itself may determine the user's body posture based on the sensor signal. In some embodiments, the processing unit 120 may determine preset characteristic conditions based on multiple signal features corresponding to the user's body posture being in a stationary state (e.g., prone position, supine position, body tilted at a predetermined angle) and a moving state (e.g., slowly standing up). The user's body posture is determined by determining whether the signal features of the sensor signal satisfy the preset characteristic conditions. For example, if the signal features of the sensor signal satisfy the preset characteristic conditions corresponding to the body posture being in a stationary state (e.g., prone position), the user's body posture can be determined to be in a stationary state (e.g., prone position).

[0155] In some embodiments, the processing unit 120 may determine whether the user is in a fall state based on signal characteristics of the sensor signal generated by the vibration sensor device. The processing unit 120 may determine the user's body posture based on signal characteristics of the sensor signal generated by the motion sensor device. The processing unit 120 may determine whether the user has fallen and the user's body posture based on the sensor signals generated by the vibration sensor device and the motion sensor device. In some embodiments, the processing unit 120 may determine the user's physiological state based on whether the user is in a fall state and the user's body posture. Illustratively, the user's physiological state may be divided into a dangerous state and a non-dangerous state. If the user is in a fall state and the user's body posture is in a stationary state (e.g., supine) within a predetermined time threshold (e.g., 10 seconds, 20 seconds, 30 seconds, 1 minute, etc.), it is determined that the user is in a dangerous state and needs help. Also, for example, if the user is not in a falling state or if the user is in a falling state but their body posture is in a moving state (e.g., slowly standing up), it is determined that the user is in a non-dangerous state and does not need help.

[0156] In some embodiments, processing unit 120 may determine the motion of the target object based on the user's physiological state. For example, if processing unit 120 determines that the user is in a falling state and that the user's body position is in a stationary state (e.g., supine) within a threshold time, processing unit 120 may determine that the user is in a dangerous state and determine that a mobile device (e.g., a mobile phone) communicatively coupled to earphones 1600 should issue an early warning to pre-stored contacts or request external assistance. Also, for example, if processing unit 120 determines that the user is not in a falling state or that the user is in a falling state but the user's body position is in a moving state (e.g., slowly standing up, slowly sitting down, etc.), processing unit 120 may determine that the user is in a non-dangerous state and determine that a mobile device communicatively coupled to earphones 1600 should record the sensor signal related information for subsequent evaluation of the user's health state.

[0157] In some embodiments, the earphone 1600 may further include a physiological parameter sensor device. Exemplary physiological parameter sensor devices include a heart rate measuring element, a blood pressure measuring element, a blood glucose measuring element, etc. The physiological parameter sensor device may be used to detect or analyze a user's vasodilation, chest cavity movement, blood constituents, etc., and generate a sensor signal. The processing unit 120 may identify signal features of the sensor signal and determine a physiological parameter of the user. Exemplary physiological parameters may include heart rate, blood pressure, blood glucose, etc. Illustratively, the physiological parameter sensor device may include a photoelectric sensor unit that acquires a pulse signal from a body part of the user (e.g., wrist, upper arm, head, etc.) and determines the user's blood pressure status based on the pulse signal via the processing unit 120. In some embodiments, a processor (e.g., chip) of the physiological parameter sensor device itself may also determine the user's physiological parameter based on the sensor signal.

[0158] The processing unit 120 may determine whether the user has fallen and the user's body posture and / or physiological parameters based on the sensor signals generated by the vibration sensor device, the motion sensor device, and / or the physiological parameter sensor device. In some embodiments, the processing unit 120 may determine the user's physiological state based on whether the user is in a fall state and the user's body posture and / or physiological parameters. Illustratively, the user's physiological state may be divided into dangerous physiological states and non-dangerous physiological states. If the user is in a fall state and the user's body posture is in a stationary state (e.g., supine) within a predetermined time threshold (e.g., 10 seconds, 20 seconds, 30 seconds, 1 minute, etc.), and the physiological parameters exceed the thresholds (e.g., heart rate is lower than a preset heart rate threshold, blood glucose is lower than a preset blood glucose threshold, and blood pressure is higher than a preset blood pressure threshold), the processing unit 120 determines that the user is in a dangerous physiological state and needs help. The heart rate being lower than a preset heart rate threshold, the blood glucose being lower than a preset blood glucose threshold, and / or the blood pressure being higher than a preset blood pressure threshold may be determined based on the heart rate, blood glucose, and / or blood pressure of a normal human body. Illustratively, the preset heart rate threshold may be 100 beats / minute, 120 beats / minute, 140 beats / minute, 160 beats / minute, etc. Furthermore, for example, if the user is not in a fallen state or if the user is in a fallen state but their body posture is in an active state (e.g., standing up slowly) or each physiological parameter is within a threshold range, it is determined that the user is in a non-dangerous physiological state and does not need help.

[0159] Compared to judging based on the single condition of whether the user has fallen or not, judging the user's physiological state based on the user's body posture and / or physiological parameters is more accurate and effective, and the final determined behavior of the target object is more in line with the actual situation.

[0160] FIG. 17 is an exemplary flowchart for determining the motion of a target object based on vibration signals generated by a user's physical activity. This embodiment illustrates a process for determining the motion of a target object based on a vibration sensor device and a motion sensor device installed in a wearable device (e.g., earphones 1600). Illustratively, the vibration sensor device may be a MEMS accelerometer (abbreviated as accelerometer), and the motion sensor device may be a three-axis gyroscope. In this embodiment, vibration signals generated by a user's physical activity (e.g., a bump, a fall, etc.) while wearing the earphones 1600 are transmitted to the MEMS accelerometer fixedly connected to the earphones 1600. The MEMS accelerometer collects the vibration signals and generates corresponding sensor signals. The three-axis gyroscope also collects information / data related to the user's body attitude angle. In some embodiments, the processing unit 120 (e.g., a signal processing unit of the earphones 1600) may process the sensor signals generated by the MEMS accelerometer after collecting the vibration signals and identify signal features of the sensor signals to determine whether the user has fallen. For example, the processing unit 120 may perform acceleration analysis based on the sensor signals to determine whether the user has fallen. The processing unit 120 may process the sensor signals generated by the three-axis gyroscope after collecting signals and identify signal features of the sensor signals to determine the user's body posture. For example, the processing unit 120 may perform body posture analysis based on the sensor signals to determine the user's body posture.

[0161] In some embodiments, the processing unit 120 may determine whether to trigger an early warning based on whether the user has fallen and the user's body posture. As described above, if the processing unit 120 determines that the user is in a falling state and that the user's body posture is in a stationary state within a threshold time, it may determine that the user is in danger and determine that the mobile terminal (e.g., a mobile phone) should issue an early warning to pre-stored contacts or request external assistance.

[0162] FIG. 18 is an exemplary flowchart for determining the motion of a target object based on vibration signals generated by a user's physical activity. This embodiment illustrates a process for determining the motion of a target object based on a vibration sensor, a motion sensor, and a physiological parameter sensor installed in a wearable device (e.g., earphones 1600). Illustratively, the vibration sensor may be an accelerometer, the motion sensor may be a three-axis gyroscope, and the physiological parameter sensor may be a heart rate measuring element. In this embodiment, vibration signals generated by a user's physical activity (e.g., a bump, a fall, etc.) while wearing the earphones 1600 are transmitted to a MEMS accelerometer fixedly connected to the earphones 1600. The MEMS accelerometer collects the vibration signals and then generates a corresponding sensor signal. The three-axis gyroscope may collect information / data related to the user's body posture angle. The heart rate measuring element may also collect information / data related to the user's heart rate. In some embodiments, the processing unit 120 (e.g., a signal processing unit of the earphone 1600) may process a sensor signal generated by a MEMS accelerometer after collecting a vibration signal and identify signal features of the sensor signal to determine whether the user has fallen. For example, the processing unit 120 may determine whether the user has fallen by performing acceleration analysis based on the sensor signal. The processing unit 120 may process a sensor signal generated by a three-axis gyroscope after collecting a signal and identify signal features of the sensor signal to determine the user's body posture. For example, the processing unit 120 may determine the user's body posture by performing body posture analysis based on the sensor signal. The processing unit 120 may process a sensor signal generated by a heart rate measuring component after collecting a signal and identify signal features of the sensor signal to determine the user's heart rate status. For example, the processing unit 120 (e.g., a processing unit (e.g., chip) of the heart rate measuring component) may determine the user's heart rate status by performing heart rate value analysis based on the sensor signal.

[0163] In some embodiments, the processing unit 120 may determine whether the user has fallen, and whether to trigger an early warning based on the user's body posture and the user's heart rate. For example, if the processing unit 120 determines that the user is in a fall state and the user's body posture is in a stationary state within a threshold time period and / or the user's physiological parameters exceed a preset threshold (e.g., the diastolic blood pressure exceeds a preset diastolic blood pressure threshold (e.g., 140 mmHg, 160 mmHg, 180 mmHg, etc.)), the processing unit 120 may determine that the user is in a dangerous state, and the mobile terminal may issue an early warning to pre-stored contacts or request external assistance.

[0164] In some cases, compared with confirming the user's status based only on physical activity, confirming the user's status based on information such as whether the user has fallen, the user's physical posture, and the user's physiological parameters, the confirmation result is more accurate, the finally determined target object's movement is more in line with reality, and the user's physical health status can be effectively monitored.

[0165] FIG. 19 is a schematic diagram illustrating a target object control system applied to a wearable device according to some embodiments of the present application. The sensor device 110 of the target object control system 100 may include a vibration sensor device. The vibration sensor device may be integrated into or attached to the wearable device (e.g., by adhesion, snap connection, etc.). The vibration sensor device may be attached to a specific location. The specific location may be a location that can more completely and clearly receive vibration signals generated by the user's physical activity and transmitted through the user's skeleton or muscles. Exemplary specific locations may include the user's nose bridge, ears, mouth, throat, etc. In some embodiments, the location of the vibration sensor device is related to the type of wearable device. For example, if the wearable device is a pair of glasses, the vibration sensor device may be attached to the nose pads of the glasses or to the temples in a position that contacts the ears. For example, if the wearable device is an earphone, the vibration sensor device may be located at the user's ears. In some embodiments, the at least one vibration sensor device may include a single vibration sensor device attached to a specific location or multiple vibration sensor devices attached to different locations.

[0166] Illustratively, the wearable device may include earphones 1900 (e.g., in-ear earphones). One or more components or units of the target object control system 100 may be integrated into the earphones 1900 or communicatively coupled to the earphones 1900. For example, a vibration sensor device 1910 is attached to the earphones 1900. The vibration sensor device 1910 may be integrated into or attached to the earphones 1900 (e.g., by adhesive, snap connection, etc.) to collect vibration signals due to the user's physical activity. In some embodiments, the vibration sensor device may be a microphone built into the earphones that uses bone conduction as one of the primary sound propagation methods. In some embodiments, the vibration sensor device may be a microelectromechanical system (MEMS) accelerometer. Also for example, the processing unit 120 (e.g., a mobile phone or a computer) may be communicatively coupled to the earphones 1900 and the sensor device 110. The sensor device 1910 may be a vibration sensor device.

[0167] The vibration sensor device 1910 may receive a vibration signal caused by the user's physical activity through the earphones 1900. When the user wears the earphones 1900, the earphones 1900 are in close contact with a part of the user's body (e.g., the ear), and the vibration signal can be accurately transmitted to the vibration sensor device via the earphones 1900. In some embodiments, the vibration sensor device may be in close contact with a part of the user's body (e.g., the ear). The vibration signal caused by the user's physical activity may be collected directly by the vibration sensor device without using the earphones 1900. In this embodiment, the user's physical activity may refer to the user's teeth striking or rubbing. The user generates a vibration signal by striking or rubbing their teeth. The vibration signal is transmitted to the vibration sensor device via the user's bones or facial muscles.

[0168] In some embodiments, the earphone 1900 may be worn on one ear of the user. For example, the earphone 1900 may be a Bluetooth earphone with a single speaker and worn on the left or right ear of the user. In this case, the vibration sensor device 1910 may collect vibration signals transmitted to the left or right ear of the user. In some embodiments, the earphone 1900 may be worn on both ears of the user. For example, the earphone 1900 may be a headphone, an ear-hook earphone, an in-ear earphone, or the like with two speakers, and the two speakers are worn on the left and right ears of the user, respectively. In this case, the vibration sensor device 1910 may include two vibration sensor devices that collect vibration signals transmitted to the left and right ears of the user, respectively.

[0169] In some embodiments, the processing device 120 may receive the vibration sensor signal generated by the vibration sensor device 1910 and identify signal features of the vibration sensor signal. The processing device 120 may determine an action of the target object based on the signal features, for example, to switch the target object from a first state to a second state. The target object may be one or any combination of the earphones 1900 or the terminal device 130 (e.g., a mobile device (e.g., a smart wearable device), a tablet computer, a laptop computer, an in-car device (e.g., an in-car system, an air conditioner, a vehicle lamp, a wiper, etc.), a smart home device (e.g., a lamp, a television, a curtain, etc.), etc.). For details about the processing device 120 determining the action of the target object based on the vibration sensor signal, please refer to FIG. 21 and the description thereof in the present application.

[0170] Compared with controlling a terminal device (e.g., a wearable device) with a button, an operation panel, etc., issuing an operation command to a wearable device or other terminal device by striking with teeth allows a user to keep both hands free and is safer in some situations (e.g., driving, cycling, dark environments). Furthermore, compared with controlling a terminal device by transmitting a voice signal, issuing an operation command to a terminal device by striking with teeth is less noticeable, less disturbing to those around, and also helps to keep the user's personal information secret.

[0171] 20 is an exemplary flowchart of a target object control method according to some embodiments of the present application. A vibration signal caused by a user's physical activity (e.g., a teeth collision) is transmitted to the vibration sensor device 1910 via the user's facial bones or muscles. The vibration signal transmission process can be seen in FIG. 21. As shown in FIG. 21, a vibration signal may be generated at a collision point P due to a user's teeth collision, and the vibration signal may be transmitted to the vibration sensor device 1910 via the user's facial bones. The path along which the vibration signal is transmitted from point P to the vibration sensor device 1910 is shown as a vibration transmission path A in the figure.

[0172] The vibration sensor device 1910 may collect vibration signals and then generate a corresponding vibration sensor signal. After receiving the vibration sensor signal, the processing device 120 may process the vibration sensor signal to identify signal features of the vibration sensor signal. The signal features may include the number of vibration peaks, the interval between adjacent vibration peaks, signal strength, frequency components, and / or signal duration of the vibration sensor signal generated by the vibration sensor device. The number of vibration peaks of the vibration sensor signal may indicate the number of tooth collisions. The interval between adjacent vibration peaks of the vibration sensor signal may indicate the speed of the collisions. The signal strength of the vibration sensor signal may indicate the strength of the tooth collisions. The frequency components of the vibration sensor signal may indicate whether there is another object (e.g., food) between the teeth. If there is another object, the low-frequency components will increase. The signal duration of the vibration sensor signal indicates the duration of the entire vibration sensor signal or the duration of a single vibration peak.

[0173] In some embodiments, processing unit 120 may determine whether signal features of the sensor signal satisfy one of a plurality of preset feature conditions. Each preset feature condition corresponds to at least one action of the target object or an instruction for controlling the target object to perform the action. In some embodiments, processing unit 120 may set a signal feature corresponding to a combination of specific impact actions as a preset feature condition. For example, a signal feature corresponding to two consecutive impacts (where the time interval Δt between vibration peaks is less than a first impact interval threshold t0) may be set as a preset feature condition. The preset feature condition may correspond to an on / off operation of earphone 1900. For example, a signal feature corresponding to two slow impacts (where the time interval Δt between vibration peaks is greater than a first impact interval threshold t0 and less than a second impact interval threshold t1) may be set as a preset feature condition. The preset feature condition may correspond to a play / pause operation of earphone 1900.

[0174] When the signal features of the sensor signal satisfy one of the preset feature conditions, the processing unit 120 may determine an action of the target object corresponding to the sensor signal. For example, when the signal features satisfy the preset feature condition of two consecutive collisions, the processing unit 120 may control the earphone 1900 to perform an on / off operation. The processing unit 120 may detect the state of the earphone 1900, and when the earphone 1900 is in the on state (i.e., the first state), the processing unit 120 may determine to adjust the earphone 1900 to the off state (i.e., the second state). When the earphone 1900 is in the off state, the processing unit 120 may determine to adjust the earphone 1900 to the on state.

[0175] In some embodiments, when the vibration sensor device includes only vibration sensor devices installed at certain positions (e.g., in FIG. 22 , vibration sensor devices are installed only at the right portion of earphone 1900), the signal features include the number of vibration peaks, the interval time between adjacent vibration peaks, and / or the signal duration of the vibration sensor signal generated by the vibration sensor device. In some embodiments, when the sensor unit includes vibration sensor devices installed at different positions (e.g., in FIG. 24 , vibration sensor devices 1920 and 1910 are installed at the left and right portions of earphone 1900, respectively), the signal features of the sensor signal further include a phase difference between the sensor signals of the vibration sensor devices at different positions. The phase difference may be used to identify the location of the vibration source (i.e., tooth impact point P). 24, when the collision point P is on the right side, the distances between the collision point P and the vibration sensor devices at different positions are different, so the lengths of the vibration transmission paths (e.g., vibration transmission path B from the collision point P to the left vibration sensor device 1920 and vibration transmission path A from the collision point P to the right vibration sensor device 1910) are different. After the right vibration sensor device 1910 captures a vibration signal, the left vibration sensor device 1920 also captures the vibration signal. There is a phase difference between the vibration signals collected by the two vibration sensor devices 1910 and 1920. Based on the phase difference, the difference between vibration transmission path B and vibration transmission path A can be determined. Since the positions of the vibration sensor devices 1910 and 1920 are fixed, the position of the collision point P (e.g., left side, right side, middle, etc.) can be determined.

[0176] In some cases, by identifying the location of the vibration source (i.e., tooth collision point P), the user can combine more types and more complex tooth collision actions by changing the location of the collision point P, the number of collisions and / or the time between collisions, etc., to accommodate more and more complex target object actions or action commands.

[0177] In some cases, a user may inadvertently or unavoidably perform a teeth striking motion. For example, a user may perform a teeth striking motion while eating. For example, a user may perform a teeth striking motion while talking. For further example, a user may perform a teeth striking motion when performing physical activities such as shaking, sneezing, or receiving an external impact (e.g., a bump). These situations may trigger a movement of the target object (i.e., a false trigger). In some embodiments, the processing unit 120 may avoid false trigger situations by filtering or distinguishing sensor signals.

[0178] The processing device 120 may acquire a vibration sensor signal of at least one vibration sensor device in real time or intermittently. Upon acquiring the vibration sensor signal (also referred to herein as a second sensor signal), the processing device 120 may acquire related information of the second sensor signal, such as a frequency, a signal strength, etc. The processing device 120 may determine whether the second sensor signal is a false trigger signal based on the related information of the second sensor signal. Exemplarily, the processing device 120 may determine whether the second sensor signal is a false trigger signal based on the frequency of the second sensor signal. For example, if the frequency of the second sensor signal is lower than a preset frequency threshold, the second sensor signal may be determined to be a false trigger signal. If the frequency of the second sensor signal is lower than a preset frequency threshold, it may be considered that the user is eating. Since the sensor signal generated at this time can be determined to be a false trigger signal, the target object does not need to take any action.

[0179] In some embodiments, the sensor device 110 may further include an audio input device (e.g., a microphone). In some embodiments, the microphone may be an element of the wearable device (e.g., earphone 1900) itself. Upon acquiring the vibration sensor signal (also referred to herein as the third sensor signal), the processing device 120 may determine whether the audio input device simultaneously receives user voice information. If the audio input device receives user voice information, the processing device 120 determines that the third sensor signal is a false trigger signal. At this time, it may be considered that the user is talking to another person or making a call using a communication device. Because the sensor signal generated at this time can be determined as a false trigger signal, the target object does not need to take any action.

[0180] In some embodiments, upon acquiring a vibration sensor signal (also referred to herein as a fourth sensor signal), the processing device 120 may determine whether the fourth sensor signal is a false trigger signal based on a false trigger identification model. In some embodiments, the false trigger identification model may be a machine learning model. In some embodiments, the processing device 120 may use the fourth sensor signal as input data for the machine learning model. The machine learning model can obtain a result of whether the fourth sensor signal is a false trigger signal. If the fourth sensor signal is a false trigger signal, the target object does not need to perform any action. If the fourth sensor signal is not a false trigger signal, the processing device 120 may acquire a signal within a threshold time range (e.g., 2 s, 3 s, 5 s, 10 s, etc.) after the fourth sensor signal as the sensor signal. In some embodiments, the false trigger identification model may be a trained machine learning model. The training process of the false trigger identification model is the same as or similar to the training process of the feature extraction model.

[0181] FIG. 22 is a schematic diagram illustrating a target object control system applied to a wearable device according to some embodiments of the present application. One or more components or units of the target object control system 100 may be integrated into earphones 1900 or may be communicatively connected to the earphones 1900. As shown in FIG. 22 , a vibration sensor device 1910 is installed on the right side of the earphones 1900, and no vibration sensor device is installed on the left side. When a user impacts their teeth, a vibration signal is generated at the impact point P. The vibration signal may be transmitted to the vibration sensor device 1910 via a vibration transmission path A. The vibration sensor device 1910 generates a corresponding vibration sensor signal based on the collected vibration signal. The processing device 120 may identify signal features of the vibration sensor signal and determine whether the signal features satisfy a preset feature condition. In some embodiments, the vibration sensor signal may be output as a signal feature spectrum. The processing device 120 may identify the signal features of the sensor signal based on the signal feature spectrum. For example, the processing device 120 may read related information, such as the number of vibration peaks and the frequency components of the signal, from the signal feature spectrum. 23 illustrates a signal feature spectrum of a sensor signal corresponding to a user's teeth impact, according to some embodiments of the present application. As can be seen from FIG. 23, the sensor signal includes three vibration peaks, and the interval time between the first two of the three vibration peaks is Δt1, and the interval time between the last two of the three vibration peaks is Δt2 based on the time of signal collection / generation.

[0182] In some embodiments, the signal characteristics corresponding to the collision operation of specific teeth may be used as preset characteristic conditions. Exemplary tooth collision operations may include the following operations: (1) two consecutive collisions: Δt < t0; (2) two slow collisions: t1 > Δt > t0; (3) three consecutive collisions: Δt1 < t0, Δt2 < t0; (4) three slow collisions: t1 > Δt1 > t0, t1 > Δt2 > t0; (5) two consecutive collisions + one slow collision: Δt1 < t0, t1 > Δt2 > t0; (6) one slow collision + two consecutive collisions: t1 > Δt1 > t0, Δt2 < t0. In the formula, Δt is the interval time between two adjacent collisions (which can indicate the interval time between two vibration peaks), t0 is the first collision interval threshold, and t1 is the second collision interval threshold. In some embodiments, the first collision interval threshold t0 may be within the range of 0.1 s to 1 s. In some embodiments, the first collision interval threshold t0 may be within the range of 0.15 s to 0.9 s. In some embodiments, the first collision interval threshold t0 may be within the range of 0.2 s to 0.8 s. In some embodiments, the second collision interval threshold t1 may be within the range of 0.8 s to 5 s. In some embodiments, the second collision interval threshold t1 may be within the range of 0.9 s to 4 s. In some embodiments, the second collision interval threshold t1 may be within the range of 1 s to 2 s.

[0183] The signal characteristics of the sensor signals resulting from the above tooth collision operations respectively correspond to different operations of the target object. Exemplary operations include on / off, play / pause, make / end a call, increase / decrease volume, Bluetooth on / off, etc. It should be noted that the above tooth collision operations, the values of related parameters, and the corresponding operations of the target object are merely exemplary and do not limit the scope protected by this application.

[0184] In some embodiments, when the signal features of the sensor signal generated by the user colliding teeth meet a certain preset feature condition, the processing device 120 may determine an action of the target object corresponding to the certain preset feature condition, and control the target object (e.g., a terminal device, such as the earphone 1900, a mobile phone, etc.) to perform the corresponding action.

[0185] FIG. 24 is a schematic diagram of a target object control system applied to a wearable device according to some embodiments of the present application. Unlike the embodiment shown in FIG. 22, in this embodiment, the left and right portions of earphones 1900 include vibration sensor devices 1920 and 1910, respectively. The vibration sensor devices 1910 and 1920 are the same or similar. A vibration signal generated at a tooth collision point P is transmitted to the left vibration sensor device 1920 via vibration transmission path B and to the right vibration sensor device 1910 via vibration transmission path A. The vibration sensor devices 1910 and 1920 generate sensor signals a and b, respectively. The processing device 120 may identify signal features of the sensor signals a and b (e.g., the vibration peaks of the sensor signals a / b, the time interval between adjacent vibration peaks of the sensor signals a / b, the signal duration of the sensor signals a / b, and / or the phase difference between the sensor signals a and b) and determine whether the signal features satisfy a preset characteristic condition.

[0186] In some embodiments, signal characteristics corresponding to specific tooth impact operations may be used as preset characteristic conditions. Exemplary tooth impact operations may include operations performed by left teeth, right teeth, or middle teeth (i.e., front teeth), such as: (1) two consecutive impacts: Δt < t0; (2) two slow impacts: t1 > Δt > t0; (3) three consecutive impacts: Δt1 < t0, Δt2 < t0; (4) three slow impacts: t1 > Δt1 > t0, t1 > Δt2 > t0; (5) two consecutive impacts + one slow impact: Δt1 < t0, t1 > Δt2 > t0; (6) one slow impact + two consecutive impacts: t1 > Δt1 > t0, Δt2 < t0. In some other examples, tooth impact operations may be performed by combinations of operations of left teeth, right teeth, and middle teeth. For example: (1) two consecutive impacts on the left (i.e., left teeth) + one impact on the right (i.e., right teeth): Δt1 < t0, t1 > Δt2 > t0; (2) two consecutive impacts on the left + one impact in the middle (i.e., middle teeth): Δt1 < t0, t1 > Δt2 > t0; (3) two consecutive impacts on the right + one impact on the left: Δt1 < t0, t1 > Δt2 > t0; (4) two consecutive impacts on the right + one impact in the middle: Δt1 < t0, t1 > Δt2 > t0; (5) two consecutive impacts in the middle + one impact on the right: Δt1 < t0, t1 > Δt2 > t0; (6) two consecutive impacts in the middle + one impact on the left: Δt1 < t0, t1 > Δt2 > t0; (7) one impact on the left + two consecutive impacts on the right: t1 > Δt2 > t0, Δt2 < t0; (8) one impact on the left + two consecutive impacts in the middle: t1 > Δt2 > t0, Δt2 < t0; (9) one impact on the right + two consecutive impacts on the left: t1 > Δt2 > t0, Δt2 < t0; (10) one impact on the right + two consecutive impacts in the middle: t1 > Δt2 > t0, Δt2 < t0; (11) one impact in the middle + two consecutive impacts on the right: t1 > Δt2 > t0, Δt2 < t0; (12) one impact in the middle + two consecutive impacts on the left: t1 > Δt2 > t0, Δt2 < t0.

[0187] The signal characteristics of the sensor signal generated by the teeth collision motions correspond to different actions of the target object. Exemplary actions include on / off, play / pause, making / hanging up a phone call, making / hanging up an emergency contact, making / hanging up an emergency center call, increasing / decreasing the volume, turning Bluetooth on / off, increasing / decreasing the brightness of a light, etc. Note that the above teeth collision motions and the corresponding actions of the target object are merely exemplary and do not limit the scope of protection of the present application.

[0188] In some embodiments, when the signal features of the sensor signal generated by the user colliding teeth meet a certain preset feature condition, the processing device 120 may determine an action of the target object corresponding to the certain preset feature condition, and control the target object (e.g., a terminal device, such as the earphone 1900, a mobile phone, etc.) to perform the corresponding action.

[0189] Although the basic concepts have been described above, it will be apparent to those skilled in the art that the above disclosure of the invention has been presented by way of example only and is not intended to limit the present specification. Although not expressly described herein, those skilled in the art may make various changes, improvements, and modifications to the present specification. These changes, improvements, and modifications are intended to be suggested by the present specification and are therefore within the spirit and scope of the exemplary embodiments of the present specification.

[0190] Furthermore, certain terms are used herein to describe embodiments herein. For example, "one embodiment," "one embodiment," and / or "some embodiments" refer to a particular feature, structure, or characteristic associated with at least one embodiment herein. Therefore, it is emphasized and understood that two or more references to "one embodiment" or "one embodiment" or "one alternative embodiment" in various parts of this specification do not necessarily all refer to the same embodiment. Also, certain features, structures, or characteristics in one or more embodiments herein may be combined as appropriate.

[0191] Moreover, as will be appreciated by those skilled in the art, each aspect of the present specification may be illustrated and described in several patentable classes or contexts, including any new and useful process, machine, manufacture, or combination of matter, or any new and useful improvement thereto. Accordingly, each aspect of the present specification may be implemented entirely in hardware, entirely in software (including firmware, resident software, microcode, etc.), or a combination of hardware and software. Any of the above hardware or software may be referred to as a "data block," "module," "engine," "unit," "assembly," or "system." Furthermore, each aspect of the present specification may take the form of a computer program product embodied in one or more computer-readable medium(s) containing computer-readable program code.

[0192] Furthermore, unless expressly stated in the claims, the enumerated order, use of alphanumeric characters, or use of other designations of processing elements or sequences described herein does not limit the order of the procedures and methods herein. While the above disclosure has set forth through various examples what are presently believed to be various useful embodiments of the invention, it will be understood that such details are for the purpose of illustration only, and that the appended claims are not limited to the disclosed embodiments, but on the contrary, are intended to cover all modifications and equivalent combinations within the spirit and scope of the embodiments herein. For example, the system assembly described above may be implemented by a hardware device, or may be implemented as a software-only solution, e.g., by installing the described system on an existing server or mobile device.

[0193] Similarly, in the foregoing description of embodiments herein, it will be understood that various features may be grouped together in a single embodiment, drawing, or description for the purpose of simplifying the description and facilitating an understanding of one or more inventive embodiments. However, this method of disclosure should not be interpreted as reflecting an intention that the claimed subject matter requires more features than are recited in each claim. Rather, claimed subject matter may comprise less than all features of a single foregoing disclosed embodiment.

[0194] In some embodiments, numbers describing the number of components and attributes are used, and the numbers describing such embodiments may be understood to be modified in some instances by the modifiers "about," "approximately," or "substantially." Unless otherwise specified, "about," "approximately," or "substantially" indicates that a variation of ±20% from the value described by the number is permitted. Thus, in some embodiments, all numerical parameters used in the specification and claims are approximations that may vary depending on the characteristics required for a particular embodiment. In some embodiments, numerical data should be calculated using the specified number of significant digits and ordinary rounding techniques. Notwithstanding that the numerical ranges and data used to determine ranges in some embodiments herein are approximations, in certain embodiments, such numerical values are set as precisely as possible.

[0195] Finally, it is to be understood that the embodiments described herein are merely illustrative of the principles of the embodiments herein. Other variations may be within the scope of the present disclosure. Thus, by way of example, and not of limitation, alternative configurations of the embodiments herein may be considered consistent with the teachings herein. Thus, the embodiments herein are not limited to the embodiments expressly introduced and described herein. [Explanation of symbols]

[0196] 100 Target Object Control System 110 Sensor device 120 Processing equipment 130 Terminal Equipment 140 Storage device 300 Target Object Control System 310 Sensor Signal Acquisition Module 320 Signal Feature Identification Module 330 Action Decision Module 600 Indoor environment 610 Doors 620 beds 630 Headboard 640 Lamp 800 In-car environment 810 Co-pilot storage box 820 steering wheel 1000 Tabletop Environment 1010 Table 1020 Chair 1400 earphones 1600 earphones 1900 earphones

Claims

1. a storage device configured to store computer instructions; a processor in communication with the storage device; A system comprising: When the processor executes the computer instructions, the processor causes the system to: acquiring a sensor signal from at least one sensor device, the at least one sensor device including a vibration sensor device and an audio input device, the vibration sensor device being disposed on a wearable device, the wearable device being in close contact with a body part of the user, and the vibration sensor device receiving a vibration signal generated by the user's physical activity via the wearable device; determining whether the audio input device simultaneously receives user voice information; designating the vibration signal as a false trigger signal in response to determining that the audio input device has received voice information from the user; in response to determining that the audio input device is not receiving voice information from the user; identifying signal features of the vibration signal; determining a movement of a target object associated with the at least one sensor device based on the signal characteristics; configured to perform system.

2. The system of claim 1 , wherein the signal features include at least one of a number of vibration peaks, a signal strength, a time interval between adjacent vibration peaks, a frequency component, and a signal duration.

3. The step of acquiring a sensor signal of the at least one sensor device includes: acquiring a first sensor signal of the at least one sensor device; determining whether the first sensor signal is greater than a signal threshold; responsive to determining that the first sensor signal is greater than the signal threshold, obtaining as the sensor signal a signal within a threshold time range after the first sensor signal; The system of claim 1 , comprising:

4. The system according to claim 1 or 2, wherein the vibration sensor device is installed in a wearable device that is in close contact with a body part of the user, and the wearable device receives vibration signals resulting from the physical activity of the user.

5. Determining a movement of a target object associated with the at least one sensor device based on the signal characteristics comprises: determining a physiological state of the user based on the signal characteristics; determining, based on the physiological state of the user, a behavior of the target object corresponding to the physiological state; The system of claim 1 or 4, comprising:

Images