Terminal control system and method

Abstract

The embodiments of the present application disclose a system and a method, the system comprising: at least one storage device, the at least one storage device storing computer instructions; and at least one processor, the at least one processor being in communication with the at least one storage device, and when executing the stored computer instructions, the at least one processor causes the system to perform operations of: acquiring a sensing signal of at least one sensing device; identifying a signal feature of the sensing signal; and determining an operation of a target object associated with the at least one sensing device based on the signal feature.

Description

TECHNICAL FIELD

[0001] The present specification relates to the field of sensors, and in particular to a system and method for controlling a terminal device based on a sensing signal collected by a sensing device. BACKGROUND

[0002] More and more intelligent terminal devices appear in daily life, and efficient and convenient control of the intelligent terminal devices is beneficial to improve user experience. Common human-computer interaction is achieved by voice dialogue or manual operation of physical structures provided on the terminal device. However, in some cases, for example, high noise, low ambient brightness or user inconvenience, it may be difficult and problematic to control the terminal device by voice dialogue or panel manual operation.

[0003] The present specification provides a target object operation determination method, which can improve the accuracy of determining the operation of the target object, so that the operation of the target object is more in line with the user's expectations. SUMMARY

[0004] Some embodiments of the present application provide a system, comprising: a storage device configured to store computer instructions; and a processor in communication with the storage device, when executing the stored computer instructions, the processor causes the system to perform operations of: obtaining a sensing signal of at least one sensing device; identifying a signal feature of the sensing signal; and determining an operation of a target object associated with the at least one sensing device based on the signal feature.

[0005] In some embodiments, the at least one sensing device includes a vibration sensing device.

[0006] In some embodiments, the signal feature includes one or a combination of a number of vibration peaks, signal intensity, interval time of adjacent vibration peaks, frequency component, and signal duration time.

[0007] In some embodiments, the vibration sensing device is connected to a vibration receiving area through a solid medium and receives a vibration signal input to the vibration receiving area.

[0008] In some embodiments, the vibration signal is input to the vibration receiving area by tapping, slapping or scratching the vibration receiving area.

[0009] In some embodiments, the vibration sensing device can be fixedly connected to the solid medium by at least one of bonding, inlaying, welding, riveting, and screwing.

[0010] In some embodiments, the vibration sensing device is arranged at a position where the amplitude of the solid medium is large.

[0011] In some embodiments, the determining the operation of the target object associated with the at least one sensing device based on the signal feature comprises: determining whether the signal feature satisfies a preset feature; and in response to the signal feature satisfying the preset feature, determining the operation of the target object corresponding to the preset feature.

[0012] In some embodiments, the determining whether the signal feature satisfies the preset feature comprises: determining whether the signal feature satisfies the preset based on a preset feature condition recognition model, the preset feature condition recognition model being a machine learning model.

[0013] In some embodiments, the operation of the target object comprises switching a terminal device from a first state to a second state.

[0014] In some embodiments, the obtaining the sensing signal of the at least one sensing device comprises: obtaining a first sensing signal of the at least one sensing device; determining whether the first sensing signal is greater than a signal threshold; and in response to the first sensing signal being greater than the signal threshold, obtaining a signal within a threshold time range from the first sensing signal as the sensing signal.

[0015] In some embodiments, the vibration sensing device is arranged on a wearable device, the wearable device is attached to a body part of a user, and the vibration sensing device receives a vibration signal generated by a body activity of the user through the wearable device.

[0016] In some embodiments, the vibration sensing device is attached to a body part of a user, and the vibration sensing device receives a vibration signal generated by a body activity of the user.

[0017] In some embodiments, the body activity comprises coughing, sneezing, snoring, yawning, or falling.

[0018] In some embodiments, the determining the operation of the target object associated with the at least one sensing device based on the signal feature comprises: determining a physiological state of the user based on the signal feature; and determining the operation of the target object corresponding to the physiological state of the user based on the physiological state of the user.

[0019] In some embodiments, the determining the physiological state of the user based on the signal feature comprises: determining whether the signal feature satisfies a preset feature; and in response to the signal feature satisfying the preset feature, determining the physiological state corresponding to the preset feature.

[0020] In some embodiments, the operation of the target object comprises recording a health condition or issuing a warning by a mobile terminal.

[0021] In some embodiments, the vibration sensor device has a response frequency of 2KHz-4.5KHz.

[0022] In some embodiments, the vibration sensor device has a sensitivity of -35dBV / (m / s 2 ) -15dBV / (m / s 2 ).

[0023] In some embodiments, the at least one sensor device further comprises a motion sensor device.

[0024] In some embodiments, the determining the operation of the target object associated with the at least one sensor device based on the signal feature comprises: determining whether the user falls down and a body posture of the user based on the signal feature; and determining the corresponding operation of the target object based on whether the user falls down and the body posture of the user.

[0025] In some embodiments, the determining the corresponding operation of the target object based on whether the user falls down and the body posture of the user comprises: if it is determined that the user falls down and the body posture is static, determining that the user is in a dangerous state, and determining that the mobile terminal performs an operation of calling for help.

[0026] In some embodiments, the at least one sensor device further comprises a physiological parameter sensor device.

[0027] In some embodiments, the determining the operation of the target object associated with the at least one sensor device based on the signal feature comprises: determining whether the user falls down and a body posture and a physiological parameter of the user based on the signal feature; and determining the corresponding operation of the target object based on whether the user falls down and the body posture and the physiological parameter of the user.

[0028] In some embodiments, the determining the corresponding operation of the target object based on whether the user falls down and the body posture and the physiological parameter of the user comprises: if it is determined that the user falls down, and the body posture is static or the physiological parameter exceeds a preset threshold, determining that the user is in a dangerous state, and determining that the mobile terminal performs an operation of calling for help.

[0029] In some embodiments, the physiological parameter comprises at least one of a heart rate, a blood pressure, or a blood sugar.

[0030] In some embodiments, the body activity comprises tooth tapping.

[0031] In some embodiments, the at least one sensor device comprises a vibration sensor device arranged at a specific position.

[0032] In some embodiments, the identifying the signal feature of the sensing signal comprises identifying a number of vibration peaks, an interval time of adjacent vibration peaks, and a signal duration time of the sensing signal.

[0033] In some embodiments, the at least one sensing device comprises vibration sensing devices respectively arranged at different positions.

[0034] In some embodiments, the signal feature further comprises a phase difference of the sensing signals of the vibration sensing devices respectively arranged at the different positions, which can be used to determine a position of the vibration signal.

[0035] In some embodiments, the identifying the signal feature of the sensing signal comprises identifying a number of vibration peaks, an interval time of adjacent vibration peaks, a signal duration time, and a phase difference of the vibration signal.

[0036] In some embodiments, the operation of the target object comprises switching of a terminal device from a first state to a second state.

[0037] In some embodiments, the obtaining the sensing signal of the at least one sensing device comprises obtaining a second sensing signal of the at least one sensing device; determining whether a frequency of the second sensing signal is lower than a preset frequency threshold; and in response to the frequency of the second sensing signal being lower than the preset frequency threshold, determining that the second sensing signal is a false trigger signal.

[0038] In some embodiments, the at least one sensing device comprises an audio input device, the obtaining the sensing signal of the at least one sensing device comprises obtaining a third sensing signal of the at least one sensing device; determining whether the audio input device simultaneously receives user voice information; and in response to the audio input device receiving user voice information, determining that the third sensing signal is a false trigger signal.

[0039] In some embodiments, the obtaining the sensing signal of the at least one sensing device comprises obtaining a fourth sensing signal of the at least one sensing device; determining, based on a false trigger identification model, whether the fourth sensing signal is a false trigger signal; and in response to the fourth sensing signal not being a false trigger signal, obtaining a signal within a threshold time range from the second sensing signal as the sensing signal.

[0040] In some embodiments, the false trigger identification model is a machine learning model.

[0041] Some embodiments of the present application further provide a method, comprising: obtaining a sensing signal of at least one sensing device; identifying a signal feature of the sensing signal; and determining, based on the signal feature, an operation of a target object associated with the at least one sensing device.

[0042] Some embodiments of the present application also provide a non-transitory computer readable medium comprising computer instructions, which when executed by at least one processor, can cause the at least one processor to perform operations of: obtaining a sensing signal of at least one sensing device; identifying a signal feature of the sensing signal; and determining an operation of a target object associated with the at least one sensing device based on the signal feature. BRIEF DESCRIPTION OF DRAWINGS

[0043] The present specification will be further described in the manner of exemplary embodiments, which will be described in detail with reference to the accompanying drawings. These embodiments are not limiting, and in these embodiments, the same reference numbers represent similar structures, in which:

[0044] Figure 1 is a schematic diagram of an application scenario of a target object control system according to some embodiments of the present application;

[0045] Figure 2 is an exemplary flowchart of a target object control method according to some embodiments of the present application;

[0046] Figure 3 is an exemplary block diagram of a target object control system according to some embodiments of the present application;

[0047] Figure 4 is an exemplary flowchart of a target object control method according to some embodiments of the present application;

[0048] Figures 5A-5D is a signal feature spectrum of a vibration signal generated by different operations of a user according to some embodiments of the present application;

[0049] Figure 6 is a schematic diagram of an indoor environment provided with a terminal device according to some embodiments of the present application;

[0050] Figure 7 is an exemplary flowchart of controlling a lamp in an indoor environment according to some embodiments of the present application;

[0051] Figure 8 is a schematic diagram of an in-vehicle environment provided with a terminal device according to some embodiments of the present application;

[0052] Figure 9 is an exemplary flow of controlling a terminal device in a vehicle according to some embodiments of the present application;

[0053] Figure 10 is a schematic diagram of a desktop environment provided with a terminal device according to some embodiments of the present application;

[0054] Figure 11 is an exemplary flowchart of a target object control method according to some embodiments of the present application;

[0055] Figures 12A-12E is a signal feature spectrum of a vibration sensing signal corresponding to different physical activities according to some embodiments of the present application;

[0056] Figure 13 is a frequency curve diagram of a vibration sensing signal of a user's physical activity according to some embodiments of the present application;

[0057] Figure 14 is a schematic diagram of a target object control system applied to a wearable device according to some embodiments of the present application;

[0058] Figure 15 is an exemplary flowchart of determining a target object operation based on a vibration signal generated by a user's physical activity according to some embodiments of the present application;

[0059] Figure 16 is a schematic diagram of a target object control system applied to a wearable device according to some embodiments of the present application;

[0060] Figure 17 is an exemplary flowchart of determining a target object operation based on a vibration signal generated by a user's physical activity;

[0061] Figure 18 is an exemplary flowchart of determining a target object operation based on a vibration signal generated by a user's physical activity;

[0062] Figure 19 is a schematic diagram of a target object control system applied to a wearable device according to some embodiments of the present application;

[0063] Figure 20 is an exemplary flowchart of a target object control method according to some embodiments of the present application;

[0064] Figure 21 is a schematic diagram of a vibration signal transmission according to some embodiments of the present application;

[0065] Figure 22 is a schematic diagram of a target object control system applied to a wearable device according to some embodiments of the present application;

[0066] Figure 23 is a signal feature spectrum of a sensing signal corresponding to a user's tooth tapping; and

[0067] Figure 24is a schematic diagram of a target object control system applied to a wearable device according to some embodiments of the present application. DETAILED DESCRIPTION

[0068] In order to more clearly illustrate the technical solutions of the embodiments of the present specification, the drawings required to be used in the embodiment description will be briefly introduced below. Obviously, the drawings in the following description are only some examples or embodiments of the present specification, and those skilled in the art can also apply the present specification to other similar scenarios without creative labor on the basis of these drawings. It should be understood that these exemplary embodiments are only given to enable those skilled in the art to better understand and implement the present application, and do not limit the scope of the present application in any way. Unless the context clearly indicates otherwise or otherwise stated, the same reference numbers in the drawings represent the same structures or operations.

[0069] As shown in the specification and claims, unless the context clearly indicates otherwise or otherwise stated, the words "one", "a", "an", and / or "the" do not specifically refer to the singular, but can also include the plural. Generally speaking, the terms "comprise" and "include" only indicate the inclusion of the steps and elements explicitly identified, and these steps and elements do not constitute an exclusive list, and the method or device can also include other steps or elements. The term "based on" is "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment". Related definitions of other terms will be given in the following description.

[0070] Some embodiments of the present specification provide a target object operation determination method. The method acquires a sensing signal through at least one sensing device, and the sensing signal is generated by the sensing device after acquiring an external signal. In some embodiments, the external signal can include a vibration signal or a combination of a vibration signal and other types of signals. Other types of signals can include acoustic signals, optical signals, electrical signals, etc. Since the vibration signal is transmitted through a solid medium, the vibration signal can still be accurately and effectively collected by the sensing device even in an environment with sound interference or even high noise. By identifying the signal characteristics of the sensing signal, the operation of the target object associated with the at least one sensing device can be determined based on the signal characteristics, so that the operation of the target object is more accurate and convenient. Wherein, the target object can refer to a terminal device connected / communicated with the sensing device for performing various functions.

[0071] Figure 1Fig. 1 is a schematic diagram of an application scenario of a target object control system according to some embodiments of the present application. For the convenience of description, the target object control system 100 can be referred to as system 100. The system 100 can include a sensing device 110, a processing device 120, a terminal device 130 (or target object), and a storage device 140. In some embodiments, the system 100 can identify a signal feature of a sensing signal collected by the sensing device 110, and determine an operation to be performed by the terminal device based on the signal feature. The components in the system 100 can be connected to each other by wired or wireless means.

[0072] In some embodiments, the wired connection includes, but is not limited to, the use of metal cables, optical cables, or a combination of metal and optical cables, such as coaxial cables, communication cables, flexible cables, spiral cables, non-metal sheathed cables, metal sheathed cables, multi-core cables, twisted pair cables, ribbon cables, shielded cables, telecommunications cables, twin cables, parallel twin-core wires, and twisted pairs. The above-described examples are only for convenience of description, and the medium of the wired connection can also be other types, such as other electrical or optical signal transmission carriers.

[0073] The wireless connection includes, but is not limited to, radio communication, free-space optical communication, acoustic communication, and electromagnetic induction, etc. The radio communication includes, but is not limited to, IEEE 302.11 series standards, IEEE 302.15 series standards (such as Bluetooth technology and Zigbee technology, etc.), first-generation mobile communication technology, second-generation mobile communication technology (such as FDMA, TDMA, SDMA, CDMA, and SSMA, etc.), general packet radio service technology, third-generation mobile communication technology (such as CDMA2000, WCDMA, TD-SCDMA, and WiMAX, etc.), fourth-generation mobile communication technology (such as TD-LTE and FDD-LTE, etc.), satellite communication (such as GPS technology, etc.), near-field communication (NFC), and other technologies operating in the ISM frequency band (such as 2.4 GHz, etc.); the free-space optical communication includes, but is not limited to, visible light, infrared signals, etc.; the acoustic communication includes, but is not limited to, sound waves, ultrasonic signals, etc.; the electromagnetic induction includes, but is not limited to, near-field communication technology, etc. The above-described examples are only for convenience of description, and the medium of the wireless connection can also be other types, such as Z-wave technology, other licensed civilian radio frequency bands or military radio frequency bands, etc.

[0074] The sensing device 110 can acquire an external signal and generate a sensing signal (e.g., an electrical signal) based on the external signal. The external signal can include a mechanical vibration signal (also referred to as a vibration signal), an acoustic signal, an optical signal, an electrical signal, etc. In some embodiments, the external signal is inputted by a user or by a user in a specific manner, which can also be referred to as a user signal. The sensing device 110 can include, but is not limited to, one or more of a pressure sensing device, a vibration sensing device, a tactile sensing device, an audio input device, an optical sensing device, etc. In some embodiments, the sensing device 110 can include at least a vibration sensing device for acquiring a vibration signal. In some embodiments, a user can input a signal to the sensing device 110 to cause the sensing device to generate a corresponding sensing signal. For example, the sensing device 110 can acquire a vibration signal inputted by a user (e.g., by tapping a door panel, tapping a tooth, etc.). Since the vibration signal is less likely to be affected by environmental noise during transmission, the vibration signal can be accurately and effectively acquired by the sensing device 110.

[0075] The processing device 120 can process data and / or information obtained from the sensing device 110, the storage device 140, or other components of the system 100. For example, the processing device 120 can process a sensing signal acquired from the sensing device 110 and determine a signal feature of the sensing signal. In some embodiments, the processing device 120 can be a single server or a group of servers. The group of servers can be centralized or distributed. In some embodiments, the processing device 120 can be local or remote. For example, the processing device 120 can access information and / or data from the sensing device 110, the terminal device 130, and / or the storage device 140. For another example, the processing device 120 can be directly connected to the sensing device 110, the terminal device 130, and / or the storage device 140 to access information and / or data. In some embodiments, the processing device 120 can include one or more sub-processors (e.g., a single-core processor or a multi-core processor). Merely by way of example, the processor can include a central processing unit (CPU), an application-specific integrated circuit (ASIC), an application-specific instruction-set processor (ASIP), a graphics processing unit (GPU), a physics processing unit (PPU), a digital signal processor (DSP), a field-programmable gate array (FPGA), a programmable logic device (PLD), a controller, a microcontroller unit, a reduced instruction set computer (RISC), a microprocessor, etc., or any combination thereof. In some embodiments, the processing device 120 can be a chip. The chip can be disposed in the sensing device 110. In some specific embodiments, the processing device 120 can be a processor of the sensing device 110 (e.g., a chip of the sensing device 110), which can be used not only to acquire a vibration signal but also to process a sensing signal generated by the sensing device 110.

[0076] The storage device 140 can store data, instructions, and / or any other information such as the aforementioned sensor signals and signal feature information of the sensor signals, etc. In some embodiments, the storage device 140 can store data obtained from the sensor apparatus 110 and / or the processing device 120. In some embodiments, the storage device 140 can store data and / or instructions used by the processing device 120 to perform or use to complete the example methods described in the present application. In some embodiments, the storage device 140 can include a mass storage, a removable storage, a volatile read / write memory, a read-only memory (ROM), etc., or any combination thereof. In some embodiments, the storage device 140 can be implemented on a cloud platform.

[0077] In some embodiments, the storage device 140 can be in communication with at least one other component in the system 100 (e.g., the processing device 120). At least one component in the system 100 can access data (e.g., signal features) stored in the storage device 140. In some embodiments, the storage device 140 can be part of the processing device 120.

[0078] In some embodiments, the terminal device 130 can include one or any combination of a mobile device, a tablet, a laptop, an in-vehicle device, a smart home device, etc. In some embodiments, the mobile device can include one or any combination of a wearable device, a smart mobile device, a virtual reality device, an augmented reality device, a smart toy, a smart speaker, etc. In some embodiments, the wearable device can include one or any combination of a smart bracelet, a smart footwear, a smart eyewear, a smart helmet, a smart watch, a smart clothing, a smart backpack, a smart accessory, etc. In some embodiments, the smart mobile device can include one or any combination of a smart phone, a personal digital assistant (PDA), a gaming device, a navigation device, a POS device, etc. In some embodiments, the virtual reality device and / or the augmented reality device can include one or any combination of a virtual reality helmet, a virtual reality eyewear, a virtual reality eyeshield, an augmented reality helmet, an augmented reality eyewear, an augmented reality eyeshield, etc. In some embodiments, the in-vehicle device can include a car phone, a car multimedia, Bluetooth, navigation, etc. In some embodiments, the smart home device can include one or any combination of a smart lighting device (e.g., a lamp), a control device of a smart appliance, a smart monitoring device, a smart television, a smart camera, an intercom, etc.

[0079] Figure 2is an exemplary flowchart of a target object control method according to some embodiments of the present disclosure. Specifically, the target object control method 200 can be performed by the target object control system 100 (e.g., the processing device 120). For example, the target object control method 200 can be stored in the form of a program or instructions in a storage device (e.g., a storage unit of the processing device 120 or the storage device 140), and when the target object control system 100 (e.g., the processing device 120) executes the program or instructions, the target object control method 200 can be implemented. The operations of the flowchart shown below are for illustrative purposes only. In some embodiments, the method 200 can be completed with one or more additional operations not described and / or one or more operations not shown. In addition, Figure 2 The order of the operations of the method 200 shown in the figure and described below is not limiting.

[0080] At step 210, the processing device 120 can acquire a sensing signal of the at least one sensing device 110. In some embodiments, step 210 can be performed by the sensing signal acquisition module 310.

[0081] The sensing signal refers to a signal generated based on an external signal after the sensing device 110 receives the external signal. For example, the sensing signal can be an electrical signal generated by the sensing device 110 based on a received vibration signal. In some embodiments, the external signal can include a mechanical vibration signal (or referred to as a vibration signal) or a combination of the vibration signal and other types of signals. The other types of signals can include optical signals, acoustic signals, electrical signals, etc. The sensing device 110 can include, but is not limited to, one or more of a vibration sensing device, a pressure sensing device, a tactile sensing device, an audio input device, an optical sensing device, etc. Exemplarily, the sensing device 110 can include at least a vibration sensing device to collect a vibration signal. In some embodiments, a user's physical activity, a user's tapping on teeth, or a vibration signal generated by performing a specific operation (e.g., tapping, patting, swiping, etc.) in a specific area (e.g., a vibration receiving area). The sensing device 110 can receive the vibration signal and generate a corresponding sensing signal based on the vibration signal.

[0082] At step 220, the processing device 120 can identify a signal feature of the sensing signal. In some embodiments, step 220 can be performed by the signal feature identification module 320.

[0083] The signal feature can refer to relevant information reflecting the characteristics of the signal. In some embodiments, the processing device 120 can identify the signal feature of the sensing signal by performing time domain processing and / or frequency domain processing on the sensing signal. For a vibration signal, the signal feature of the corresponding sensing signal can include, but is not limited to, a combination of one or more of the number of vibration peaks, signal intensity, interval time of adjacent vibration peaks, frequency components, signal duration, etc.

[0084] The number of vibration peaks refers to the number of vibration peaks with an amplitude greater than a preset amplitude. The number of vibration peaks can reflect the number characteristic of the external signal (e.g., the number of times of user tapping, the number of times of tooth tapping, the number of times of a specific body activity, etc.). The signal strength refers to the strength of the signal. The signal strength can reflect the intensity characteristic of the external signal (e.g., the force of user tapping, slapping, etc.). The greater the force of user tapping, slapping, etc., the greater the signal strength of the generated vibration signal. The interval time of adjacent vibration peaks refers to the time interval between adjacent two vibration peaks in the vibration peaks. In some embodiments, the interval time of adjacent vibration peaks can reflect the density characteristic of the external signal (e.g., the interval time of user tapping, slapping, tooth tapping, etc., the time interval between adjacent body activities, etc.). The frequency component of the signal refers to the frequency proportion information of the sensing signal. The frequency proportion information includes, for example, the proportion of high-frequency signals, medium-high-frequency signals, medium-frequency signals, medium-low-frequency signals, low-frequency signals, etc. The high frequency, medium-high frequency, medium frequency, medium-low frequency, and / or low frequency in this specification can be artificially defined, for example, the high-frequency signal can be a signal with a frequency greater than 4000 Hz. The medium-high-frequency signal can be a signal with a frequency in the range of 2500 Hz-5000 Hz. The medium-frequency signal can be a signal with a frequency in the range of 1000 Hz-4000 Hz. The medium-high-frequency signal can be a signal with a frequency in the range of 600 Hz-2000 Hz. The low-frequency signal can be a signal with a frequency in the range of 20 Hz-1000 Hz. The signal duration time can refer to the duration time of the entire sensing signal or the duration time of a single vibration peak in the sensing signal. For example, the entire sensing signal can include 3 vibration peaks, and the duration time of the entire sensing signal is 3 seconds.

[0085] In some embodiments, the processing device 120 can determine the signal feature spectrum of the sensing signal by performing time domain processing and / or frequency domain processing on the sensing signal, and then determine the signal feature of the sensing signal. More details about identifying the signal feature of the sensing signal can be referred to the embodiments of Figure 4 , which will not be described here.

[0086] In step 230, the processing device 120 can determine the operation of the target object associated with the at least one sensing device 110 based on the signal feature. In some embodiments, step 220 can be performed by the operation determination module 330.

[0087] The target object refers to a terminal device 130 used to perform a specific function. For example, a mobile device (such as a smartphone, smartwatch, etc.) used to make a phone call. For another example, an audio device (such as a headphone, car speaker, Bluetooth speaker, etc.) used to play music. For yet another example, a lighting device (such as an indoor light bulb, car light, etc.) used to illuminate. It is noted that the above-mentioned terminal devices 130 are only exemplary, and the terminal device 130 can be any device performing a function required by a user. The association of the target object with the at least one sensing device 110 can be understood as that the terminal device 130 is used to perform a specific function in response to a specific signal feature of the sensing signal of the sensing device 110. In some embodiments, the target object can be communicatively connected with the processing device 120. In some embodiments, the communicative connection can include wired connection or wireless connection. For example, wired connection through a cable. For another example, wireless connection through a Bluetooth device. The operation of the target object can refer to a function of the terminal device 130, such as playing / pausing music, making / hanging up a phone call, turning on / off illumination, etc. More details about determining the operation of the target object based on the signal feature can be found in the embodiments of Figures 4-10 , which will not be repeated here.

[0088] In some embodiments, the processing device 120 can determine a physiological state of the user based on the signal feature. Further, based on the physiological state of the user, the processing device 120 can determine an operation of the target object corresponding to the physiological state. In some embodiments, the processing device 120 can determine whether the user falls down and a body posture of the user based on the signal feature, and determine a corresponding operation of the target object based on whether the user falls down and the body posture of the user. In some embodiments, the processing device 120 can determine whether the user falls down and a body posture and physiological parameters of the user based on the signal feature, and determine a corresponding operation of the target object based on whether the user falls down and the body posture and physiological parameters of the user. More details about determining the physiological state of the user based on the signal feature can be found in the embodiments of Figures 11-18 , which will not be repeated here.

[0089] In some embodiments, the processing device 120 can perform false trigger prevention when acquiring the sensing signal. For example, the processing device 120 can acquire the sensing signal of the at least one sensing device 110 in real time or intermittently. When the processing device 120 acquires the sensing signal (also referred to as a first sensing signal), the processing device 120 can determine whether the signal strength of the first sensing signal is greater than a signal threshold. When the signal strength of the first sensing signal is less than the signal threshold, the processing device 120 can determine that the first sensing signal is a false trigger signal. When the signal strength of the first sensing signal is greater than the signal threshold, the processing device 120 can acquire the signal within a threshold time range from the first sensing signal as the sensing signal. More details about acquiring the sensing signal of the at least one sensing device 110 can be found in other parts of the specification and will not be repeated here.

[0090] Figure 3 is an exemplary block diagram of a target object control system according to some embodiments of the present application. As shown in Figure 3 , the target object control system 300 can include a sensing signal acquisition module 310, a signal feature identification module 320, and an operation determination module 330. In some embodiments, the target object control system 300 can be implemented by the target object control system 100 (e.g., the processing device 120) shown in Figure 1 .

[0091] In some embodiments, the sensing signal acquisition module 310 can be configured to acquire the sensing signal of the vibration sensing device. In some embodiments, the sensing signal acquisition module 310 can also be configured to acquire the sensing signal of the at least one sensing device 110.

[0092] In some embodiments, the signal feature identification module 320 can be configured to identify the signal feature of the vibration sensing signal. In some embodiments, the signal feature identification module 320 can also be configured to identify the signal feature of the sensing signal.

[0093] In some embodiments, the operation determination module 330 can be configured to determine the operation of the target object associated with the at least one sensing device 110 based on the signal feature. In some embodiments, the operation determination module 330 can also be configured to determine the physiological state of the user based on the signal feature. In some embodiments, the operation determination module 330 can also be configured to determine the operation of the target object associated with the at least one sensing device 110 based on the physiological state of the user.

[0094] It should be noted that the above description of the target object control system 300 and its devices / modules is for the convenience of description only, and does not limit the application to the scope of the embodiments. It can be understood that, for those skilled in the art, after understanding the principles of the system, any combination of the devices / modules or connection of the devices / modules to form a subsystem can be made without departing from the principles. For example, Figure 3 The signal feature identification module 320 and the operation determination module 330 shown can be different modules in one device (e.g., the processing device 120), or one module can implement the functions of two or more modules described above. For example, each module can have its own storage module. For another example, each module can share one storage module. Variations such as these are within the scope of the application.

[0095] Figure 4 is an exemplary flowchart of a target object control method according to some embodiments of the application. Specifically, the target object control method 400 can be performed by the target object control system 100 (e.g., the processing device 120). For example, the target object control method 400 can be stored in the form of a program or instructions in a storage device (e.g., a storage unit of the processing device 120 or the storage device 140), and when the target object control system 100 (e.g., the processing device 120) executes the program or instructions, the target object control method 400 can be implemented. The operations of the flowchart shown below are for illustrative purposes only. In some embodiments, the method 400 can be completed with one or more additional operations not described and / or one or more operations not shown. In addition, Figure 4 The order of the operations of the method 400 shown in and described below is not limiting. In some embodiments, the method 400 can be applied in the fields of smart home, smart car, smart factory, smart speaker, smart toy, etc.

[0096] At step 410, the processing device 120 can obtain a sensing signal of a vibration sensing device. In some embodiments, step 410 is performed by the sensing signal obtaining module 310.

[0097] The vibration sensing device can collect a vibration signal. For example, the vibration sensing device can be a microphone (also known as a bone conduction microphone) that uses bone conduction as one of the main sound propagation methods, an accelerometer, etc. In some embodiments, the vibration sensing device can collect a vibration signal in a specific area. The specific area can be an area set by humans for receiving a vibration signal, which can also be referred to as a vibration receiving area. In some embodiments, the vibration sensing device can obtain a vibration signal of the vibration receiving area and generate a corresponding sensing signal. The sensing signal obtained by the vibration signal is also referred to as a vibration sensing signal. The vibration sensing signal can be, for example, an electrical signal.

[0098] In some embodiments, the vibration sensing device can include a housing, which can have a certain rigidity to facilitate the transmission of vibration signals. Illustratively, the housing of the vibration sensing device can serve as a vibration receiving area, on which a user can perform certain operations (e.g., one or more of a combination of tapping, patting, or swiping, etc.) to generate a certain vibration signal. The certain vibration signal corresponds to a certain operation instruction.

[0099] Because mechanical vibrations propagate with less loss in a solid, the vibration receiving area does not need to be located at the vibration sensing device (e.g., the housing of the vibration sensing device). In some embodiments, the vibration receiving area can be located at a location that can effectively transmit mechanical vibrations. In some embodiments, the vibration receiving area can be located on a solid medium. The solid medium can be metal (e.g., stainless steel, aluminum alloy, etc.), non-metal (e.g., wood, plastic, etc.), etc. The vibration sensing device is connected to the vibration receiving area through the solid medium and receives the vibration signal input to the vibration receiving area. The vibration signal received by the vibration receiving area can be transmitted to the vibration sensing device through the solid medium. In some embodiments, the vibration receiving area can be a selected area on the solid medium. For example, in the embodiment shown in FIG. 6, the vibration receiving area can be a selected area on the door 610. As another example, in the embodiment shown in FIG. 7, the vibration receiving area can be a selected area on the headboard 630 or the side wall 640. As yet another example, in the embodiment shown in FIG. 8, the vibration receiving area can be a selected area on the steering wheel 820. Figure 6 In some embodiments, the vibration sensing device can be fixedly connected to the solid medium. The manner of fixed connection can include, but is not limited to, bonding, inlaying, welding, riveting, screwing, buckling, etc., to ensure that the vibration sensing device has good and firm contact with the solid medium, so that the vibration signal is accurately and effectively transmitted from the solid medium to the vibration sensing device. For example, in the embodiment shown in FIG. 6, at least one vibration sensing device can be bonded to the door 610, and at least one vibration sensing device can be bonded to the headboard 630 or screwed to the side wall. As another example, in the embodiment shown in FIG. 7, at least one vibration sensing device can be bonded to the headboard 630 or screwed to the side wall 640. As yet another example, in the embodiment shown in FIG. 8, at least one vibration sensing device can be bonded to the steering wheel 820. Figure 8

[0100] In some embodiments, the vibration sensing device can be fixedly connected to the solid medium. The manner of fixed connection can include, but is not limited to, bonding, inlaying, welding, riveting, screwing, buckling, etc., to ensure that the vibration sensing device has good and firm contact with the solid medium, so that the vibration signal is accurately and effectively transmitted from the solid medium to the vibration sensing device. For example, in the embodiment shown in FIG. 6, at least one vibration sensing device can be bonded to the door 610, and at least one vibration sensing device can be bonded to the headboard 630 or screwed to the side wall. As another example, in the embodiment shown in FIG. 7, at least one vibration sensing device can be bonded to the headboard 630 or screwed to the side wall 640. As yet another example, in the embodiment shown in FIG. 8, at least one vibration sensing device can be bonded to the steering wheel 820. Figure 6 Figure 8 ​​In the illustrated embodiment, the at least one vibration sensing device can be embedded in the steering wheel 820. In some embodiments, the vibration sensing device can be connected to the solid medium by adhesion, which is convenient and fast, and also facilitates disassembly. In some cases, the vibration sensing device can be embedded or adhered to the solid medium (e.g., the door 610 and the side wall in the indoor environment 600, the steering wheel 810 in the use environment 800, etc.). Since the mechanical vibration has less loss in the solid medium, it still has a large enough signal strength at a long distance, so the signal input area (i.e., the vibration receiving area) can be effectively expanded. The vibration signal can be input in a large range, which saves the user the trouble of finding the operation panel or button, and improves the user's experience. In some cases, especially in dark environments, it can avoid the user from walking in the dark to manipulate the lamp 640 (e.g., in the indoor environment 600, the user needs to walk to the position where the switch is set on the side wall to find the switch of the lamp 640), and knocking into tables and chairs, etc.

[0101] In some embodiments, the vibration sensing device can be arranged at any position of the solid medium. For example, the vibration sensing device can be arranged on the door 610, the steering wheel 810, the side wall, the floor, the ceiling, etc. Figure 6 Taking the door 610 as an example, the exemplary installation positions can include the door frame of the door 610, the door handle of the door 610, the bottom of the door 610, the center of the door 610, etc. In some embodiments, the vibration sensing device can be arranged at a position where the vibration amplitude is large on the solid medium. For example, when the user knocks on the door 610, the amplitude near the center of the door 610 is usually large, and the vibration signal received by the vibration sensing device is stronger.

[0102] For example, the vibration sensing device can be adhered to the door 610, and the upper half area of the door 610 can be used as the vibration receiving area. The user can perform a specific operation in the upper half area (i.e., the vibration receiving area) of the door 610, and the generated vibration signal can be transmitted to the vibration sensing device connected to the door 610 via the door 610.

[0103] In some embodiments, the vibration receiving area can be at least a part of the solid medium. In some embodiments, the vibration receiving area can be located at a position that is easy for the user to operate (e.g., knock, pat, or rub). For example, in the indoor environment 600, the vibration receiving area can be located on the door 610, the steering wheel 810, the side wall, etc. Figure 6In the illustrated indoor environment 600, the solid medium can be a door 610, and the vibration receiving area can be a surface of the door 610 that is away from the indoor environment 600. For another example, in the indoor environment 600, the upper half of the door 610 can serve as the vibration receiving area. In some embodiments, the vibration receiving area can have any position, shape, and / or size. For example, the solid medium can be a bed headboard 630, and the vibration receiving area can be the bed headboard 630 or a specific area thereon (e.g., a right side area, a left side area, etc. of the bed headboard 630). For another example, when the solid medium is the bed headboard 630, the entire surface of the bed headboard 630 facing the user can serve as the vibration receiving area.

[0104] In some embodiments, the vibration receiving area can also be a separate structure disposed on the solid medium. For example, the vibration receiving area can be a vibration receiving surface disposed on the surface of the door 610. The vibration receiving surface can be a rigid sheet object or a rigid plate object, such as an iron sheet, a steel plate, etc. In some embodiments, the vibration receiving surface can be detachably connected to the solid medium. In some embodiments, the vibration receiving surface can be installed at any position of the solid medium according to the user's needs. For example, in the illustrated embodiment, the user is usually on the right side of the bed 620, and thus the vibration receiving surface can be disposed on the right side of the bed headboard 630. Figure 6 In the illustrated embodiment, the user is usually on the right side of the bed 620, and thus the vibration receiving surface can be disposed on the right side of the bed headboard 630.

[0105] In addition, in some embodiments, the vibration receiving area can also be part of the vibration sensing device, and the housing of the vibration sensing device as described in the foregoing embodiments can serve as the vibration receiving area.

[0106] In order to avoid injury to the user when performing a specific operation to input the vibration signal, in some embodiments, the external packaging of the vibration sensing device (e.g., the external housing of the sensing device) and / or the vibration receiving area needs to avoid sharp edges. For example, the surface of the external packaging of the vibration sensing device can be provided as a circular arc surface. In some embodiments, the installation position of the vibration sensing device can avoid the position where the user usually performs the specific operation. For example, the user sleeping on the right side of the bed 620 usually performs tapping, patting, and / or scratching operations on the right edge of the bed headboard 630, and thus the vibration sensing device can be embedded inside the bed headboard 630 or disposed at a position away from the right side of the bed headboard 630 (e.g., a top area, a right side area, etc. of the bed headboard 630) so that the user does not touch the external packaging of the vibration sensing device when performing the specific operation.

[0107] In some embodiments, the vibration sensing device can be powered by a battery disposed therein. Exemplary battery types can include lithium batteries, hydrogen fuel cells, alkaline zinc-manganese batteries, cadmium-nickel batteries, hydrogen-nickel batteries, etc. In some embodiments, the vibration sensing device can be powered by an external power source. For example, the vibration sensing device can be connected to an external power source, such as a power cord or a wireless charging module, to be powered by the external power source. The external power source can be, for example, a portable charger, a household power supply, etc.

[0108] The vibration sensing device has a certain volume. In some embodiments, the volume of the vibration sensing device can be between 1 mm 3 and 10 cm 3 . In some embodiments, the volume of the vibration sensing device can be between 0.5 mm 3 and 20 cm 3 . In some embodiments, the volume of the vibration sensing device can be between 1.5 mm 3 and 5 cm 3 . In some embodiments, the volume of the vibration sensing device can be between 2 mm 3 and 1 cm 3 .

[0109] In some embodiments, in order to enable the vibration sensing device to completely and clearly collect the vibration signals of the user input, the sensitivity of the vibration sensing device also has certain requirements. Sensitivity can be understood as the magnitude of the response of the sensing device to a particular signal when the sensing device is working. In some embodiments, the sensitivity of the vibration sensing device can be between -50 dBV / (m / s 2 and -10 dBV / (m / s 2 ). In some embodiments, the sensitivity of the vibration sensing device can be between -35 dBV / (m / s 2 and -15 dBV / (m / s 2 ). In some embodiments, the sensitivity of the vibration sensing device can be between -30 dBV / (m / s 2 and -15 dBV / (m / s 2 ). In some embodiments, the sensitivity of the vibration sensing device can be between -25 dBV / (m / s 2 and -20 dBV / (m / s 2 ).

[0110] Step 420, the processing device 120 can identify the signal features of the vibration sensing signal. In some embodiments, step 420 can be performed by the signal feature identification module 320.

[0111] In some embodiments, the processing device 120 can process the vibration sensing signal (e.g., time domain processing and / or frequency domain processing, etc.) and output a signal feature spectrum of the vibration sensing signal. Based on the signal feature spectrum, the processing device 120 can identify a signal feature of the sensing signal. For example, the processing device 120 can read the number of vibration peaks, frequency components of the signal, etc. from the signal feature spectrum. In some embodiments, the processing device 120 can also identify the signal feature based on the relevant data / information of the vibration sensing signal collected by the vibration sensing device. For example, the processing device 120 can calculate the interval time between two adjacent vibration peaks according to the time of obtaining the two vibration peaks.

[0112] In some embodiments, the processing device 120 can identify at least one signal feature of the sensing signal, such as at least one of the number of vibration peaks, signal intensity, interval time between adjacent vibration peaks, frequency components, signal duration time, etc. For example, the processing device 120 can identify that there are 3 vibration peaks in the signal feature of the sensing signal. For another example, the processing device 120 can identify both the number of vibration peaks and the interval time between adjacent vibration peaks. For example, the processing device 120 can identify that there are 3 vibration peaks in 2s, the interval time between the first two vibration peaks is short (e.g., 0.1s, 0.2s, 0.3s, 0.4s, 0.5s, etc.), and the interval time between the last two vibration peaks is long (e.g., 1.1s, 1.2s, 1.3s, 1.4s, 1.5s, etc.). For another example, the signal processing unit 420 can identify the frequency components, signal intensity, and signal duration time of the sensing signal at the same time. For example, the signal processing unit 420 identifies that the signal feature of the sensing signal is that there are more medium and high frequency signal components (e.g., the proportion of medium and high frequency signals is greater than 70%), the vibration amplitude (i.e., signal intensity) is small, the signal duration time is short (e.g., the signal only lasts for 1 second), and the generated vibration peak is sharp.

[0113] In some embodiments, the processing device 120 can identify the signal feature of the vibration sensing signal based on a feature extraction model. The processing device 120 can input the sensing signal to the feature extraction model. The output of the feature extraction model can include at least one signal feature of the vibration sensing signal (e.g., at least one of the number of vibration peaks, signal intensity, interval time between adjacent vibration peaks, frequency components, signal duration time, etc.). In some embodiments, the feature extraction model can be a machine learning model. The feature extraction model can be a trained machine learning model. The machine learning model can include various models and structures, such as a deep neural network model, a recurrent neural network model, a custom model structure, etc., which are not limited in the present disclosure.

[0114] In some embodiments, when training the feature extraction model, a plurality of vibration sensing signals with labels (or called tags) can be used as training data, and the model parameters can be learned by common training methods such as gradient descent. In some embodiments, the feature extraction model can be trained in another device or module.

[0115] At step 430, the processing device 120 can determine the operation of the target object associated with the at least one sensing device 110 based on the signal features. In some embodiments, step 430 can be performed by the operation determination module 330.

[0116] In some embodiments, the processing device 120 can further determine an operation instruction for controlling the target object to perform the operation. The operation instruction can instruct the target object (e.g., the terminal device 130) to perform the corresponding operation. For example, in the embodiment shown in FIG. 6, the operation instruction can instruct the light 640 to turn on or off. In this embodiment, the user can generate a specific vibration signal by performing a specific action. The vibration sensing device can collect these vibration signals and generate corresponding sensing signals for processing by the processing device 120. The processing device 120 can determine the operation of the target object, thereby achieving control of the target object. Compared with the voice interaction method, the influence of the noise in the environment on the vibration signal is small, and even in a high-noise environment, the vibration signal can still be completely and effectively collected by the vibration sensing device. This makes the operation or operation instruction of the target object determined by the processing device 120 more accurate. Figure 6

[0117] ​In some embodiments, the processing device 120 can determine whether the identified signal features satisfy at least one of a plurality of preset feature conditions. The preset feature conditions include a preset feature or a combination of a plurality of features. In some embodiments, the processing device 120 can set the signal features corresponding to a specific operation of the target object as the preset feature conditions. In some embodiments, each preset feature condition can correspond to a specific operation of the target object and / or an instruction for controlling the target object to perform the specific operation. For example, the preset feature condition can be three vibration peaks occurring within 1s with equal or approximately equal interval time (e.g., within a threshold range of 0.3s, 0.5s, 0.8s, etc.). This preset feature condition indicates that the user taps or pats the vibration receiving area three times within 1s with equal or approximately equal interval time. For another example, the preset feature condition can be three vibration peaks occurring within 3s (indicating that the user taps or pats three times within 3s), the interval time of the first two vibration peaks is short (e.g., 0.5s), the interval time of the last two vibration peaks is long (e.g., 2s), or the interval time of the first two vibration peaks is long (e.g., 2s), and the interval time of the last two vibration peaks is short (e.g., 0.5s). Each preset feature condition can correspond to a different operation or operation instruction of the target object. For example, the preset feature condition of two vibration peaks occurring within 1s can correspond to an operation instruction of turning on or off the light (e.g., the light 640) shown in FIG. 6. For another example, the preset feature condition of three vibration peaks occurring within 3s with short interval time of the first two vibration peaks and long interval time of the last two vibration peaks can correspond to an operation instruction of entering the warm light mode of the light 640. For yet another example, the preset feature condition of three vibration peaks occurring within 3s with long interval time of the first two vibration peaks and short interval time of the last two vibration peaks can correspond to an operation instruction of entering the cold light mode of the light 640. Figure 6

[0118] In some embodiments, the user can also set the preset feature conditions and the corresponding operation or operation instruction of the target object according to the needs. For example, the user can set the preset feature condition corresponding to a commonly used operation as a simplified preset feature condition (e.g., including fewer signal features) for easier implementation. For example, the user can set the preset feature condition corresponding to the operation of turning on the light 640 as two vibration peaks occurring within 1s to facilitate quick turning on of the light 640 each time the user enters the indoor environment 600.

[0119] ​In some embodiments, the preset characteristic condition can only include one signal characteristic, facilitating user memory and operation. In some embodiments, the preset characteristic condition can be a combination of multiple signal characteristics, so as to achieve more complex operation through the combination of different signal characteristics, while also avoiding misoperation. In some specific embodiments, the preset characteristic condition can include signal strength and number of vibration peaks. For example, two vibration peaks appearing within 1s, the peak value of the first vibration peak being smaller, and the peak value of the second vibration peak being larger, or the peak value of the first vibration peak being larger, and the peak value of the second vibration peak being smaller, can correspond to two different operation instructions respectively.

[0120] In some specific embodiments, when the user taps or slaps the solid medium with different parts, different vibration signals (for example, vibration signals with different frequency components, duration time and / or signal strength) are generated in the solid medium. Correspondingly, the vibration sensing signals generated by the vibration sensing device are also different (for example, vibration sensing signals with different frequency components, duration time and / or signal strength). At this time, the frequency components, duration time and / or signal strength, in combination, form more preset characteristic conditions, corresponding to more complex operations.

[0121] Figures 5A-5D is a signal characteristic spectrum of the vibration signal generated by the user according to some embodiments of the present application. Figures 5A-5D The signal characteristic spectra of the vibration sensing signals generated by nail tapping, single-finger tapping, multi-finger tapping and palm slapping are sequentially and exemplarily shown. As can be seen from the figure, the vibration sensing signals corresponding to nail tapping, single-finger tapping, multi-finger tapping and palm slapping are different. For example, the nail is hard, so the sensing signal has more medium and high frequency signal components, the vibration amplitude is generally small, the duration time of a single vibration peak is short, and the generated vibration peak is relatively sharp. For another example, the force of single-finger tapping is generally greater than that of nail tapping, and due to the buffering of the skin tissue, the sensing signal will have more low or medium-low frequency signal components, and the signal duration time will also increase. For still another example, when multi-finger tapping, multiple finger joints generally do not contact the surface of the solid medium at the same time, so multiple vibration peaks with a very short distance are generated. For yet another example, the muscle tissue on the palm is more than that on the finger joint, so there is a larger buffering when slapping, and the palm has a larger contact area with the surface of the solid medium, which will result in more medium and low frequency signal components of the vibration signal generated by palm slapping, and a longer signal duration time. In some embodiments, the user can also use different tools to slap, tap or scrape, so as to generate vibration sensing signals with different signal characteristics, corresponding to more operation instructions, and achieving more complex operation. For example, when tapping the solid medium with a key, a mobile phone, a water cup or a glove, vibration signals with different signal characteristics are generated. In some cases, the user can use different tools to achieve more complex device operation, while avoiding misoperation. Exemplarily, in the case of a smart watch, the user can use a key to tap the watch, a mobile phone to tap the watch, a water cup to tap the watch, a glove to tap the watch, and a palm to slap the watch, so as to achieve different operations. Figure 6In the indoor environment 600 shown, the user can use a key to knock on the door 610 three times within 1s to turn off or turn on the light 640, and the light 640 can be put into the warm light mode by using a finger to knock on the door 610 three times within 1s, which can effectively avoid misoperation.

[0122] In some embodiments, the signal processing unit 420 can determine whether the signal feature meets the preset feature condition based on the difference between the signal feature of the sensing signal and the preset feature condition. For example, the preset feature condition can be that two vibration peaks occur within 1s, and the intensity of the second vibration peak is lower than that of the first vibration peak (i.e., 2 times of knocking within 1s, the first time is heavy, and the second time is light). The signal processing unit 420 can determine the number of vibration peaks occurring within 1s in the collected sensing signal. If it is not 2, it is determined that the preset feature condition is not met. If it is two, the signal processing unit 420 can continue to determine the intensity of the two vibration peaks of the sensing signal, and determine whether the signal intensity of the second vibration peak is lower than that of the first vibration peak. If not, it is determined that the preset feature condition is not met. If yes, it is determined that the preset feature condition is met.

[0123] In some embodiments, the processing device 120 can determine whether the signal feature meets the preset feature condition based on the signal feature spectrum of the sensing signal and the signal feature spectrum of the preset feature condition. For example, the processing device 120 can compare the signal feature spectrum of the sensing signal with the signal feature spectrum of the preset feature condition. If the signal curves in the two signal feature spectra coincide or approximately coincide, it can be determined that the signal feature meets the preset feature condition.

[0124] In some embodiments, the processing device 120 can determine whether the signal feature meets the preset feature condition based on the preset feature condition recognition model. When the signal feature meets the preset feature condition, the processing device 120 can determine the operation or operation instruction corresponding to the signal feature.

[0125] In some embodiments, the preset feature condition recognition model can be a machine learning model. In some embodiments, the processing device 120 can use the signal feature spectrum of the sensing signal collected by the vibration sensing device as the input data of the machine learning model. The machine learning model can obtain the result of whether the signal feature meets the preset feature condition. In some embodiments, the preset feature condition recognition model can be a trained machine learning model. The training process of the preset feature condition recognition model is the same as or similar to the training process of the feature extraction model.

[0126] The processing device 120 can process the signal feature spectrum image of the sensing signal using the trained preset feature condition recognition model to determine whether the signal feature in the signal feature spectrum satisfies the preset feature condition. In some embodiments, the preset feature condition recognition model can include a neural network model, a logistic regression model, a support vector machine, etc. For example, the neural network model can include multiple layers, such as an input layer, one or more convolutional layers, one or more nonlinear activation layers, one or more pooling layers, one or more fully connected layers, and / or an output layer. The neural network model can acquire the signal feature spectrum at the input layer, extract and / or distinguish visual features or patterns from the image using the intermediate layers, and output the signal feature spectrum with the features or patterns of the feature points at the output layer. For example, the identified feature points can be marked with feature identifiers or feature vectors. In some embodiments, the identified feature points can be representative signal feature points, such as the highest and lowest points of the vibration peaks, the end and start points of the vibration peaks, etc.

[0127] In some embodiments, when the signal feature satisfies the preset feature condition, the processing device 120 can determine the operation of the target object corresponding to the preset feature condition.

[0128] In some cases, the user often unintentionally or unavoidably makes some actions to generate vibration signals, causing the target object to perform incorrect operations (e.g., the terminal device 130 switches from the first state to the second state). For example, in the indoor environment 600 shown in FIG. 6, the user’s hand or head may Figure 6 For example, in the indoor environment 600 shown in FIG. 6, the user’s hand or head may

[0129] Therefore, in order to avoid the above situation, in some embodiments, the processing device 120 can filter the sensing signals acquired from the vibration sensing devices. The processing device 120 can acquire the sensing signals of at least one vibration sensing device in real time or intermittently. When the processing device 120 acquires a sensing signal (also referred to as a first sensing signal), the processing device 120 can retain the signals within a threshold time range (e.g., 1s, 2s, 3s, 5s, 10s, 15s, etc.) from the first sensing signal as sensing signals. In some embodiments, the processing device 120 can determine whether the first sensing signal is a signal threshold. The signal threshold can be a parameter for measuring whether the sensing signal is generated by a user's accidental touch or a user's conscious action. In some embodiments, the signal threshold can be a threshold of signal strength. In some embodiments, the signal strength threshold can be in the range of 2dB-10dB. In some embodiments, the signal strength threshold can be in the range of 4dB-8dB. In some embodiments, the signal strength threshold can be 6dB. For example, when the first sensing signal is greater than the signal strength threshold, the first sensing signal can be considered to be generated by a user's conscious action. Therefore, the processing device 120 can retain the signals within a time range (e.g., a threshold time range) after the first sensing signal as sensing signals. For signals with signal strength less than the signal strength threshold, the first sensing signal can be considered to be generated by a user's accidental touch, and thus no processing is performed.

[0130] In another application scenario, the user can have a pet cat, and the pet cat can scratch the door 610 to generate a vibration signal, which can be collected by the vibration sensing device to generate a corresponding sensing signal. For example, if the signal characteristics of the sensing signal happen to meet the preset characteristic condition, and the operation instruction corresponding to the preset characteristic condition is to turn on or off the light 640, the light 640 can be incorrectly turned on or off. Therefore, in some embodiments, the processing device 120 can prevent misoperation based on determining whether the object inputting the vibration signal is the user and a specific object specified by the user to issue operation instructions. In some embodiments, the processing device 120 can determine whether the object inputting the vibration signal is the user and a specific object capable of issuing operation instructions based on information related to the object inputting the vibration signal. For example, the contour image of the object inputting the vibration signal can be acquired by the camera, and whether the object inputting the vibration signal is the user himself or a specific object capable of issuing operation instructions can be determined according to the contour image. When the processing device 120 determines that the object inputting the vibration signal is not the user or a specific object capable of issuing operation instructions, the processing device 120 can not perform any operation.

[0131] Figure 6Fig. 1 is a schematic diagram of an indoor environment provided with terminal devices according to some embodiments of the present application. Although the description of the techniques described in this embodiment is described with reference to a home, a residence, or a hotel, those skilled in the art will understand that the features, processes, algorithms, and mechanisms implemented by these techniques can be easily applied in other environments, such as an office, a warehouse, a garage, or other environments.

[0132] In some embodiments, the indoor environment 600 can be a part of a residence, a home environment, a hotel. For example, the indoor environment 600 can be a bedroom, a living room of a user's residence. For example, the indoor environment 600 can be one of the rooms of a hotel where the user stays. In some embodiments, the indoor environment 600 can be configured with one or more terminal devices 130 (e.g., a lamp 640). The one or more terminal devices 130 can be controlled by the processing device 120.

[0133] In some example application scenarios, a door 610 is installed at the entrance of the indoor environment 600. A lamp 640 (e.g., a light bulb, a light fixture, a lamp, etc.) is installed on a side wall or a top of the indoor environment 600. A switch of the lamp 640 is arranged on the side wall close to the indoor lamp 640, and a user can control the indoor lamp 640 to be turned off or on through the switch. A bed 620 is installed at the connection between the floor and the side wall of the indoor environment 600, and the bed 620 includes a headboard 630. In addition, the door 610 and the headboard 630 are physically connected (e.g., bonded) with a sensing device 110 (e.g., a vibration sensing device). The vibration sensing device can collect a vibration signal input by a user. The processing device 120 can identify a signal feature of the sensing signal and determine whether the signal feature satisfies a preset feature condition. When the processing device 120 determines that the signal feature satisfies the preset feature condition, an operation instruction can be sent to a target object (e.g., the switch of the lamp 640) to control the target object to perform a corresponding operation (e.g., turning on or off the lamp 640, adjusting the color temperature of the lamp 640, adjusting the brightness of the lamp 640, etc.).

[0134] For example, when the user enters the indoor environment 600 in the evening (e.g., the user enters the living room or the bedroom in the evening after work), the user can need to turn on the light 640. The door 610 is provided with a vibration sensing device. The user can input a vibration signal by knocking, patting, or scratching on the door 610. The signal feature of the sensing signal generated based on the vibration signal meets the preset feature condition, thereby realizing the control (e.g., turning on) of the light 640. Compared with walking to the side wall to turn on the switch, it is more convenient and safer. In some embodiments, a specific area of the door 610 can be used as a vibration receiving area. For example, the door handle can be used as the vibration receiving area, and the user can input the operation instruction of turning on the light by knocking, patting, or scratching on the vibration receiving area when opening the door 610. For another example, the surface of the door 610 can be used as the vibration receiving area. The vibration sensing device is connected to the vibration receiving area through the surface of the door 610 and receives the vibration signal input to the vibration receiving area. The vibration sensing device can be arranged at, for example, the center of the door 610, the edge of the door 610, or the like. In some embodiments, because the center of the door 610 has a higher amplitude when the user knocks or pats, the vibration sensing device can be arranged (e.g., inlaid or pasted) at the center of the door 610.

[0135] In some embodiments, a specific area of the surface of the door 610 away from the indoor environment 600 can be used as the vibration receiving area. For example, the vibration receiving area can be located on the upper side of the surface of the door 610 away from the indoor environment 600, so that the user can use the hand to perform a specific operation to input the vibration signal. For another example, the vibration receiving area can be located on the lower side of the surface of the door 610 away from the indoor environment 600, so that the user can kick the door 610 to input the vibration signal.

[0136] Figure 7is an exemplary flowchart of controlling a light in an indoor environment according to some embodiments of the present application. In the present embodiment, when a user taps the bedside panel 630 for 3 times in succession, a vibration sensing device disposed on or mechanically connected to the bedside panel 630 can receive the vibration signals and generate corresponding sensing signals. The processing device 210 (e.g., a chip of the vibration sensing device) can perform feature recognition on the sensing signals, and determine whether the sensing signals have 3 vibration peaks with a time interval of no more than 0.5s between any two of the 3 vibration peaks within 1s. If yes, the processing device 210 continues to determine the light state of the light 640. If the light 640 is in an on state (i.e., a first state), the processing device 210 issues an instruction to turn off the light 640, and adjusts the light 640 to an off state (i.e., a second state). If the light 640 is in an off state (i.e., a second state), the processing device 210 issues an instruction to turn on the light 640, and adjusts the light 640 to an on state (i.e., a first state). If the processing device 210 determines that the sensing signals do not have 3 vibration peaks within 1s, or the time interval between adjacent vibration peaks exceeds 0.5s, the processing device 210 does not perform any operation.

[0137] When a user gets up at night, he or she needs to find the switch in the dark if the switch is not at the bedside, which can cause a risk of falling or bumping. If a vibration sensing device is installed on the bedside panel 630, the user can control the light 640 by performing a specific operation on the bedside panel 630, which is not only safer but also more convenient.

[0138] In some embodiments, a plurality of switches and buttons are disposed around the bed 620. For example, when the indoor environment 600 is one of the rooms of a hotel, a plurality of switches for controlling target objects (e.g., the light 640) are usually disposed near the bedside panel 630 of the bed 620. When a user wants to control a specific target object, he or she needs to find the specific switch. If a vibration sensing device is installed on the bedside panel 630, the user can control the target object (e.g., turn off the light 640) by simply tapping, patting, or rubbing the bedside panel 630.

[0139] In some embodiments, the indoor environment 600 can be arranged in a manner other than Figure 6 For example, the indoor environment 600 can also be arranged with other target objects, such as a smart TV, a curtain, an air conditioner, etc. The user can control the other target objects through the system 100. For example, a curtain can be disposed on a side wall of the indoor environment 600, and the user can control the curtain through the system 100. For example, the user can tap the bedside panel 630 at the same time or at approximately the same time interval within 1s to control the curtain to open or close.

[0140] Figure 8FIG. 8 is a schematic diagram of an in-vehicle environment according to some embodiments of the present disclosure. In some embodiments, the in-vehicle environment 800 can include one or more terminal devices (e.g., a vehicle air conditioner, a vehicle audio, a window, etc.). The one or more terminal devices can be controlled by the system 100.

[0141] In some example application scenarios, the glove box 810 on the co-driver side is provided with a sensing unit (e.g., a vibration sensing device). The vibration sensing device can be associated with the vehicle air conditioner on the co-driver side. A user can control the vehicle air conditioner on the co-driver side through the system 100. For example, the user can continuously knock or tap the surface of the glove box 810. The vibration sensing device generates a sensing signal after receiving the vibration signal generated by the knocking or tapping. The system 100 can identify the signal feature of the sensing signal and determine whether the signal feature satisfies a preset feature condition. For example, the preset feature condition corresponds to the operation of turning on / off the vehicle air conditioner. If the signal feature satisfies the preset feature condition, the system 100 can control the vehicle air conditioner on the co-driver side to turn on / off.

[0142] In some example application scenarios, the steering wheel 820 is physically connected with at least one sensing unit (e.g., a vibration sensing device). The vibration sensing device can be associated with the terminal devices such as the vehicle air conditioner, the vehicle audio, the window, etc. Similarly, a user can control the vehicle air conditioner, the vehicle audio, the window, etc. through the system 100.

[0143] Figure 9is an exemplary flow of controlling in-vehicle terminal devices according to some embodiments of the present application. In this embodiment, when the driver taps the steering wheel 820 for 3 times in succession, the vibration sensing device disposed on the steering wheel 820 can collect the vibration signal and generate a sensing signal. The system 100 can identify the signal feature of the sensing signal and determine whether the preset feature condition is satisfied. As an example, the system 100 can identify whether the sensing signal has 3 vibration peaks with the same time interval or approximately the same time interval within 2s (i.e., the number of vibration peaks is 3, and the time interval between adjacent two vibration peaks is the same or approximately the same). If not (i.e., the signal feature of the sensing signal does not satisfy the preset feature condition), no operation is performed. If yes (i.e., the signal feature of the signal satisfies the preset feature condition), the current state of the in-vehicle air conditioner is obtained. If the in-vehicle air conditioner is in the on state (i.e., the first state), an instruction to turn off the in-vehicle air conditioner is issued, and the in-vehicle air conditioner is adjusted to the off state (i.e., the second state). If the in-vehicle air conditioner is in the off state, an instruction to turn on the in-vehicle air conditioner is issued, and the in-vehicle air conditioner is adjusted to the on state. As another example, the system 100 can identify whether the signal has 3 vibration peaks with unequal intervals within 2s (e.g., the time interval between the first vibration peak and the second vibration peak is 1s, and the time interval between the second vibration peak and the third vibration peak is 2s). If not (i.e., the signal feature of the sensing signal does not satisfy the preset feature condition), no operation is performed. If yes (i.e., the signal feature of the signal satisfies the preset feature condition), the current state of the in-vehicle sound box is obtained. If the in-vehicle sound box is in the on state, an instruction to turn off the in-vehicle sound box is issued. If the in-vehicle sound box is in the off state, an instruction to turn on the in-vehicle sound box is issued.

[0144] In some embodiments, the arrangement of the in-vehicle environment 800 can not be limited to Figure 8 As an example, the in-vehicle environment 800 can also be provided with other target objects, such as a sunroof, a seat heater, etc. In some specific embodiments, the roof of the in-vehicle environment 800 can be provided with a sunroof, and the user can control the sunroof through the system 100. For example, the steering wheel 820 is tapped for 4 times with the same time interval or approximately the same time interval within 1s to control the sunroof to be turned off or on.

[0145] During the driving of the vehicle, the user (for example, the driver) can adjust the vehicle air conditioner, the vehicle audio amplifier, and control the buttons, switches and the like on the vehicle, which can distract the driver's attention and may cause traffic accidents. Although voice interaction can avoid the above problems to a certain extent, tire noise, music and conversation can greatly interfere with voice interaction. Compared with the control mode of voice interaction, by setting a vibration sensing device at a specific position (for example, the steering wheel 820) in the vehicle, the driver can control the vehicle air conditioner, the vehicle audio amplifier, the sunroof and the like by tapping, patting and scratching on the vibration receiving area (for example, any position on the steering wheel 820) without moving the line of sight from the front of the driving, which can improve the safety of the vehicle driving.

[0146] Figure 10 is a schematic diagram of a desktop environment provided with a terminal device according to some embodiments of the present application. The desktop environment 1000 can include one or more terminal devices. The terminal device can be one or more office, entertainment devices.

[0147] In some example application scenarios, the desktop environment 1000 includes a table 1010 and a chair 1020. Among them, the table 1010 and / or the chair 1020 can be provided with a sensing unit (for example, a first vibration sensing device provided on the table 1010 and a second vibration sensing device provided on the chair 1020). For example, the first vibration sensing device can be provided on the surface of the table 1010, and the second vibration sensing device can be provided at the armrest of the chair 1020. In some embodiments, the user can perform a specific operation on the vibration receiving area (for example, any position on the surface of the table 1010 and / or the armrest of the chair 1020) to input a specific vibration signal to the vibration sensing device, so as to determine the operation or operation instruction of the one or more office, entertainment devices. For example, the user can tap the tabletop of the table 1010 with a single finger, and the corresponding vibration sensing signal meets the preset feature condition, and then the corresponding entertainment device (for example, a musical instrument) can be composed into a song according to the rhythm of the user's finger tapping and played through an external audio output device. The user can effectively relieve stress in this way. For example, the user can pat the armrest of the chair 1020, and the corresponding vibration sensing signal meets the preset feature condition and the associated massage device can massage the user's back.

[0148] In some embodiments, the arrangement of the desktop environment 1000 can not be limited to Figure 10The desktop environment 1000 can further include other terminal devices, such as toys, which can be pressed by the user, and the like. In some embodiments, the toys can include a vibration sensing device. When the user presses the toy, the vibration sensing device can collect a vibration signal and generate a haptic feedback. For example, pressing the toy for 3 times within 1 s can control the toy to continuously vibrate to massage the hand.

[0149] In some embodiments, the system 100 can also be applied to other use scenarios. For example, a smart factory, a smart audio device. In some exemplary application scenarios, the smart factory can include a pipeline conveying device, a mechanical arm, and a sensing unit (e.g., a vibration sensing device) installed in a common area. Generally, the factory environment is relatively noisy or even full of high noise. Compared with voice interaction, the user can input a vibration signal by performing a specific tapping, patting, scratching, or the like in a region convenient for operation to control the pipeline conveying device, the mechanical arm, or communicate with colleagues, without being disturbed by noise, and can more conveniently and conveniently control the machine equipment or communicate. Exemplarily, the user can tap at the same time interval or approximately the same time interval within 3 s, and the operation instruction corresponding to the generated vibration signal is to control the pipeline conveying device to start working. In some embodiments, the vibration sensing device can be arranged in an area away from the mechanical arm and the pipeline conveying device to prevent the vibration generated by the mechanical arm and the pipeline conveying device from affecting the vibration signal input by the user.

[0150] In some exemplary application scenarios, the system 100 can be applied to a smart audio device (e.g., a smart speaker). Exemplarily, the smart speaker can include a vibration sensing device arranged (e.g., adhered) thereon. The smart speaker itself can serve as a terminal device to communicate with the vibration sensing device (e.g., through a Bluetooth connection). In some embodiments, the user can control the smart speaker by performing a specific tapping, patting, scratching, or the like on the smart speaker. For example, the user can pat the shell of the smart speaker with the palm, the vibration sensing device can collect the vibration signal generated by the palm patting and generate a sensing signal, the system 100 can identify the signal feature, and then compare the signal feature with a preset feature condition. Based on the comparison result, it is determined that the operation or operation instruction corresponding to the sensing signal is to play the next song. The interaction mode of the smart speaker is mostly voice interaction, and the lack of haptic information can reduce the user's interaction experience. By arranging the vibration sensing device on the shell of the smart speaker, a haptic interaction between the user and the smart speaker can be established, and the interaction experience can be improved.

[0151] In some embodiments, the target object control system 100 can also monitor and analyze the user's physical activities (e.g., cough, sneeze, snore, yawn, fall, etc.) to more accurately determine the user's physiological condition. For example, the system 100 can accurately and effectively collect signals of the user's physical activities through the sensing device 110 and generate corresponding sensing signals based on the signals. The system 100 can identify signal features of the sensing signals, determine the user's physiological state based on the signal features, and finally more accurately determine the user's health condition based on the user's physiological state. The sensing device 110 can be a vibration sensing device. In some embodiments, the sensing device 110 can further include a heart rate measuring component, a blood glucose measuring component, a blood pressure measuring component, a blood lipid measuring component, etc. In some embodiments, the system 100 can determine the operation or operation instruction of the target object (e.g., the terminal device 130) based on the user's physiological state. The operation instruction can be used to control the target object to perform corresponding functions to provide the user with more comprehensive health protection. Exemplary functions can include recording the user's health condition, issuing a health warning, issuing an aid request, etc.

[0152] Figure 11 is an exemplary flowchart of a target object control method according to some embodiments of the present application. Specifically, the target object control method 1100 can be performed by the target object control system 100 (e.g., the processing device 120). For example, the target object control method 1100 can be stored in the form of a program or an instruction in a storage device (e.g., a self-provided storage unit of the processing device 120 or the storage device 140), and when the target object control system 100 (e.g., the processing device 120) executes the program or the instruction, the target object control method 1100 can be implemented. The operations of the flowchart shown below are for illustrative purposes only. In some embodiments, the method 1100 can be completed with one or more additional operations not described and / or one or more operations not shown. In addition, Figure 11 The order of the operations of the method 1100 shown in the figure and described below is not limiting. In some embodiments, the method 1100 can be applied in the field of human health monitoring, etc.

[0153] At step 1110, the processing device 120 can obtain a sensing signal of at least one sensing device. In some embodiments, step 1110 is performed by the sensing signal obtaining module 310.

[0154] The at least one sensing device can include a vibration sensing device. The vibration sensing device can collect vibration signals. For example, the vibration sensing device can be a microphone, an accelerometer, etc. that has bone conduction as one of the main ways of sound propagation. In some embodiments, the vibration sensing device can be disposed on a wearable device. Exemplary wearable devices can include a smart bracelet, smart footwear, smart eyewear, smart headgear, smart watch, smart clothing, smart backpack, smart accessory, etc. or any combination thereof. When a user wears the wearable device, the wearable device can be attached to a body part (e.g., head, neck, ear, etc.) of the user. The vibration sensing device receives vibration signals generated by the user's body activity through the wearable device. In some embodiments, the vibration sensing device can be a standalone device. The vibration sensing device can be directly attached to a body part of the user and receive vibration signals generated by the user's body activity.

[0155] The vibration sensing device directly or indirectly through a wearable device contacts a body part of a user. The user's body activity, such as coughing, sneezing, snoring, yawning, shivering, bumping, falling, etc. can generate vibration signals. The vibration signals are transmitted to the vibration sensing device via the user's bones or muscles. The vibration sensing device can acquire the vibration signals and generate sensing signals. The vibration sensing device is connected to the processing device 120. The processing device 120 can acquire the sensing signals generated by the vibration sensing device.

[0156] At step 1120, the processing device 120 can identify the signal features of the sensing signals. In some embodiments, step 1120 can be performed by the signal feature identification module 320. In some embodiments, step 1120 can be the same as or similar to step 420 in flow 400.

[0157] In some embodiments, the processing device 120 can process the vibration sensing signals (e.g., time domain processing and / or frequency domain processing, etc.) and output the vibration sensing signals as a signal feature spectrum. Based on the signal feature spectrum, the processing device 120 can identify the signal features of the sensing signals. For example, the processing device 120 can read the number of vibration peaks, frequency components of the signals, etc. from the signal feature spectrum. In some embodiments, the processing device 120 can also directly identify the signal features based on the relevant data / information of the vibration signals collected by the vibration sensing device. For example, the processing device 120 can calculate the interval time of adjacent two vibration peaks according to the time of acquiring the two vibration peaks.

[0158] In some embodiments, the processing device 120 can identify at least one signal feature of the sensing signal, such as at least one of the number of vibration peaks, the signal intensity, the interval time of adjacent vibration peaks, the frequency component, the signal duration time. Different physical activities of the user, such as coughing, sneezing, snoring, yawning, shivering, bumping, falling, produce different vibration signals (e.g., vibration signals with different frequency components, interval times of adjacent vibration peaks, duration times, and / or signal intensities). Correspondingly, the vibration sensing signals generated by the vibration sensing device are also different (e.g., vibration signals with different frequency components, interval times of adjacent vibration peaks, duration times, and / or signal intensities). For example, when the user sneezes, there are more high-frequency signal components in the signal feature spectrum, and the duration time of the vibration peaks is longer; when the user yawns, there are more high-frequency signal components in the signal feature spectrum, and there is usually no obvious vibration peak. More details about the signal features of the sensing signals corresponding to different physical activities can be referred to the description of other parts of the present application, such as Figures 12A-12E , which will not be repeated here.

[0159] At step 1130, the processing device 120 can determine the physiological state of the user based on the signal features. In some embodiments, step 1130 can be performed by the operation determination module 330.

[0160] The physiological state described herein refers to the state of the user's body. Each physical activity of the user has a corresponding physiological state. The physiological state of the user can be a dangerous physiological state and a non-dangerous physiological state. The non-dangerous physiological state can include a coughing state, a sneezing state, a snoring state, a yawning state, etc. The dangerous physiological state can include a shivering state, a bumping state, a falling state, etc. The processing device 120 can determine the signal features by analyzing and processing the sensing signal generated by the vibration sensing device, and then determine the physiological state of the user based on the signal features.

[0161] In some embodiments, the processing device 120 can determine whether the identified signal feature satisfies at least one of a plurality of preset feature conditions. The preset feature conditions include a preset feature or a combination of a plurality of features. In some embodiments, the processing device 120 can use the signal feature corresponding to the physiological state as the preset feature condition. In some embodiments, each preset feature condition can correspond to a physiological state of the user. For example, the preset feature condition can be that two or more vibration peaks with close intervals occur within a threshold time (e.g., 5s, 8s, 10s, 15s, etc.). For another example, the preset feature condition can be that there are more high-frequency signal components in the signal feature spectrum and there is no obvious vibration peak. For another example, the preset feature condition is that there are more low-frequency signal components in the signal feature spectrum. Each preset feature condition can correspond to a different physiological state. For example, the preset feature condition that two or more vibration peaks with close intervals occur within 10s corresponds to a cough state. For another example, the preset feature condition that the high-frequency signal components in the signal feature spectrum account for 60% and there is no obvious vibration peak corresponds to a yawn state. For another example, the preset feature condition that the low-frequency signal components in the signal feature spectrum account for 70% corresponds to a fall state.

[0162] In some embodiments, the preset feature condition corresponding to each physiological state can be determined based on the signal features of the sensing signals generated by the real physical activities of a plurality of users. For example, the preset feature condition corresponding to the yawn state can be determined by extracting the signal features of the vibration sensing signals generated by the vibration sensing device when a plurality of users yawn. In some embodiments, the processing device 120 can use a preset feature condition determination model to determine the preset feature condition of each physiological state based on the extracted signal features. The preset feature condition determination model can be, for example, a machine learning model. In some embodiments, the preset feature condition determination model can be a trained machine learning model. The training process of the preset feature condition determination model is the same as or similar to the training process of the feature extraction model.

[0163] In some embodiments, the processing device 120 can determine whether the signal feature satisfies the preset feature condition based on a difference between the signal feature of the sensing signal and the preset feature condition. For example, the preset feature condition can include that three or more vibration peaks occur within 5s. The processing device 120 can determine the number of vibration peaks occurring within 5s of the collected sensing signal, and if only two vibration peaks occur, the preset feature condition is not satisfied. In some embodiments, the processing device 120 can determine whether the signal feature satisfies the preset feature condition based on a signal feature spectrum of the sensing signal and a signal feature spectrum of the preset feature condition. For example, the processing device 120 can compare the signal feature spectrum of the sensing signal with the signal feature spectrum of the preset feature condition, and if the signal curves in the two signal feature spectrums coincide or approximately coincide, it can be determined that the signal feature satisfies the preset feature condition. In some embodiments, the processing device 120 can also determine whether the signal feature satisfies the preset feature condition based on a preset feature condition recognition model. When the signal feature satisfies the preset feature condition, the processing device 120 can determine the physiological state corresponding to the preset feature condition as the physiological state of the user.

[0164] At step 1140, the processing device 120 can determine an operation of the target object associated with the at least one sensing device 110 based on the physiological state of the user. In some embodiments, step 1140 can be performed by the operation determination module 330. In some embodiments, the processing device 120 can further determine an operation instruction for controlling the target object to perform the operation. The operation instruction can instruct the target object (e.g., a smart wearable device, a terminal device 130, etc.) to perform a corresponding operation.

[0165] In some embodiments, the processing device 120 can determine the operation of the target object according to whether the physiological state is dangerous. In some embodiments, when the physiological state is a dangerous physiological state, for example, the user is in a falling state, the processing device 120 can control the terminal device 130 (for example, a mobile terminal) to perform one or more operations of issuing a voice inquiry (for example, "Is it dangerous?" or "Do you need help?"), issuing a warning (for example, issuing a warning to a pre-stored contact through a mobile terminal such as a mobile phone), and requesting external assistance (for example, issuing a request for assistance to the public security organ or a hospital). In some embodiments, when the physiological state is a non-dangerous physiological state, for example, the user is yawning, the processing device 120 can record the relevant information of the sensing signal. The relevant information of the sensing signal can include the frequency of the occurrence of the sensing signal (for reflecting the frequency of the occurrence of the body activity), the signal characteristics of the sensing signal (for reflecting the type of body activity), the time of the occurrence of the sensing signal (for reflecting the specific time point or time period of the occurrence of the body activity), and the like. In some embodiments, the processing device 120 can evaluate the health condition of the user according to the recorded signal characteristics. For example, when the frequency of yawning exceeds a frequency threshold, the processing device 120 can determine that the user may have a throat disease. When the frequency of the user sniffing or sneezing exceeds a frequency threshold, the processing device 120 can determine that the user may have a cold. In some embodiments, the processing device 120 can record and / or send the evaluation of the health condition of the user to the terminal device 130 (for example, a mobile phone) for the user to view.

[0166] In some embodiments, the processing device 120 can determine the operation of the target object in combination with the relevant information of the user. The relevant information of the user can include the medical history of the user, the age of the user, and various physiological parameters (for example, blood pressure, blood sugar, heart rate, and the like) of the user. In some embodiments, the relevant information of the user can be input by the user through the terminal device 130 (for example, input through a mobile terminal in communication with the processing device 120). In some embodiments, the at least one sensing device further includes at least one of a heart rate measuring component, a blood pressure measuring component, a blood sugar measuring component, and the like. The various physiological parameters (for example, blood pressure, blood sugar, heart rate, and the like) of the user can be obtained through the at least one sensing device. For example, when the processing device 120 determines that the physiological state of the user is a falling state, the age of the user can be obtained, for example, the age of the user is 80 years old, and the processing device 120 can directly control the terminal device 130 (for example, a mobile terminal) to issue a warning. For another example, the age of the user is 20 years old, and the processing device 120 can control the terminal device 130 (for example, a mobile terminal) to issue a voice inquiry. In some cases, compared with young people, the harm to the health of the elderly after falling is greater, and therefore it is necessary to timely issue a warning to family members or friends to provide help to the user.

[0167] Figures 12A to 12E is a diagram of signal feature spectrum of vibration sensing signals corresponding to different physical activities according to some embodiments of the present application. Figures 12A to 12E is a diagram of signal feature spectrum of vibration sensing signals generated by a user when coughing, yawning, sneezing, snoring and falling down, respectively. Figures 12A to 12E It can be seen that the vibration sensing signals caused by different physical activities have different signal features. For example, Figure 12A When the user is coughing, the user usually coughs for several times, so there are multiple vibration peaks with close intervals. For example, Figure 12B When the user is yawning, there are more high-frequency signal components in the signal feature spectrum, and there is usually no obvious vibration peak. For example, Figure 12C When the user is sneezing, there are more high-frequency signal components in the signal feature spectrum, and the vibration peak lasts for a long time. For example, Figure 12D When the user is snoring, the high-frequency signal components in the signal feature spectrum increase and are more concentrated. For example, Figure 12E When the user falls down, there are more low-frequency signal components in the signal feature spectrum.

[0168] Figure 13 is a diagram of frequency curve of vibration sensing signals of physical activities of a user according to some embodiments of the present application. As shown in Figure 13 In some embodiments, the frequency of the vibration signal generated by the physical activities (e.g., coughing, sneezing, etc.) of the user is basically lower than 5 kHz (the frequency at f1 is 5 kHz). Therefore, the resonance frequency (i.e., the natural frequency) of the vibration sensing device needs to be less than 5 kHz. In some embodiments, the natural frequency of the vibration sensing device can be between 0.5 kHz and 5 kHz. In some embodiments, the natural frequency of the vibration sensing device can be between 0.8 kHz and 5 kHz. In some embodiments, the natural frequency of the vibration sensing device can be between 1 kHz and 5 kHz. In some embodiments, the natural frequency of the vibration sensing device can be between 1.25 kHz and 4.75 kHz. In some embodiments, the natural frequency of the vibration sensing device can be between 1.5 kHz and 4.5 kHz. In some embodiments, the natural frequency of the vibration sensing device can be between 2 kHz and 4.5 kHz. The sensitivity of the vibration sensing device needs to be as high as possible so that the vibration signal obtained is more accurate. In some embodiments, the sensitivity of the vibration sensing device can be between -50 dBV / (m / s 2 ) and -10 dBV / (m / s 2 ) in some embodiments, the sensitivity of the vibration sensing device can be between -35 dBV / (m / s 2 ) and -15 dBV / (m / s 2between -30 dBV / (m / s 2 ) and -15 dBV / (m / s 2 ) in some embodiments. In some embodiments, the sensitivity of the vibration sensing device can be between -25 dBV / (m / s 2 ) and -20 dBV / (m / s 2 ).

[0169] Figure 14 is a schematic diagram of a wearable device to which the target object control system according to some embodiments of the present application is applied. Exemplarily, the wearable device can be earphones 1400. One or more components or units of the target object control system 100 can be integrated on the earphones 1400.

[0170] In some embodiments, the earphones 1400 can only have an audio output function, for example, the earphones 1400 can be loudspeakers. In some embodiments, the earphones 1400 can have an audio output and input function, for example, earphones capable of audio input and output. In some embodiments, the earphones 1400 can be hearing aids. In some embodiments, the earphones 1400 can be earphones in which bone conduction is one of the main sound propagation ways or earphones in which air conduction is one of the main sound propagation ways. In some embodiments, the earphones 1400 can be headphones (for example, single-ear headphones, double-ear headphones), over-ear earphones, in-ear earphones, etc.

[0171] In some embodiments, the earphone 1400 can be an in-ear earphone. The earphone 1400 is provided with a sensing device 1410. The sensing device 1410 can be a vibration sensing device for collecting vibration signals generated by the user's physical activity. In some embodiments, the vibration sensing device can be a microphone of the earphone 1400, which is provided with bone conduction as one of the main sound propagation methods. In some embodiments, the vibration sensing device can be a micro-electro-mechanical system (MEMS) accelerometer. The vibration sensing device 1410 can receive the vibration signals generated by the user's physical activity through the earphone 1400. When the user wears the earphone 1400, the earphone 1400 is in close contact with the user's body part (e.g., the ear), and the vibration signals can be accurately transmitted to the vibration sensing device via the earphone 1400. In some embodiments, the connection stiffness between the vibration sensing device and the earphone 1400 can be improved to reduce the loss of vibration signals during transmission, so that the vibration signals can be more accurately and completely collected by the vibration sensing device. In some embodiments, the vibration sensing device can be fixedly connected between the user and the shell of the earphone 1400. Since the shell usually has a certain hardness, the loss of vibration signals during transmission can be reduced. The fixed connection can include, but is not limited to, inlaying, screwing, riveting, welding, and bonding. In some embodiments, the vibration sensing device can be connected to the earphone 1400 by bonding, so as to facilitate the disassembly of the vibration sensing device.

[0172] In some embodiments, the vibration sensing device can be directly in contact with the user's body part (e.g., the ear). For example, when the user wears the earphone 1400, the vibration sensing device can be arranged on the shell of the earphone 1400 and directly contact the user's ear. The vibration signals generated by the user's physical activity can be directly collected by the vibration sensing device without being transmitted through one or more parts (e.g., the shell) of the earphone 1400, thereby reducing the loss of vibration signals during transmission.

[0173] In some embodiments, in order to ensure that the wearable device (e.g., a smart earphone, smart glasses, a smart helmet, etc.) has a reasonable overall size, the volume of the vibration sensing device is also required. In some embodiments, the volume of the vibration sensing device can be between 1 mm 3 and 10 cm 3 . In some embodiments, the volume of the vibration sensing device can be between 0.5 mm 3 and 20 cm 3 . In some embodiments, the volume of the vibration sensing device can be between 1.5 mm 3 and 5 cm 3 . In some embodiments, the volume of the vibration sensing device can be between 2 mm 3 and 1 cm 3 .

[0174] Figure 15 is an example flowchart of determining the operation of the target object according to the vibration signal generated by the user's physical activity shown in some embodiments of the present application. In the embodiment, the vibration signal generated by the physical activity of the user wearing the earphone 1400 is transmitted to the vibration sensing device fixedly connected with the earphone 1400. The vibration sensing device generates the corresponding vibration sensing signal after receiving the vibration signal. The processing device 120 can obtain the sensing signal generated by the vibration sensing device and identify the signal feature in the sensing signal. In some embodiments, the processing device 120 can determine whether the signal feature satisfies at least one of a plurality of preset feature conditions. For example, the preset feature condition can be a signal feature corresponding to a coughing state, a yawning state, a sneezing state, a nose-picking state, a snoring state, a falling state, etc., or a combination of a plurality of signal features. In some embodiments, if the signal feature of the sensing signal does not satisfy any one of the preset feature conditions, the processing device 120 does not perform the operation. In some embodiments, if the signal feature of the sensing signal satisfies one of the preset feature conditions, the processing device 120 can determine the physiological state corresponding to the preset feature condition. The processing device 120 can further determine whether the physiological state corresponding to the preset feature condition is a dangerous physiological state such as falling or bumping. In some embodiments, when the physiological state is falling, the processing device 120 can determine the operation of the target object corresponding to the dangerous physiological state. For example, the target object can include the earphone 1400 and other devices in communication with the earphone 1400. For example, the other devices in communication with the earphone 1400 can be a mobile terminal such as a mobile phone. In some embodiments, the processing device 120 can issue an operation instruction to the earphone 1400 to make the earphone 1400 issue a voice query to the user: "Have you encountered danger?" or "Do you need help?". The user can reply to the voice query to make the processing device 120 perform subsequent operations. For example, the user can reply to the voice query by voice (for example, the earphone has a voice input function) "I need help", and the processing device 120 can control the mobile terminal to issue a warning to the pre-stored contact or request external assistance. In some embodiments, if the processing device 120 does not detect the user's response within a certain time range (for example, 10s, 20s, 30s, etc.), the processing device 120 can issue a warning to the pre-stored contact or request external assistance. In some embodiments, when the physiological state is a non-dangerous physiological state (for example, a coughing state, a yawning state, etc.), the processing device 120 can record the related information of the sensing signal to facilitate subsequent evaluation of the user's health status.

[0175] Figure 16Fig. 1 is a schematic diagram of a target object control system according to some embodiments of the present application. The target object control system 100 can be applied to a wearable device. For example, the wearable device can include a headset 1600 (e.g., an ear-hanging headset). One or more components or units of the target object control system 100 can be integrated on the headset 1600 or communicatively connected to the headset 1600.

[0176] In some example application scenarios, the sensing device 1610 can be disposed on the headset 1600. The sensing device 1610 can include a vibration sensing device for collecting a vibration signal generated by a physical activity (e.g., an impact when falling) of a user of the headset 1600. An example vibration sensing device 1610 can be a MEMS accelerometer, a bone conduction microphone, or the like. In some embodiments, the bone conduction microphone can be an element of the headset 1600. For example, the headset 1600 can be a headset including a bone conduction microphone. In some embodiments, the processing device 120 (e.g., a signal processing unit of the headset 1600) can determine a physiological state of the user based on a vibration sensing signal generated by the sensing device 1610. In some embodiments, the processing device 120 can determine an operation of a target object based on the physiological state of the user. The target object can refer to the terminal device 130 in the system 100. In some embodiments, the target object can include the headset 1600 and a smart terminal in communication with the headset 1600. An example smart terminal can be a mobile phone, a tablet computer, a bracelet, or the like.

[0177] In some example application scenarios, the sensing device 1610 can include a vibration sensing device and a motion sensing device. The motion sensing device can acquire motion signals related to the user's body posture. Example motion sensing devices can include, but are not limited to, a three-axis gyroscope, a three-axis accelerometer, a three-axis electronic compass, etc. Taking the three-axis gyroscope as an example, the three-axis gyroscope can acquire information / data related to the attitude angle of the earphone 1600 (e.g., angular velocity of three orthogonal axes) and generate corresponding sensing signals. The attitude angle can include a pitch angle (i.e., the angle between the earphone 1600 and the horizontal plane), a yaw angle, and a roll angle. The processing device 120 can process the sensing signals and determine the signal features thereof. Based on the signal features, the processing device 120 can determine the user's body posture. The body posture can include, for example, a static state, such as lying on the stomach, lying on the back, tilting the body at a certain angle, etc., or a motion state, such as slowly standing up, etc. In some embodiments, the processor (e.g., a chip) of the three-axis gyroscope itself can also determine the user's body posture based on the sensing signals thereof. In some embodiments, the processing device 120 can determine a preset feature condition based on the signal features corresponding to when a plurality of user body postures are in a static state (e.g., lying on the stomach, lying on the back, tilting the body at a certain angle) and in a motion state (e.g., slowly standing up). The signal features of the sensing signals are determined to determine the user's body posture. For example, when the signal features of the sensing signals satisfy the preset feature condition corresponding to when the body posture is in a static state (e.g., lying on the stomach), it can be determined that the user's body posture is in a static state (e.g., lying on the stomach).

[0178] In some embodiments, the processing device 120 can determine whether the user is in a falling state based on the signal features of the sensing signals generated by the vibration sensing device. The processing device 120 can determine the user's body posture based on the signal features of the sensing signals generated by the motion sensing device. In combination with the sensing signals generated by the vibration sensing device and the motion sensing device, it can be determined whether the user has fallen and the user's body posture. In some embodiments, the processing device 120 can determine the user's physiological state based on whether the user is in a falling state and the user's body posture. For example, the user's physiological state can be divided into a dangerous state and a non-dangerous state. When the user is in a falling state and the user's body posture is static (e.g., lying on the back) within a certain time threshold (e.g., 10 seconds, 20 seconds, 30 seconds, 1 minute, etc.), it is determined that the user is in a dangerous state and needs help. For another example, when the user is not in a falling state or the user is in a falling state but the user's body posture is in a motion state (e.g., slowly standing up), it is determined that the user is in a non-dangerous state and does not need help.

[0179] In some embodiments, the processing device 120 can determine the operation of the target object based on the physiological state of the user. For example, when the processing device 120 determines that the user is in a falling state and the body posture of the user is static (e.g., lying on the side) within a threshold time, it can be determined that the user is in a dangerous state, and the mobile terminal (e.g., a mobile phone) in communication connection with the earphone 1600 can send a warning to a pre-stored contact or send an external aid request. For another example, when the processing device 120 determines that the user is not in a falling state or the user is in a falling state but the body posture of the user is in a moving state (e.g., slowly standing up, slowly sitting up, etc.), it can be determined that the user is in a dangerous state, and the mobile terminal in communication connection with the earphone 1600 can record the relevant information of the sensing signal so as to facilitate the subsequent evaluation of the health status of the user.

[0180] In some embodiments, the earphone 1600 can further include a physiological parameter sensing device. Exemplary physiological parameter sensing devices include a heart rate measuring component, a blood pressure measuring component, a blood glucose measuring component, etc. The physiological parameter sensing device can be used to sense or analyze the vasodilation, chest activity, blood composition, etc. of the user, and generate a sensing signal. The processing device 120 can identify the signal features of the sensing signal and determine the physiological parameters of the user. Exemplary physiological parameters can include heart rate, blood pressure, blood glucose, etc. For example, the physiological parameter sensing device can include an optical sensing unit, which acquires the pulse signal of a body part (e.g., wrist, upper arm, head, etc.) of the user, and then determines the blood pressure condition of the user based on the pulse signal through the processing device 120. In some embodiments, the processor (e.g., a chip) of the physiological parameter sensing device itself can determine the physiological parameters of the user based on the sensing signal.

[0181] In combination with the sensing signals generated by the vibration sensing device, the motion sensing device and / or the physiological parameter sensing device, the processing device 120 can determine whether the user has fallen down and the user's body posture and / or physiological parameters. In some embodiments, the processing device 120 can determine the user's physiological state based on whether the user is in a falling state and the user's body posture and / or physiological parameters. Illustratively, the user's physiological state can be classified into a dangerous physiological state and a non-dangerous physiological state. When the user is in a falling state and the user's body posture is static (e.g., lying on the back) and the user's physiological parameters exceed their threshold values (e.g., heart rate is lower than a preset heart rate threshold, blood sugar is lower than a preset blood pressure threshold, blood pressure is higher than a preset blood pressure threshold, etc.) within a certain time threshold (e.g., 10 seconds, 20 seconds, 30 seconds, 1 minute, etc.), it is determined that the user is in a dangerous physiological state and needs help. The heart rate lower than the preset heart rate threshold, the blood sugar lower than the preset blood sugar threshold and / or the blood pressure higher than the preset blood pressure threshold can be determined with reference to the normal human heart rate, blood sugar and / or blood pressure. Illustratively, the preset heart rate threshold can be 100 beats per minute, 120 beats per minute, 140 beats per minute, 160 beats per minute, etc. For another example, when the user is not in a falling state or the user is in a falling state but the user's body posture is in a moving state (e.g., slowly standing up) or the user's physiological parameters are within the threshold range, it is determined that the user is in a non-dangerous physiological state and does not need help.

[0182] Compared with the single condition of whether the user has fallen down, the physiological state of the user determined in combination with the user's body posture and / or physiological parameters is more accurate and effective, and the operation of the target object ultimately determined is also more in line with the actual situation.

[0183] Figure 17is based on a vibration signal generated by a user's physical activity, and an exemplary flowchart of determining a target object's operation. This embodiment shows a process of determining a target object's operation based on a vibration sensing device and a motion sensing device disposed on a wearable device (e.g., earphone 1600). Exemplarily, the vibration sensing device can be a MEMS accelerometer (abbreviated as accelerometer), and the motion sensing device can be a three-axis gyroscope. In this embodiment, a user's physical activity (e.g., bumping, falling, etc.) wearing the earphone 1600 generates a vibration signal that is transmitted to the MEMS accelerometer fixedly connected to the earphone 1600. After the MEMS accelerometer collects the vibration signal, it generates a corresponding sensing signal. At the same time, the three-axis gyroscope also collects information / data related to the user's body posture angle. In some embodiments, the processing device 120 (e.g., a signal processing unit of the earphone 1600) can process the sensing signal generated after the MEMS accelerometer collects the vibration signal, identify the signal features in the sensing signal, and thus determine whether the user has fallen. For example, the processing device 120 can perform acceleration analysis based on the sensing signal to determine whether the user has fallen. The processing device 120 can process the sensing signal generated after the three-axis gyroscope collects the signal, identify the signal features in the sensing signal, and thus determine the user's body posture. For example, the processing device 120 can perform body posture analysis based on the sensing signal to determine the user's body posture.

[0184] In some embodiments, the processing device 120 can determine whether to trigger a warning in combination with whether the user has fallen and the user's body posture. As described above, when the processing device 120 determines that the user is in a falling state and the user's body posture is stationary within a threshold time, it can be determined that the user is in a dangerous state, and the mobile terminal (e.g., a mobile phone) can send a warning to a pre-stored contact or send an external aid request.

[0185] Figure 18is based on a vibration signal generated by a user's physical activity, an example flowchart for determining a target object's operation. This embodiment shows a process for determining a target object's operation based on a vibration sensing device, a motion sensing device, and a physiological parameter sensing device disposed on a wearable device (e.g., earphone 1600). By way of example, the vibration sensing device can be an accelerometer, the motion sensing device can be a three-axis gyroscope, and the physiological parameter sensing device can be a heart rate measurement component. In this embodiment, a user wearing the earphone 1600's physical activity (e.g., bumping, falling, etc.) generates a vibration signal that is transmitted to a MEMS accelerometer fixedly connected to the earphone 1600. The MEMS accelerometer generates a corresponding sensing signal after collecting the vibration signal. The three-axis gyroscope can collect information / data related to the user's body posture angle. At the same time, the heart rate measurement component can also collect information / data related to the user's heart rate. In some embodiments, the processing device 120 (e.g., a signal processing unit of the earphone 1600) can process the sensing signal generated by the MEMS accelerometer after collecting the vibration signal, identify the signal features in the sensing signal, and thus determine whether the user has fallen. For example, the processing device 120 can perform acceleration analysis based on the sensing signal to determine whether the user has fallen. The processing device 120 can process the sensing signal generated by the three-axis gyroscope after collecting the signal, identify the signal features in the sensing signal, and thus determine the user's body posture. For example, the processing device 120 can perform body posture analysis based on the sensing signal to determine the user's body posture. The processing device 120 can process the sensing signal generated by the heart rate measurement component after collecting the signal, identify the signal features in the sensing signal, and thus determine the user's heart rate. For example, the processing device 120 (e.g., a processing unit (such as a chip) of the heart rate measurement component) can perform heart rate value analysis based on the sensing signal to determine the user's heart rate condition.

[0186] In some embodiments, the processing device 120 can determine whether to trigger a warning based on whether the user has fallen, the user's body posture, and the user's heart rate condition. For example, when the processing device 120 determines that the user is in a falling state and the user's body posture is static and / or the user's physiological parameter exceeds a preset threshold (e.g., diastolic pressure exceeds a preset diastolic pressure threshold (such as 140 mmHg, 160 mmHg, 180 mmHg, etc.)) within a threshold time, it can be determined that the user is in a dangerous state, and the mobile terminal can be determined to send a warning to a pre-stored contact or send an external aid request.

[0187] In some cases, compared to confirming the user's state only by physical activity, confirming the user's state by combining information such as whether the user has fallen, the user's body posture, and the user's physiological parameter, the confirmation result is more accurate, and the finally determined target object's operation is more in line with reality, which can effectively monitor the user's physical health condition.

[0188] Figure 19 FIG. 1 is a schematic diagram of a target object control system applied to a wearable device according to some embodiments of the present disclosure. The sensing device 110 in the target object control system 100 can include a vibration sensing device. The vibration sensing device can be integrated with or disposed (e.g., attached, snap connected, etc.) on the wearable device. The vibration sensing device can be disposed at a specific location. The specific location can be a location where vibration signals generated by a user's physical activity and transmitted via the user's bones or muscles can be more completely and clearly received. Exemplary specific locations can include the bridge of a user's nose, the user's ear, the user's mouth, the user's throat, etc. In some embodiments, the location where the vibration sensing device is disposed can be related to the type of wearable device. For example, when the wearable device is a pair of glasses, the vibration sensing device can be disposed on the bridge of the glasses or at a location where the earpiece of the glasses contacts the user's ear. For another example, when the wearable device is a pair of earphones, the vibration sensing device can be disposed at a location on the user's ear. In some embodiments, the at least one vibration sensing device can include a single vibration sensing device disposed at a location or multiple vibration sensing devices disposed at different locations.

[0189] Exemplarily, the wearable device can include a pair of earphones 1900 (e.g., in-ear earphones). One or more components or units of the target object control system 100 can be integrated with or communicatively connected to the pair of earphones 1900. For example, the pair of earphones 1900 can be provided with a vibration sensing device 1910. The vibration sensing device 1910 can be integrated with or disposed (e.g., attached, snap connected, etc.) on the pair of earphones 1900 for collecting vibration signals generated by a user's physical activity. In some embodiments, the vibration sensing device can be a microphone of the pair of earphones 1900 that uses bone conduction as one of the main ways of sound propagation. In some embodiments, the vibration sensing device can be a micro-electro-mechanical system (MEMS) accelerometer. For another example, a processing device 120 (e.g., a mobile phone or a computer) can be communicatively connected to the pair of earphones 1900 and the sensing device 110. The sensing device 1910 can be a vibration sensing device.

[0190] The vibration sensing device 1910 can receive vibration signals generated by a user's physical activity via the pair of earphones 1900. When the user wears the pair of earphones 1900, the pair of earphones 1900 fits the user's body part (e.g., the user's ear), and the vibration signals can be accurately transmitted to the vibration sensing device via the pair of earphones 1900. In some embodiments, the vibration sensing device can also directly fit the user's body part (e.g., the user's ear). The vibration signals generated by the user's physical activity can be directly collected by the vibration sensing device without passing through the pair of earphones 1900. In this embodiment, the user's physical activity can refer to the user's tapping or rubbing of the user's teeth. The user taps or rubs the user's teeth to generate vibration signals. The vibration signals are transmitted to the vibration sensing device via the user's bones or facial muscles.

[0191] In some embodiments, the earphone 1900 can be worn on one ear of the user. For example, the earphone 1900 can be a Bluetooth earphone with a single speaker, worn on the left or right ear of the user. In this case, the vibration sensing device 1910 can collect vibration signals transmitted to the left or right ear of the user. In some embodiments, the earphone 1900 can also be worn on both ears of the user. For example, the earphone 1900 can be a headset, ear-hook earphone, in-ear earphone, etc., with two speakers, one on the left ear and one on the right ear of the user. In this case, the vibration sensing device 1910 can include two vibration sensing devices, which collect vibration signals transmitted to the left and right ears of the user, respectively.

[0192] In some embodiments, the processing device 210 can receive vibration sensing signals generated by the vibration sensing device 1910 and identify the signal characteristics of the vibration sensing signals. The processing device 210 can determine the operation of a target object based on the signal characteristics, for example, the target object switching from a first state to a second state. The target object can be headphones 1900 or terminal device 130 (e.g., mobile devices (such as smart wearable devices), tablet computers, laptops, in-vehicle devices (such as vehicle infotainment systems, air conditioners, headlights, windshield wipers, etc.), smart home devices (such as lights, televisions, curtains, etc.) or any combination thereof). For a detailed description of how the processing device 210 determines the operation of the target object based on the vibration sensing signals, please refer to this application. Figure 21 And its description.

[0193] Compared to controlling terminal devices (such as wearable devices) via buttons or control panels, issuing commands to wearable devices and other terminal devices by tapping with teeth frees up the user's hands and is safer in certain situations (such as driving, cycling, or in dark environments). Furthermore, compared to controlling terminal devices by issuing voice signals, issuing commands by tapping with teeth is more discreet, less likely to disturb those around the user, and also helps protect the user's personal information.

[0194] Figure 20 This is an exemplary flowchart of a target object control method according to some embodiments of this application. Vibration signals generated by a user's physical activity (e.g., teeth tapping) are transmitted to the vibration sensing device 1910 via the user's facial bones or muscles. The process of transmitting the vibration signal can be referred to... Figure 21 .like Figure 21As shown, the tooth tapping of the user will generate a vibration signal at the tapping point P, and the vibration signal can be transmitted to the vibration sensing device 1910 via the user's facial bones. The path of the vibration signal transmitted from the point P to the vibration sensing device 1910 is shown as the vibration transmission path A in the figure.

[0195] When the vibration sensing device 1910 collects the vibration signal, a corresponding vibration sensing signal can be generated. After the processing device 120 receives the vibration sensing signal, the vibration sensing signal can be processed to identify the signal characteristics in the vibration sensing signal. The signal characteristics can include the number of vibration peaks of the vibration sensing signal generated by the vibration sensing device, the interval time between adjacent vibration peaks, the signal strength, the frequency component, and / or the signal duration time. The number of vibration peaks of the vibration sensing signal can reflect the number of tooth taps. The interval time between adjacent vibration peaks of the vibration sensing signal can reflect the speed of the tapping. The signal strength of the vibration sensing signal can reflect the force of the tooth tapping. The frequency component of the vibration sensing signal can reflect whether there is another object (e.g., food) between the teeth. If there is another object, the low-frequency component will increase. The signal duration time of the vibration sensing signal reflects the duration time of the entire vibration sensing signal or the duration time of a single vibration peak.

[0196] In some embodiments, the processing device 120 can determine whether the signal characteristics of the sensing signal satisfy one of a plurality of preset characteristic conditions. Each preset characteristic condition corresponds to at least one operation of the target object or an instruction for controlling the target object to perform the operation. In some embodiments, the processing device 120 can set the signal characteristics corresponding to a combination of specific tapping actions as a preset characteristic condition. For example, the signal characteristics corresponding to two consecutive taps (the interval time Δt between vibration peaks is less than a first tapping interval threshold t0) can be set as a preset characteristic condition. The preset characteristic condition can correspond to the power on / off operation of the earphone 1900. For another example, the signal characteristics corresponding to two slow taps (the interval time Δt between vibration peaks is greater than the first tapping interval threshold t0 and less than a second tapping interval threshold t1) can be set as a preset characteristic condition. The preset characteristic condition can correspond to the play / pause operation of the earphone 1900.

[0197] When the signal characteristics of the sensing signal satisfy one of the preset characteristic conditions, the processing device 120 can determine the operation of the target object corresponding to the sensing signal. For example, when the signal characteristics satisfy the preset characteristic condition of two consecutive taps, the processing device 120 can control the earphone 1900 to perform the power on / off operation. The processing device 120 can detect the state of the earphone 1900, and when the earphone 1900 is in the powered-on state (i.e., the first state), it can be determined to adjust the earphone 1900 to the powered-off state (i.e., the second state); when the earphone 1900 is in the powered-off state, it can be determined to adjust the earphone 1900 to the powered-on state.

[0198] In some embodiments, when the vibration sensing device only includes vibration sensing devices arranged at certain positions (e.g., in the case of the earphone 1900 only arranged with vibration sensing devices at the right side portion), the signal features include the number of vibration peaks of the vibration sensing signals generated by the vibration sensing devices, the interval time of adjacent vibration peaks, and / or the signal duration time. In some embodiments, when the sensing unit includes vibration sensing devices arranged at different positions (e.g., in the case of the earphone 1900 arranged with vibration sensing devices 1920 and 1910 at the left and right side portions, respectively), the signal features of the sensing signals additionally include the phase difference of the sensing signals of the vibration sensing devices at different positions. The phase difference can be used to determine the position of the vibration source (i.e., the tapping point P of the tooth tapping). Exemplarily, as shown in FIG. 19B, when the tapping point P is at the right side, the tapping point P is at different distances from the vibration sensing devices at different positions, thus the vibration transmission paths (e.g., the vibration transmission path B from the tapping point P to the vibration sensing device 1920 at the left side and the vibration transmission path A from the tapping point P to the vibration sensing device 1910 at the right side) are of different lengths, the vibration sensing device 1910 at the right side portion captures the vibration signal first, and the vibration sensing device 1920 at the left side portion captures the vibration signal later, and there is a phase difference between the vibration signals collected by the two vibration sensing devices 1910 and 1920. Based on the phase difference, the difference between the vibration transmission path B and the vibration transmission path A can be determined, and thus the position of the tapping point P (e.g., the left side, the right side, the middle, etc.) can be determined since the positions of the vibration sensing devices 1910 and 1920 are fixed. Figure 22 Figure 24 Figure 24

[0199] In some cases, by locating the position of the vibration source (i.e., the tapping point P of the tooth), the user can perform more types and more complex tooth tapping operations by changing the position of the tapping point P, the number of taps, and / or the interval time of the taps, etc. in combination, to correspond to more and more complex target object operations or operation instructions.

[0200] In some cases, the user can make the tooth tapping action inadvertently or unavoidably. For example, the user can make the tooth tapping action when eating. For another example, the user can make the tooth tapping action when speaking. For yet another example, the user can make the tooth tapping action when having a body activity such as shivering, sneezing, etc. or being impacted by external impact (e.g., bumping). The above cases can trigger the operation of the target object (i.e., false triggering). In some embodiments, the processing device 120 can screen or identify the sensing signals to avoid the false triggering.

[0201] ​​​The processing device 120 can acquire the vibration sensing signal of the at least one vibration sensing device in real time or intermittently. When the vibration sensing signal (also referred to as a second sensing signal herein) is acquired, the processing device 120 can acquire the relevant information of the second sensing signal, such as the frequency, signal strength, and the like. The processing device 120 can determine whether the second sensing signal is a false trigger signal based on the relevant information of the second sensing signal. Illustratively, the processing device 120 can determine whether the second sensing signal is a false trigger signal based on the frequency of the second sensing signal. For example, when the frequency of the second sensing signal is lower than a preset frequency threshold, it can be determined that the second sensing signal is a false trigger signal. When the frequency of the second sensing signal is lower than the preset frequency threshold, it can be considered that the user is eating. The sensing signal generated at this time can be determined as a false trigger signal, and the target object does not need to perform any operation.

[0202] In some embodiments, the sensing device 110 can further include an audio input device (for example, a microphone). In some embodiments, the microphone can also be an element of the wearable device (for example, the earphone 1900) itself. When the vibration sensing signal (also referred to as a third sensing signal herein) is acquired, the processing device 120 can determine whether the audio input device receives user voice information at the same time. If the audio input device receives user voice information, it is determined that the third sensing signal is a false trigger signal. At this time, it can be considered that the user is talking with others or making a call using a communication device. The sensing signal generated at this time can be determined as a false trigger signal, and the target object does not need to perform any operation.

[0203] In some embodiments, when the vibration sensing signal (also referred to as a fourth sensing signal herein) is acquired, the processing device 120 can determine whether the fourth sensing signal is a false trigger based on a false trigger identification model. In some embodiments, the false trigger identification model can be a machine learning model. In some embodiments, the processing device 120 can take the fourth sensing signal as input data of the machine learning model. The result of whether the fourth sensing signal is a false trigger signal can be obtained by the machine learning model. If the fourth sensing signal is a false trigger signal, the target object does not need to perform any operation; if the fourth sensing signal is not a false trigger signal, the processing device 120 can acquire the signal within a threshold time range (for example, 2s, 3s, 5s, 10s, and the like) from the fourth sensing signal as the sensing signal. In some embodiments, the false trigger identification model can be a trained machine learning model. The training process of the false trigger identification model is the same as or similar to the training process of the feature extraction model.

[0204] Figure 22is a schematic diagram of the target object control system according to some embodiments of the present application applied to a wearable device. One or more components or units of the target object control system 100 can be integrated on or communicatively connected with the earphone 1900. As shown in Figure 22 the right part of the earphone 1900 is provided with a vibration sensing device 1910, while the left part is not provided with a vibration sensing device. When the user taps the teeth, a vibration signal is generated at the tap point P. The vibration signal can be transmitted to the vibration sensing device 1910 via a vibration transmission path A. The vibration sensing device 1910 generates a corresponding vibration sensing signal according to the collected vibration signal. The processing device 120 can identify the signal features in the vibration sensing signal and determine whether the signal features satisfy the preset feature condition. In some embodiments, the vibration sensing signal can be output as a signal feature spectrum. Based on the signal feature spectrum, the processing device 120 can identify the signal features of the sensing signal. For example, the processing device 120 can read the number of vibration peaks, the frequency components of the signal, and other related information from the signal feature spectrum. Figure 23 is a signal feature spectrum of the sensing signal corresponding to the user's tooth tapping according to some embodiments of the present application. As can be seen from Figure 23 , the sensing signal includes three vibration peaks. According to the time of signal collection / generation, the interval time of the first two vibration peaks in the three vibration peaks is Δt1, and the interval time of the last two vibration peaks in the three vibration peaks is Δt2.

[0205] In some embodiments, the signal features corresponding to specific tooth tapping actions can be used as the preset feature condition. Exemplary tooth tapping actions can include (1) two consecutive taps: Δt < t0; (2) two slow taps: t1 > Δt > t0; (3) three consecutive taps: Δt1 < t0, Δt2 < t0; (4) three slow taps: t1 > Δt1 > t0, t1 > Δt2 > t0; (5) two consecutive taps + one slow tap: Δt1 < t0, t1 > Δt2 > t0; (6) one slow tap + two consecutive taps: t1 > Δt1 > t0, Δt2 < t0. Wherein, Δt is the interval time of adjacent two taps (which can reflect the interval time of two vibration peaks), t0 is the first tapping interval threshold, and t1 is the second tapping interval threshold. In some embodiments, the first tapping interval threshold t0 can be in the range of 0.1s-1s. In some embodiments, the first tapping interval threshold t0 can be in the range of 0.15s-0.9s. In some embodiments, the first tapping interval threshold t0 can be in the range of 0.2s-0.8s. In some embodiments, the second tapping interval threshold t1 can be in the range of 0.8s-5s. In some embodiments, the second tapping interval threshold t1 can be in the range of 0.9s-4s. In some embodiments, the second tapping interval threshold t1 can be in the range of 1s-2s.

[0206] The signal features of the sensing signals generated by the tooth tapping actions correspond to different operations of the target object. Exemplary operations include turning on / off, playing / pausing, connecting / hanging up a call, increasing / decreasing volume, turning on / off Bluetooth, etc. It should be noted that the tooth tapping actions, the values of the related parameters, and the corresponding operations of the target object are only examples and do not limit the scope of the application.

[0207] In some embodiments, when the signal features of the sensing signals generated by the user tapping the teeth satisfy a specific preset feature condition, the processing device 120 can determine the operation of the target object corresponding to the specific preset feature condition and control the target object (e.g., a terminal device such as the earphone 1900, a mobile phone, etc.) to perform the corresponding operation.

[0208] Figure 24 is a schematic diagram of a target object control system applied to a wearable device according to some embodiments of the application. Unlike the embodiments described above, Figure 22 Unlike the embodiments described above, in this embodiment, the left and right parts of the earphone 1900 respectively include the vibration sensing devices 1920 and 1910. The vibration sensing devices 1910 and 1920 are the same or similar. The vibration signals generated at the tooth tapping point P are transmitted to the left vibration sensing device 1920 via the vibration transmission path B and to the right vibration sensing device 1910 via the vibration transmission path A. The vibration sensing devices 1910 and 1920 respectively generate the sensing signal a and the sensing signal b. The processing device 120 can identify the signal features of the sensing signal a and the sensing signal b (e.g., the vibration peaks of the sensing signal a / b, the time intervals between adjacent vibration peaks of the sensing signal a / b, the signal duration time of the sensing signal a / b, and / or the phase difference between the sensing signal a and the sensing signal b) and determine whether the signal features satisfy the preset feature condition.

[0209] In some embodiments, the signal features corresponding to specific tooth tapping actions can be preset feature conditions. Exemplary tooth tapping actions can include tapping (1) twice with left teeth, right teeth or middle teeth (i.e. front teeth): Δt < t0; (2) twice slowly with left teeth, right teeth or middle teeth: t1 > Δt > t0; (3) three times with left teeth, right teeth or middle teeth: Δt1 < t0, Δt2 < t0; (4) three times slowly with left teeth, right teeth or middle teeth: t1 > Δt1 > t0, t1 > Δt2 > t0; (5) twice with left teeth, right teeth or middle teeth + once with left teeth, right teeth or middle teeth: Δt1 < t0, t1 > Δt2 > t0; (6) once with left teeth, right teeth or middle teeth + twice with left teeth, right teeth or middle teeth: t1 > Δt1 > t0, Δt2 < t0. In other examples, tooth tapping actions can be performed with the cooperation of left teeth, right teeth and middle teeth. For example, (1) twice with left teeth + once with right teeth: Δt1 < t0, t1 > Δt2 > t0; (2) twice with left teeth + once with middle teeth: Δt1 < t0, t1 > Δt2 > t0; (3) twice with right teeth + once with left teeth: Δt1 < t0, t1 > Δt2 > t0; (4) twice with right teeth + once with middle teeth: Δt1 < t0, t1 > Δt2 > t0; (5) twice with middle teeth + once with right teeth: Δt1 < t0, t1 > Δt2 > t0; (6) twice with middle teeth + once with left teeth: Δt1 < t0, t1 > Δt2 > t0; (7) once with left teeth + twice with right teeth: t1 > Δt2 > t0, Δt2 < t0; (8) once with left teeth + twice with middle teeth: t1 > Δt2 > t0, Δt2 < t0; (9) once with right teeth + twice with left teeth: t1 > Δt2 > t0, Δt2 < t0; (10) once with right teeth + twice with middle teeth: t1 > Δt2 > t0, Δt2 < t0; (11) once with middle teeth + twice with right teeth: t1 > Δt2 > t0, Δt2 < t0; (12) once with middle teeth + twice with left teeth: t1 > Δt2 > t0, Δt2 < t0.

[0210] The signal features of the sensing signals generated by the above tooth tapping actions correspond to different operations of the target object, respectively. Exemplary operations include turning on / off, playing / pausing, connecting / hanging up a phone, dialing / hanging up an emergency contact, dialing / hanging up an emergency center, increasing / decreasing volume, turning on / off Bluetooth, increasing / decreasing light brightness, etc. It should be noted that the above tooth tapping actions and the corresponding operations of the target object are only examples and do not limit the scope of protection of the present application.

[0211] In some embodiments, when the signal features of the sensing signals generated by the user tapping the teeth satisfy a specific preset feature condition, the processing device 120 can determine the operation of the target object corresponding to the specific preset feature condition and control the target object (e.g. a terminal device such as an earphone 1900, a mobile phone, etc.) to perform the corresponding operation.

[0212] Having described the basic concepts, it is obvious to those skilled in the art that the above-described disclosure of the invention is merely an example and does not limit the present specification. Although not explicitly described herein, those skilled in the art can make various modifications, improvements and corrections to the present specification. Such modifications, improvements and corrections are suggested in the present specification, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of the present specification.

[0213] Meanwhile, the present specification uses specific terms to describe the embodiments of the present specification. As "one embodiment", "an embodiment" and / or "some embodiments" mean a certain feature, structure, or characteristic that relates to at least one embodiment of the present specification. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "one alternative embodiment" referred to in different places in the present specification does not necessarily refer to the same embodiment. In addition, certain features, structures, or characteristics of one or more embodiments of the present specification can be properly combined.

[0214] In addition, those skilled in the art can understand that aspects of the present specification can be described and claimed in a broadest form and in a broadest form, including any new and useful processes, machines, articles of manufacture, or compositions of matter or any new and useful improvements thereof. Accordingly, various aspects of the present specification can be performed entirely by hardware, entirely by software (including firmware, resident software, microcode, etc.), or by a combination of hardware and software. The above hardware or software can be referred to as "data blocks", "modules", "engines", "units", "components", or "systems". In addition, aspects of the present specification can be embodied as a computer product located in one or more computer readable media, including computer readable program code.

[0215] In addition, unless the order of the processing elements and sequences described in the present specification, the use of numerals and letters, or the use of other names is explicitly described in the claims, it is not intended to limit the order of the processes and methods of the present specification. Although some of the presently considered useful embodiments of the invention are discussed through various examples in the above disclosure, it should be understood that such details are only for the purpose of illustration, and the additional claims are not limited to the disclosed embodiments, but rather, the claims are intended to cover all modifications and equivalent combinations that fall within the spirit and scope of the embodiments of the present specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on existing servers or mobile devices.

[0216] Similarly, it should be noted that, in order to simplify the description disclosed herein and thus aid in the understanding of one or more embodiments of the invention, the foregoing description of embodiments in this specification may sometimes combine multiple features into a single embodiment, drawing, or description thereof. However, this method of disclosure does not imply that the subject matter of this specification requires more features than those mentioned in the claims. In fact, the embodiments contain fewer features than all the features of a single embodiment disclosed above.

[0217] In some embodiments, numbers describing the quantity of components and attributes are used. It should be understood that such numbers used in the description of embodiments are modified in some examples by terms such as "approximately," "approximately," or "generally." Unless otherwise stated, "approximately," "approximately," or "generally" indicates that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical data used in the specification and claims are approximate values, which may be changed depending on the characteristics required by individual embodiments. In some embodiments, numerical data should take into account specified significant digits and employ general methods of digit reservation. Although the numerical ranges and data used to confirm their breadth in some embodiments of this specification are approximate values, in specific embodiments, such numerical values ​​are set as precisely as feasible.

[0218] Finally, it should be understood that the embodiments described in this specification are merely illustrative of the principles of the embodiments described herein. Other variations may also fall within the scope of this specification. Therefore, alternative configurations of the embodiments described herein are intended to be illustrative rather than limiting, and should be considered consistent with the teachings of this specification. Accordingly, the embodiments described herein are not limited to those explicitly introduced and described herein.

Claims

1. A target object control system, comprising: a storage device configured to store computer instructions; and a processor in communication with the storage device, the processor, when executing the computer instructions, causes the system to perform operations of: obtaining a sensing signal of at least one sensing device, the at least one sensing device comprising a vibration sensing device and an audio input device, the vibration sensing device being attached to a body part of a user, the vibration sensing device receiving a vibration signal generated by a user's body activity; the obtaining a sensing signal of at least one sensing device comprising: obtaining a third sensing signal of the vibration sensing device;determining whether the audio input device simultaneously receives user voice information;and in response to the audio input device receiving user voice information, determining that the third sensing signal is a false trigger signal; identifying a signal feature of the sensing signal;and based on the signal feature, determining an operation of a target object associated with the at least one sensing device. 2.The target object control system of claim 1, wherein the signal feature comprises a combination of one or more of a number of vibration peaks, a signal intensity, a time interval between adjacent vibration peaks, a frequency component, and a signal duration time. 3.The target object control system of claim 1 or 2, wherein the vibration sensing device is connected to a vibration receiving area through a solid medium, and receives the vibration signal input to the vibration receiving area. 4.The target object control system of claim 3, wherein the vibration signal is input to the vibration receiving area by tapping, patting or scraping on the vibration receiving area. 5.The target object control system of claim 3, wherein the vibration sensing device is fixedly connected to the solid medium by at least one of adhesion, inlay, welding, riveting, and screwing. 6.The target object control system of claim 3, wherein the vibration sensing device is arranged at a position of the solid medium with a larger amplitude. 7.The target object control system of claim 3, wherein the determining an operation of a target object associated with the at least one sensing device based on the signal feature comprises: determining whether the signal feature meets a preset feature; and in response to the signal feature meeting the preset feature, determining an operation of the target object corresponding to the preset feature. 8.The target object control system of claim 7, wherein the determining whether the signal feature meets a preset feature comprises: determining whether the signal feature meets a preset feature based on a preset feature condition recognition model, the preset feature condition recognition model being a machine learning model. 9.The target object control system of claim 3, wherein the operation of the target object comprises switching a terminal device from a first state to a second state. 10.The target object control system of claim 1, wherein the obtaining a sensing signal of at least one sensing device comprises: obtaining a first sensing signal of the at least one sensing device; determining whether the first sensing signal is greater than a signal threshold; and In response to the first sensing signal being greater than the signal threshold, a signal within a first sensing signal threshold time range is obtained as the sensing signal. 11.The target object control system of claim 1, wherein the vibration sensing device is disposed on a wearable device that is attached to a body part of the user, and the vibration sensing device receives the vibration signal generated by the user's physical activity through the wearable device. 12.The target object control system of claim 1, wherein the physical activity includes coughing, sneezing, snoring, yawning, or falling. 13.The target object control system of claim 11, wherein determining the operation of the target object associated with the at least one sensing device based on the signal feature comprises: determining a physiological state of the user based on the signal feature; and determining the operation of the target object corresponding to the physiological state based on the physiological state of the user. 14.The target object control system of claim 13, wherein determining the physiological state of the user based on the signal feature comprises: determining whether the signal feature meets a preset feature; and determining the physiological state corresponding to the preset feature in response to the signal feature meeting the preset feature. 15.The target object control system of claim 11, wherein the operation of the target object includes recording a health condition or sending an early warning by a mobile terminal. 16.The target object control system of claim 11, wherein the vibration sensing device has a response frequency of 2KHz-4.5KHz. 18.The target object control system of claim 11, wherein the at least one sensing device further comprises a motion sensing device. 19.The target object control system of claim 18, wherein determining the operation of the target object associated with the at least one sensing device based on the signal feature comprises: determining whether the user falls and a body posture of the user based on the signal feature; and determining the corresponding operation of the target object based on whether the user falls and the body posture of the user. 20.The target object control system of claim 19, wherein determining the corresponding operation of the target object based on whether the user falls and the body posture of the user comprises: determining that the user is in a dangerous state and determining that a mobile terminal performs a help-seeking operation if it is determined that the user falls and the body posture is static. 21.The target object control system of claim 18, wherein the at least one sensing device further comprises a physiological parameter sensing device. 22.The target object control system of claim 19, wherein determining the operation of the target object associated with the at least one sensing device based on the signal feature comprises: determining whether the user falls, a body posture, and a physiological parameter of the user based on the signal feature; and determining the corresponding operation of the target object based on whether the user falls, the body posture, and the physiological parameter of the user. ​ 17. The target object control system of claim 11, the vibration sensing device having a sensitivity of -35 dBV / (m / s 2 ) - -15 dBV / (m / s 2 ). ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ 23.The target object control system of claim 22, wherein the determining the corresponding operation of the target object based on whether the user falls down and the body posture and the physiological parameter of the user comprises: determining that the user is in a dangerous state if it is determined that the user falls down and the body posture is static or the physiological parameter exceeds a preset threshold, and determining that the mobile terminal performs a help-seeking operation. 24.The target object control system of claim 23, wherein the physiological parameter comprises at least one of a heart rate, a blood pressure, or a blood sugar. 25.The target object control system of claim 11, wherein the body activity comprises tooth tapping. 26.The target object control system of claim 1, wherein the identifying the signal feature of the sensing signal comprises: identifying a number of vibration peaks, an interval time of adjacent vibration peaks, and a signal duration time of the sensing signal. 27.The target object control system of claim 25, wherein the at least one sensing device comprises vibration sensing devices respectively arranged at different positions. 28.The target object control system of claim 27, wherein the signal feature further comprises a phase difference of the sensing signals of the vibration sensing devices respectively arranged at the different positions, and the phase difference of the sensing signals is used to determine a position of the vibration signal. 29.The target object control system of claim 28, wherein the identifying the signal feature of the sensing signal comprises: identifying a number of vibration peaks, an interval time of adjacent vibration peaks, a signal duration time, and a phase difference of the vibration signal of the sensing signal. 30.The target object control system of claim 25, wherein the operation of the target object comprises switching a terminal device from a first state to a second state. 31.The target object control system of claim 25, wherein the acquiring the sensing signal of the at least one sensing device comprises: acquiring a second sensing signal of the at least one sensing device; determining whether a frequency of the second sensing signal is lower than a preset frequency threshold; and determining that the second sensing signal is a false trigger signal in response to the frequency of the second sensing signal being lower than the preset frequency threshold. 32.The target object control system of claim 25, wherein the acquiring the sensing signal of the at least one sensing device comprises: acquiring a fourth sensing signal of the at least one sensing device; determining whether the fourth sensing signal is a false trigger signal based on a false trigger identification model; and acquiring a signal within a threshold time range from the second sensing signal as the sensing signal in response to the fourth sensing signal not being a false trigger signal. 33.The target object control system of claim 32, wherein the false trigger identification model is a machine learning model. 34.A target object control method, comprising: acquiring a sensing signal of at least one sensing device; wherein the at least one sensing device comprises a vibration sensing device and an audio input device, the vibration sensing device is attached to a body part of a user, and the vibration sensing device receives a vibration signal generated by a body activity of the user. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ The obtaining the sensing signal of the at least one sensing device comprises: obtaining a third sensing signal of the vibration sensing device; determining whether the audio input device simultaneously receives user voice information; and in response to the audio input device receiving user voice information, determining that the third sensing signal is a false trigger signal; identifying a signal feature of the sensing signal; and determining an operation of a target object associated with the at least one sensing device based on the signal feature.

35. The target object control method of claim 34, wherein the signal feature comprises a combination of one or more of a number of vibration peaks, a signal intensity, an interval time between adjacent vibration peaks, a frequency component, and a signal duration time.

36. The target object control method of claim 34, wherein the vibration sensing device is connected to a vibration receiving area through a solid medium and receives a vibration signal input to the vibration receiving area.

37. The target object control method of claim 36, wherein the vibration signal is input to the vibration receiving area by tapping, patting, or scratching on the vibration receiving area.

38. The target object control method of claim 36, wherein the vibration sensing device is fixedly connected to the solid medium by at least one of adhesion, inlaying, welding, riveting, or screwing.

39. The target object control method of claim 36, wherein the vibration sensing device is disposed at a position of the solid medium with a larger amplitude.

40. The target object control method of claim 36, wherein the determining the operation of the target object associated with the at least one sensing device based on the signal feature comprises: determining whether the signal feature satisfies a preset feature; and in response to the signal feature satisfying the preset feature, determining an operation of the target object corresponding to the preset feature.

41. The target object control method of claim 40, wherein the determining whether the signal feature satisfies the preset feature comprises: determining whether the signal feature satisfies the preset feature based on a preset feature condition recognition model, the preset feature condition recognition model being a machine learning model.

42. The target object control method of claim 36, wherein the operation of the target object comprises switching a terminal device from a first state to a second state.

43. The target object control method of claim 34, wherein the obtaining the sensing signal of the at least one sensing device comprises: obtaining a first sensing signal of the at least one sensing device; determining whether the first sensing signal is greater than a signal threshold value; and in response to the first sensing signal being greater than the signal threshold value, obtaining a signal within a threshold time range from the first sensing signal as the sensing signal.

44. The target object control method of claim 34, wherein the vibration sensing device is disposed on a wearable device, the wearable device being attached to a body part of a user, and the vibration sensing device receives a vibration signal generated by a body activity of the user through the wearable device. ​ ​ 45. The target object control method of claim 44, wherein the physical activity comprises coughing, sneezing, snoring, yawning, or falling.

46. The target object control method of claim 44, wherein determining the operation of the target object associated with the at least one sensing device based on the signal feature comprises: determining a physiological state of the user based on the signal feature; and determining the operation of the target object corresponding to the physiological state based on the physiological state of the user.

47. The target object control method of claim 46, wherein determining the physiological state of the user based on the signal feature comprises: determining whether the signal feature satisfies a preset feature; and determining the physiological state corresponding to the preset feature in response to the signal feature satisfying the preset feature.

48. The target object control method of claim 44, wherein the operation of the target object comprises recording a health condition or sending an early warning by a mobile terminal.

49. The target object control method of claim 44, wherein the response frequency of the vibration sensing device is 2 KHz-4.5 KHz.

51. The target object control method of claim 44, wherein the at least one sensing device further comprises a motion sensing device.

52. The target object control method of claim 51, wherein determining the operation of the target object associated with the at least one sensing device based on the signal feature comprises: determining whether the user falls and a body posture of the user based on the signal feature; and determining the corresponding operation of the target object based on whether the user falls and the body posture of the user.

53. The target object control method of claim 52, wherein determining the corresponding operation of the target object based on whether the user falls and the body posture of the user comprises: determining that the user is in a dangerous state and determining that a mobile terminal performs a help-seeking operation if it is determined that the user falls and the body posture of the user is static.

54. The target object control method of claim 51, wherein the at least one sensing device further comprises a physiological parameter sensing device.

55. The target object control method of claim 52, wherein determining the operation of the target object associated with the at least one sensing device based on the signal feature comprises: determining whether the user falls, a body posture of the user, and a physiological parameter of the user based on the signal feature; and determining the corresponding operation of the target object based on whether the user falls, the body posture of the user, and the physiological parameter of the user.

56. The target object control method of claim 55, wherein determining the corresponding operation of the target object based on whether the user falls, the body posture of the user, and the physiological parameter of the user comprises: determining that the user is in a dangerous state and determining that a mobile terminal performs a help-seeking operation if it is determined that the user falls and the body posture of the user is static or the physiological parameter of the user exceeds a preset threshold.

50. The target object control method according to claim 44, wherein the vibration sensing device has a sensitivity of -35 dBV / (m / s 2 ) - -15 dBV / (m / s 2 ).

57. The target object control method of claim 56, wherein the physiological parameter comprises at least one of a heart rate, a blood pressure, or a blood sugar. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ 58.The target object control method of claim 44, wherein the physical activity comprises tooth tapping. 59.The target object control method of claim 58, wherein the at least one sensing device comprises a vibration sensing device disposed at a specific location. 60.The target object control method of claim 59, wherein the identifying the signal feature of the sensing signal comprises: identifying a number of vibration peaks, an interval time of adjacent vibration peaks, and a signal duration time of the sensing signal. 61.The target object control method of claim 58, wherein the at least one sensing device comprises vibration sensing devices respectively disposed at different locations. 62.The target object control method of claim 61, wherein the signal feature further comprises a phase difference of the sensing signals of the vibration sensing devices at the different locations, the phase difference of the sensing signals being used to determine a location of the vibration signal. 63.The target object control method of claim 62, wherein the identifying the signal feature of the sensing signal comprises: identifying a number of vibration peaks, an interval time of adjacent vibration peaks, a signal duration time, and the phase difference of the vibration signal. 64.The target object control method of claim 58, wherein the operation of the target object comprises a switching of a terminal device from a first state to a second state. 65.The target object control method of claim 58, wherein the obtaining the sensing signal of the at least one sensing device comprises: obtaining a second sensing signal of the at least one sensing device; determining whether a frequency of the second sensing signal is lower than a preset frequency threshold; and in response to the frequency of the second sensing signal being lower than the preset frequency threshold, determining that the second sensing signal is a false trigger signal. 66.The target object control method of claim 58, wherein the obtaining the sensing signal of the at least one sensing device comprises: obtaining a fourth sensing signal of the at least one sensing device; determining, based on a false trigger identification model, whether the fourth sensing signal is a false trigger signal; and in response to the fourth sensing signal not being a false trigger signal, obtaining a signal within a threshold time range from the second sensing signal as the sensing signal. 67.The target object control method of claim 66, wherein the false trigger identification model is a machine learning model. 68.A non-transitory computer-readable medium comprising: computer instructions; when executed by at least one processor, the computer instructions cause the at least one processor to perform operations of: obtaining a sensing signal of at least one sensing device; the at least one sensing device comprising a vibration sensing device and an audio input device, the vibration sensing device being attached to a body part of a user, the vibration sensing device receiving a vibration signal generated by a physical activity of the user; the obtaining the sensing signal of the at least one sensing device comprising: obtaining a third sensing signal of the vibration sensing device; determining whether the audio input device receives user voice information at the same time; and in response to the audio input device receiving user voice information, determining that the third sensing signal is a false trigger signal. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ identifying a signal feature of the sensing signal; and determining, based on the signal feature, an operation of a target object associated with the at least one sensing device.

Images