Control method, device, storage medium, and program product
By using piezoelectric vibrator components to sense impact events and generate passwords to be verified, the convenience and security issues of traditional equipment control methods are solved, enabling secure equipment control without the need to carry mobile terminals or physical keys.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- SHANGHAI PATEO ELECTRONIC EQUIPMENT MANUFACTURING CO LTD
- Filing Date
- 2024-12-30
- Publication Date
- 2026-06-30
AI Technical Summary
Traditional device control methods require users to carry mobile terminals, making it impossible to control the device if the user forgets to bring it. Furthermore, existing keyless entry systems are vulnerable to relay attacks, and voice recognition technology is easily simulated, resulting in insufficient security.
By sensing knocking events through piezoelectric oscillator components, parsing electrical signals to generate passwords to be verified, and executing control commands under certain control conditions, combined with character electrical signal mapping and region matching verification, security and convenience are enhanced.
It enables secure and convenient control of devices without the need to carry mobile terminals and physical keys, improving the security of device control and user experience.
Smart Images

Figure CN122308343A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of equipment control technology, and in particular to a control method, device, storage medium, and computer program product. Background Technology
[0002] With the continuous development of technology, intelligent control technology has been widely applied in various fields. Traditional methods of controlling equipment may require users to carry mobile devices, and if users forget to bring their mobile devices, they cannot control the equipment. Summary of the Invention
[0003] One embodiment of this application provides a control method, device, storage medium, and program product, wherein a piezoelectric vibrator assembly senses a tapping event to enable the input of a password to be verified, and executes a corresponding control command when the password to be verified meets the control conditions, so that the user can input control commands even if he forgets to bring the control device.
[0004] Another embodiment of this application provides a control method, device, storage medium, and program product, wherein the electrical signal to be parsed is converted into a password to be verified by a preset mapping relationship between character electrical signals and characters, thereby increasing the encryption effect of the tapping event and improving the security of control command input based on the tapping event.
[0005] Another embodiment of this application provides a control method, apparatus, storage medium, and program product, wherein the boundary of a character electrical signal can be accurately determined by comparing the signal attributes of adjacent electrical signals, thereby reducing the occurrence of recognition errors or recognition failures caused by segmentation errors of character electrical signals.
[0006] Another embodiment of this application provides a control method, apparatus, storage medium, and program product, wherein by using the sensing of a tapping event occurring in a target area as a trigger identifier for parsing an electrical signal to be parsed, it is easy to distinguish between tapping events that need to be verified and those that do not.
[0007] Another embodiment of this application provides a control method, apparatus, storage medium, and program product, wherein a region-varying electrical signal grouping strategy enhances the ability to recognize and process complex keystroke patterns, thereby enabling more accurate segmentation of character electrical signals and providing an accurate data foundation for subsequent mapping of the password to be verified. Simultaneously, this method reduces the accuracy requirements of user keystroke operations.
[0008] Another embodiment of this application provides a control method, device, storage medium, and program product, wherein, based on the signal transmission interface information of the electrical signal received by the control unit and the setting area of the piezoelectric vibrator assembly, the generation area of the electrical signal can be accurately and quickly determined, thereby enhancing the ability to identify and distinguish complex knocking events.
[0009] Another embodiment of this application provides a control method, apparatus, storage medium, and program product, wherein multiple piezoelectric oscillators are arranged in the same area to improve the sensing sensitivity and sensing uniformity of impact events.
[0010] Another embodiment of this application provides a control method, device, storage medium, and program product, wherein a piezoelectric vibrator component senses a tapping event to realize the input and verification of the password to be verified, and executes an unlocking command if the verification is successful. This enables secure unlocking of the device without using traditional physical keys or wireless communication technology, avoiding security risks such as lost keys and relay attacks, while providing convenience for users, allowing users to easily access locked resources by meeting preset conditions.
[0011] Another embodiment of this application provides a control method, device, storage medium, and program product, wherein a piezoelectric vibrator assembly is installed on the vehicle to sense a tapping event to enable the input of a password to be verified, and an unlocking command is executed when the password to be verified meets the control conditions, thereby enabling keyless entry without the need to install additional input devices such as keyboards or microphones on the vehicle, and without the user carrying a physical key or virtual key.
[0012] Another embodiment of this application provides a control method, device, storage medium, and program product, wherein a piezoelectric vibrator assembly is installed on the vehicle to sense a tapping event to enable the input of a password to be verified, and a vehicle control command or a remote request command is executed when the password to be verified meets the control conditions, so that the user can control the vehicle outside the vehicle and improve the security of vehicle control.
[0013] Another embodiment of this application provides a control method, apparatus, storage medium, and program product, wherein the precision, flexibility, and security of control are improved by setting matching verification for keystroke events in combination with various control conditions such as character matching and region matching.
[0014] Another embodiment of this application provides a control method, apparatus, storage medium, and program product, wherein the security of control is improved by dual verification of tapping events and voice signals.
[0015] Another embodiment of this application provides a control method, apparatus, storage medium, and program product, wherein a tapping event automatically activates the auditory perception state of the second piezoelectric vibrator in the microphone assembly / piezoelectric vibrator assembly to collect voice signals, thereby improving the device's interactive convenience and user experience. Users can initiate the sound acquisition function without manual operation, achieving faster and more natural voice interaction. Yet another embodiment of this application provides a control method, apparatus, storage medium, and program product, wherein, in cases where the voice recognition result indicates an execution risk, the piezoelectric vibrator assembly senses and verifies the tapping event, thereby improving the accuracy and security of identity verification without increasing the user's burden, and thus improving the security and reliability of control.
[0016] Another embodiment of this application provides a control method, apparatus, storage medium, and program product, which can comprehensively consider multiple factors, effectively identify potential execution risks in voice signals, provide more accurate and reliable voice recognition results, and thereby improve user experience and security.
[0017] Another embodiment of this application provides a control method, apparatus, storage medium, and program product, wherein voice signals and tapping events are collected by a piezoelectric vibrator assembly, thereby achieving dual verification based on the piezoelectric vibrator assembly. This not only simplifies the system structure and reduces costs, but also improves the overall system performance and user experience. The reuse of the piezoelectric vibrator assembly can enhance security while enabling more flexible and intelligent user interaction methods.
[0018] Another embodiment of this application provides a control method, device, storage medium, and program product, wherein the user is prompted to input a voice signal or input a password to be verified by tapping through a piezoelectric vibrator assembly, thereby improving the user-friendliness and ease of operation of the system and making the user interaction experience more humanized.
[0019] Another embodiment of this application provides a control method, device, storage medium, and program product, wherein, when supplementary verification is required through a tapping event, the piezoelectric vibrator assembly prompts the user to input the password to be verified by tapping, and then seamlessly switches to a vibration sensing state to collect the electrical signal generated by the user's tapping for verification.
[0020] Another embodiment of this application provides a control method, apparatus, storage medium, and program product, which can simultaneously acquire electrical signals generated by a tapping event and user voice signals, improving the system's response speed and data processing capabilities while ensuring control security. Simultaneously, it allows users to speak voice commands while tapping, improving the convenience and efficiency of user interaction.
[0021] Another embodiment of this application provides a control method, device, storage medium, and program product, wherein, by intelligently completing voice commands, the situation of voice recognition errors or failures caused by incomplete voice signal reception when simultaneously sensing tapping events and collecting voice signals is reduced. This not only improves the user experience but also enhances the intelligence level of the system, bringing users a more convenient and efficient voice interaction experience.
[0022] To achieve one or more of the above objectives, the technical solution of this application embodiment is implemented as follows:
[0023] In a first aspect, embodiments of this application provide a control method applied to a control unit, the control unit being communicatively connected to a piezoelectric vibrator assembly. The method includes: sensing a tapping event through the piezoelectric vibrator assembly to obtain an electrical signal to be parsed; parsing the electrical signal to be parsed to obtain a password to be verified corresponding to the tapping event; and executing a control command corresponding to the satisfied control condition when the password to be verified satisfies a control condition.
[0024] Secondly, embodiments of this application further provide a vehicle control device, comprising: a piezoelectric vibrator assembly, a memory, and a processor; the piezoelectric vibrator assembly and the processor are communicatively connected; wherein the piezoelectric vibrator assembly is used to collect electrical signals; the memory stores a computer program that can run on the processor; and the processor executes the computer program to implement the aforementioned vehicle control method.
[0025] Thirdly, embodiments of this application further provide a computer-readable storage medium storing executable instructions thereon, which, when executed by a processor, implement the above-described vehicle control method.
[0026] Fourthly, an embodiment of this application provides a computer program product, including a computer program or instructions, which, when executed by a processor, implement the vehicle control method described above.
[0027] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of this application. Attached Figure Description
[0028] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with this application and, together with the specification, serve to explain the technical solutions of this application.
[0029] Figure 1A A system architecture diagram of a control system provided in an embodiment of this application;
[0030] Figure 1B A schematic diagram illustrating the implementation process of a control method provided in this application embodiment;
[0031] Figure 2 A schematic diagram of the implementation process of a control method provided in this application embodiment. Figure 2 ;
[0032] Figure 3A A schematic diagram illustrating the implementation process of a method for determining the generation region of an electrical signal according to an embodiment of this application;
[0033] Figure 3B A schematic diagram illustrating a scenario for the installation of a piezoelectric vibrator assembly, as provided in an embodiment of this application.
[0034] Figure 4 A schematic diagram of the implementation process of a control method provided in an embodiment of this application is shown in Figure 3.
[0035] Figure 5 A schematic diagram of the implementation process of a control method provided in this application embodiment. Figure 4 ;
[0036] Figure 6 A schematic diagram of the implementation process of a control method provided in this application embodiment. Figure 5 ;
[0037] Figure 7 This is a schematic diagram of the hardware entity of a control device provided in an embodiment of this application. Detailed Implementation
[0038] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application are further described in detail below with reference to the accompanying drawings and embodiments. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0039] In the following description, references to "some embodiments" refer to a subset of all possible embodiments. It is understood that "some embodiments" may be the same or different subsets of all possible embodiments and may be combined with each other without conflict. The terms "first / second / third" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first / second / third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.
[0040] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains. The terminology used herein is for descriptive purposes only and is not intended to limit the scope of this application.
[0041] With the continuous advancement of vehicle safety and convenience technologies, vehicle unlocking methods are undergoing innovation and transformation. However, existing unlocking technologies all face their own challenges. Keyless entry systems, as a mainstream technology, rely on wireless communication technologies such as RFID or Bluetooth, greatly improving user convenience. However, on the one hand, this solution still requires users to carry a smart terminal to unlock and start the vehicle; on the other hand, this solution is vulnerable to relay attacks, where attackers can intercept and forward communication signals to achieve unauthorized unlocking, seriously threatening vehicle security. To address this issue, some technologies use input panels or keyboards as unlocking methods, improving security by requiring password input. However, this method disrupts the vehicle's streamlined design and affects its overall aesthetics. Meanwhile, with the rapid development of voice recognition technology, some technologies use microphones to collect voice commands for unlocking, but the security of this method is highly questionable, as AI technology can simulate user voice, bypass verification mechanisms, and achieve unauthorized unlocking.
[0042] Figure 1A A system architecture diagram of a control system provided in this application embodiment includes an electronic device 110, a control unit 120, a microphone 130, and a piezoelectric vibrator assembly 140. The electronic device 110 can be, but is not limited to, a vehicle, smart home appliances, access control equipment, camera equipment, etc. The vehicle includes passenger vehicles such as SUVs, buses, trucks, and various commercial vehicles; water transport vehicles including various boats and ships, and aircraft; and includes hybrid vehicles, electric vehicles, hybrid electric vehicles, hydrogen-powered vehicles, and other alternative fuel vehicles (e.g., fuels derived from resources other than petroleum). Smart home appliances may include smart TVs, smart air conditioners, smart washing machines, smart speakers, smart rice cookers, cleaning equipment, smart body fat scales, lighting equipment, curtains, etc., without limitation. For example, Figure 1A The electronic device 110 in the picture is a vehicle.
[0043] The piezoelectric vibrator assembly 140 is disposed inside the housing of the electronic device 110. In some embodiments, the piezoelectric vibrator assembly 140 may include at least one first piezoelectric vibrator and at least one second piezoelectric vibrator. For example, as... Figure 1AAs shown, at least one first piezoelectric vibrator 141 and at least one second piezoelectric vibrator 142 can be disposed on the inner side of the door shell to detect the user's tapping action. A piezoelectric vibrator is a device that utilizes the piezoelectric effect to achieve energy conversion. When a piezoelectric material is subjected to external mechanical stress, such as compression, tension, or bending, its internal polarization intensity changes, thereby generating a measurable potential difference, i.e., voltage. This process realizes the conversion of mechanical energy into electrical energy, i.e., the piezoelectric effect. Correspondingly, when an electric field is applied to a piezoelectric material, the piezoelectric material will undergo mechanical deformation under the action of the electric field. This effect is the opposite of the piezoelectric effect; it is the process of converting electrical energy into mechanical energy, i.e., the inverse piezoelectric effect.
[0044] The electronic device 110 may also include a control unit 120, which is connected to the piezoelectric vibrator assembly 140. In some embodiments, the control unit 120 is used to receive electrical signals generated by the piezoelectric vibrator assembly 140; in other embodiments, the control unit 120 is also used to send electrical signals to the piezoelectric vibrator assembly 140 to control the piezoelectric vibrator assembly 140 to vibrate based on the inverse piezoelectric effect, thereby causing the outer casing panel to vibrate and produce sound.
[0045] The electronic device 110 may also include a microphone 130, and the control unit 120 is connected to the microphone 130 for receiving user voice commands. In some embodiments, the electronic device 110 is associated with a smart terminal 150. The smart terminal 150 may be a wearable device, smartphone, cloud server, smart speaker, personal computer (PC), laptop computer, all-in-one computer, PDA, tablet computer, or portable device, etc., and is not limited thereto. The control unit 120 may send remote request commands to the smart terminal 150, which may be, but are not limited to, communication requests, alarm information, vehicle information synchronization requests, and permission requests.
[0046] This application provides a control method that can be executed by a control unit. In some embodiments, the control unit is communicatively connected to a piezoelectric vibrator assembly. Both the control unit and the piezoelectric vibrator assembly are disposed in an electronic device. The control unit is used to control the electronic device in response to a tapping event. The piezoelectric vibrator assembly can be disposed at an appropriate location in the electronic device to receive the tapping event.
[0047] In some embodiments, the electronic device may refer to a server, laptop computer, tablet computer, desktop computer, smart TV, set-top box, mobile device (e.g., mobile phone, portable video player, personal digital assistant, dedicated messaging device, portable gaming device), vehicle, or other device with data processing capabilities.
[0048] Figure 1B A schematic diagram illustrating the implementation flow of a control method provided in this application embodiment is shown below. Figure 1B As shown, the method includes the following steps S101 to S103:
[0049] Step S101: Sensing the impact event through the piezoelectric vibrator assembly to obtain the electrical signal to be analyzed.
[0050] In some embodiments, the piezoelectric vibrator assembly described above may include at least one piezoelectric vibrator for converting mechanical stress (such as impact, vibration, etc.) into electrical energy (electrical signal). When the piezoelectric material in the piezoelectric vibrator is subjected to an external force, the charge distribution within it changes, thereby generating a potential difference on the material surface and forming an electrical signal.
[0051] The aforementioned tapping event refers to the interaction between an interactive object and an electronic device through a physical tapping action. In some implementation scenarios, this interaction behavior may involve the user tapping or striking the surface of the device with their hand, pen, or other object to trigger a specific function or operation. In some embodiments, the tapping event may be, but is not limited to, a single tap, continuous tapping, or tapping at a specific rhythm.
[0052] In the embodiments of this application, by measuring and analyzing these electrical signals, relevant information about the striking event, such as the striking location, force, and time, can be extracted, providing basic data for subsequent signal analysis and processing.
[0053] In some embodiments, the piezoelectric vibrator assembly is mounted inside the housing of the electronic device to detect the user's tapping action. When the user taps, the piezoelectric vibrator assembly is subjected to mechanical stress, generating an electric charge and converting it into an electrical signal to be analyzed. The control unit analyzes this electrical signal to complete subsequent control processes.
[0054] Step S102: Parse the electrical signal to be parsed to obtain the password to be verified corresponding to the tapping event.
[0055] The electrical signal to be analyzed is the output signal of the piezoelectric vibrator assembly. Since the electrical signal to be analyzed is generated in response to the knocking event, it carries relevant information about the knocking event and needs to be further analyzed to extract useful data or information.
[0056] In some embodiments, features can be extracted from the electrical signal to be analyzed based on a preset feature extraction algorithm to obtain feature information related to the tapping event; this feature information can then be directly used as the password to be verified corresponding to the tapping event. In other embodiments, after obtaining the feature information, the extracted feature information can be converted into the password to be verified based on a preset feature conversion method. Here, the feature information of the tapping event may include, but is not limited to, the frequency, intensity, duration, and interval of the tapping.
[0057] In some embodiments, the above-mentioned feature information can be extracted by the following scheme: using a peak detection algorithm, the maximum value or average value in the electrical signal to be analyzed is extracted as the intensity feature of the knocking event.
[0058] In other embodiments, the electrical signal to be analyzed can be analyzed first based on the waveform characteristics of the tapping, identifying the tapping waveform present in the signal, and then determining the number of taps and the time point of each tap in the tapping event. Thus, the frequency characteristic of the tapping event can be obtained by recording the number of taps per unit time; the duration characteristic can be obtained by recording the length of time from start to end of the tapping event; and when the tapping event involves multiple taps, the time point of each tap can be recorded, and the time difference between adjacent taps can be calculated as the interval time characteristic of the tapping event.
[0059] In other embodiments, the electrical signal to be analyzed is a pulse signal, and the characteristic information of the knocking event can be obtained directly from the parameters of the pulse signal. For example, the parameters of the pulse signal include, but are not limited to, the number of pulses, the pulse width, the pulse peak value, and the duty cycle. For instance, the number of knocks can be determined based on the number of pulses. Or, for example, the intensity of the knock can be determined based on the pulse width.
[0060] In some embodiments, the password to be verified may include characters; the extracted electrical signal feature information can be quantized and mapped to obtain the password to be verified corresponding to the tapping event. The electrical signal feature information can be parameters characterizing the electrical signal properties, such as frequency, intensity, pulse width, duration, and interval. The process of obtaining the password to be verified may include: using a pre-established mapping relationship between feature information and characters, converting the extracted feature information into corresponding characters, thereby obtaining the password to be verified corresponding to the tapping event.
[0061] To facilitate understanding of the above process of generating the password to be verified, the following will use a real-world scenario as an example to illustrate the above scheme.
[0062] Based on the aforementioned frequency characteristics, assuming that 2 taps per second correspond to the character "A", 3 taps per second correspond to the character "B", and 4 taps per second correspond to the character "C", then in the case where the user taps the device at a frequency of 3 taps per second, the control unit parses the tapping frequency and converts it into the character "B".
[0063] Based on the aforementioned intensity characteristics, assuming a light tap corresponds to the character "1", a medium tap corresponds to the character "2", and a heavy tap corresponds to the character "3", then in the case of a tapping event where the user taps the device with medium force, the control unit parses the tap intensity and converts it into the character "2". In some implementations, the tap intensity can be determined based on the pulse width of a pulse signal modulated by an electrical signal. Generally, the wider the pulse width, the greater the corresponding tapping force.
[0064] Based on the aforementioned duration characteristics, assuming a tap duration of 0.3 seconds corresponds to the character "D", 0.5 seconds corresponds to the character "E", and 0.7 seconds corresponds to the character "F", then when a tap event occurs where the user taps the device and maintains the tapping state for 0.5 seconds, the control unit parses the tap duration and converts it into the character "E".
[0065] Based on the aforementioned interval characteristics, assuming that 0.1 seconds corresponds to the character "G", 0.2 seconds corresponds to the character "H", and 0.3 seconds corresponds to the character "I", then when a user performs two taps with a 0.2-second interval between them, the control unit parses this interval and converts it into the character "H".
[0066] In some embodiments, at least two of the signal features described above can be combined to convert characters. The following example illustrates a scenario where character conversion is performed using Morse code rules.
[0067] In some embodiments, when a tapping event includes multiple taps, at least two of the aforementioned feature information can be extracted simultaneously, and the password to be verified can be generated based on the combination of these at least two feature information. It should be noted that the combination of feature information here includes two meanings: first, one tap corresponds to only one character, and the characters in the password to be verified can be determined by different feature information; second, one tap can correspond to multiple characters, and different characters are determined by different feature information of this tap; third, multiple taps correspond to one character.
[0068] For example, suppose the user taps the first time with medium force at second 0, lasting 0.3 seconds, then taps the second time with medium force at second 0.5, lasting 0.5 seconds, then taps the third time with light force at second 1.1, lasting 0.3 seconds, then taps the fourth time with medium force at second 1.6, lasting 0.3 seconds, and stops at second 1.9.
[0069] Using the first combination method, assuming the password to be verified consists of three digits, determined based on frequency, strength, and duration: the first digit is determined by the first two taps, with a tapping frequency of 2 taps per second, corresponding to the character "A"; the second digit is determined by the third tap, with a tapping force corresponding to the character "1"; and the third digit is determined by the fourth tap, with a duration of 0.3 seconds, corresponding to the character "D". Therefore, the password to be verified is "A1D". Of course, if the password to be verified contains a fourth digit determined by the interval time, it will be determined based on the fifth and sixth taps.
[0070] If we use the second combination method, assuming that each tap can be used to determine the corresponding character based on its intensity and duration, then, according to the above tapping action, after the first tap, based on the intensity and duration of the first tap, we can determine that the character corresponding to the first tap includes "2D". Then, based on the intensity and duration of the second tap, we can determine that the character corresponding to the second tap includes "2E", and so on, so that the password to be verified is "2D2E...".
[0071] If the third combination method is used, multiple taps in the tapping event can be divided into tapping combinations by the interval time, and the signal type corresponding to the tapping combination can be determined based on the number of taps in the tapping combination; finally, the corresponding character can be determined by using the signal type corresponding to one or more tapping combinations in the tapping event.
[0072] In some embodiments, a tapping interval threshold can be set, and this threshold can be used to divide each tap in a tapping event into multiple tapping combinations. For example, if there are 10 taps in a tapping event, and the tapping intervals between two adjacent taps are 0.5S, 0.3S, 0.2S, 0.5S, 0.3S, 0.3S, 0.5S, 0.3S, and 0.3S respectively, assuming the tapping interval threshold is 0.4S, then the first tap can be divided into the first tapping combination, the second to fourth taps into the second tapping combination, the fifth to seventh taps into the third tapping combination, and the eighth to tenth taps into the fourth tapping combination.
[0073] In some embodiments, the signal type corresponding to a tapping combination can be determined based on the number of taps included in the tapping combination. Here, the signal type can include short signals and long signals. For example, a tapping combination containing one tap can be determined as a short signal; a tapping combination containing three taps can be determined as a long signal. For example, the signal types corresponding to the first to fourth tapping combinations mentioned above are short signal, long signal, long signal, and long signal, respectively.
[0074] After obtaining the signal type corresponding to each keystroke combination, the corresponding character can be determined based on the signal types corresponding to multiple keystroke combinations. Continuing with the example above, if we refer to the conversion method of Morse code, the signal combination "short signal, long signal, long signal, long signal" can be converted into the character "J".
[0075] By adopting the above scheme, multiple taps are first divided into tap combinations based on the time interval between taps, and the signal type of the tap combination is determined by the number of taps included in the tap combination. Therefore, users can input the desired signal type of tap combination by tapping the number of taps. Compared with the scheme that controls the tapping duration of a single tap, the accuracy of user input can be improved. In addition, users only need to determine the number of rapid taps in a tap combination when inputting, making the input logic simpler and more convenient.
[0076] Step S103: If the password to be verified meets the control conditions, execute the control instruction corresponding to the met control conditions.
[0077] The control condition determines whether the password to be verified is valid or meets specific requirements. In some embodiments, the control condition may include the password length, character combination, generation time, generation area, etc. Understandably, different control commands require different passwords to be verified to trigger them. When the input password meets the preset control conditions, the corresponding control command is generated. This control command is a specific operation or command that the electronic device needs to perform when the password meets the control conditions. In some embodiments, the control command may include unlocking the device, opening an application, performing a specific function, etc.
[0078] In some embodiments, a mapping table between control conditions and control instructions can be preset. Different control conditions correspond to different control instructions. After obtaining the password to be verified, the mapping table will be automatically searched to determine the control conditions that the password to be verified satisfies, and then the control instructions that match the control conditions will be determined.
[0079] In this embodiment, a piezoelectric vibrator component senses a tapping event to input a password to be verified, and executes the corresponding control command when the password meets the control conditions, so that the user can input control commands even if they forget to bring the control device.
[0080] Figure 2 This is a schematic diagram of the implementation flow of a control method provided in an embodiment of this application. Figure 2 This method can be executed by the processor of a computer device. Based on Figure 1B The password to be verified includes at least one character, and each character corresponds to a set of character electrical signals; Figure 1B Step S102 can be updated to steps S201 to S202, combining Figure 2 The steps shown are explained.
[0081] Step S201: Analyze the electrical signal to be analyzed to obtain at least one set of character electrical signals.
[0082] The password to be verified refers to the password generated based on the tapping event and used for subsequent verification. In this embodiment, the password to be verified consists of at least one character, each character corresponding to a specific set of character electrical signals. These character electrical signals are obtained by parsing the electrical signals to be parsed generated by the tapping event.
[0083] In some embodiments, the electrical signal to be parsed may include multiple electrical signals, each of which may correspond to one tap in a tapping event; a set of character electrical signals may include at least one electrical signal, that is, a set of character electrical signals may correspond to at least one tap in a tapping event. For example, a pulse electrical signal that reaches a preset pulse width corresponds to one tap, and multiple pulse electrical signals that reach a preset pulse width correspond to multiple taps.
[0084] In some embodiments, a set of character electrical signals may include a single electrical signal. Accordingly, the above-described parsing of the electrical signal to be parsed to obtain at least one set of character electrical signals can be implemented as follows: detecting feature change points in the electrical signal to be parsed, and dividing the electrical signal to be parsed into multiple independent electrical signals based on the feature change points, each electrical signal corresponding to a tap in a tapping event. Here, each independent electrical signal corresponds to a set of character electrical signals.
[0085] In other embodiments, a set of character electrical signals may include at least two electrical signals. Accordingly, the above-described parsing of the electrical signal to be parsed to obtain at least one set of character electrical signals can be implemented in the following way: detecting signal segmentation points in the electrical signal to be parsed, and dividing the electrical signal to be parsed into multiple electrical signal segments based on the signal segmentation points, each electrical signal segment may correspond to electrical signals generated by one or more tapping actions in a tapping event; then, detecting feature change points in each electrical signal segment, and dividing each electrical signal segment into multiple independent electrical signals based on the feature change points.
[0086] It is understandable that the signal segmentation points and feature change points mentioned above are all points in the electrical signal to be analyzed that reflect the feature changes of the electrical signal. The difference is that the degree of feature change at the signal segmentation point is greater than the degree of feature change at the feature change point.
[0087] In some embodiments, the signal segmentation point and characteristic change point can be determined using the time interval between peaks in the electrical signal (i.e., between two strikes). That is, a time point (which can be the midpoint) between two peaks is used as the signal segmentation point and the characteristic change point. The time interval at the signal segmentation point is greater than the time interval at the characteristic change point.
[0088] In other embodiments, the signal segmentation point can also be determined based on the region where the electrical signal (tapping) is generated.
[0089] In other embodiments, the signal segmentation point and feature change point can also be determined using the impact intensity, wherein the difference in impact intensity before and after the signal segmentation point is greater than the difference in impact intensity before and after the feature change point.
[0090] Step S202: Determine the password to be verified corresponding to the tapping event according to the preset mapping relationship between character electrical signals and characters.
[0091] In this embodiment, feature extraction is performed on each segmented electrical signal to obtain feature information in at least one dimension (which may include frequency, intensity, duration, interval, etc.). This feature information can reflect different aspects of the tapping event. Finally, according to a preset character electrical signal feature library, the extracted feature information is matched with the character electrical signal features in the feature library to determine the character corresponding to each electrical signal; or, the feature information of at least two consecutive taps is matched with the character electrical signal features in the feature library to determine the character corresponding to these at least two taps.
[0092] In some embodiments, after obtaining the characters corresponding to each group of character electrical signals, the obtained characters can be combined to obtain the password to be verified corresponding to the tapping event. This can be achieved by using the time sequence of each group of character electrical signals to sort and combine the corresponding characters to obtain the password to be verified; alternatively, the set of characters can be directly used as the password to be verified, where there is no specific order among the characters.
[0093] In some implementation scenarios, the mapping process from a group of character electrical signals to a single character can be a Morse code mapping process. The basic components of Morse code are dots and dashes. In this embodiment, a dot is designed as a short signal, i.e., the electrical signal generated by a single tap, while a dash is a long signal, with a tap duration three times that of a dot, i.e., the electrical signal generated by three consecutive taps. In this scenario, the method of dividing different groups of character electrical signals can utilize the switching of tapping areas or specific time intervals to separate adjacent characters.
[0094] For example, if a set of character signals includes a short signal followed by a long signal (i.e., "—"), it can be determined that this is the Morse code representation of the letter A based on the mapping relationship. Similarly, if a set of character signals is detected to include three short signals and one long signal (i.e., "—···"), it will be identified as the letter B.
[0095] In this embodiment, the electrical signal to be parsed is converted into a password to be verified by a preset mapping relationship between character electrical signals and characters, which increases the encryption effect of the tapping event and improves the security of control command input based on the tapping event.
[0096] In some embodiments, the electrical signal to be parsed includes a plurality of electrical signals received sequentially; the above-mentioned parsing of the electrical signal to be parsed can be achieved through step S2011 to obtain at least one set of character electrical signals.
[0097] Step S2011: Based on the comparison result of the signal attributes of two continuously received electrical signals, the electrical signal to be parsed is split to obtain at least one set of character electrical signals.
[0098] The signal attributes include at least one of the following: the generation area of the electrical signal, the reception time of the electrical signal, and the intensity of the electrical signal; the generation area is the area where the piezoelectric vibrator assembly that generates the electrical signal is located.
[0099] The signal generation area is the area where the piezoelectric vibrator assembly (or piezoelectric vibrator) that generates the signal is located. The signal generation area can be used to distinguish the signal generated at different striking positions.
[0100] The reception time of the electrical signal is the point in time when the electrical signal is received and recorded by the processor. In the electrical signal generated by the striking action, the reception time can be used to determine the order in which the striking actions occur and the time interval between different striking actions.
[0101] The intensity of an electrical signal can be its amplitude, pulse width, or other parameters used to characterize its energy. In the electrical signal generated by a striking action, the intensity reflects the force or energy of the strike. Generally, the greater the striking force, the higher the intensity of the generated electrical signal. Therefore, the intensity of the electrical signal can be used to distinguish between different forces or types of striking actions.
[0102] In some embodiments, step S2011 can be implemented as follows: sequentially compare the signal attributes of two adjacent electrical signals. If the attribute difference between two adjacent electrical signals exceeds a preset threshold, it is considered that there may be a boundary between these two electrical signals as character electrical signals. Based on this judgment, the electrical signal to be parsed can be divided into multiple independent electrical signal segments. Then, at least one electrical signal in each electrical signal segment corresponds to a set of character electrical signals.
[0103] In this embodiment of the application, by comparing the signal attributes of adjacent electrical signals, the boundary of the character electrical signal can be accurately determined, thereby reducing the occurrence of recognition errors or recognition failures caused by segmentation errors of the character electrical signal.
[0104] The following will use time characteristics as an example to decompose the electrical signal to be parsed into at least one set of character electrical signals. In some embodiments, the decomposition of the electrical signal to be parsed into at least one set of character electrical signals based on the comparison result of the signal attributes of two consecutively received electrical signals includes: in response to determining that the time difference between the reception time of the previous electrical signal and the reception time of the subsequent electrical signal is greater than or equal to a preset first time difference threshold, taking the previous electrical signal as the last electrical signal of the previous set of character electrical signals, and taking the subsequent electrical signal as the first electrical signal of the next set of character electrical signals.
[0105] The first time difference threshold is a preset time interval value used to determine whether two consecutively received electrical signals belong to the same group of character signals. When the reception time difference between the two electrical signals is greater than or equal to the threshold, they are considered not to belong to the same group of character signals.
[0106] In some embodiments, the step of splitting the electrical signal to be parsed based on the comparison result of the signal attributes of two consecutively received electrical signals to obtain at least one set of character electrical signals includes: in response to the fact that no new electrical signal is received within a second time difference threshold after the reception time of the current electrical signal is determined, the current electrical signal is taken as the last electrical signal of the last set of character electrical signals; the second time difference threshold is greater than the first time difference threshold.
[0107] The second time difference threshold is another preset time interval value used to determine whether it is necessary to continue receiving and parsing a new set of character signals. If no new signal is received within this threshold time after the current signal is received, it is considered that it is not necessary to continue receiving and parsing a new set of character signals. The current signal is the last signal of the last set of character signals in the current tapping event. The second time difference threshold is greater than the first time difference threshold. It can be understood that the setting of the second time difference threshold can be used to end the current parsing process.
[0108] For example, suppose the signal to be parsed includes four consecutive electrical signals A, B, C, and D, with reception times of T1, T2, T3, and T4, respectively. If the preset first time difference threshold is 0.3 seconds, the second time difference threshold is 1 second, and T2-T1 = 0.1 seconds, T3-T2 = 0.4 seconds, and T4-T3 = 1.1 seconds, then A and B will be considered to belong to the same group of character signals, C will be the first signal of a new group of character signals, and since D appears 1.1 seconds after C, and no new signal is received within 0.3 seconds after C, C will be considered the last signal of the last group of character signals in the currently input password to be verified. Ultimately, the signal to be parsed is split into two groups of character signals: [A, B] and [C]. Understandably, D can be the first signal of the first group of character signals that triggers the next round of interaction, or it can be considered an invalid signal and blocked or filtered.
[0109] In this embodiment, by determining whether the time difference between the reception times of the previous and subsequent electrical signals is greater than or equal to a preset first time difference threshold, the electrical signals can be flexibly divided into different groups of character electrical signals. This ensures that the electrical signals within each group are closely related in time, while there is a clear separation between groups. Simultaneously, by monitoring whether a new electrical signal is received within a second time difference threshold after the current electrical signal is received, it can be determined whether the current electrical signal is the last electrical signal of the last group of character electrical signals in the tapping event, thus ending the entire parsing process. Therefore, setting a second time difference threshold helps avoid long waiting times to confirm whether a new electrical signal has been received, thereby improving response efficiency and optimizing the user experience.
[0110] The following will use regional features as an example to decompose the electrical signal to be parsed, obtaining at least one set of character electrical signals. In some embodiments, the piezoelectric vibrator assembly includes at least two first piezoelectric vibrators disposed in different regions, and the method further includes: in response to receiving a first electrical signal from a first piezoelectric vibrator located in a target region, determining the first electrical signal as the first electrical signal of a first set of character electrical signals, wherein the target region is a pre-defined region among the different regions.
[0111] The target area refers to one or more specific areas pre-defined within the aforementioned different areas. When a piezoelectric vibrator located within the target area receives a strike, it generates an electrical signal, which serves as the first electrical signal of the first set of character electrical signals corresponding to the strike event.
[0112] In some embodiments, a target area can be preset, and the electrical signal output of each piezoelectric vibrator on the piezoelectric vibrator assembly can be monitored. When the first electrical signal of the first piezoelectric vibrator located in the target area is received, the signal is marked as the first electrical signal of the first group of character electrical signals.
[0113] For example, suppose the piezoelectric vibrator assembly includes piezoelectric vibrators disposed in two different regions, A and B. Region A is preset as the target region. When a user taps the piezoelectric vibrator in region A with their finger, the piezoelectric vibrator generates an electrical signal, which is recognized as the first electrical signal of the first set of character electrical signals.
[0114] In some embodiments, electrical signals received in non-target areas may not be parsed or responded to before being received through the target area. Based on the above characteristics, tapping events in non-target areas can be regarded as masks, increasing the difficulty of tapping passwords being leaked or imitated.
[0115] In some embodiments, the target area can be switched in response to a user's change command. That is, the user can periodically change the target area, thereby increasing the complexity of the password and thus improving security.
[0116] In some embodiments, when there are at least two target regions, when the control unit receives the first electrical signal from the piezoelectric vibrator located in any one of the target regions, this electrical signal is determined as the first electrical signal of the current striking event. From this point onward, subsequent electrical signals from the same or different target regions, or from non-target regions, cannot be considered the first electrical signal of a striking event, until a certain condition is met indicating that the striking event has ended.
[0117] It is important to note that if, after receiving the first electrical signal in the target area, another electrical signal is received from the same or a different area within a short period (i.e., the time difference between the reception time of the previous electrical signal and the reception time of the next electrical signal is less than a preset first time difference threshold), these signals will be considered part of the current tapping event and added to the first set of character electrical signals. If, after receiving the first electrical signal, the control unit does not receive any new electrical signals for a relatively long period (i.e., no new electrical signals are received within the second time difference threshold after the reception time of the current electrical signal), it determines that the current tapping event has ended and prepares to receive the signal for the next tapping event.
[0118] In this embodiment of the application, by using the sensing of a tapping event occurring in the target area as a trigger identifier for parsing the electrical signal to be parsed, it is easy to distinguish between tapping events that need to be verified and those that do not.
[0119] In some embodiments, the step of splitting the electrical signal to be parsed based on the comparison result of the signal attributes of two consecutively received electrical signals to obtain at least one set of character electrical signals includes: in response to determining that the generation regions of the two consecutively received electrical signals belong to different regions, taking the previous electrical signal as the last electrical signal of the previous set of character electrical signals and taking the next electrical signal as the first electrical signal of the next set of character electrical signals.
[0120] For example, suppose a user first strikes the piezoelectric vibrator in area A, generating signal S1, and then quickly strikes the piezoelectric vibrator in area B, generating signal S2. Since S1 and S2 are generated from different areas (areas A and B), the control unit will treat S1 as the last signal of the previous group of character signals, and S2 as the first signal of the next group of character signals. In this way, the control unit successfully divides two consecutive signals from different areas into two different groups of character signals.
[0121] In some embodiments, in response to determining that the generation regions of two consecutively received electrical signals belong to the same region, both the preceding and following electrical signals are included as part of the current character signal group.
[0122] In this embodiment, a region-varying electrical signal grouping strategy enhances the ability to recognize and process complex tapping patterns, thereby enabling more accurate segmentation of character electrical signals and providing an accurate data foundation for subsequent mapping of the password to be verified. Simultaneously, this method reduces the accuracy requirements of user tapping operations.
[0123] Figure 3AThis is a schematic flowchart illustrating the implementation of a method for determining the generation region of an electrical signal according to an embodiment of this application. This method can be executed by a processor of a computer device. (The last sentence appears to be incomplete and possibly refers to a separate, unrelated point.) Figure 3A The steps shown are explained.
[0124] Step S301: Obtain the signal transmission interface for receiving the electrical signal.
[0125] In some embodiments, the piezoelectric vibrator assembly includes piezoelectric vibrators disposed in different regions. Piezoelectric vibrators located in the same region can transmit electrical signals to the control unit through the same signal transmission interface, while piezoelectric vibrators located in different regions can transmit electrical signals to the control unit through different signal transmission interfaces. While receiving the electrical signals transmitted by the piezoelectric vibrator assembly, the control unit also acquires information about the signal transmission interface receiving the electrical signals, in order to subsequently determine the region where the electrical signals are generated, i.e., the region where the piezoelectric vibrator receiving the electrical signals is located.
[0126] Step S302: Determine the generation area of the electrical signal based on the setting area of the piezoelectric vibrator assembly connected to the signal transmission interface.
[0127] In some embodiments, the control unit may pre-store a mapping table or database that records the correspondence between signal transmission interfaces and the setting areas of piezoelectric resonator components. By matching the information of the current signal transmission interface, the control unit can determine the generation area of the electrical signal.
[0128] In this embodiment, based on the signal transmission interface information of the electrical signal received by the control unit and the setting area of the piezoelectric vibrator assembly, the generation area of the electrical signal can be accurately and quickly determined, thereby enhancing the ability to identify and distinguish complex knocking events.
[0129] In some embodiments, the piezoelectric resonator assembly includes at least two piezoelectric resonators, each transmitting an electrical signal through a corresponding signal transmission interface, and different piezoelectric resonators correspond to different signal transmission interfaces. Based on this, the piezoelectric resonator that generates the electrical signal can be determined based on the signal transmission interface corresponding to the electrical signal, thereby determining the signal generation region. The at least two piezoelectric resonators can be of the same type or at least two types; this embodiment does not limit this.
[0130] In some embodiments, the piezoelectric vibrator assembly includes at least one first piezoelectric vibrator and at least one second piezoelectric vibrator. The at least one first piezoelectric vibrator includes at least one independent piezoelectric vibrator. The area where the independent piezoelectric vibrator is located does not have a second piezoelectric vibrator. The at least one first piezoelectric vibrator transmits electrical signals through the same first signal transmission interface, and the at least one second piezoelectric vibrator transmits electrical signals through different second signal transmission interfaces.
[0131] Please see Figure 3B A schematic diagram illustrating the setup scenarios for the provided piezoelectric resonator assembly. (For example...) Figure 3B As shown, the piezoelectric vibrator assembly includes n first piezoelectric vibrators, including 311 (first piezoelectric vibrator) to 3n1 (independent piezoelectric vibrator). In addition to the independent piezoelectric vibrator 3n1, at least one second piezoelectric vibrator is provided in the region where the other first piezoelectric vibrators (also called non-independent piezoelectric vibrators) are located. Only the region where the independent piezoelectric vibrator 3n1 is located does not have a second piezoelectric vibrator.
[0132] In this embodiment, the first piezoelectric vibrators 311 to 3n1 all transmit electrical signals to the control unit (not shown in the figure) through a first signal transmission interface (e.g., signal transmission interface 30); while at least one second piezoelectric vibrator transmits electrical signals through a different second signal transmission interface. For example, the second piezoelectric vibrator 312 transmits electrical signals through signal transmission interface 31, the second piezoelectric vibrator 322 transmits electrical signals through signal transmission interface 32, and so on.
[0133] In some embodiments, the first piezoelectric vibrators 311 to 3n1 are a group of first piezoelectric vibrators, each connected to a single signal transmission interface (i.e., signal transmission interface 30). Of course, the piezoelectric vibrator assembly may also include a second to an nth group of first piezoelectric vibrators. Different groups of first piezoelectric vibrators transmit electrical signals through different signal transmission interfaces. Each group of first piezoelectric vibrators transmits electrical signals through a single signal transmission interface. Specifically, the second group of first piezoelectric vibrators can transmit electrical signals through signal transmission interface 31, the third group of first piezoelectric vibrators can transmit electrical signals through signal transmission interface 32, and so on.
[0134] In some embodiments, the signal transmission interface may be an I / O interface.
[0135] In some embodiments, the operating state of the first piezoelectric vibrator may include a vibration sensing state, and the operating state of the second piezoelectric vibrator may include a vibration sensing state, a sound sensing state, and a sound generation state. Accordingly, the hardware circuits connected to the first and second piezoelectric vibrators are also different. For example, the first piezoelectric vibrator may be connected to a vibration sensing circuit or a pulse modulation circuit, which receives and processes the electrical signal generated by the piezoelectric vibrator based on the elastic wave signal; while the second piezoelectric vibrator can switch between at least three circuits through a selection circuit or a combination of switches, etc., and the three circuits may include, but are not limited to: 1. a vibration sensing circuit or a pulse modulation circuit; 2. a sound sensing circuit; 3. a sound generation circuit / audio output circuit.
[0136] It is understandable that, considering that increasing the number of piezoelectric vibrators in the same area can improve the sensitivity and uniformity of the striking position, in this embodiment of the application, while setting a second piezoelectric vibrator, a first piezoelectric vibrator is set for each area, which can assist the second piezoelectric vibrator in vibration sensing and improve the sensitivity and uniformity of the striking event.
[0137] In some embodiments, determining the generation region of the electrical signal based on the setting region of the piezoelectric vibrator assembly connected to the signal transmission interface may include: determining the generation region of the electrical signal based on the type and setting region of the piezoelectric vibrator assembly connected to the signal transmission interface.
[0138] Here, the type of piezoelectric vibrator assembly refers to whether the piezoelectric vibrator in the assembly is a first piezoelectric vibrator or a second piezoelectric vibrator; the different setting areas are not directly connected, thus, the transmission of vibration can be blocked. Considering the above factors, it is necessary to set a corresponding piezoelectric vibrator for each different setting area in order to detect the impact event located in different setting areas. For example, the different setting areas can be different panels of the vehicle body.
[0139] In some embodiments, steps S3021 and S3022 can be used to determine the type and setting area of the piezoelectric vibrator assembly connected to the signal transmission interface, and to determine the generation area of the electrical signal.
[0140] Step S3021: In response to determining that both the first signal transmission interface and the second signal transmission interface have received electrical signals, the region where the second piezoelectric vibrator corresponding to the second signal transmission interface that received the electrical signal is located is determined as the region where the electrical signal is generated.
[0141] Continue reading Figure 3BWhen both the first signal transmission interface 30 and the second signal transmission interface 31 receive an electrical signal, the determination area 1 is the region where the electrical signal is generated; similarly, when both the first signal transmission interface 30 and the second signal transmission interface 3k receive an electrical signal, the determination area k is the region where the electrical signal is generated, where k is a positive integer less than n.
[0142] Step S3022: In response to determining that only the first signal transmission interface receives an electrical signal, the region where the independent piezoelectric vibrator is located is determined as the region where the electrical signal is generated.
[0143] Continue reading Figure 3B If an electrical signal is received at the first signal transmission interface 30 and no electrical signal is received at any of the second signal transmission interfaces, then the determination region n is the region where the electrical signal was generated.
[0144] In this embodiment of the application, by combining the reception of the first signal transmission interface and the second signal transmission interface, accurate perception and detailed division of the tapping position can be achieved, while improving the system's reliability and accidental touch recognition capability.
[0145] In some implementation scenarios, the control method provided in this application can be an unlocking method, wherein the control command includes an unlocking command, which is used to release the locked state of the object managed by the control unit.
[0146] In the current scenario, the control command is an unlock command, which unlocks an object managed by the control unit. This object can be any physical or virtual resource that requires a password or authentication to access. In some embodiments, the object can be an electronic device, such as a smartphone, tablet, or electronic lock.
[0147] In this embodiment, when the piezoelectric vibrator component senses a tapping event and generates an electrical signal to be parsed, the signal is parsed into a password to be verified. If the password matches preset control conditions, the control unit executes the corresponding unlocking command, thereby releasing the locked state of the object managed by the control unit. It is understood that the control unit and the object it manages can be the same device or two separate devices.
[0148] In this embodiment, a piezoelectric vibrator component senses a tapping event to input and verify a password. Upon successful verification, an unlocking command is executed, enabling secure device unlocking without the use of traditional physical keys or wireless communication technologies. This avoids security risks such as lost keys and relay attacks, while providing convenience for users who can easily access locked resources by meeting preset conditions. Furthermore, by installing a piezoelectric vibrator component on the vehicle to sense tapping events and input a password, and then executing an unlocking command when the password meets control conditions, keyless entry is achieved without the need for additional input devices such as keyboards or microphones, and without the user carrying a physical or virtual key.
[0149] In some embodiments, the object is a vehicle, and the control command further includes at least one of the following: a vehicle control command, which is used to control the operating state of the vehicle components of the vehicle; and a remote request command, which is used to send a remote request to the associated electronic equipment of the vehicle.
[0150] Among them, vehicle control commands are used to perform at least one of the following controls: component control, vehicle system control, and settings of the control system itself.
[0151] In some embodiments, the above-mentioned component control is a process of controlling components inside and outside the vehicle, including but not limited to: headlights, windows, air conditioning, etc.; correspondingly, the corresponding vehicle control commands can be to start or stop the headlights, adjust the window lifting, set the air conditioning temperature, etc.
[0152] In some embodiments, the control of the vehicle system is the control of a subsystem within the vehicle that performs a specific function, wherein the subsystem may consist of multiple components. For example, the subsystem may include a vehicle energy system, and correspondingly, its vehicle control command may be a power-off command, etc.; the subsystem may also be a power steering system, and correspondingly, its vehicle control command may be activating / deactivating a vehicle follow mode, etc.
[0153] In some embodiments, the control system itself can be configured as control commands to the piezoelectric component. For example, controlling the piezoelectric component to switch between a vibration sensing state, a sound sensing state, and a sound-generating state. Another example is adjusting the volume of the piezoelectric component in the sound-generating state. Yet another example is switching the sensitivity of the piezoelectric component in the vibration sensing state.
[0154] The remote request command is sent by the control unit to the electronic devices associated with the vehicle (which can be understood as...). Figure 1A This refers to an instruction sent by a smart terminal within the vehicle. Electronic devices associated with the vehicle can include smartphones, tablets, cloud servers, smart speakers, etc.
[0155] In some embodiments, the remote request instruction may include at least one of the following: a communication request, an alarm message, a vehicle information synchronization request, and a permission request.
[0156] This communication request refers to a request to establish a communication connection, used to enable data transmission between two or more devices. In the interaction between a vehicle and electronic devices, this communication request is for the vehicle to request a call connection with the electronic device in order to conduct voice or video calls.
[0157] The alarm information refers to an emergency notification generated by the vehicle and sent to electronic devices when an abnormal situation occurs (such as a collision, malfunction, illegal intrusion, or a pet / child being locked inside the vehicle). In some embodiments, the alarm information may include detailed information about the abnormal situation so that the recipient can take timely countermeasures.
[0158] The vehicle information synchronization request is used to synchronize relevant vehicle information to electronic devices. This information may include real-time status data, such as vehicle location, speed, remaining fuel / battery level, and door status; it may also include multimedia information synchronization, such as audio and video, and video captured by in-vehicle cameras / dashcams.
[0159] In this embodiment, a permission request is sent by the vehicle to an electronic device before performing a specific operation or accessing a specific resource. The electronic device decides whether to grant permission based on user authorization and security policies. If permission is granted, the vehicle can continue to perform the operation; if permission is denied, the operation will be aborted. In this embodiment, a piezoelectric vibrator component is installed on the vehicle to sense tapping events to enable the input of a password to be verified. If the password to be verified meets the control conditions, vehicle control commands or remote request commands are executed, allowing the user to control the vehicle from outside the vehicle and improving the security of vehicle control.
[0160] In some embodiments, the password to be verified includes at least one character, and the control conditions include: the password to be verified conforms to a preset control character corresponding to a control instruction, and / or the generation area of the character electrical signal corresponding to each character conforms to the preset area of the preset control character.
[0161] In some embodiments, the control conditions can be met by the password to be verified including at least one character that is the same as the preset control character corresponding to the control instruction.
[0162] For example, suppose the preset control characters include "ABC", which correspond to preset regions "region 1, region 2, and region 3" respectively. The parsed password to be verified is also "ABC", which corresponds to generation regions "region 3, region 1, and region 2" respectively. In this case, although the generation regions of each character are different, the password to be verified matches the preset control characters corresponding to the control instruction, and therefore, the control condition is satisfied.
[0163] In other embodiments, the control conditions can be satisfied by the generation area of each character in at least one of the characters in the password to be verified being the same as the preset area of each preset control character in the preset control character corresponding to the control instruction.
[0164] For example, suppose the preset control characters include "ABC", with their corresponding preset regions being "Region 1, Region 2, and Region 3" respectively. The parsed password to be verified is "83g" (or any three other characters), with their corresponding generation regions being "Region 1, Region 2, and Region 3" respectively. In this case, although the password to be verified does not conform to the preset control characters corresponding to the control instruction, the generation region of each character is the same as the preset region of each preset control character. Therefore, the control condition is satisfied.
[0165] In some other embodiments, the control conditions can be met by the fact that at least one character in the password to be verified is the same as a preset control character corresponding to the control instruction, and the generation area of each character is the same as the preset area of each preset control character.
[0166] For example, suppose the preset control characters include "ABC", with their corresponding preset areas being "Area 1, Area 2, and Area 3" respectively. The parsed password to be verified is "ABC", with its corresponding generation areas being "Area 1, Area 2, and Area 3" respectively. It can be seen that the password to be verified conforms to the preset control characters corresponding to the control instruction, and the generation area of each character is the same as the preset area of each preset control character. Therefore, the control condition is satisfied.
[0167] In this embodiment, by setting matching verification for the tapping event using a combination of character matching and region matching and other control conditions, the precision, flexibility and security of the control are improved.
[0168] Figure 4 This is a schematic diagram of the implementation flow of a control method provided in an embodiment of this application. This method can be executed by the processor of a computer device. Based on... Figure 1B The control unit is communicatively connected to the sound acquisition component; before executing the control command, the method further includes step S401; Figure 1B Step S103 can be updated to step S402, combining Figure 4 The steps shown are explained.
[0169] Step S401: Acquire the first voice signal through the sound acquisition component.
[0170] In some embodiments, the control unit is communicatively connected to a sound acquisition component and a piezoelectric vibrator component, and is used to receive a first voice signal acquired by the sound acquisition component and an electrical signal to be parsed acquired by the piezoelectric vibrator component. The sound acquisition component is used to acquire the voice signal so as to perform voice recognition and verification while verifying the password to be verified.
[0171] In some embodiments, the acquisition of the first voice signal by the sound acquisition component can be achieved through step S4011.
[0172] Step S4011: While sensing the knocking event through the piezoelectric vibrator assembly, the first voice signal is acquired through the sound acquisition assembly.
[0173] In some implementation scenarios, the piezoelectric vibrator component is in a sensing state and can activate the sound acquisition component in response to the tapping event to acquire the first voice signal; in other implementation scenarios, the sound acquisition component is in an active state or in a sensing state and can also activate the vibration sensing state of the piezoelectric vibrator component in response to the acquisition of the first voice signal to sense the tapping event; in still other embodiments, both the piezoelectric vibrator component and the sound acquisition component are in an active state or in a sensing state.
[0174] For example, when a user taps the exterior surface of the vehicle and simultaneously utters a preset voice command, the piezoelectric vibrator assembly senses the tapping event and generates an electrical signal to be analyzed, while the sound acquisition assembly captures the user's first voice signal. The electrical signal to be analyzed and the first voice signal are transmitted to the vehicle's control unit for recognition and processing. If both the electrical signal to be analyzed and the first voice signal meet preset control conditions (such as tapping force, number of taps, and voice command content), the vehicle will execute the corresponding control command (such as unlocking).
[0175] Step S402: If both the first voice signal and the password to be verified meet the control conditions, execute the control command corresponding to the met control conditions.
[0176] In some embodiments, for the password to be verified, the control conditions may include the password length, character combination, generation time, etc.; for the first voice signal, the control conditions may include the clarity of the voice, volume, speech rate, specific voice command content, or the matching degree between the voice signal and a preset voice template, etc.
[0177] In some embodiments, a mapping table between control conditions and control commands can be preset. This mapping table not only contains the correspondence between the control conditions of the password to be verified and the corresponding control commands, but also extends to the control conditions of the first voice signal. When the control unit detects that both the password to be verified and the first voice signal meet their respective control conditions, it will automatically search for a matching control command in the mapping table and trigger its execution.
[0178] In this embodiment of the application, in addition to requiring the password to be verified to meet the control conditions, the first voice signal must also meet the control conditions in order to execute the control command corresponding to the met control conditions. This dual verification method greatly improves security.
[0179] In some embodiments, the sound acquisition component includes at least one of the following: a microphone component, a second piezoelectric vibrator in the piezoelectric vibrator component; the operating state of the second piezoelectric vibrator includes a sound perception state.
[0180] The microphone component uses principles such as electromagnetic induction or capacitance to convert sound waves into electrical signals.
[0181] The piezoelectric vibrator assembly further includes a second piezoelectric vibrator, whose operating states include a sound perception state. In some embodiments, the operating states of the second piezoelectric vibrator may also include a vibration perception state and a sound generation state.
[0182] Both the sound perception state and the vibration perception state utilize the piezoelectric effect to convert the deformation of piezoelectric materials into electrical signals. In the sound perception state, the second piezoelectric vibrator functions as a sound sensor. When sound waves act on the second piezoelectric vibrator, they cause deformation of the piezoelectric material, resulting in changes in charge or voltage, which are then converted into electrical signals and output to the sound perception circuit for further processing. In the vibration perception state, the second piezoelectric vibrator also utilizes the piezoelectric effect to sense external vibrations. The difference is that the collected electrical signals are used as the signals to be analyzed, and then deciphered into the password to be verified.
[0183] In the sound-generating state, the second piezoelectric oscillator operates using the inverse piezoelectric effect. When a piezoelectric material is subjected to an electric field, it undergoes mechanical deformation, thereby producing sound. By controlling the strength and direction of the electric field, parameters such as the frequency, amplitude, and waveform of the sound can be precisely controlled.
[0184] In some embodiments, before acquiring a user's first voice signal through the sound acquisition component, the method further includes at least one of the following: activating the microphone component in response to sensing a tapping event through the piezoelectric vibrator component; and activating the auditory perception state of the second piezoelectric vibrator in response to sensing a tapping event through the piezoelectric vibrator component.
[0185] In some embodiments, when the piezoelectric vibrator assembly detects a knocking event, it sends a signal to the control unit. Upon receiving the signal, the control unit executes a preset activation command to put the microphone assembly into working state and begin collecting sound signals. In other embodiments, when the piezoelectric vibrator assembly detects a knocking event, the control unit sends a switching command to the second piezoelectric vibrator to switch it to the sound perception state (i.e., switch the output to the sound perception circuit). Subsequently, the second piezoelectric vibrator begins to capture and convert sound waves into electrical signals and outputs the collected electrical signals to the sound perception circuit.
[0186] In this embodiment, the second piezoelectric vibrator in the microphone assembly / piezoelectric vibrator assembly is automatically activated by a tapping event to collect voice signals, thereby improving the device's interactive convenience and user experience. Users can start the sound collection function without manual operation, achieving faster and more natural voice interaction.
[0187] Figure 5 This is a schematic diagram of the implementation flow of a control method provided in an embodiment of this application. Figure 4 This method can be executed by the processor of a computer device. Based on Figure 1B , Figure 1B Step S101 can be updated to steps S501 to S502, combining Figure 5 The steps shown are explained.
[0188] Step S501: Recognize the first speech signal to obtain the recognition result.
[0189] The recognition result is used to characterize whether the first voice signal was issued by a real user.
[0190] In some embodiments, biometric features can be extracted from the first speech signal, and then the authenticity of the speech can be determined based on these biometric features. Specifically, during the training phase, speech features of real users can be collected and learned to build a voiceprint model of the real user. During the recognition phase, features are extracted from the input first speech signal and compared with the voiceprint model of the real user. If the feature matching degree is high, the speech is determined to be spoken by a real user.
[0191] In other embodiments, the user's speech behavior patterns can be extracted from the first speech signal, and then used to identify whether the speech is from a real user. Generally, real users exhibit certain behavioral characteristics when speaking, such as breathing sounds, pauses, and repetitions. Non-real user speech often lacks these natural behavioral characteristics. Therefore, during the training phase, real user speech behavior patterns can be collected and learned to establish a behavior pattern model. During the recognition phase, behavioral features are extracted from the input first speech signal and compared with the behavior pattern model. If the feature matching degree is high, it is determined to be speech from a real user.
[0192] In other embodiments, quality features of the first speech signal can also be acquired, and then used to identify whether the speech is from a real user. Real user speech typically has natural tone quality and volume variations, while speech generated by non-real users often exhibits relatively stable or mechanical tone quality characteristics. Therefore, during the training phase, features such as tone quality, volume, and noise level in the speech signal can be extracted, and machine learning algorithms can be used to train and classify these features. During the recognition phase, the control unit extracts quality features from the input first speech signal and compares them with the classification model. If the features match the quality features of real user speech, it is determined that the speech was produced by a real user.
[0193] Step S502: If the recognition result indicates that there is an execution risk, the piezoelectric vibrator component senses the knocking event to obtain the electrical signal to be analyzed. The execution risk includes the probability that the first voice signal is emitted by a real user is lower than a first preset value.
[0194] In some embodiments, the probability that the first voice signal is issued by a real user is lower than a first preset value, indicating that the first voice signal is not issued by a real user and there is a risk of execution of control commands. Therefore, further verification is required, namely, by sensing the knocking event through the piezoelectric vibrator component to obtain the electrical signal to be parsed in order to verify the password to be verified.
[0195] In other embodiments, if the probability that the first voice signal is issued by a real user is not less than a first preset value, it can be determined that the first voice signal is issued by a real user and there is no risk of execution of the control command. Therefore, the corresponding control command can be executed directly based on the first voice signal, and the control command can be determined based on the semantic information of the first voice signal.
[0196] In this embodiment, when the speech recognition result indicates an execution risk, the piezoelectric vibrator component senses and verifies the knocking event, thereby improving the accuracy and security of identity verification without increasing the user's burden, and thus improving the security and reliability of control.
[0197] In some embodiments, an execution risk is determined to exist if at least one of the following conditions is met:
[0198] Background noise exists at the start and / or end positions of the first speech signal;
[0199] The first speech signal contains fewer real speech features than a second preset value. The real speech features include at least one of the following: the presence of high-frequency details; changes in speech rate, volume, or intonation; and the presence of labiodental sounds, swallowing sounds, or breathing sounds.
[0200] The time it takes to receive the first voice signal exceeds the preset time for responding to the question generated by the control unit.
[0201] Specifically, when the first voice signal contains background noise at the beginning or end, it indicates that the first voice signal may be a recorded voice message. This voice message can be a voice message in instant messaging software in the related art, and the background noise contained at the beginning or end can be a prompt tone for the voice message. For example, the background noise at the beginning can be a "beep" prompt tone to prompt the user to start entering a voice message; the background noise at the end can be a "beep" prompt tone to indicate that the voice message has ended.
[0202] Speech generated using TTS and voice cloning technologies often lacks the high-frequency details and intonation variations of natural speech, and also lacks natural features such as labiodental consonants and swallowing sounds. Therefore, the frequency of occurrence of authentic speech features in the first speech signal can be statistically analyzed. If the number of authentic speech features is less than a second preset value, an execution risk is identified. These authentic speech features include high-frequency details, speech rate, volume, and intonation variations, as well as natural speech features such as labiodental consonants, swallowing sounds, and breathing sounds. When authentic speech features are significantly missing from the speech signal, it can indicate to some extent that the first speech signal was not emitted by a real user, but rather generated by a machine or algorithm.
[0203] If, after the control unit generates a question, the user takes too long to respond with a voice message (i.e., the time taken to receive the first voice signal exceeds a preset time), it may indicate that the first voice signal was generated using an algorithm after calculating the delay at intervals. Therefore, it can be determined that there is a certain execution risk.
[0204] In this embodiment, multiple factors are comprehensively considered to effectively identify potential execution risks in the speech signal, providing more accurate and reliable speech recognition results, thereby improving user experience and security.
[0205] In some embodiments, the piezoelectric vibrator assembly includes a second piezoelectric vibrator, the second piezoelectric vibrator having an operating state including a sound-generating state and a vibration-sensing state; before sensing a tapping event through the piezoelectric vibrator assembly to obtain the electrical signal to be analyzed, the method further includes: if the recognition result indicates an execution risk, activating the sound-generating state of the second piezoelectric vibrator to output a second voice signal; the second voice signal is used to prompt the user to input the password to be verified by tapping; in response to the completion of the second voice signal output, switching the second piezoelectric vibrator to the vibration-sensing state.
[0206] In some embodiments, the operating states of the second piezoelectric oscillator include a sound-generating state and a vibration-sensing state. The sound-generating state is the operating mode in which the second piezoelectric oscillator undergoes mechanical deformation under the influence of an electric field, thereby emitting sound; this sound-generating state utilizes the inverse piezoelectric effect. The vibration-sensing state is the operating mode in which the second piezoelectric oscillator generates charge or voltage changes under external vibration propagating through a liquid or solid, and converts these changes into electrical signals for subsequent processing; this vibration-sensing state utilizes the direct piezoelectric effect.
[0207] In this embodiment, when the identification result indicates an execution risk, the control unit first activates the sound output state of the second piezoelectric vibrator, generating a second voice signal (such as "Please tap to enter the verification password") by controlling the electric field parameters. This voice signal prompts the user to perform the next operation, which may include a tapping operation (to generate subsequent electrical signals to be parsed). Then, the control unit waits for the second voice signal output to complete and automatically switches the second piezoelectric vibrator to vibration sensing state. At this time, the second piezoelectric vibrator begins to sense and collect the vibration signal generated by the user's tapping, and converts it into an electrical signal to be parsed for subsequent processing.
[0208] In this embodiment, voice signals and tapping events are collected using a piezoelectric vibrator assembly, thereby achieving dual verification based on the piezoelectric vibrator assembly. This not only simplifies the system structure and reduces costs but also improves the overall system performance and user experience. The reuse of the piezoelectric vibrator assembly can enhance security while enabling more flexible and intelligent user interaction methods.
[0209] In some embodiments, the sound acquisition component includes a second piezoelectric vibrator in the piezoelectric vibrator component, and the second piezoelectric vibrator has operating states including a sound-generating state, a vibration-sensing state, and a sound-sensing state. The step of executing the control command corresponding to the satisfied control condition when both the first voice signal and the password to be verified meet the control conditions includes: when the password to be verified matches a preset control character in the control conditions, switching the second piezoelectric vibrator to the sound-generating state and outputting a third voice signal through the second piezoelectric vibrator, the third voice signal being used to prompt the user to answer a preset question; responding to the completion of the third voice signal output, switching the second piezoelectric vibrator to the sound-sensing state and receiving a fourth voice signal through the second piezoelectric vibrator; and executing the control command corresponding to the satisfied control condition when the fourth voice signal matches a preset answer and / or a preset voiceprint in the control conditions.
[0210] In the above embodiment, when the password to be verified matches the preset control characters in the control conditions, the control unit first activates the sound-emitting state of the second piezoelectric vibrator, generating a specific sound signal (i.e., the third voice signal) by controlling the electric field parameters, such as "Please give the password: Open Sesame". Then, the control unit waits for the third voice signal to finish outputting and automatically switches the second piezoelectric vibrator to the sound perception state. At this time, the second piezoelectric vibrator begins to receive and convert the sound signal generated by the user answering the preset question (i.e., the fourth voice signal), and converts it into an electrical signal for subsequent processing. The control unit parses and verifies the fourth voice signal. If it matches the preset answer and / or preset voiceprint in the control conditions, it executes the control command corresponding to the satisfied control conditions.
[0211] For example, a user authenticates their identity by entering a password through a tapping event. When the characters of the entered password match preset control characters (such as containing a specific combination of numbers or letters), a third voice signal is output through the sound output state of the second piezoelectric vibrator: "Please enter your birth year." After hearing the prompt, the user answers a preset question: "1990." The second piezoelectric vibrator receives and converts the user's answer into a fourth voice signal in a sound perception state. The control unit parses and verifies the fourth voice signal. If the user's answer matches the preset answer and the voiceprint matches, the corresponding control command is executed.
[0212] In this embodiment, the piezoelectric vibrator component prompts the user to input a voice signal or input the password to be verified by tapping, thereby improving the user-friendliness and ease of operation of the system and making the user interaction experience more humanized.
[0213] In some embodiments, the control unit is communicatively connected to the sound acquisition component, the piezoelectric vibrator component includes a second piezoelectric vibrator, the second piezoelectric vibrator having an operating state including a sound-emitting state; before sensing a tapping event through the piezoelectric vibrator component, the method further includes: in response to the activation of the sound acquisition component, switching the second piezoelectric vibrator to the sound-emitting state, and outputting a second voice signal through the second piezoelectric vibrator, the second voice signal being used to prompt the user to input a first voice signal or input the password to be verified by tapping.
[0214] In the above embodiments, to effectively prompt the user to proceed to the next step, this application, in response to the activation signal of the sound acquisition component, switches the second piezoelectric vibrator to a sound-emitting state and outputs a second voice signal. This second voice signal is used to prompt the user to input the first voice signal or to input the password to be verified by tapping, thereby guiding the user to complete the identity verification process.
[0215] For example, after the sound acquisition component is activated, the control unit switches the second piezoelectric vibrator in the piezoelectric vibrator assembly to sound-emitting mode and outputs a voice prompt: "Please enter your voice password to continue operation." After hearing this prompt, the user will enter the preset voice password, which was set by the user during previous registration. The control unit will match the entered voice password with the preset password stored in the system (or voiceprint matching) to determine whether to continue executing the next control command.
[0216] For example, after the sound acquisition component is activated, the control unit switches the second piezoelectric vibrator in the piezoelectric vibrator assembly to sound-emitting mode and outputs a voice prompt: "Please enter your tapping password. Please note that you need to tap within the designated area according to the preset rhythm and sequence." After hearing the prompt, the user will tap within the designated area according to the preset rhythm and sequence. The control unit will verify the password to be verified based on the acquired tapping events, and then determine whether to continue executing the next control command.
[0217] In this embodiment, the piezoelectric vibrator component prompts the user to enter the password to be verified by tapping, and then seamlessly switches to the vibration sensing state to collect the electrical signal generated by the user's tapping for verification.
[0218] Figure 6 This is a schematic diagram of the implementation flow of a control method provided in an embodiment of this application. Figure 5 This method can be executed by the processor of a computer device. Based on Figure 4 , Figure 4 Step S4011 can be updated to steps S601 and S602, combining Figure 6The steps shown are explained.
[0219] Step S601: In response to the tapping event being sensed by the piezoelectric vibrator assembly, the sound acquisition assembly is activated.
[0220] In some embodiments, when the piezoelectric vibrator assembly senses a tapping event, it outputs an electrical signal to the control unit. After receiving the electrical signal generated by the piezoelectric vibrator assembly, the control unit immediately sends an activation command to the sound acquisition assembly, causing it to enter the working state and prepare to acquire sound signals. The sound acquisition assembly here can be a microphone assembly or a second piezoelectric vibrator in the sound perception state described in the above embodiments.
[0221] Step S602: While acquiring the electrical signal to be analyzed, the first voice signal is acquired through the sound acquisition component.
[0222] In this system, the control unit activates the sound acquisition component when the piezoelectric vibrator assembly senses a tapping event. Therefore, through the coordination of the control unit, the piezoelectric vibrator assembly and the sound acquisition component can work simultaneously, acquiring the electrical signal generated by the tapping and the user's voice signal, respectively. In other words, the acquisition of the electrical signal and voice signal can be performed in parallel, improving the system's response speed. From the user's perspective, they can perform voice verification while tapping, enhancing the user experience.
[0223] In this embodiment, both the electrical signal generated by the tapping event and the user's voice signal can be collected simultaneously, improving the system's response speed and data processing capabilities while ensuring control safety. Furthermore, it allows the user to speak voice commands while tapping, enhancing the convenience and efficiency of user interaction.
[0224] In some embodiments, the piezoelectric vibrator assembly includes a first piezoelectric vibrator and a second piezoelectric vibrator. The first piezoelectric vibrator operates in a vibration sensing state, and the second piezoelectric vibrator operates in a sound sensing state. The sound acquisition assembly includes the second piezoelectric vibrator. The activation of the sound acquisition assembly can be achieved through step S6011. Correspondingly, the acquisition of the electrical signal to be analyzed and the acquisition of the first speech signal through the sound acquisition assembly can be achieved through step S6021.
[0225] Step S6011: Activate the auditory perception state of the second piezoelectric vibrator;
[0226] In this process, the first piezoelectric vibrator in vibration sensing state can first detect the knocking event, and after detecting the knocking event, the second piezoelectric vibrator can be set to sound sensing state.
[0227] It is understandable that both the sound perception state and the vibration perception state utilize the piezoelectric effect to convert the deformation of piezoelectric materials into electrical signals. In the sound perception state, the second piezoelectric vibrator functions as a sound sensor. When sound waves act on the second piezoelectric vibrator, they cause deformation of the piezoelectric material, resulting in changes in charge or voltage, which are then converted into electrical signals and output to the sound perception circuit for further processing. In the vibration perception state, the second piezoelectric vibrator also utilizes the piezoelectric effect to sense external vibrations. The difference is that the collected electrical signals are used as the signals to be analyzed, and then deciphered into the password to be verified.
[0228] In some embodiments, the aforementioned activation of the second piezoelectric vibrator's auditory perception state can actually be achieved by switching the output of the second piezoelectric vibrator to the auditory perception circuit.
[0229] Step S6021: While acquiring the electrical signal to be analyzed through the first piezoelectric vibrator, the first voice signal is acquired through the second piezoelectric vibrator.
[0230] In the current implementation scenario, while the first piezoelectric vibrator senses the impact event and outputs an electrical signal, the second piezoelectric vibrator is activated and in a sound perception state. Therefore, the control unit can simultaneously acquire the electrical signal generated by the impact (the electrical signal to be parsed) from the first piezoelectric vibrator and acquire the user's voice signal (the first voice signal) from the second piezoelectric vibrator.
[0231] In this embodiment, without increasing additional hardware costs, the dual functions of tapping event detection and voice recognition can be achieved by making reasonable use of the multifunctionality of piezoelectric vibrators, providing users with a more convenient and efficient interactive experience.
[0232] In some embodiments, after acquiring the first speech signal through the sound acquisition component, the method further includes steps S603 and S604.
[0233] Step S603: Identify the voice command corresponding to the first voice signal.
[0234] In some embodiments, the user's voice commands can be identified by using speech recognition algorithms (such as Hidden Markov Models, Deep Learning Algorithms, etc.) to extract features and match patterns from the received speech signals.
[0235] In some embodiments, the voice command corresponding to the first voice signal is used to determine the control command to be executed. After obtaining the control command, and if the password to be verified determined based on the tapping event meets the control conditions corresponding to the control command, the control command is executed. The control conditions can be preset passwords, and different voice commands can correspond to different preset passwords.
[0236] For example, suppose a user wants to play a specific song. The user needs to say the voice command "Play song A" and perform a tapping action. The control unit recognizes the voice command and determines that the control command to be executed is "Play song A". In addition, the control unit receives the tapping event through the piezoelectric vibrator assembly and parses it to obtain the password to be verified. Then, the control unit can obtain the preset password corresponding to playing the music and compare the preset password with the password to be verified to determine whether the control command "Play song A" can be executed.
[0237] Step S604: In response to determining that the voice command is incomplete, complete the voice command.
[0238] In some embodiments, because the user issues the voice command before the tapping action—that is, before the tapping action wakes up the voice acquisition component (which may be a microphone or a second piezoelectric vibrator in a hearing-sensing state)—the voice acquisition component cannot capture the portion of the voice command issued by the user before wake-up, and therefore cannot capture the complete voice command. In cases where the recognized voice command is incomplete or ambiguous, contextual information can be obtained and used to supplement the voice command; here, contextual information may include, but is not limited to, the user's previous voice commands, behavior records, and preference settings.
[0239] For example, suppose the recognized voice command is "open the door once", but does not specify the specific action to the door, the control unit can combine the vehicle door status, such as if the door is closed, and automatically supplement the voice command to the complete command "open the door once".
[0240] In some embodiments, the above-mentioned completion of the voice command can be achieved through step S6041.
[0241] Step S6041: Based on the voice command and the current scene and / or preset corpus, complete the voice command.
[0242] The current scenario can be the specific environment or background during the aforementioned voice interaction. For example, it can include various factors such as the physical environment (e.g., parking spaces in a residential area, company parking spaces, shopping mall parking spaces, etc.), time (e.g., daytime, nighttime), and the vehicle's own status (e.g., the area or location where the tapping event was received). The preset corpus is a pre-set database containing language elements such as words, phrases, and sentences, used to supplement the user's voice commands. That is, when the voice command lacks necessary elements, it is supplemented based on the language elements stored in the preset corpus.
[0243] In some embodiments, the control unit can receive and parse voice commands issued by the user. Then, based on the user's current context (such as environmental information obtained through sensors, the user's historical behavior records, etc.) and / or a pre-defined corpus (such as a database containing common words, phrases, and sentences), the control unit intelligently infers and supplements the voice command. For example, the supplementation process may include semantic analysis of the voice command, contextual understanding, and correlation matching with other information. Finally, the control unit generates a complete and supplemented voice command.
[0244] In this embodiment, by intelligently completing voice commands, the situation of voice recognition errors or failures caused by incomplete voice signal reception when simultaneously sensing tapping events and collecting voice signals is reduced. This not only improves the user experience but also enhances the intelligence level of the system, bringing users a more convenient and efficient voice interaction experience.
[0245] Based on the foregoing embodiments, this application provides a control device, which includes the included units and the modules included in each unit, which can be implemented by a processor in a computer device; of course, it can also be implemented by specific logic circuits; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor unit (MPU), a digital signal processor (DSP), or a field programmable gate array (FPGA), etc.
[0246] Figure 7 This is a schematic diagram of the composition structure of a control device provided in an embodiment of this application, as shown below. Figure 7 As shown, the control device 700 includes: a piezoelectric vibrator assembly 710, a memory 730, and a processor 720; the piezoelectric vibrator assembly 710 and the processor 720 are communicatively connected; wherein, the piezoelectric vibrator assembly 710 is used to acquire electrical signals; the memory 730 stores a computer program that can run on the processor 720; when the processor 720 executes the computer program, it senses a tapping event through the piezoelectric vibrator assembly to obtain an electrical signal to be parsed; it parses the electrical signal to be parsed to obtain a password to be verified corresponding to the tapping event; and when the password to be verified meets the control conditions, it executes the control command corresponding to the met control conditions.
[0247] The memory 730 stores computer programs that can run on the processor. The memory 730 is configured to store instructions and applications that can be executed by the processor 720. It can also cache data to be processed or already processed by the processor 720 and the various modules in the control device 700 (e.g., image data, audio data, voice communication data and video communication data). It can be implemented by flash memory or random access memory (RAM).
[0248] When the processor 720 executes the program, it implements the steps of any of the above control methods. The processor 720 typically controls the overall operation of the control device 700.
[0249] This application provides a computer storage medium that stores one or more programs, which can be executed by one or more processors to implement the steps of the control method as described in any of the above embodiments.
[0250] It should be noted that the descriptions of the storage medium and device embodiments above are similar to the descriptions of the method embodiments above, and have similar beneficial effects. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.
[0251] The aforementioned processor can be at least one of the following: Application Specific Integrated Circuit (ASIC), Digital Signal Processor (DSP), Digital Signal Processing Device (DSPD), Programmable Logic Device (PLD), Field Programmable Gate Array (FPGA), Central Processing Unit (CPU), Controller, Microcontroller, and Microprocessor. It is understood that other electronic devices can also implement the functions of the aforementioned processor, and this application does not specifically limit the specific implementation.
[0252] The aforementioned computer storage media / memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic random access memory (FRAM), flash memory, magnetic surface memory, optical disc, or compact disc read-only memory (CD-ROM), etc.; or it can be various terminals that include one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.
[0253] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.
[0254] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple units or components can be combined, or integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed can be through some interfaces, and the indirect coupling or communication connection between devices or units can be electrical, mechanical, or other forms.
[0255] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units. They may be located in one place or distributed across multiple network units. Some or all of the units may be selected to achieve the purpose of this embodiment according to actual needs.
[0256] Furthermore, in the various embodiments of this application, all functional units can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or in a combination of hardware and software functional units. Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, read-only memory (ROM), magnetic disks, or optical disks.
[0257] Alternatively, if the integrated units described above are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence or the part that contributes to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, ROM, magnetic disks, or optical disks.
[0258] The above description is merely an embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application.
Claims
1. A control method applied to a control unit, the control unit being communicatively connected to a piezoelectric vibrator assembly, the method comprising: The piezoelectric vibrator assembly senses the impact event to obtain the electrical signal to be analyzed. The electrical signal to be parsed is parsed to obtain the password to be verified corresponding to the tapping event; If the password to be verified meets the control conditions, the control instruction corresponding to the met control conditions is executed.
2. The method according to claim 1, wherein, The password to be verified includes at least one character, each character corresponding to a set of character electrical signals; parsing the electrical signals to be parsed to obtain the password to be verified corresponding to the tapping action includes: The electrical signal to be analyzed is analyzed to obtain at least one set of character electrical signals; The password to be verified corresponding to the tapping event is determined according to the preset mapping relationship between character electrical signals and characters.
3. The method according to claim 2, wherein, The electrical signal to be parsed includes a plurality of electrical signals received sequentially; the parsing of the electrical signal to be parsed to obtain at least one set of character electrical signals includes: Based on the comparison results of the signal attributes of two consecutively received electrical signals, the electrical signal to be parsed is split to obtain at least one set of character electrical signals; The signal attributes include at least one of the following: the generation area of the electrical signal, the reception time of the electrical signal, and the intensity of the electrical signal; the generation area is the area where the piezoelectric vibrator assembly that generates the electrical signal is located.
4. The method according to claim 3, wherein, Based on the comparison result of the signal attributes of two consecutively received electrical signals, the electrical signal to be parsed is split to obtain at least one set of character electrical signals, including: In response to determining that the time difference between the reception time of the previous electrical signal and the reception time of the next electrical signal is greater than or equal to a preset first time difference threshold, the previous electrical signal is taken as the last electrical signal of the previous group of character electrical signals, and the next electrical signal is taken as the first electrical signal of the next group of character electrical signals; or, In response to the fact that no new electrical signal is received within a second time difference threshold after the reception time of the current electrical signal is determined, the current electrical signal is regarded as the last electrical signal of the last group of character electrical signals; the second time difference threshold is greater than the first time difference threshold.
5. The method according to claim 3, wherein, The piezoelectric vibrator assembly includes at least two first piezoelectric vibrators disposed in different regions, and the method further includes: In response to receiving a first electrical signal from a first piezoelectric vibrator located in a target region, the first electrical signal is identified as the first electrical signal of a first group of character electrical signals, wherein the target region is a pre-defined region among the different regions.
6. The method according to claim 3, wherein, Based on the comparison result of the signal attributes of two consecutively received electrical signals, the electrical signal to be parsed is split to obtain at least one set of character electrical signals, including: In response to determining that the generation regions of two consecutively received electrical signals belong to different regions, the preceding electrical signal is taken as the last electrical signal of the preceding group of character electrical signals, and the following electrical signal is taken as the first electrical signal of the following group of character electrical signals.
7. The method according to claim 6, wherein, The region where the electrical signal is generated is determined based on the following steps: Obtain the signal transmission interface for receiving the electrical signal; The generation area of the electrical signal is determined based on the setting area of the piezoelectric vibrator assembly connected to the signal transmission interface.
8. The method according to claim 7, wherein, The piezoelectric vibrator assembly includes at least one first piezoelectric vibrator and at least one second piezoelectric vibrator. The at least one first piezoelectric vibrator includes at least one independent piezoelectric vibrator. No second piezoelectric vibrator is provided in the area where the independent piezoelectric vibrator is located. The at least one first piezoelectric vibrator transmits electrical signals through the same first signal transmission interface, and the at least one second piezoelectric vibrator transmits electrical signals through different second signal transmission interfaces.
9. The method according to claim 8, wherein, The determination of the generation region of the electrical signal based on the setting area of the piezoelectric vibrator assembly connected to the signal transmission interface includes: In response to determining that both the first signal transmission interface and the second signal transmission interface have received electrical signals, the region where the second piezoelectric vibrator corresponding to the second signal transmission interface that received the electrical signal is located is determined as the region where the electrical signal is generated; In response to determining that only the first signal transmission interface receives an electrical signal, the region where the independent piezoelectric vibrator is located is determined as the region where the electrical signal is generated.
10. The method according to any one of claims 1 to 9, wherein, The control commands include an unlock command, which is used to release the locked state of the object managed by the control unit.
11. The method according to claim 10, wherein, The object is a vehicle, and the control command further includes at least one of the following: Vehicle control commands, which are used to control the operating status of the vehicle components of the vehicle; A remote request instruction, which is used to send a remote request to the associated electronic equipment of the vehicle.
12. The method according to any one of claims 1 to 9, wherein, The password to be verified includes at least one character, and the control conditions include: the password to be verified conforms to the preset control character corresponding to the control instruction, and / or the generation area of the character electrical signal corresponding to each character conforms to the preset area of the control character.
13. The method according to any one of claims 1 to 9, wherein, The control unit is communicatively connected to the sound acquisition component; Before executing the control command, the method further includes: acquiring a first speech signal through the sound acquisition component; The step of executing the control instruction corresponding to the satisfied control condition when the password to be verified meets the control condition includes: executing the control instruction corresponding to the satisfied control condition when both the first voice signal and the password to be verified meet the control condition.
14. The method according to claim 13, wherein, The sound acquisition component includes at least one of the following: a microphone component, and a second piezoelectric vibrator in the piezoelectric vibrator component; the operating state of the second piezoelectric vibrator includes a sound perception state; Before acquiring the user's first voice signal through the sound acquisition component, the method further includes at least one of the following: In response to a tapping event detected by the piezoelectric vibrator assembly, the microphone assembly is activated; In response to a tapping event detected by the piezoelectric vibrator assembly, the second piezoelectric vibrator is activated to enter a sound-sensing state.
15. The method according to claim 13, wherein, The acquisition of the first speech signal through the sound acquisition component includes: While sensing the impact event through the piezoelectric vibrator assembly, the first voice signal is acquired through the sound acquisition assembly.
16. The method according to claim 13, wherein, The step of sensing the impact event through the piezoelectric vibrator assembly to obtain the electrical signal to be analyzed includes: The first speech signal is identified to obtain the identification result; If the identification result indicates that there is an execution risk, the piezoelectric vibrator component senses the knocking event to obtain the electrical signal to be analyzed. The execution risk includes the probability that the first voice signal is emitted by a real user being lower than a first preset value.
17. The method according to claim 16, wherein, An execution risk is determined to exist if at least one of the following conditions is met: Background noise exists at the start and / or end positions of the first speech signal; The first speech signal contains fewer real speech features than a second preset value. The real speech features include at least one of the following: the presence of high-frequency details; changes in speech rate, volume, or intonation; and the presence of labiodental sounds, swallowing sounds, or breathing sounds. The time it takes to receive the first voice signal exceeds the preset time for responding to the question generated by the control unit.
18. The method according to claim 16, wherein, The piezoelectric vibrator assembly includes a second piezoelectric vibrator, and the second piezoelectric vibrator has two operating states: a sound-generating state and a vibration-sensing state. Before obtaining the electrical signal to be analyzed by sensing the impact event through the piezoelectric oscillator assembly, the method further includes: If the identification result indicates that there is an execution risk, the sound-emitting state of the second piezoelectric vibrator is activated to output a second voice signal; The second voice signal is used to prompt the user to enter the password to be verified by tapping. In response to the completion of the second voice signal output, the second piezoelectric vibrator is switched to the vibration sensing state.
19. The method according to claim 13, wherein, The sound acquisition component includes a second piezoelectric vibrator in the piezoelectric vibrator component, and the working states of the second piezoelectric vibrator include a sound generation state, a vibration sensing state, and a sound perception state. When both the first voice signal and the password to be verified satisfy the control conditions, the control instruction corresponding to the satisfied control conditions is executed, including: If the password to be verified matches the preset control characters in the control conditions, the second piezoelectric vibrator is switched to the sound-emitting state, and a third voice signal is output through the second piezoelectric vibrator. The third voice signal is used to prompt the user to answer a preset question. In response to the completion of the third voice signal output, the second piezoelectric vibrator is switched to the sound perception state, and the fourth voice signal is received through the second piezoelectric vibrator; If the fourth voice signal meets the preset answer and / or preset voiceprint in the control conditions, the control command corresponding to the satisfied control conditions is executed.
20. The method according to any one of claims 1 to 9, wherein, The control unit is communicatively connected to the sound acquisition component, and the piezoelectric vibrator component includes a second piezoelectric vibrator, the second piezoelectric vibrator's working state including a sound-generating state; Prior to sensing the impact event via the piezoelectric vibrator assembly, the method further includes: In response to the activation of the sound acquisition component, the second piezoelectric vibrator is switched to the sound-emitting state and a second voice signal is output through the second piezoelectric vibrator. The second voice signal is used to prompt the user to input the first voice signal or to input the password to be verified by tapping.
21. The method according to claim 15, wherein, The step of simultaneously sensing a striking event through the piezoelectric vibrator assembly and acquiring a first voice signal through the sound acquisition assembly includes: In response to a strike event detected by the piezoelectric vibrator assembly, the sound acquisition assembly is activated; While acquiring the electrical signal to be analyzed, the first voice signal is acquired through the sound acquisition component.
22. The method according to claim 21, wherein, The piezoelectric vibrator assembly includes a first piezoelectric vibrator and a second piezoelectric vibrator. The first piezoelectric vibrator has a vibration sensing state, and the second piezoelectric vibrator has a sound sensing state. The sound acquisition assembly includes the second piezoelectric vibrator. Activating the sound acquisition component includes: activating the auditory perception state of the second piezoelectric vibrator; The step of acquiring a first voice signal through the sound acquisition component while acquiring the electrical signal to be analyzed includes: acquiring the electrical signal to be analyzed through the first piezoelectric vibrator while acquiring the first voice signal through the second piezoelectric vibrator.
23. The method according to claim 21, wherein, After acquiring the first speech signal through the sound acquisition component, the method further includes: Identify the voice command corresponding to the first voice signal; In response to determining that the voice command is incomplete, the voice command is completed.
24. The method according to claim 23, wherein, The step of completing the voice command includes: Based on the voice command and the current scene and / or a preset corpus, the voice command is completed.
25. A control device, wherein, include: Piezoelectric oscillator components, memory, and processor; The piezoelectric resonator assembly and the processor are communicatively connected; wherein, The piezoelectric vibrator assembly is used to collect electrical signals; The memory stores computer programs that can run on the processor; When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 24.
26. A computer-readable storage medium having a computer program stored thereon, wherein, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 24.
27. A computer program product comprising a computer program or instructions which, when executed by a processor, implement the steps of the method according to any one of claims 1 to 24.