Device for distinguishing touch operation by using friction signal

Abstract

One or more embodiments of the present specification relate to a device for discriminating a touch operation using a friction signal, at least a portion of a surface of the device comprising a sliding area, the sliding area comprising at least a first sliding area and a second sliding area, the first sliding area and the second sliding area having different characteristics, the characteristic shows that a friction signal generated when a finger slides in the first sliding area and a friction signal generated when the finger slides in the second sliding area have distinguishability in time domain or frequency.

Description

Cross-references

[0001] This application claims priority to Chinese application No. 202311407961.X filed on October 27, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0002] The present specification relates to the field of acoustic technology, and in particular to a device for identifying touch operations using friction signals. Background Art

[0003] The use of touch technology to achieve touch operation of acoustic devices is becoming more and more common. Currently, the existing touch technologies mainly include capacitive, pressure, optical, etc. Optical touch technology is prone to light interference and distortion in curved surfaces. Capacitive touch technology is easily affected by sweat and other factors, and the distortion problem is difficult to solve. The price of resistive touch technology products is relatively high and they are easily scratched and damaged. Now we propose an acoustic wave technology solution that can identify the friction signal generated when the user slides on the surface of the device, thereby judging the user's sliding operation and realizing the touch function. Summary of the invention

[0004] Some embodiments of the present specification provide a device for distinguishing touch operations using friction signals, wherein at least part of the surface of the device includes a sliding area, wherein the sliding area includes at least a first sliding area and a second sliding area, wherein the first sliding area and the second sliding area have different characteristics, wherein the characteristics are manifested in that the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area are distinguishable in the time domain or the frequency domain. By setting the first sliding area and the second sliding area to have different characteristics, the difference in acoustic characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area can be increased, thereby facilitating the determination of the sliding direction based on the acoustic characteristics of the friction signal.

[0005] In some embodiments, the distinguishability is reflected in that the friction signal generated when the finger slides in the first sliding area has an amplitude difference with the friction signal generated when the finger slides in the second sliding area. In this setting, the sliding direction can be determined based on the amplitude difference between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area.

[0006] In some embodiments, the first sliding area and the second sliding area have different porosities. In this configuration, the difference in amplitude between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area can be increased.

[0007] In some embodiments, the distinguishability is reflected in the difference in peak characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area. In this setting, the sliding direction can be determined based on the difference in peak characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area.

[0008] In some embodiments, the peak feature includes at least one of the number of peaks, the distribution of peak time, and the intensity of peaks. In this setting, the sliding direction can be determined based on at least one of the difference in the number of peaks, the difference in the distribution of peak time, and the difference in the intensity of peaks between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area.

[0009] In some embodiments, the distinguishability is reflected in the difference in discontinuity characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area. In this setting, the sliding direction can be determined based on the difference in discontinuity characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area.

[0010] In some embodiments, an array structure is provided on one of the first sliding area and the second sliding area, and the material of the array structure is a hard material. In this configuration, the difference in discontinuity characteristics between the friction signal generated when the finger slides on the first sliding area and the friction signal generated when the finger slides on the second sliding area can be increased.

[0011] In some embodiments, the distinguishability is reflected in the frequency difference between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area. In this setting, the sliding direction can be determined based on the frequency difference between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area.

[0012] In some embodiments, the base frequency or peak frequency of the friction signal generated when the finger slides in the first sliding area is different from that of the friction signal generated when the finger slides in the second sliding area. In this configuration, the difference in frequency characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area can be increased.

[0013] In some embodiments, the first sliding area and the second sliding area have different natural resonant frequencies. In this configuration, the difference in frequency characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area can be increased.

[0014] In some embodiments, the distinguishability is reflected in that the proportion of the friction signal at a specific frequency or a specific frequency range in the friction signal generated when the finger slides in the first sliding area is different from that in the friction signal generated when the finger slides in the second sliding area. In this setting, the sliding direction can be determined based on the difference in the proportion of the friction signal at a specific frequency or a specific frequency range in the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area.

[0015] In some embodiments, the first sliding area and the second sliding area have different characteristics, including different material characteristics, roughness characteristics, or surface structure characteristics of the first sliding area and the second sliding area. In this configuration, the difference in acoustic characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area can be increased.

[0016] In some embodiments, the device includes a processing circuit configured to identify the sliding direction of the finger according to the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area. The processing circuit can identify the friction signal, such as preprocessing, feature extraction, and pattern matching, so as to improve the accuracy of identifying the sliding direction.

[0017] Some embodiments of the present specification also provide a device for distinguishing touch operations using friction signals, wherein at least part of the surface of the device includes a sliding area, wherein the sliding area includes at least a first sliding area and a second sliding area, wherein the first sliding area and the second sliding area have different characteristics, wherein the characteristics include material characteristics, roughness characteristics, or surface structure characteristics. By setting the first sliding area and the second sliding area to have different characteristics, the difference in acoustic characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area can be increased, thereby facilitating the determination of the sliding direction based on the acoustic characteristics of the friction signal.

[0018] In some embodiments, the material property includes: the materials on the first sliding area and the second sliding area have different elastic modulus or hardness. By setting the first sliding area and the second sliding area to have different material properties, the difference in acoustic characteristics between the friction signal generated when the finger slides on the first sliding area and the friction signal generated when the finger slides on the second sliding area can be increased.

[0019] In some embodiments, the difference between the Shore hardness of the material of the first sliding area and the Shore hardness of the material of the second sliding area is within the range of 42HD to 86HD. In this configuration, the difference between the material properties of the first sliding area and the second sliding area can be increased, thereby increasing the difference in acoustic characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area.

[0020] In some embodiments, the roughness characteristic includes: particles with different parameters are arranged on the first sliding area and the second sliding area, and the parameters of the particles include particle shape, particle size, particle quantity or particle spacing. By setting the first sliding area and the second sliding area to have different roughness characteristics, the difference in acoustic characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area can be increased.

[0021] In some embodiments, the roughness characteristic includes: stripes with different parameters are arranged on the first sliding area and the second sliding area, and the parameters of the stripes include stripe width, stripe height or stripe spacing. In this setting, the difference between the roughness characteristics of the first sliding area and the second sliding area can be increased, thereby increasing the difference in acoustic characteristics between the friction signal generated when the finger slides on the first sliding area and the friction signal generated when the finger slides on the second sliding area.

[0022] In some embodiments, the surface structure design includes: a differentiated surface structure is set on the first sliding area and the second sliding area, and the surface structure includes a plane structure or a gradient structure. By setting the first sliding area and the second sliding area to have different surface structure designs, the difference in acoustic characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area can be increased.

[0023] In some embodiments, the differentiation of the gradient structure is manifested as a difference in slope or orientation. In this configuration, the difference between the surface structure designs of the first sliding area and the second sliding area can be increased, thereby increasing the difference in acoustic characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area.

[0024] In some embodiments, the first sliding area and the second sliding area have different natural resonant frequencies. In this configuration, the difference in frequency characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area can be increased.

[0025] In some embodiments, at least one of a wave plate, a string, a beam, a membrane, and a cavity structure is disposed on the first sliding region and the second sliding region. In this configuration, the first sliding region and the second sliding region can have different natural resonant frequencies.

[0026] In some embodiments, a microstructure is disposed on one of the first sliding region and the second sliding region, and the microstructure includes a spring sheet. In this configuration, the first sliding region and the second sliding region can have different natural resonant frequencies.

[0027] In some embodiments, an array structure is provided on one of the first sliding area and the second sliding area, and the material of the array structure is a flexible material. In this configuration, the difference in peak characteristics between the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area can be increased.

[0028] In some embodiments, an array structure is provided on one of the first sliding area and the second sliding area, and the material of the array structure is a hard material. In this configuration, the difference in discontinuity characteristics between the friction signal generated when the finger slides on the first sliding area and the friction signal generated when the finger slides on the second sliding area can be increased.

[0029] In some embodiments, the characteristic is that the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area are distinguishable in at least one of amplitude, peak characteristics, discontinuity characteristics and frequency domain. In this setting, it is convenient to determine the sliding direction according to the acoustic characteristics of the friction signal.

[0030] In some embodiments, the device includes a processing circuit configured to identify the sliding direction of the finger according to the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area. The processing circuit can identify the friction signal, such as preprocessing, feature extraction, and pattern matching, so as to improve the accuracy of identifying the sliding direction. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] This specification will be further described in the form of exemplary embodiments, which will be described in detail by the accompanying drawings. These embodiments are not restrictive, and in these embodiments, the same number represents the same structure, wherein:

[0032] Figure 1 is a schematic diagram of application scenarios shown in some embodiments of this specification;

[0033] Figure 2A is a schematic diagram of the structure of headphones according to some embodiments of this specification;

[0034] Figure 2B is a result diagram of a friction signal according to some embodiments of the present specification;

[0035] Figure 2C is an exemplary structural diagram of a sliding area according to some embodiments of this specification;

[0036] Figure 2D is a result diagram of a friction signal according to some embodiments of the present specification;

[0037] Figure 2E is an exemplary structural diagram of a sliding area according to some embodiments of this specification;

[0038] Figure 2F is a geometric relationship diagram of concentric circles formed by vertices of connected helical gear structures according to some embodiments of this specification;

[0039] Figure 2G is a frequency distribution diagram of a friction signal generated when sliding on a helical gear structure according to some embodiments of the present specification;

[0040] Figure 2H is a result diagram of a friction signal according to some embodiments of the present specification;

[0041] Fig.2I and Figure 2J is a schematic diagram of the structure of a microcolumn according to some embodiments of the present specification;

[0042] Figure 2K is a result diagram of a friction signal according to some embodiments of the present specification;

[0043] Figure 2L is a result diagram of a friction signal according to some embodiments of the present specification;

[0044] Figure 3A-3C is a schematic diagram of a structure in which the first sliding area and the second sliding area have different surface roughnesses according to some embodiments of this specification;

[0045] Figure 4A-4B is another structural schematic diagram of a first sliding area and a second sliding area having different surface roughnesses according to some embodiments of this specification;

[0046] Figure 5 is a schematic diagram of the structure of a fish scale structure according to some embodiments of this specification;

[0047] Figure 6 is a schematic structural diagram of a helical gear structure according to some embodiments of this specification;

[0048] Figure 7A-7C is a schematic diagram of a structure in which the first sliding area and the second sliding area have different surface structures according to some embodiments of the present specification;

[0049] Fig.7D is a result diagram of friction signals generated in different sliding directions according to some embodiments of this specification;

[0050] Figure 8 It is a flowchart of the friction signal recognition process shown in some embodiments of this specification. DETAILED DESCRIPTION

[0051] In order to more clearly illustrate the technical solutions of the embodiments of this specification, the following is a brief introduction to the drawings required for the description of the embodiments. Obviously, the drawings described below are only some examples or embodiments of this specification. For ordinary technicians in this field, this specification can also be applied to other similar scenarios based on these drawings without creative work. Unless it is obvious from the language environment or otherwise explained, the same reference numerals in the figures represent the same structure or operation.

[0052] It should be understood that the "system", "device", "unit" and / or "module" used herein are a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the words can be replaced by other expressions.

[0053] As shown in this specification and claims, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "comprise" and "include" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.

[0054] Figure 1 It is a schematic diagram of application scenarios shown in some embodiments of this specification.

[0055] The application scenario 100 may include a network 110, a processor 120, a storage device 130, and a terminal device 140. In some embodiments, a user performs a sliding operation on the surface of the terminal device 140, and the sliding operation generates a friction signal. The processor 120 identifies the friction signal generated by the sliding operation, so that the user operation can be identified (for example, the sliding direction, sliding force, sliding distance, etc.), and the terminal device 140 is controlled to perform a corresponding function (for example, increase or decrease the volume) according to the user operation, thereby realizing the touch function of the terminal device 140. In some embodiments, the processor 120 can identify the friction signal generated by the sliding operation, so that the sliding direction of the user can be identified, and the terminal device 140 is controlled to increase or decrease the volume according to the sliding direction. In some embodiments, the processor 120 can identify the friction signal generated by the sliding operation, so that the sliding force and / or sliding distance of the user can be identified, and whether the sliding operation is a false touch can be determined according to the sliding force and / or sliding distance. For example, when the sliding force and / or sliding distance are not within the preset range (such as too small or too large), the sliding operation may be caused by the user's accidental touch. At this time, there is no need to control the terminal device 140 to perform the operation. In some embodiments, in addition to controlling the operation of the terminal device 140 according to the identification of the friction signal, the operation of the terminal device 140 can also be controlled by identifying other signal types, such as vibration signals. As an example, the user taps on the surface of the terminal device 140, and the tapping operation generates a vibration signal. The processor 120 identifies the vibration signal generated by the tapping operation (for example, the number of taps, the frequency of the tapping, and the strength of the tapping), so as to identify the user operation and control the terminal device 140 to perform the corresponding function (for example, pause or continue to play audio) according to the user operation, thereby realizing the touch function of the terminal device 140. In some embodiments, the processor 120 can be located inside the terminal device 140, or it can be located outside the terminal device 140 and communicate with the terminal device 140 via wired or wireless means. For example, the friction signal generated by the user's operation on the surface of the terminal device 140 can be directly processed by the processing device in the terminal device 140, and a control instruction for controlling the terminal device 140 is generated based on the user operation identified by the processing result.

[0056] In some embodiments, the processor 120 may be a single processor or a processor group. The processor group may be centralized or distributed (e.g., the processor 120 may be a distributed system). In some embodiments, the processor 120 may be local or remote. For example, the processor 120 may access information and / or data stored in a storage device 130 or a terminal device 140 through the network 110. For another example, the processor 120 may be directly connected to the storage device 130 or the terminal device 140 to access the stored information and / or data. In some embodiments, the processor 120 may be implemented on a cloud platform. By way of example only, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, between clouds, multiple clouds, etc., or any combination of the above examples.

[0057] The storage device 130 may store data and / or instructions related to the terminal device 140. For example, training samples for machine learning models (i.e., multiple friction signals generated by multiple sliding operations performed by the user) are stored. In some embodiments, the storage device 130 may include a large-capacity memory, a removable memory, a volatile read-write memory, a read-only memory (ROM), etc., or any combination thereof. Exemplary large-capacity storage may include a disk, an optical disk, a solid-state disk, etc. Exemplary removable memory may include a flash drive, a floppy disk, an optical disk, a memory card, a compressed disk, a tape, etc. Exemplary volatile read-only memory may include a random access memory (RAM). Exemplary RAM may include dynamic RAM (DRAM), double rate synchronous dynamic RAM (DDRSDRAM), static RAM (SRAM), thyristor RAM (T-RAM), and zero capacitance RAM (Z-RAM), etc. Exemplary ROM may include mask ROM (MROM), programmable ROM (PROM), erasable programmable ROM (PEROM), electronically erasable programmable ROM (EEPROM), optical disk ROM (CD-ROM), and digital universal disk ROM, etc. In some embodiments, the storage device 130 may be implemented on a cloud platform.

[0058] In some embodiments, the storage device 130 may be connected to the network 110 to communicate with one or more components (e.g., the processor 120, the terminal device 140) in the application scenario 100. One or more components in the application scenario 100 may access data or instructions stored in the storage device 130 through the network 110. In some embodiments, the storage device 130 may be directly connected or communicated with one or more components (e.g., the processor 120, the terminal device 140, etc.) in the application scenario 100. In some embodiments, the storage device 130 may be part of the processor 120.

[0059] The network 110 can connect the components of the system and / or connect the system with external resources. The network 110 enables communication between the components and with other parts outside the system to facilitate the exchange of data and / or information. In some embodiments, the network 110 can be any one or more of a wired network or a wireless network. The processor 120 can obtain friction signal data from the terminal device 140 and / or the storage device 130 through the network 110.

[0060] The terminal device 140 can perform functions related to user operations. In some embodiments, the terminal device 140 may include headphones (e.g., earbud headphones 141, open headphones 142), watches 143, glasses 144, bracelets, wearable clothing, smart helmets, VR / AR devices, etc. Taking headphones as an example, the user slides on the surface of the headphones, and the sliding operation generates a friction signal. The microphone component in the headphones picks up the friction signal, and the processor 120 processes the friction signal (such as signal segmentation, signal pre-emphasis, feature extraction, etc.) to identify the user's sliding direction, thereby controlling the headphones to perform corresponding functions (e.g., increase or decrease the volume) according to the sliding direction, thereby realizing the touch function of the headphones.

[0061] The description of the application scenario 100 is intended to be illustrative, not limiting, of the scope of the present application. Many alternatives, modifications, and variations will be apparent to those of ordinary skill in the art. It is understood that, after understanding the principles of the application, those of ordinary skill in the art may modify the various components without departing from the principles, and these modifications are within the scope of protection of this specification.

[0062] In some embodiments, part of the shell surface of the terminal device may include a sliding area. For example, the shell surface of the sound-emitting part of the earphone may include a sliding area. The user performs a sliding operation in the sliding area to generate a friction signal, which is picked up by a sound pickup component (e.g., a microphone), and the processing device processes the friction signal (such as friction signal segmentation, friction signal pre-emphasis, feature extraction, etc.) to identify the sliding direction, sliding force, etc., so as to control the earphone to perform the corresponding function. Taking the identification of the sliding direction as an example, when the user's finger slides on the sliding area, the friction signals generated in different sliding directions (the friction signal refers to the signal obtained after being picked up by the sound pickup component and processed by the processing device) are different, so the sliding direction can be identified based on the friction signal. For example, when the sliding direction is different, the acoustic characteristics of the corresponding friction signal in the time domain or frequency domain (e.g., the volume of the friction signal, the frequency of the friction signal, the number of peaks in the friction signal, the discontinuity of the friction signal) are different, so the sliding direction can be identified based on the acoustic characteristics of the friction signal in the time domain or frequency domain. In some embodiments, when the structure and / or material of the sliding area where the user's finger slides are roughly the same or have little difference (and the propagation path of the friction signal and the position of the pickup assembly are basically the same), there will be certain differences between the acoustic characteristics of the friction signals generated in different sliding directions, but the difference may be small, which will make it difficult to use the algorithm to identify the sliding direction based on the difference in the acoustic characteristics of the friction signal and the algorithm is too complicated. What's more, too small a difference in acoustic characteristics may also make it impossible to use the algorithm to identify the sliding direction. Based on this, further, in order to reduce the difficulty of the algorithm to identify the sliding direction, the design can be carried out at different levels such as the generation, propagation and collection of the friction signal, so as to increase the degree of difference in the acoustic characteristics between the friction signals generated in different sliding directions, thereby reducing the difficulty of the algorithm. For example, from the level of the generation of the friction signal, the sliding area can be designed with characteristics, so that the sliding area includes multiple sub-sliding areas, and different sub-sliding areas have different characteristics (such as different materials, different structures, etc.), thereby increasing the degree of difference in the acoustic characteristics of the friction signal. For another example, from the perspective of the propagation of the friction signal, acoustic materials can be arranged in the propagation path of the friction signal to increase the degree of difference in the acoustic characteristics of the friction signal. For another example, from the perspective of the collection of the friction signal, the degree of difference in the acoustic characteristics of the friction signal can be increased by setting the position of the pickup assembly. In some embodiments, the characteristics of the two sliding areas can also be designed so that the different types of acoustic characteristics of the friction signal generated by the sliding operation in the two sliding areas have a large difference, so that the sliding direction can be determined based on the different types of acoustic characteristics of the friction signal.

[0063] Figure 2A Schematic diagram of the structure of the earphone according to some embodiments of this specification. Figure 2A As shown, the earphone 150 may include a sound-emitting portion 154, an ear hook 155 and a housing 156. The sound-emitting portion 154 may be located near the ear and transmit sound. The housing 156 is electrically connected to the sound-emitting portion 154, and the housing 156 may accommodate a battery that provides power to the sound-emitting portion 154. The ear hook 155 is connected between the sound-emitting portion 154 and the housing 156, and the ear hook 155 may be suspended on the ear and place the sound-emitting portion 154 near the user's ear. In some embodiments, the sound-emitting portion 154 may include a movement housing and an earphone core. The movement housing is connected to one end of the ear hook 155 and is used to accommodate the earphone core. The earphone core is located in the internal space formed by the movement housing. The earphone core can be used to convert electrical signals into corresponding mechanical vibrations (that is, "sound"). The housing 156 is connected to the other end of the ear hook 155 (the end away from the sound-emitting portion 154). In some alternative embodiments, the housing 156 can accommodate a circuit board, and the circuit board is electrically connected to the sound-emitting part 154, so that the sound control of the sound-emitting part 154 can be realized. For example, the circuit board can be electrically connected to the earphone core of the sound-emitting part 154 (for example, electrically connected by a wire or a flexible circuit board) so that the circuit board can control the sound of the earphone core. In some alternative embodiments, the housing 156 can be omitted, and the battery can be located inside the core housing. In some embodiments, the earphone 150 may include a microphone. A microphone is a pickup device that can convert a friction signal (such as a sound signal) into an electrical signal. In some embodiments, the microphone may include a bone conduction microphone. The bone conduction microphone can convert a vibration signal into an electrical signal. For example, when a user's finger slides on the surface of the sound-emitting part 154, a vibration signal is generated, and the vibration signal can be transmitted to the bone conduction microphone through the housing structure, and the bone conduction microphone can collect the vibration signal and convert it into an electrical signal. In some embodiments, the microphone may include an air conduction microphone. The air conduction microphone can convert an air conduction friction signal into an electrical signal. For example, when the user's finger slides on the surface of the sound-emitting portion 154, the vibration of the surface of the sound-emitting portion 154 will drive the surrounding air to vibrate and generate an air conduction friction signal. The air conduction microphone can collect the air conduction friction signal and convert it into an electrical signal.

[0064] In some embodiments, the outer surface of the core shell of the sound-emitting portion 154 of the earphone 150 (the outer surface of the core shell of the sound-emitting portion 154 refers to the surface of the core shell facing away from the ear when the earphone 150 is worn) may include a sliding area. The sliding area is arranged on the outer surface of the core shell of the sound-emitting portion 154. On the one hand, it can ensure that the sliding area has a large enough sliding area and is convenient for the user's sliding operation. On the other hand, it can also maintain the wearing stability of the earphone during the sliding process. In some embodiments, in order to make the friction signals generated by different sliding directions have a more obvious distinction, the sliding area can be divided, and the characteristics of the divided sub-sliding areas can be designed so that different sub-sliding areas have different structures or material designs, thereby increasing the difference in the acoustic characteristics of the friction signals generated by the sliding operations on different sub-sliding areas, and then judging the sliding direction according to the different characteristics of the friction signals.

[0065] In some embodiments, Figure 2A As shown, the sliding area may include adjacent first sliding area 151 and second sliding area 152. The first sliding area 151 and the second sliding area 152 are provided on the outer surface of the movement housing of the sound-emitting part 154 of the earphone 150, and the user's fingers may slide on the first sliding area 151 and the second sliding area 152.

[0066] In some embodiments, a certain position on the outer surface of the movement housing of the sound-emitting portion 154 can be used as the transition area 153, and the transition area 153 divides the outer surface into two areas, wherein the surface area between the transition area 153 and one end (free end) of the sound-emitting portion 154 is the second sliding area 152, and the surface area between the transition area 153 and the other end (non-free end) of the sound-emitting portion 154 is the first sliding area 151. For example, Figure 2A As shown, the midline of the long axis direction of the sound-emitting portion 154 can be used as the transition area 153. The transition area 153 can be a transition line (such as Figure 2A In some embodiments, the sum of the areas of the first sliding area 151 and the second sliding area 152 may be less than or equal to the surface area of ​​the outer surface of the core shell of the sound-emitting portion 154 of the earphone 150. In some embodiments, the surface area of ​​the outer surface of the core shell of the sound-emitting portion 154 may be the area of ​​the projection of the sound-emitting portion 154 on the sagittal plane of the human body when the earphone 150 is in the wearing state. For example, Figure 2AAs shown, the sum of the areas of the first sliding area 151 and the second sliding area 152 may be equal to or approximately equal to the surface area of ​​the outer surface of the core shell of the sound-emitting part 154 (in this case, the sliding area is the entire outer surface of the core shell of the sound-emitting part 154). For another example, in other embodiments, considering that the area of ​​the earphone 150 exposed to the air or the area convenient for touch when worn is smaller than the outer surface of the core shell of the sound-emitting part 154 (this is because the free end of the sound-emitting part 154 may be blocked by the auricle when the earphone 150 is worn), the sum of the areas of the first sliding area 151 and the second sliding area 152 may be set to be smaller than the surface area of ​​the outer surface of the core shell of the sound-emitting part 154, such as the sliding area as a whole is far away from the free end of the sound-emitting part 154 (in this case, the sliding area is part of the outer surface of the core shell of the sound-emitting part 154). By setting the free end of the sliding area away from the sound-emitting part 154 as a whole, on the one hand, it can be convenient for the user to perform sliding operations on the entire sliding area; on the other hand, when the earphone 150 is in the worn state, it can ensure that the user's fingers can slide to the entire sliding area, avoiding the situation where the fingers only slide on a sub-sliding area.

[0067] In some embodiments, the user's finger may slide from the first sliding area 151 to the second sliding area 152, or from the second sliding area 152 to the first sliding area 151. The direction of sliding from the second sliding area 152 to the first sliding area 151 may be recorded as sliding in the first direction, and the direction of sliding from the first sliding area 151 to the second sliding area 152 may be recorded as sliding in the second direction. In some embodiments, in order to ensure that the friction signals generated by different sliding directions have a relatively obvious degree of distinction in acoustic characteristics, the first sliding area 151 and the second sliding area 152 may be designed to have different structures and / or material designs, thereby improving the difference in acoustic characteristics of the friction signals generated by sliding in the two sliding directions. In some embodiments, when the first sliding area 151 and the second sliding area 152 have different characteristics (for example, material characteristics, roughness characteristics, or surface structure characteristics), the friction signal (also referred to as the first friction signal) generated when the finger slides in the first sliding area 151 and the friction signal (also referred to as the second friction signal) generated when the finger slides in the second sliding area 152 are distinguishable in the time domain or frequency domain. Distinguishability refers to the difference in acoustic characteristics between the first friction signal and the second friction signal in the time domain or frequency domain. The acoustic characteristics of the friction signal may include, but are not limited to, the amplitude of the friction signal, the peak characteristics (number of peaks, peak time distribution or peak intensity, etc.), the discontinuity characteristics, the fundamental frequency, the peak frequency, etc. For more information on the distinguishability of the friction signals generated when sliding in different sliding areas in the time domain or frequency domain, please refer to the relevant description below.

[0068] For the purpose of illustration, in order to facilitate the comparison of friction signals corresponding to different sliding areas, the friction signals can be collected in the following test method: simulate a finger sliding on two sliding areas with the same condition parameters to generate corresponding friction signals. The condition parameters here may include pressing force, sliding speed and sliding distance. For example, when collecting friction signals, a finger model made of silicone can be used to slide on the two sliding areas with the same pressing force, sliding speed and sliding distance. When the characteristics of the first sliding area 151 and the second sliding area 152 are exactly the same, the acoustic characteristics of the first friction signal generated when the simulated finger slides on the first sliding area 151 with the same condition parameters and the second friction signal generated when the simulated finger slides on the second sliding area 152 are basically the same in the time domain or frequency domain; on the contrary, when the first sliding area 151 and the second sliding area 152 have different characteristics, the first friction signal generated when the simulated finger slides on the first sliding area 151 with the same condition parameters and the second friction signal generated when the simulated finger slides on the second sliding area 152 have obvious differences in the time domain or frequency domain, that is, distinguishability.

[0069] It should be noted that the first sliding area 151 and the second sliding area 152 described above are only exemplary. In other embodiments, more sliding areas may be set to increase the discrimination of the friction signal generated by the sliding operation, or to identify more sliding directions. For example, the sliding area may also include a third sliding area, and the first sliding area 151, the second sliding area 152 and the third sliding area are arranged in sequence along the long axis direction of the sound-emitting portion 154. In this setting, when the user's finger passes through the three sliding areas, the discrimination of the friction signal generated by the sliding operation can be further increased. As an example, when the sliding area includes two sub-sliding areas, the friction signal generated by the sliding operation may have one characteristic mutation, such as when the friction signal generates a mutation when sliding to the connection of the two sub-sliding areas; and when the sliding area includes three sub-sliding areas, the friction signal may generate mutations twice, namely, at the connection between the first sub-sliding area and the second sub-sliding area, and at the connection between the second sub-sliding area and the third sub-sliding area. For another example, the arrangement direction of the three sliding areas may be changed, such as the three sliding areas are arranged in a direction perpendicular to the long axis direction of the sound-emitting portion 154, so as to achieve the recognition of more sliding directions. In some embodiments, the user's finger can not only slide along the first direction or the second direction, but also slide along more other directions, for example, sliding along a third direction and a fourth direction perpendicular to the first direction. The setting method of multiple sliding areas only needs to satisfy that the acoustic characteristics of the friction signal generated by the user sliding on the multiple sliding areas can have a large difference, thereby judging the sliding direction based on the acoustic characteristics of the friction signal.

[0070] In some embodiments, the two sliding areas may be designed with characteristics to improve the distinguishability of the friction signal generated when the user's finger slides in the two sliding areas in terms of acoustic characteristics (e.g., the volume of the friction signal, the frequency of the friction signal, the number of peaks in the friction signal, the discontinuity of the friction signal), so as to determine the sliding direction based on the difference in acoustic characteristics. In some embodiments, the two sliding areas may be designed with characteristics to improve the degree of difference in the volume of the friction signal generated when the user's finger slides in the two sliding areas, so as to determine the sliding direction based on the volume. In some embodiments, the two sliding areas may be designed with characteristics so that the surface roughness, material, surface structure, porosity, etc. of the two sliding areas are different, so as to achieve a significant difference in the volume of the friction signal generated when the finger slides in the two sliding areas. At this time, the distinguishability is reflected in the difference in volume (also called amplitude difference) between the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152. In other words, when the surface roughness, material, surface structure or porosity of the two sliding areas are different, the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152 have an amplitude difference at least in the time domain. In some embodiments, the amplitude difference mentioned here can be understood as the amplitude difference between the first friction signal and the second friction signal is not less than 20% of the amplitude of the first friction signal or the second friction signal.

[0071] In some embodiments, the characteristic design of the sliding area may include material design. In some embodiments, the first sliding area 151 and the second sliding area 152 may be made of different materials. The volume of the friction signal generated by sliding on the sliding areas with different material designs has a large difference. That is, the material characteristics of the two sliding areas are set to be different, and the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152 have an amplitude difference at least in the time domain. In some embodiments, the material of the sliding area may include but is not limited to rubber, silicone, plastic, metal (or metal alloy), etc. In some embodiments, plastic may include but is not limited to high molecular polyethylene, blown nylon, engineering plastics, etc. or any combination thereof. Rubber may refer to other single or composite materials that can achieve the same performance, and may include but is not limited to general-purpose rubber and special rubber. In some embodiments, general-purpose rubber may include but is not limited to natural rubber, isoprene rubber, styrene-butadiene rubber, butadiene rubber, chloroprene rubber, etc. or any combination thereof. In some embodiments, special rubber may include but is not limited to nitrile rubber, silicone rubber, fluororubber, polysulfide rubber, polyurethane rubber, epichlorohydrin rubber, acrylate rubber, propylene oxide rubber, etc. or any combination thereof. In some embodiments, the composite material may include but is not limited to reinforcing materials such as glass fiber, carbon fiber, boron fiber, graphite fiber, fiber, graphene fiber, silicon carbide fiber or aramid fiber. In some embodiments, in order to increase the difference in volume of the friction signal generated by sliding on the first sliding area 151 and the second sliding area 152, different materials may be used for the first sliding area 151 and the second sliding area 152. For example, the first sliding area 151 may be silicone and the second sliding area 152 may be plastic. For another example, the first sliding area 151 may be silicone and the second sliding area 152 may be metal aluminum. For another example, the first sliding area 151 may be rubber and the second sliding area 152 may be aluminum alloy.

[0072] In some embodiments, different materials have different parameters. The parameters of the material may include, but are not limited to, hardness, elastic modulus, plasticity, toughness, etc. In some embodiments, in order to increase the volume difference of the friction signal generated by sliding on the first sliding area 151 and the second sliding area 152, at least one of the parameters of the materials of the first sliding area 151 and the second sliding area 152 is different. In some embodiments, the elastic modulus of the materials of the first sliding area 151 and the second sliding area 152 may be different. For example, the materials of the first sliding area 151 and the second sliding area 152 may be a flexible material and a rigid material, respectively. The elastic modulus of the flexible material ranges from 7.8 MPa to 1.2 GPa. The elastic modulus of the rigid material ranges from 2.2 G Pa to 150 GPa. As an example, the material of the first sliding area 151 may be rubber, and the material of the second sliding area 152 may be plastic. In some embodiments, the hardness of the materials of the first sliding area 151 and the second sliding area 152 may be different. The difference between the Shore hardness of the material of the first sliding area 151 and the Shore hardness of the material of the second sliding area 152 is in the range of 42 HD to 86 HD. As an example, the material of the first sliding area 151 may be hard plastic, and the material of the second sliding area 152 may be rubber. It should be noted that the first sliding area 151 and the second sliding area 152 may be made of different materials or the same material with different material parameters, as long as the volume of the friction signal generated by sliding on the first sliding area 151 and the second sliding area 152 has a large difference so as to be able to determine the sliding direction, and this specification does not specifically limit the combination of materials or material parameters.

[0073] In some embodiments, the characteristic design of the sliding area may include a roughness design. In some embodiments, the first sliding area 151 and the second sliding area 152 may have different roughness. The roughness characteristics of the two sliding areas are set to be different, and the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152 have an amplitude difference at least in the time domain. Roughness can be used to characterize the degree of smoothness or roughness of the sliding area. The smaller the roughness, the smoother the sliding area; the larger the roughness, the rougher the sliding area. The volume of the friction signal generated by sliding on sliding areas with different roughness is different, so the sliding direction can be judged according to the volume of the friction signal generated by the sliding operation.

[0074] In some embodiments, the roughness can be characterized by particle parameters. The particle parameters can include but are not limited to particle size, shape, number, spacing, etc. Figure 3A-3CSchematic diagram of a structure in which the first sliding area and the second sliding area have different roughness according to some embodiments of the present specification. In some embodiments, the roughness can be formed by processing particles on the sliding area. In some embodiments, Figure 3A As shown, a number of particles can be arranged on the first sliding area 151, and the first sliding area 151 has a rough surface; no particles are arranged on the second sliding area 152, and the second sliding area 152 has a smooth surface. In some embodiments, the parameters of the particles on the first sliding area 151 can determine the roughness of the first sliding area 151. It can be understood that the parameters of the particles are related to the size of the sound-emitting part of the earphone and ergonomics. As an exemplary description only, the size of the area where the particles can be arranged on the outer surface of the sound-emitting part is about 12mm*24mm, and the size of the contact area between the fingertips and the earphone during sliding (i.e., the sliding area) is about 14mm*14mm. In order to increase the difference in the volume of the friction signal generated by sliding on the two sliding areas, the shape of the particles on the first sliding area 151 can be hemispherical, the diameter of the particles is 0.1mm~2mm, and the distance between the particles is 0.2mm~4mm. In some embodiments, as Figure 3B As shown, no particles are arranged on the first sliding area 151, and the first sliding area 151 is a smooth surface; a plurality of particles are arranged on the second sliding area 152, and the second sliding area 152 is a rough surface. The particles on the second sliding area 152 are spherical in shape, with a diameter of 0.1 mm to 2 mm, and a particle spacing of 0.2 mm to 4 mm.

[0075] In some embodiments, Figure 3C As shown, a plurality of particles can be disposed on each of the first sliding region 151 and the second sliding region 152, but the particles on the two sliding regions have different parameters. Figure 3C As shown, the particles on the two sliding areas have the same shape and size, but the number of particles and the distance between particles are different. The difference in the number of particles and the distance between particles can make the friction signals generated by sliding on the two sliding areas have a large difference. For example, in other embodiments, the particles in the two sliding areas have the same shape, different particle sizes, different number of particles and different distance between particles, or the particles in the two sliding areas have different shapes, the same particle sizes, the same number of particles and the same distance between particles, or the particles have different shapes, particle sizes, number of particles and distance between particles.

[0076] Figure 4A-4B1 is another structural schematic diagram of a first sliding area and a second sliding area having different roughnesses according to some embodiments of the present specification. In some embodiments, the sliding area can have different roughnesses by processing stripes on the sliding area. In some embodiments, the width, height and spacing of the stripes can determine the roughness of the sliding area. The stripe width refers to the length of the stripe along the stripe arrangement direction. The stripe height refers to the length of the stripe protruding from the surface of the sliding area. The stripe spacing refers to the distance between two adjacent stripes. In some embodiments, Figure 4A As shown, a plurality of stripes can be arranged on the first sliding area 151, and the first sliding area 151 is a rough surface; no stripes are arranged on the second sliding area 152, and the second sliding area 152 is a smooth surface. It can be understood that the parameters of the stripes are related to the size of the sound-emitting part of the earphone and ergonomics. As an exemplary description only, the size of the striped area on the outer surface of the sound-emitting part can be arranged is about 12mm*24mm, and the size of the contact area between the fingertips and the earphone during sliding (i.e., the sliding area) is about 14mm*14mm. In order to increase the difference in the volume of the friction signal generated by sliding on the two sliding areas, the width of the stripes on the first sliding area 151 can be 0.5mm~5mm, the height of the stripes is 0.1mm~2mm, and the spacing between the stripes is 0.2mm~8mm. In some embodiments, as Figure 4B As shown, a plurality of stripes can be set on both the first sliding area 151 and the second sliding area 152, but the stripes on the two sliding areas have different parameters. For example, the stripes on the two sliding areas have the same width and height, but different stripe intervals. For another example, the stripes on the two sliding areas have different widths, the same height, but different stripe intervals. For another example, the stripes on the two sliding areas have different widths, different heights, and different stripe intervals. It should be noted that Figure 3A-3C The design of the particle roughness shown in Figure 4A-4B The stripe roughness designs shown in can be used in combination.

[0077] As a specific example, the first sliding area 151 can be a smooth surface (such as silicone, resin), and the second sliding area 152 can be a frosted surface. The volume of the friction signal generated by the user's finger sliding on the frosted surface is usually higher than the volume of the friction signal generated by the finger sliding on the smooth surface (it can be understood that when sliding on the frosted surface and the smooth surface, the force of the finger sliding is basically the same), so the sliding direction can be judged according to the volume of the friction signal generated by the sliding operation. For example, if the volume of the friction signal generated by the sliding operation is small at first and then large, it can be judged that the user's finger is sliding from the smooth surface to the frosted surface (i.e., sliding from the first sliding area 151 to the second sliding area 152); if the volume of the friction signal generated by the sliding operation is large at first and then small, it can be judged that the user's finger is sliding from the frosted surface to the smooth surface (i.e., sliding from the second sliding area 152 to the first sliding area 151). In some embodiments, in order to ensure that the volume of the friction signal generated by the frosted surface and the smooth surface has a large difference, the difference in the dynamic friction coefficient between the frosted surface and the smooth surface can be greater than 0.3. Figure 2B is a result diagram of the friction signal according to some embodiments of the present specification. Figure 2B The left friction signal in the figure represents the friction signal generated by the smooth surface, and the right friction signal represents the friction signal generated by the frosted surface. It can be seen from the figure that the amplitude (that is, volume) of the friction signal on the right is greater than that of the friction signal on the left.

[0078] In some embodiments, the characteristic design of the sliding area may include a surface structure design. In some embodiments, the first sliding area 151 and the second sliding area 152 may have different surface structures. The surface structure characteristics of the two sliding areas are set to be different, and the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152 have an amplitude difference at least in the time domain. The surface structure may refer to a special structure of the surface of the sliding area. In some embodiments, the surface structure may include a plane structure and a gradient structure. The gradient structure has a certain slope (greater than zero), and when the slope of the gradient structure is different, the volume of the friction signal generated by the sliding operation has a large difference. It is understandable that the slope of the plane structure is zero. In some embodiments, the gradient structure may include, but is not limited to, a fish scale structure and a helical tooth structure.

[0079] Figure 5 It is a schematic diagram of the structure of the fish scale structure shown in some embodiments of this specification. Figure 6 Schematic diagram of the structure of the helical gear structure according to some embodiments of this specification. Figure 5 As shown in the figure, several scale-like structures are arranged in the same direction and tilted to form a fish scale-like structure. Figure 6As shown, a plurality of triangular protrusions are arranged to form a helical tooth structure. In some embodiments, two adjacent protrusions may be arranged at intervals (e.g. Figure 6 In some embodiments, the shape of the protrusions is not limited to Figure 6 The triangle shown may also be other geometric shapes, for example, regular and / or irregular shapes such as a pentagonal star and a quadrilateral. In some embodiments, the gradient structure (fish scale structure or bevel tooth structure) may have a slope. For example, when the protrusion is a triangle, the slope of the bevel tooth structure may be the tangent value of the angle α. When sliding on sliding areas with gradient structures of different slopes, the volume of the friction signal generated is quite different. By setting the slope of the gradient structure, the volume of the friction signal generated by sliding on the sliding area of ​​the gradient structure with the slope can be adjusted, thereby increasing the differentiation of the volume of the friction signal generated by sliding on the two sliding areas.

[0080] In some embodiments, different surface structures can be set on the two sliding areas to increase the difference in volume between the friction signals generated by sliding on the two sliding areas. For example, the surface structure of the first sliding area 151 is a plane structure, and the surface structure of the second sliding area 152 is a helical tooth structure. For another example, the surface structures of the first sliding area 151 and the second sliding area 152 are both helical tooth structures, but the slopes of the two helical tooth structures are different. In other embodiments, the direction of the gradient structure can also be set to increase the difference in volume of the friction signals generated by sliding on the two sliding areas. For example, the surface structures of the two sliding areas are both fish scale structures, and the directions of the fish scale structures are different.

[0081] Figure 7A-7C is a schematic diagram of a structure in which the first sliding area and the second sliding area have different surface structures according to some embodiments of the present specification. Fig. 7A As shown, the surface structure of the first sliding area 151 is a helical tooth structure, and the surface structure of the second sliding area 152 is a flat structure. Figure 7B As shown, the surface structure of the first sliding area 151 is a plane structure, and the surface structure of the second sliding area 152 is a helical tooth structure. Figure 7CAs shown, the surface structures of the first sliding area 151 and the second sliding area 152 are both helical tooth structures, and the slopes of the helical tooth structures are the same, and the orientations of the helical tooth structures are different. It should be noted that the plane structure and the gradient structure are only exemplary structures of the surface structure. In other alternative embodiments, the surface structure may include any protruding structure provided on the surface of the sliding area. The protruding structure may refer to a geometric structure protruding from the surface of the sliding area. For example, the protruding particles provided on the surface of the sliding area may serve as the surface structure of the sliding area. In addition, the embodiments of this specification do not specifically limit the number of protruding structures.

[0082] In some embodiments, the first sliding area 151 and the second sliding area 152 can be arbitrarily combined in terms of material, roughness and surface structure design, so that the volume of the friction signal generated by sliding on the two sliding areas can be more distinguished, thereby improving the accuracy of sliding direction judgment. In some embodiments, the first sliding area 151 and the second sliding area 152 can have the same characteristic design in terms of material, roughness and surface structure design, and the other two characteristic designs are different. In some embodiments, the materials of the first sliding area 151 and the second sliding area 152 can be the same, but the roughness and surface structure are different. For example, the materials of the first sliding area 151 and the second sliding area 152 are both silicone; particles are set on the first sliding area 151, and the first sliding area 151 is a rough surface, and no particles are set on the second sliding area 152, and the second sliding area 152 is a smooth surface; the surface structure of the first sliding area 151 is a fish scale structure, and the surface structure of the second sliding area 152 is a plane structure. In other embodiments, the roughness of the first sliding area 151 and the second sliding area 152 may be the same, but the material and surface structure are different, or the surface structure of the first sliding area 151 and the second sliding area 152 may be the same, but the material and roughness are different. In some embodiments, the first sliding area 151 and the second sliding area 152 may be different in design of material, roughness and surface structure. For example, the material of the first sliding area 151 is silicone, and the material of the second sliding area 152 is plastic; no particles are set on the first sliding area 151, and the first sliding area 151 is a smooth surface, and particles are set on the second sliding area 152, and the second sliding area 152 is a rough surface; the surface structure of the first sliding area 151 is a plane structure, and the surface structure of the second sliding area 152 is a helical tooth structure.

[0083] Fig.7D It is a result diagram of the friction signal generated by different sliding directions according to some embodiments of this specification. Fig.7DThe setting of the middle sliding area is as follows: the materials, roughness and surface structures of the first sliding area 151 and the second sliding area 152 are all different. The friction signals on the left and right sides of the figure are respectively the friction signals generated by sliding in the first direction (sliding from the second sliding area to the first sliding area) and sliding in the second direction (sliding from the first sliding area to the second sliding area). Fig.7D From the friction signals on the left and right sides, it can be seen that the volume of the left friction signal is significantly lower than that of the right friction signal. Therefore, the sliding direction can be determined by the volume of the friction signal.

[0084] In some embodiments, other characteristics of the two sliding areas may be designed, such as setting different porosities of the two sliding areas, and different contact areas between the finger and the two sliding areas during sliding. Taking porosity as an example, the first sliding area 151 and the second sliding area 152 may have different porosities. The pores on the surface of the sliding area may increase the amplitude of the friction signal. The porosities of the two sliding areas are set to be different, and the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152 have an amplitude difference at least in the time domain. Figure 2C is an exemplary structural diagram of a sliding area according to some embodiments of this specification, such as Figure 2C As shown, the surface of the first sliding area 151 can be a smooth surface (i.e., no pores are provided), and the surface of the second sliding area 152 is provided with a plurality of pores 152-1. Compared with the friction signal generated by sliding in the first sliding area 151, the pores 152-1 can make the friction signal generated in the second sliding area 152 have a larger amplitude. Figure 2D is a result diagram of the friction signal according to some embodiments of the present specification. Figure 2D The left friction signal in the figure represents the friction signal generated by the second sliding area 152 (with pores), and the right friction signal represents the friction signal generated by the first sliding area 151 (without pores). It can be seen from the figure that the amplitude (that is, volume) of the friction signal on the right is smaller than the amplitude of the friction signal on the left.

[0085] In some embodiments, the characteristics of the two sliding areas can be designed to increase the frequency difference of the friction signal generated when the user's finger slides in the two sliding areas, so as to determine the sliding direction according to the frequency difference. In some embodiments, the characteristics of the sliding area can be designed so that the two sliding areas have different natural resonant frequencies, thereby increasing the distinguishability of the frequency characteristics of the friction signal generated by the finger sliding on the two sliding areas. At this time, the distinguishability is reflected in the difference in frequency characteristics between the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152. That is, the two sliding areas are set to have different natural resonant frequencies, and the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152 have differences at least in the frequency domain. In some embodiments, a wave plate, a string, a beam, a membrane, a cavity (such as a Helmholtz resonant cavity) and the like structures can be set on one of the sliding areas, while the other sliding area is not set with the above structure; or wave plates, strings, beams, membranes, cavities and the like structures with different parameters (such as different lengths / widths / thicknesses) are set on the two sliding areas. In some embodiments, wave plates with different lengths can be set on the sliding area. The frequencies of the friction signals generated by the finger sliding over the wave plates with different lengths are obviously different. Therefore, the sliding direction can be determined according to the frequency difference of the friction signal. As an example, Figure 2E is an exemplary structural diagram of a sliding area according to some embodiments of this specification, such as Figure 2E As shown in (a) in FIG. 1 , a plurality of wave plates 151 - 2 with different lengths may be arranged on one sliding region, and no wave plate may be arranged on another sliding region. Figure 2E As shown in (b) of FIG. 1 , a plurality of wave plates 151 - 2 with different lengths may be provided on both sliding regions. The length of the wave plate 151 - 2 refers to the projection size of the wave plate in a direction perpendicular to the surface of the sliding region. In some embodiments, Figure 2E As shown in (a) and (b) in FIG. 2E , the wave plate 151-2 can be arranged vertically (i.e., perpendicular to the surface of the sliding area). In other embodiments, the wave plate 151-2 can also be arranged tilted, as shown in (c) in FIG. 2E . In some embodiments, similar to the arrangement of the wave plate, strings with different lengths can also be arranged on the sliding area. The frequencies of the friction signals generated by the fingers sliding over strings of different lengths are significantly different. As an example, Figure 2EAs shown in (d) in the figure, a plurality of strings 151-3 with different lengths may be provided on both sliding areas. It is to be understood that in other embodiments, a plurality of strings with different lengths may be provided on one sliding area, and no string may be provided on the other sliding area. The length of the string 151-3 refers to the extension dimension of the string in a direction parallel to the surface of the sliding area. In some embodiments, membranes or cavities with different sizes may be formed on the sliding area, and the frequencies of the friction signals generated by the fingers sliding over membranes or cavities with different sizes are significantly different. As an example, Figure 2E As shown in (e) in FIG. 1 , a hollowing out may be performed below one sliding area to form the membrane 151 - 1 , and no provision is made for the other sliding area. Figure 2E As shown in (f) in FIG. 1 , cavities 151-4 having different sizes (such as volumes) can be formed below the two sliding areas (below the sliding area refers to the direction of the sliding area toward the inside of the sound-emitting part). The shape of the cavity 151-4 can be as follows: Figure 2E The circular or elliptical shape shown in (f) in the figure may be other shapes in other embodiments, such as square, triangle, pentagon and other regular and / or irregular geometric shapes. In some embodiments, different structures (reed, string, membrane, cavity, etc.) may be combined arbitrarily (i.e., different types of structures are respectively arranged on the two sliding areas) so that the frequency of the friction signal generated by the sliding operation has a more obvious difference.

[0086] In some embodiments, a microstructure (e.g., a spring sheet) may be provided on a sub-sliding area. When a finger slides to the sub-sliding area, the microstructure may continue to vibrate and continuously generate a friction signal with a fast jitter frequency and a small amplitude for a certain period of time (a friction signal with a fast jitter frequency and a small amplitude may be recorded as a specific friction signal). Thus, the sliding direction may be identified by the specific friction signal generated by the microstructure. For example, a microstructure may be provided on the first sliding area 151. When the sliding direction is different, the time at which the specific friction signal appears is different. For example, when the user's finger slides from the second sliding area 152 to the first sliding area 151, the specific friction signal appears later; when the user's finger slides from the first sliding area 151 to the second sliding area 152, the specific friction signal appears earlier. Thus, the sliding direction may be identified according to the time at which the specific friction signal appears.

[0087] In some embodiments, the two sliding areas may also be designed with materials, roughness, and / or surface structure so that the frequencies of the friction signals generated by the sliding operation are more obviously different, thereby determining the sliding direction based on the frequency difference of the friction signals. In some embodiments, the two sliding areas are provided with different material properties (or roughness properties, surface structure properties), and the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152 are distinguishable at least in the frequency domain, and the distinguishability is manifested in that the proportion of the friction signal within a specific frequency or a specific frequency range in the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152 is different. Taking material design as an example, the proportion of low-frequency components in the friction signal generated by sliding on sliding areas of materials with different hardness is different. For example, the proportion of low-frequency components in the friction signal generated by sliding on the sliding area of ​​soft materials is greater than the proportion of low-frequency components in the friction signal generated by sliding on the sliding area of ​​harder materials.

[0088] In some embodiments, two sliding areas are provided with different surface structural characteristics (or roughness characteristics, material characteristics), and a first friction signal generated when a finger slides in the first sliding area 151 and a second friction signal generated when a finger slides in the second sliding area 152 are distinguishable at least in the frequency domain, and the distinguishability is manifested in that the fundamental frequencies of the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152 are different. In some embodiments, the fundamental frequency refers to the lowest frequency in the friction signal. In the case of a helical tooth structure in the surface structure design (for example, Fig. 7A As an example, Figure 2F It is a geometric relationship diagram of concentric circles formed by connecting the vertices of the helical tooth structure shown in some embodiments of this specification. For ease of description, the concentric circles can be placed in the xoy coordinate system, and the distance between two adjacent helical teeth in the helical tooth structure is defined as d x , the radius of the concentric circle 301 is r1, and the radius difference between two adjacent concentric circles (concentric circle 301 and concentric circle 302) is d r , draw a perpendicular line from point A on the concentric circle 301 to the y-axis and compare it with point B on the y-axis, and the distance between the line segment oB is d. At this time, according to the geometric relationship, equation (1) can be obtained:

[0089] When the finger slides on the helical tooth structure at a speed Vx along the direction of the arrow in the figure, d x remains unchanged, and d x =d r The fundamental frequency of the friction signal generated at this time is f0 = 2Vx / dx It can be seen that the sliding speed Vx of the finger and the spacing d between adjacent helical teeth x The fundamental frequency of the friction signal is determined. Therefore, when the sliding speed remains basically the same, the spacing between adjacent helical teeth determines the fundamental frequency of the friction signal. In this case, the spacing between adjacent helical teeth can be set to increase the degree of difference in the fundamental frequency of the friction signal generated when the user's finger slides in two sliding areas (i.e., the area covered by the helical tooth structure and the smooth area). In addition, the material and shape of a single helical tooth in the helical tooth structure determine the frequency peak strength of the friction signal. Figure 2G It is a frequency distribution diagram of the friction signal generated when sliding on the helical tooth structure according to some embodiments of this specification. It can be seen from the figure that the friction signal generated by sliding on the helical tooth structure has multiple characteristic frequency lines, and each characteristic frequency line basically shows a trend of increasing frequency first and then decreasing, and has its own peak frequency. The peak frequency on the characteristic frequency line 201 is marked as 1313.5Hz, the peak frequency on the characteristic frequency line 202 is 2435.8Hz, the peak frequency on the characteristic frequency line 203 is 3704.3Hz, the peak frequency on the characteristic frequency line 204 is 4863.5Hz, and the peak frequency on the characteristic frequency line 205 is 6007.6Hz. The fundamental frequency of the friction signal and its higher harmonics constitute the friction signal soundprint.

[0090] For more information about material design, roughness design and / or surface structure design, please refer to the above description and will not be repeated here.

[0091] In some embodiments, the two sliding areas may be designed to have different peak characteristics (e.g., number of peaks, peak time distribution, peak intensity) of the friction signal generated when the user's finger slides in the two sliding areas, so that the sliding direction can be determined based on the peak characteristics in the friction signal. The fine slits may cause peaks to appear in the friction signal generated by the sliding operation of the finger on the sliding area. Based on this, in some embodiments, different fine slits may be set on the two sliding areas so that the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152 are distinguishable, and the distinguishability is manifested in that the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152 have at least a difference in peak characteristics. In some embodiments, a plurality of slits may be provided on the first sliding area 151, and no slits may be provided on the second sliding area 152. When the finger slides on the first sliding area 151, the slits may cause a peak to appear in the friction signal generated by the sliding operation, while when the finger slides on the second sliding area 152, the friction signal generated has basically no peak, so the sliding direction can be determined according to the peak time distribution in the friction signal. For example, if the time when the peak appears is the initial sliding period, it can be determined that the sliding direction is sliding from the first sliding area 151 (with slits) to the second sliding area 152 (without slits); if the time when the peak appears is the late sliding period, it can be determined that the sliding direction is sliding from the second sliding area 152 (without slits) to the first sliding area 151 (with slits). When the finger slides on the two sliding areas, the initial sliding period refers to the time period corresponding to the sliding area where the finger slides first, and the late sliding period refers to the time period corresponding to the sliding area where the finger slides later.

[0092] In some embodiments, different numbers of slits may be provided on the first sliding area 151 and the second sliding area 152, so that the sliding direction can be determined according to the number of peaks appearing in the friction signal. For example, if the number of slits provided on the first sliding area 151 is greater than that provided on the second sliding area 152, the number of peaks in the first friction signal generated when the finger slides on the first sliding area 151 is greater than the number of peaks in the second friction signal generated when the finger slides on the second sliding area 152. The sliding direction can be determined by comparing the number of peaks in the friction signal generated at the beginning of sliding and at the end of sliding. If the number of peaks in the friction signal generated at the beginning of sliding is greater, it can be determined that the sliding direction is sliding from the first sliding area 151 to the second sliding area 152; if the number of peaks in the friction signal generated at the end of sliding is greater, it can be determined that the sliding direction is sliding from the second sliding area 152 to the first sliding area 151.

[0093] In some embodiments, the depth of the slit may affect the intensity of the peak caused by the slit. The depth of the slit refers to the dimension of the slit extending from the surface of the movement housing to the inside of the sound-generating part. Within a certain range, the deeper the depth of the slit, the higher the peak intensity caused by it; the shallower the depth of the slit, the lower the peak intensity caused by it. In some embodiments, the depths of the slits set on the first sliding area 151 and the second sliding area 152 may be different, so that the sliding direction is determined according to the peak intensity of the peak appearing in the friction signal. For example, if the depth of the slit set on the first sliding area 151 is greater than the depth of the slit set on the second sliding area 152, the peak intensity of the peak in the first friction signal generated when the finger slides in the first sliding area 151 is higher than the peak intensity in the second friction signal generated when the finger slides in the second sliding area 152. If the peak intensity in the friction signal is large first and then small, it can be determined that the sliding direction is sliding from the first sliding area 151 to the second sliding area 152; if the peak intensity is small first and then large, it can be determined that the sliding direction is sliding from the second sliding area 152 to the first sliding area 151.

[0094] Figure 2H is a result diagram of the friction signal according to some embodiments of the present specification. Figure 2H The left friction signal in the figure represents the friction signal generated by the first sliding area 151 (with fine gaps), and the right friction signal represents the friction signal generated by the second sliding area 152 (without fine gaps). It can be seen from the figure that the left friction signal has a peak, while the right friction signal has no peak.

[0095] In some embodiments, an array structure may also be provided on the sliding area. When a finger slides over the array structure, the rebound and impact of the array structure itself may cause a peak or a sudden jump to appear in the friction signal generated by the sliding operation, thereby determining the sliding direction based on the characteristics of the peak or the sudden jump. Preferably, the material of the array structure may be a flexible material. In some embodiments, the constituent units of the array structure may include, but are not limited to, micro-pillars, grooves, and the like. Fig.2I and Figure 2J Schematic diagram of the structure of microcolumns according to some embodiments of this specification. Fig.2I and Figure 2J As shown, the micro-pillars 300 can be arranged in an array on the sliding area. When a finger slides over the micro-pillars 300, the rebound and impact of the micro-pillars 300 themselves can cause a peak or a sudden jump in the friction signal generated by the sliding operation. In some embodiments, the micro-pillars 300 can be arranged vertically (such as Fig.2I as shown) or tilt settings (as Figure 2J). In some embodiments, the parameters of the micro-pillar 300 are different, and the number and strength of the peaks or jumps in the friction signal are different. In some embodiments, in order to ensure that the sliding direction can be determined by the peaks or jumps in the friction signal, the micro-pillar 300 can have a suitable parameter range. As an example, the diameter of the micro-pillar 300 can be 0.5 mm to 2 mm, the gap between adjacent micro-pillars 300 is 1 mm to 10 mm, and the height of the micro-pillar 300 is 0.5 mm to 5 mm. Figure 2K is a result diagram of the friction signal according to some embodiments of the present specification. Figure 2K The left friction signal in the figure represents the friction signal generated by the sliding area where the micro-pillar array is arranged, and the right friction signal represents the friction signal generated by the sliding area where the micro-pillar array is not arranged. It can be seen from the figure that the left friction signal has a peak, while the right friction signal has no peak.

[0096] In some embodiments, material design, roughness design and / or surface structure design may also be performed on the two sliding areas so that the peak characteristics of the friction signal generated by the sliding operation have more obvious differences. For more information about material design, roughness design and / or surface structure design, please refer to the above description and will not be repeated here.

[0097] In some embodiments, the two sliding areas may be designed with characteristics so that the friction signal generated when the user's finger slides in the two sliding areas is discontinuous, so that the sliding direction can be judged according to the discontinuity of the friction signal. In some embodiments, the two sliding areas may have different array structure designs so that the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152 are distinguishable, and the distinguishability is manifested as the difference in the discontinuity characteristics between the first friction signal generated when the finger slides in the first sliding area 151 and the second friction signal generated when the finger slides in the second sliding area 152. In some embodiments, an array structure is set on the sliding area, and when the finger slides over the array structure, the finger and the array structure are constantly in contact or separated, thereby enabling obvious discontinuity characteristics to be generated in the friction signal (that is, the friction signal is discontinuous), so that the sliding direction can be judged according to the discontinuity of the friction signal. For example, a friction signal is generated when the finger contacts the array structure, and no friction signal is generated when the finger is separated from the array structure. Repeated contact and separation with the array structure will eventually result in a discontinuous friction signal. In some embodiments, the material of the array structure may be a hard material. In some embodiments, the constituent units of the array structure may include but are not limited to microcolumns (the structure and arrangement of the microcolumns can be referred to Fig.2I and Figure 2J , and related descriptions), grooves, etc. Figure 2Lis a result diagram of the friction signal according to some embodiments of the present specification. Figure 2L The right friction signal in the figure represents the friction signal generated by sliding on the sliding area with a hard micro-pillar array, and the left friction signal represents the friction signal generated by sliding on the sliding area without a hard micro-pillar array. It can be seen from the figure that the friction signal on the right is discontinuous and has discontinuity. The discontinuity here can be reflected in the discontinuity of the time domain signal corresponding to the friction signal on the right.

[0098] In some embodiments, material design, roughness design and / or surface structure design may also be performed on the two sliding areas so that the discontinuity of the friction signal generated by the sliding operation has a more obvious difference. For more information about material design, roughness design and / or surface structure design, please refer to the above description and will not be repeated here.

[0099] In the above, by designing the characteristics of the first sliding area and the second sliding area (e.g., material, roughness, surface structure, microstructure, slits, array structure, etc.), it can be understood that the difference between the friction signals generated in different sliding directions is increased at the level of friction signal generation. In some embodiments, the difference between the friction signals can also be increased at other levels, such as the level of friction signal propagation and friction signal collection.

[0100] In some embodiments, the friction signal generated by the sliding operation is collected by a microphone. Therefore, the difference of the friction signal can be further increased by setting the position of the microphone in the headset 150. In some embodiments, the position of the microphone (especially the air conduction microphone) can be set closer to a sub-sliding area, and the corresponding microphone will be further away from another sub-sliding area. At this time, the intensity of the friction signal generated by different sliding directions collected by the microphone has a large difference in the time domain. Taking the microphone closer to the first sliding area 151 and away from the second sliding area 152 as an example, when the user's finger slides from the first sliding area 151 to the second sliding area 152, the intensity of the friction signal collected by the microphone is first large and then decreases; when the user's finger slides from the second sliding area 152 to the first sliding area 151, the intensity of the friction signal collected by the microphone is first small and then increases. Therefore, by setting the position of the microphone away from the first sliding area 151 and / or the second sliding area 152, the difference in the intensity of the friction signal generated by different sliding directions collected by the microphone in the time domain can be increased, thereby improving the accuracy of sliding direction recognition. In some embodiments, the ratio of the distance between the microphone and the two sub-sliding areas (for example, the ratio of the distance between the microphone and the second sliding area 152 to the distance between the microphone and the first sliding area 151) may be greater than or equal to 1. In some embodiments, in order to increase the difference in the time domain between the strength of the friction signal generated by different sliding directions received by the microphone, the ratio of the distance between the microphone and the two sub-sliding areas may be greater than or equal to 1.5. In some embodiments, in order to increase the difference in the time domain between the strength of the friction signal generated by different sliding directions received by the microphone, the ratio of the distance between the microphone and the two sub-sliding areas may be greater than or equal to 2. In some embodiments, in order to increase the difference in the time domain between the strength of the friction signal generated by different sliding directions received by the microphone, the ratio of the distance between the microphone and the two sub-sliding areas may be greater than or equal to 3. In some embodiments, in order to increase the difference in the time domain between the strength of the friction signal generated by different sliding directions received by the microphone, the ratio of the distance between the microphone and the two sub-sliding areas may be greater than or equal to 4. In some embodiments, in order to increase the difference in the time domain between the strength of the friction signal generated by different sliding directions received by the microphone, the ratio of the distance between the microphone and the two sub-sliding areas may be greater than or equal to 5. The distance between the microphone and the sub-sliding area may refer to the distance between the geometric center of the sound inlet hole of the air conduction microphone and the geometric center of the sub-sliding area.

[0101] In some embodiments, acoustic materials (e.g., sound-absorbing materials or reinforcing materials) may be arranged in the propagation path of the friction signal, so that the friction signal generated by the sliding operation on a sub-sliding area is enhanced or weakened at a specific frequency, thereby increasing the difference in frequency distribution of the friction signals generated in different sliding directions, thereby improving the accuracy of identifying the sliding direction. For example, a sound-absorbing material (e.g., sound-absorbing cotton, acoustic gauze, etc.) may be arranged on the inner side surface (the side facing the inside of the sound-emitting part) of the first sliding area 151. At this time, when the friction signal generated by sliding on the first sliding area 151 is transmitted to the microphone, the friction signal of a specific frequency is absorbed by the sound-absorbing material and weakened, thereby increasing the difference in frequency distribution of the friction signals generated in different sliding directions. In some embodiments, an obstruction may also be formed on the propagation path of the friction signal, so that the friction signal generated by the sliding operation on a sub-sliding area is weakened at a specific frequency due to the obstruction, thereby increasing the difference in frequency distribution of the friction signals generated in different sliding directions. For example, the microphone is disposed between the first sliding area 151 and the second sliding area 152, and a baffle can be disposed on the side of the microphone close to the first sliding area 151, and the baffle can block the friction signal generated by the sliding operation on the first sliding area 151 from being transmitted to the microphone, so that the friction signal generated by the sliding operation on the first sliding area 151 is weakened at a specific frequency, thereby increasing the difference in frequency distribution of friction signals generated in different sliding directions. In other embodiments, the housing structure of the earphone itself can also be used to form a shield.

[0102] In some embodiments, considering that the friction signal generated by the sliding operation is greatly affected by individual operation factors, the structure of the sliding area can be further optimized so that the acoustic characteristics of the friction signal generated by the sliding operation have more significant differences, thereby reducing the influence of individual operation factors on the friction signal and further improving the accuracy of sliding direction judgment. As an example, when the array structure is designed on the sliding area, the height of the micro-columns in the array structure and the distance between different micro-columns can be set to further increase the degree of difference in the acoustic characteristics of the friction signal generated by the sliding operation.

[0103] It should be noted that the earphone 150 is only used as an example structure of a terminal device to describe the design of the sliding area. The design of the sliding area on other terminal devices can refer to the description of the sliding area on the earphone 150.

[0104] Figure 8 FIG. 1 is a flow chart of a friction signal recognition process according to some embodiments of this specification. Figure 8 As shown, the friction signal recognition process 200 may include pre-processing 210, feature extraction 220, and pattern matching 230. The process 200 may be performed by a processing circuit in the headset (or other device).

[0105] Preprocessing 210 may refer to the process of preprocessing the friction signal. In some embodiments, preprocessing 210 may include collecting the friction signal. In some embodiments, a microphone may be used to collect the friction signal generated by the sliding operation. In some embodiments, the microphone that collects the friction signal may be an air conduction microphone or a bone conduction microphone. An air conduction friction signal may be generated when sliding in the sliding area. When the air conduction microphone is used to collect the friction signal, the air conduction microphone may be set in an area close to the sliding area. When the terminal device is a headset, the speaker of the headset will also output sound, and the signal output by the speaker may interfere with the friction signal generated by the sliding. Therefore, setting the position of the air conduction microphone closer to the sliding area can reduce the influence of the signal output by the headset on the friction signal generated by the sliding operation. For example, combined with Figure 2A In the earphone 150 in the embodiment, the air conduction microphone can be arranged in the sound-emitting part 154 at a position close to the sliding area, and the opening of the air conduction microphone is located on the outer surface (sliding area) of the movement housing. In some embodiments, when the microphone collects the friction signal generated by the sliding operation, it is inevitable to collect the signal output by the speaker. At this time, before the sliding operation is identified, the signal of the speaker can be eliminated by an algorithm to improve the accuracy of the friction signal collection. In some embodiments, a bone conduction friction signal can also be generated when sliding in the sliding area. When the bone conduction friction signal is collected by the bone conduction microphone, the position of the bone conduction microphone can be set at any position of the terminal device, as long as the bone conduction microphone is fixedly connected to the sliding area. For example, the bone conduction microphone can be located at any position in the sound-emitting part 154. When the user uses the terminal device, he can slide in the sliding area (it is necessary to ensure that he can slide to two sliding areas), and the microphone can collect the friction signal generated by the user's sliding operation. Compared with the air conduction microphone, on the one hand, the position of the bone conduction microphone is almost unrestricted (it can be set at any position of the terminal device, as long as the bone conduction microphone is fixedly connected to the sliding area), and on the other hand, the friction signal collected by the bone conduction microphone is not affected by the signal output by the speaker. Preferably, the bone conduction microphone can be used to collect the friction signal. In some embodiments, the microphone can be a microphone built into the terminal device itself. For example, the microphone in the headset that collects the wearer's voice can be used to collect the friction signal generated by the sliding operation. In some embodiments, the microphone can also be set separately. The microphone in the headset that collects the wearer's voice and the microphone that collects the friction signal generated by the sliding operation are different microphones. For example, when the microphone that collects the wearer's voice is an air conduction microphone, a bone conduction microphone can be set in the air conduction microphone or the headset. The bone conduction microphone is used to collect the friction signal generated by the sliding operation, thereby ensuring that the friction signal generated by the sliding operation collected is not affected by the signal output by the speaker, thereby improving the accuracy of sliding direction recognition.

[0106] In some embodiments, preprocessing 210 may include modifying the collected friction signal, for example, pre-emphasizing some frequency components in the friction signal. For illustrative purposes, when a friction signal (such as a sound signal) propagates in a medium, the medium has different losses for friction signals of different frequencies. For example, in a solid medium, it is easier to propagate high-frequency friction signals, which results in greater losses for low-frequency friction signals. When a bone conduction microphone is used to collect the friction signal generated by a user's sliding operation, the low-frequency friction signal in the friction signal may be pre-emphasized to compensate for the low-frequency loss during the vibration transmission process. Specifically: the high-frequency friction signal in the collected friction signal may be filtered out using a transfer function, and then the remaining low-frequency friction signal may be enhanced, and finally the high-frequency friction signal may be combined with the enhanced low-frequency friction signal to obtain a complete friction signal with low-frequency emphasis.

[0107] Feature extraction 220 refers to the process of extracting the features of the collected friction signal. The features of the friction signal may include time domain features and frequency domain features. The time domain features may include the time when the peak value of the friction signal appears in the time domain and the regular change characteristics of the peak value. The frequency domain features may include spectrum parameters. The spectrum parameters may include but are not limited to frequency component distribution, average frequency, root mean square frequency, frequency variance, frequency standard deviation, etc. In some embodiments, the extraction algorithm of the friction signal may include but is not limited to one or more of short-time Fourier transform, discrete cosine transform, discrete wavelet transform, Mel spectrum and Mel cepstrum.

[0108] Pattern matching 230 refers to the process of comparing or matching the processed friction signal or the extracted friction signal features with the standard signal, so as to identify the sliding direction. In some embodiments, the friction signal (recorded as the friction signal to be identified) or its features generated by the user's sliding operation can be compared with the standard signal to determine the overlap of the two friction signals in the time domain, thereby judging the sliding direction. When the overlap is higher than the overlap threshold (for example, 90%), it can be approximately considered that the two friction signals overlap, and the sliding direction corresponding to the signal to be identified is determined based on the sliding direction corresponding to the standard signal (that is, the sliding direction corresponding to the standard signal is consistent with the sliding direction corresponding to the signal to be identified).

[0109] It should be noted that the characteristics of the friction signal generated by the sliding operation in the time domain will be affected by the sliding speed and / or the sliding force. For example, a fast sliding speed corresponds to a short sliding friction signal time; a slow sliding speed corresponds to a long sliding friction signal time; a large sliding force corresponds to a relatively loud sliding friction signal; a small sliding force corresponds to a relatively small sliding friction signal. In some embodiments, the influence of the sliding speed and / or sliding force on the sliding friction signal can be reduced by an algorithm, thereby improving the accuracy of the overlap judgment.

[0110] In some embodiments, pattern matching 230 can be implemented by machine learning, that is, the sliding direction can be determined by using a machine learning model. For example, the frequency domain features of the friction signal to be identified can be input into a trained machine learning model, and the machine learning model can output the sliding direction corresponding to the frequency domain features.

[0111] In some embodiments, multiple friction signals can be collected as friction signal samples for machine learning model training. In some embodiments, the duration of a single friction signal collected (friction signal generated by sliding operation) can be 0.5s to 2s, and the time interval between two samples is 0.2s to 1s, so as to ensure that the silent interval between samples is greater than the silent interval during the sampling process. In some embodiments, in order to ensure the consistency of friction signal samples and avoid information redundancy caused by too high sampling frequency or information loss caused by too low sampling frequency, multiple sampling frequencies can be set to resample the friction signal.

[0112] In some embodiments, the preprocessing of the friction signal samples may include friction signal segmentation. The friction signal samples may be segmented to facilitate the subsequent training of the machine learning model. In some embodiments, the friction signal samples may be segmented into individual segments according to the silence interval. For example, the friction signal samples may be identified using methods such as silence removal or sound detection to determine the silence segments and signal segments in the friction signal samples. The friction signal samples are segmented into friction signal segments of the same length using the center of the signal segment as the segmentation point. Furthermore, subsequent processing (such as pre-emphasis, feature extraction, etc.) may be performed on each friction signal segment.

[0113] In some embodiments, the preprocessing of the friction signal sample may include pre-emphasis. In some embodiments, when the friction signal propagates in a medium, the medium has different losses for friction signals of different frequencies. For example, in a solid medium, it is easier to propagate high-frequency friction signals, which results in greater losses for low-frequency friction signals. When a bone conduction microphone is used to collect sample friction signals, the low-frequency friction signal in the sample friction signal may be pre-emphasized to compensate for the low-frequency losses during the vibration transmission process. In some embodiments, a transfer function may be used for filtering to achieve pre-emphasis of the low-frequency friction signal. Specifically: a transfer function may be used to filter out the high-frequency friction signal in the sample friction signal, and then the remaining low-frequency friction signal may be enhanced, and finally the high-frequency friction signal may be combined with the enhanced low-frequency friction signal to obtain a complete friction signal sample with low-frequency emphasis.

[0114] In some embodiments, feature extraction can be performed on the friction signal samples that have been processed as described above, such as extracting frequency domain features. The extracted frequency domain features can be used to train parameters for training machine learning models. In some embodiments, the input of the machine learning model can be the frequency domain features of the sample friction signal, and the output is the sliding direction corresponding to the frequency domain features (such as sliding in the first direction or sliding in the second direction), and the training label is the frequency domain features with the sliding direction manually marked. Specifically, the labeled frequency domain features can be input into the initial machine learning model to obtain the output result of the initial machine learning model. The parameters of the initial machine learning model are updated through training until the trained intermediate machine learning model meets the preset conditions, and a trained machine learning model is obtained. Among them, the preset conditions can be that the loss function is less than a threshold, converges, or the training cycle reaches a threshold.

[0115] It should be noted that, in other embodiments, the collected friction signal can also be directly input into the machine learning model, and the machine learning model outputs the sliding direction corresponding to the friction signal or the operation instruction corresponding to the sliding direction. In this way, the training sample of the machine learning model is the collected friction signal, and the friction signal can be directly used for model training without performing feature extraction operations (other preprocessing operations, such as friction signal segmentation and pre-emphasis, can be determined according to the situation).

[0116] In some embodiments, for different users, the friction signals generated by the sliding operations of the users in different sliding directions can be pre-recorded, and the machine learning model can be further trained based on the friction signals collected from each user. It can be understood here that the terminal device has an initialized calibration training process, and the machine learning model is trained based on the friction signals generated by each user's sliding operation (for example, different sliding directions, sliding with the left hand / right hand, sliding with different fingers, etc.) to eliminate the differences in friction signals caused by the operating habits of different users, and further improve the accuracy of the judgment of the machine learning model.

[0117] In some embodiments, considering that the stability of the terminal device in different states, such as the wearing state and the non-wearing state, is different, the friction signal obtained by the user sliding in the sliding area will also be different. For example, in the non-wearing state, the earphone 150 is relatively stable, and the user's sliding operation in the sliding area will basically not cause the earphone 150 to move. At this time, the collected friction signal is relatively stable, and the characteristics of the friction signal are more obvious; in the wearing state, the user's sliding operation in the sliding area may cause the earphone 150 to shake (for example, the user wears Figure 2A When the earphone 150 is in the ear, when it slides from the second sliding area 152 to the first sliding area 151, the earphone 150 may move outside the ear), which will generate noise. At this time, the friction signal collected will be more complicated, and it will be more difficult to judge the sliding direction based on the characteristics of the friction signal. Based on this, different algorithms can be selected to process and extract features of the friction signal according to the state of the earphone 150, so as to improve the accuracy of judging the sliding direction. For example, the situation of the earphone 150 in the wearing state is more complicated, and an algorithm with higher computing power can be selected for processing to improve the accuracy of judging the sliding direction. For another example, the situation of the earphone 150 in the non-wearing state is relatively simple, and a streamlined algorithm can be selected for processing to reduce the amount of calculation and increase the calculation speed.

[0118] The basic concepts have been described above. Obviously, for those skilled in the art, the above detailed disclosure is only for example and does not constitute a limitation of this specification. Although not explicitly stated here, those skilled in the art may make various modifications, improvements and corrections to this specification. Such modifications, improvements and corrections are suggested in this specification, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of this specification.

[0119] At the same time, this specification uses specific words to describe the embodiments of this specification. For example, "one embodiment", "an embodiment", and / or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of this specification. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned twice or more in different positions in this specification does not necessarily refer to the same embodiment. In addition, certain features, structures or characteristics in one or more embodiments of this specification can be appropriately combined.

[0120] In addition, unless explicitly stated in the claims, the order of the processing elements and sequences described in this specification, the use of alphanumeric characters, or the use of other names are not intended to limit the order of the processes and methods of this specification. Although the above disclosure discusses some invention embodiments that are currently considered useful through various examples, it should be understood that such details are only for illustrative purposes, and the attached claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the essence and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.

[0121] Similarly, it should be noted that in order to simplify the description disclosed in this specification and thus help understand one or more embodiments of the invention, in the above description of the embodiments of this specification, multiple features are sometimes combined into one embodiment, figure or description thereof. However, this disclosure method does not mean that the features required by the subject matter of this specification are more than the features mentioned in the claims. In fact, the features of the embodiments are less than all the features of the single embodiment disclosed above.

[0122] In some embodiments, numbers describing the number of components and attributes are used. It should be understood that such numbers used in the description of the embodiments are modified by the modifiers "about", "approximately" or "substantially" in some examples. Unless otherwise specified, "about", "approximately" or "substantially" indicate that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximate values, which may change according to the required features of individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and adopt the general method of retaining digits. Although the numerical domains and parameters used to confirm the breadth of their range in some embodiments of this specification are approximate values, in specific embodiments, the setting of such numerical values ​​is as accurate as possible within the feasible range.

[0123] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, etc., cited in this specification are hereby incorporated by reference in their entirety. Except for application history documents that are inconsistent with or conflicting with the contents of this specification, documents that limit the broadest scope of the claims of this specification (currently or later attached to this specification) are also excluded. It should be noted that if the descriptions, definitions, and / or use of terms in the materials attached to this specification are inconsistent or conflicting with the contents described in this specification, the descriptions, definitions, and / or use of terms in this specification shall prevail.

[0124] Finally, it should be understood that the embodiments described in this specification are only used to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, as an example and not a limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly introduced and described in this specification.

Claims

1. A device for identifying touch operation using friction signals, characterized in that: At least part of the surface of the device includes a sliding area, and the sliding area includes at least a first sliding area and a second sliding area. The first sliding area and the second sliding area have different characteristics, and the characteristics are manifested in that a friction signal generated when a finger slides in the first sliding area and a friction signal generated when a finger slides in the second sliding area are distinguishable in a time domain or a frequency domain.

2. The device according to claim 1, characterized in that The distinguishability is reflected in that the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area have a difference in amplitude.

3. The device according to claim 2, characterized in that The first sliding region and the second sliding region have different porosities.

4. The device according to claim 1, characterized in that The distinguishability is reflected in that the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area have a difference in peak characteristics.

5. The device according to claim 4, characterized in that The spike characteristics include at least one of the number of spikes, the distribution of spike times, and the intensity of spikes.

6. The device according to claim 1, characterized in that The distinguishability is reflected in that the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area have a difference in discontinuous characteristics.

7. The device according to claim 6, characterized in that An array structure is provided on one of the first sliding area and the second sliding area, and the material of the array structure is a hard material.

8. The device according to claim 1, characterized in that The distinguishability is reflected in that the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area have a frequency difference.

9. The device according to claim 8, characterized in that The fundamental frequency or the peak frequency of the friction signal generated when the finger slides in the first sliding area is different from that of the friction signal generated when the finger slides in the second sliding area.

10. The device according to claim 8, characterized in that The first sliding region and the second sliding region have different natural resonant frequencies.

11. The device according to claim 1, characterized in that The distinguishability is reflected in that the proportion of the friction signal within a specific frequency or a specific frequency range in the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area is different.

12. The device according to claim 1, characterized in that The first sliding region and the second sliding region having different properties include that the first sliding region and the second sliding region have different material properties, roughness properties or surface structure properties.

13. The device according to claim 1, characterized in that The device includes a processing circuit configured to identify a sliding direction of the finger according to a friction signal generated when the finger slides in the first sliding area and a friction signal generated when the finger slides in the second sliding area.

14. A device for identifying touch operation using friction signals, characterized in that: At least part of the surface of the device includes a sliding area, and the sliding area includes at least a first sliding area and a second sliding area. The first sliding area and the second sliding area have different characteristics, and the characteristics include material characteristics, roughness characteristics or surface structure characteristics.

15. The device according to claim 14, characterized in that The material property includes: there is a difference in elastic modulus or hardness between the materials on the first sliding area and the materials on the second sliding area.

16. The device according to claim 15, characterized in that A difference between the Shore hardness of the material of the first sliding region and the Shore hardness of the material of the second sliding region is in the range of 42 HD to 86 HD.

17. The device according to claim 14, characterized in that The roughness characteristic includes: particles with different parameters are arranged on the first sliding area and the second sliding area, and the parameters of the particles include particle shape, particle size, particle number or particle spacing.

18. The device according to claim 14, characterized in that The roughness characteristic includes: stripes with different parameters are arranged on the first sliding area and the second sliding area, and the parameters of the stripes include stripe width, stripe height or stripe spacing.

19. The device according to claim 14, characterized in that The surface structure design includes: providing differentiated surface structures on the first sliding area and the second sliding area, and the surface structure includes a plane structure or a gradient structure.

20. The device according to claim 19, characterized in that The differentiation of the gradient structure is manifested as a difference in slope or direction.

21. The device according to claim 14, characterized in that The first sliding region and the second sliding region have different natural resonant frequencies.

22. The device according to claim 21, characterized in that At least one of differentiated wave plates, strings, beams, membranes, and cavity structures is disposed on the first sliding area and the second sliding area.

23. The device according to claim 21, characterized in that A microstructure is disposed on one of the first sliding region and the second sliding region, and the microstructure includes a spring sheet.

24. The device according to claim 14, characterized in that An array structure is provided on one of the first sliding area and the second sliding area, and the material of the array structure is a flexible material.

25. The device according to claim 14, characterized in that An array structure is provided on one of the first sliding area and the second sliding area, and the material of the array structure is a hard material.

26. The device according to claims 14 to 25, characterized in that The characteristic is that the friction signal generated when the finger slides in the first sliding area and the friction signal generated when the finger slides in the second sliding area are distinguishable in at least one of amplitude, peak characteristics, discontinuity characteristics and frequency domain.

27. The device according to claim 14, characterized in that The device includes a processing circuit configured to identify a sliding direction of the finger according to a friction signal generated when the finger slides in the first sliding area and a friction signal generated when the finger slides in the second sliding area.

Images