Control method, control button and smart glasses

Abstract

This application relates to the field of smart device technology and discloses a control method, a control button, and smart glasses. The method is applied to smart glasses equipped with a control button. The control button includes two spaced apart detection elements, one of which has a touch surface formed on the side facing away from the other detection element. When the touch surface is touched, it deforms toward the other detection element. The other detection element is configured to emit a magnetic field toward the other detection element. The method includes: determining magnetic field change information based on the magnetic field; determining the user's current touch mode based on the magnetic field change information, and performing corresponding function control according to the current touch mode. This application can use a single control button to achieve different control functions through different touch modes.

Description

Technical Field

[0001] The present application relates to the technical field of smart devices, and in particular to a control method, a control button, and smart glasses. Background Art

[0002] With the development of technology, smart glasses (such as augmented reality (AR) glasses, virtual reality (VR) glasses, etc.) are gradually becoming more and more popular. Usually, buttons are set on smart glasses for users to control corresponding functions.

[0003] However, due to the small size of existing smart glasses, the area left for setting control buttons is small. Therefore, how to make a control button achieve different control functions through different touch methods (such as single click, double click, forward swipe or backward swipe, etc.) is an urgent problem to be solved. Summary of the Invention

[0004] The main purpose of this application is to provide a control method, a control button and smart glasses, aiming to solve the existing technical problem of how to enable a control button to achieve different control functions through different touch methods.

[0005] To achieve the above objectives, embodiments of the present application provide a control method, which is applied to smart glasses equipped with a control button. The control button includes two detection elements spaced apart from each other, wherein a touch surface is formed on a side of one detection element facing away from the other detection element, and when the touch surface is touched, it deforms toward the other detection element. The one detection element is configured to emit a magnetic field toward the other detection element.

[0006] The method comprises:

[0007] determining magnetic field change information according to the magnetic field;

[0008] The current touch mode of the user is determined based on the magnetic field change information, and corresponding function control is performed according to the current touch mode.

[0009] In one embodiment, the detection element includes a first detection element and a second detection element, the first detection element is a magnetic member, and the second detection element includes a Hall sensor, and the Hall sensor is used to collect the magnetic field emitted by the magnetic member.

[0010] In one embodiment, there are multiple Hall sensors, and the multiple Hall sensors are evenly spaced apart.

[0011] In one embodiment, the second detection element further includes a substrate, the Hall sensor is provided on a side of the substrate facing away from the magnetic component, and the substrate is made of a soft material; and / or

[0012] The magnetic component is made of soft material.

[0013] In one embodiment, the step of determining the user's current touch mode based on the magnetic field change information includes:

[0014] determining pressure change information at each position on the touch surface based on the magnetic field change information;

[0015] determining the user's current touch trajectory based on the pressure change information using a preset trajectory determination model, wherein the preset trajectory determination model is obtained by training a model using sample touch trajectories and sample pressure change information at various positions on the touch surface;

[0016] A current touch mode of the user is determined based on the current touch trajectory.

[0017] In one embodiment, the step of determining the pressure change information at each position on the touch surface based on the magnetic field change information includes:

[0018] determining a current pressure value at each position on the touch surface based on the magnetic field change information;

[0019] The pressure change information of each position on the touch surface is determined according to the current pressure value of each position on the touch surface.

[0020] In one embodiment, the step of determining the current pressure value at each position on the touch surface based on the magnetic field change information includes:

[0021] determining the current magnetic field strength of the magnetic field in each dimension based on the magnetic field change information;

[0022] Obtaining a magnetic field intensity vector modulus according to the current magnetic field intensity in each dimension, and determining a displacement of a current touch area on the touch surface according to a preset displacement relationship based on the magnetic field intensity vector modulus;

[0023] A current pressure value of the current touch area is determined based on the displacement, and a current pressure value of each position on the touch surface is determined based on the current pressure value of the current touch area.

[0024] In one embodiment, the step of determining the current pressure value of each position on the touch surface based on the current pressure value of the current touch area includes:

[0025] Dividing the current touch area into grids;

[0026] Obtaining an elastic modulus and a Poisson's ratio of the detection element that receives the magnetic field, and performing finite element analysis based on a grid division result, the elastic modulus, the Poisson's ratio, and a current pressure value of the current touch area to obtain a current pressure value at each target position;

[0027] An interpolation process is performed on the current pressure value of the target position, and pressure change information of each position on the touch surface is determined based on the interpolation result.

[0028] In addition, to achieve the above-mentioned purpose, an embodiment of the present application also proposes a control button, which includes two detection elements arranged at intervals, wherein a touch surface is formed on the side of one detection element facing away from the other detection element, and when the touch surface is touched, it deforms toward the direction of the other detection element, and one detection element is used to emit a magnetic field to the other detection element.

[0029] In addition, to achieve the above-mentioned purpose, the embodiment of the present application further provides a pair of smart glasses, comprising:

[0030] Frames;

[0031] The control button as described above is provided on the frame;

[0032] A processor is electrically connected to the control button, and the processor is used to execute the steps of the control method as described above.

[0033] An embodiment of the present application provides a control method, a control button, and smart glasses. The method is applied to smart glasses provided with a control button, wherein the control button includes two detection elements arranged at intervals, wherein a touch surface is formed on the side of one detection element facing away from the other detection element, and when the touch surface is touched, it deforms toward the other detection element, and one detection element is used to emit a magnetic field toward the other detection element; the method includes: determining magnetic field change information based on the magnetic field; determining the user's current touch mode based on the magnetic field change information, and performing corresponding function control according to the current touch mode.

[0034] Since the control button in this application includes two detection elements arranged at intervals, one detection element can emit a magnetic field to the other detection element, and the other detection element can collect the magnetic field, and a touch surface is formed on one detection element, and the touch surface can produce a deformation toward the other detection element when touched. When different touch methods are used on the touch surface, the deformation produced by the touch surface is different, and the magnetic field change information under different deformations is also different. Therefore, in actual use, this application can obtain the collected magnetic field, and determine the magnetic field change information based on the magnetic field, and determine the user's current touch method based on the magnetic field change information, and perform corresponding function control according to the current touch method. Thus, different control functions can be achieved by using a control button through different touch methods. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0036] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0037] Figure 1 This is a flow chart of the first embodiment of the control method of this application;

[0038] Figure 2 This is a schematic structural diagram of the smart glasses in the first embodiment of the control method of this application;

[0039] Figure 3 This is a structural diagram of the control button in the first embodiment of the control method of this application;

[0040] Figure 4 This is a flow chart of the second embodiment of the control method of this application;

[0041] Figure 5 This is a flow chart of the third embodiment of the control method of the present application;

[0042] Figure 6 This is a schematic diagram of grid division in the third embodiment of the control method of this application;

[0043] Figure 7 This is a schematic diagram of specific division in the third embodiment of the control method of this application;

[0044] Figure 8 This is a flowchart of the interpolation processing in the third embodiment of the control method of this application.

[0045] Description of Figure Numbers:

[0046]

[0047] The realization of the objectives, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0048] It should be understood that the specific embodiments described herein are merely used to explain the technical solutions of the present application and are not intended to limit the present application.

[0049] It should be noted that with the development of technology, smart glasses (such as augmented reality (AR) glasses, virtual reality (VR) glasses, etc.) are gradually becoming more and more popular. Usually, buttons are set on smart glasses for users to control corresponding functions.

[0050] However, due to the small size of existing smart glasses, the area left for setting the control button 1 is small. Therefore, how to enable a control button 1 to achieve different control functions through different touch methods (such as single click, double click, forward swipe or backward swipe, etc.) is an urgent problem to be solved.

[0051] Therefore, to address the above-mentioned drawbacks, this embodiment provides a control method for smart glasses equipped with a control button 1. In this embodiment, the control button 1 includes two spaced-apart detection elements, one of which can emit a magnetic field toward the other, and the other can collect this magnetic field. A touch surface 3 is formed on one of the detection elements, and when touched, this touch surface 3 deforms toward the other detection element. When different touch methods are used on the touch surface 3, the deformation produced by the touch surface 3 varies, and the magnetic field change information under different deformations also varies. Therefore, in actual use, this embodiment can obtain the collected magnetic field and determine magnetic field change information based on this magnetic field. Based on this magnetic field change information, the user's current touch method is determined, and corresponding function control is performed according to the current touch method. Thus, a single control button 1 can be used to implement different control functions through different touch methods.

[0052] For ease of understanding, the following Figures 1 to 7 The control method provided in the embodiment of the present application is described in detail.

[0053] Reference Figure 1 , Figure 1 This is a flow chart of the first embodiment of the control method of this application. The first embodiment of the control method of this application is proposed. Figure 1 As shown, in this embodiment, the specific method includes:

[0054] Step S10: determining magnetic field change information according to the magnetic field.

[0055] It is understandable that the method of this embodiment can be applied to smart glasses provided with a control button 1. The smart glasses can be any glasses with data processing, program running and control method functions. For example, as an embodiment, refer to Figure 2 , Figure 2 This is a schematic diagram of the structure of the smart glasses in the first embodiment of the control method of this application. Figure 2 As shown, in this embodiment, the smart glasses may include a frame 2, the control button 1 and a processor ( Figure 2 The control button 1 can be set at any position on the frame 2. In this embodiment, it can be set on the outside of the temple of the frame 2 (such as Figure 2 As shown), of course, it can also be other positions, and this embodiment does not limit this.

[0056] The processor can be electrically connected to the control button 1 and execute the steps of the control method of this embodiment. Therefore, the execution entity of the method of this embodiment and the methods of the following embodiments can be the processor. The processor can be installed inside the frame 2 via a printed circuit board (PCB), but can also be installed in other locations, which is not limited in this embodiment.

[0057] As a setting method, in this embodiment, a hole can be opened on the outside of the temple of the frame 2, and the above-mentioned control button 1 can be set in the hole, while keeping the touch surface 3 aligned with the surface of the temple.

[0058] It should be emphasized that referring to Figure 3 , Figure 3 This is a structural diagram of the control button 1 in the first embodiment of the control method of this application, as shown in FIG. Figure 3 As shown, in this embodiment, the control button 1 includes two detection elements arranged at intervals, wherein a touch surface 3 is formed on the side of one detection element facing away from the other detection element, and when the touch surface 3 is touched, it is deformed toward the other detection element, and one detection element is used to emit a magnetic field to the other detection element.

[0059] It should be noted that, in this embodiment, the control button 1 may include two detection elements spaced apart, which are respectively referred to as a first detection element 4 and a second detection element 5 for the convenience of subsequent description. A touch surface 3 is formed on the side of any detection element facing away from the other detection element. Figure 3As shown, in this embodiment, a touch surface 3 can be formed on the side of the first detection element 4 facing away from the second detection element 5, and when the touch surface 3 is touched, it can be deformed toward the other detection element, that is, Figure 3 When the touch surface 3 of the first detection element 4 is touched, deformation toward the second detection element 5 may occur.

[0060] As another implementation, if the touch surface 3 is formed on the side of the second detection element 5 facing away from the first detection element 4 , the second detection element 5 may be deformed toward the first detection element 4 when the touch surface 3 is touched.

[0061] It should also be noted that in this embodiment, one detection element can be used to generate and transmit a magnetic field to another detection element, and the other detection element can be used to collect the magnetic field. Figure 3 As shown, in this embodiment, the first detection element 4 can be used to transmit a magnetic field to the second detection element 5 (i.e. Figure 3 In the example, N and S are represented by the first and second detection elements 5, respectively. The second detection element 5 can collect the magnetic field emitted by the first detection element 4. Similarly, as another implementation, the second detection element 5 can be used to transmit a magnetic field to the first detection element 4, which then collects the magnetic field emitted by the second detection element 5. To facilitate subsequent understanding, this embodiment uses the former method for description.

[0062] It can be understood that in this embodiment, the above-mentioned control button 1 can be set on the temple, and the touch surface 3 can be facing the outside of the temple. Then, when the user wears the smart glasses, the user touches the touch surface 3 of the control button 1 with his fingers, so that the first detection element 4 can be deformed toward the second detection element 5.

[0063] It should be understood that if the second detection element 5 is used to collect the magnetic field in this embodiment, the detection element for receiving the magnetic field may be Figure 3 The second detection element 5 in the embodiment can be electrically connected to the second detection element 5 to obtain the magnetic field. Similarly, if the first detection element 4 is used to collect the magnetic field, the detection element that receives the magnetic field can be the first detection element 4, and the processor can be electrically connected to the first detection element 4 to obtain the magnetic field. Since the second detection element 5 is used to collect the magnetic field for illustration in this embodiment, the processor in this embodiment can be electrically connected to the second detection element 5.

[0064] It should also be understood that the magnetic field change information may be information on changes in direction and strength of the magnetic field collected by a detection element that collects the magnetic field.

[0065] In actual use, the processor in this embodiment can obtain the magnetic field emitted by the first detection element 4 through the above-mentioned second detection element 5, and determine the magnetic field change information of the magnetic field at the current position of the second detection element 5 based on the magnetic field.

[0066] Step S20: determining the user's current touch mode based on the magnetic field change information, and performing corresponding function control according to the current touch mode.

[0067] It should be noted that the above-mentioned current touch mode may be a mode in which the user's finger touches the touch surface 3, including but not limited to single-tap, double-tap, forward swipe or backward swipe, etc., which is not limited in this embodiment.

[0068] like Figure 3 As shown, when different touch modes are used on the touch surface 3, the deformation of the touch surface 3 is different, the relative distance between the two detection elements is different under different deformations, and thus the magnetic field change information is also different. Therefore, different magnetic field change information can correspond to different current touch modes, and a preset touch mapping relationship table between different magnetic field change information and different current touch modes can be constructed. In actual use, the preset touch mapping relationship table can be queried according to the current magnetic field distribution to identify the current touch mode of touching the touch surface 3, thereby determining the user intention corresponding to the current touch mode and controlling the corresponding function.

[0069] For example, if the user double-clicks the touch surface 3, the first detection element 4 will produce corresponding deformation under the user's double-click. The processor can obtain corresponding magnetic field change information based on the magnetic field collected by the second detection element 5 at the current position, and then determine that the user's current touch mode is a double-click according to the preset touch mapping relationship table, and then perform corresponding function control according to the double-click.

[0070] It should be emphasized that, in order to ensure that the first detection element 4 deforms toward the second detection element 5, in this embodiment, the first detection element 4 can be located on the surface of the temple, while the second detection element 5 can be located inside the temple and fixed in position. Consequently, when the touch surface 3 of the first detection element 4 is touched, it can deform toward the second detection element 5. Since the position of the second detection element 5 remains fixed, the relative distance between the second detection element 5 and the first detection element 4 can change.

[0071] Furthermore, in order to enable one detection element to generate a magnetic field, another detection element can collect the magnetic field, and continue as follows. Figure 3 As shown, in this embodiment, the detection element includes a first detection element 4 and a second detection element 5, the first detection element 4 is a magnetic component, and the second detection element 5 includes a Hall sensor 7, which is used to collect the magnetic field emitted by the magnetic component.

[0072] It should be noted that, in this embodiment, the detection element that generates the magnetic field can be recorded as the first detection element 4, and the detection element that collects the magnetic field can be recorded as the second detection element 5, that is, Figure 3 In this embodiment, the first detection element 4 can be any magnetic component for generating a magnetic field, such as a magnet, etc. The second detection element 5 can be any component for collecting a magnetic field, such as the Hall sensor 7, etc., and this embodiment does not limit this.

[0073] In actual use, the first detection element 4 in this embodiment may include the above-mentioned magnetic component, through which a magnetic field can be emitted to the second detection element 5. The second detection element 5 may include the above-mentioned Hall sensor 7, through which the magnetic field emitted by the magnetic component can be collected.

[0074] Furthermore, in order to detect various current touch modes, continue as follows Figure 3 As shown, in this embodiment, there are multiple Hall sensors 7, and the multiple Hall sensors 7 are evenly spaced apart.

[0075] It is understandable that in this embodiment, a plurality of Hall sensors 7 can be provided and evenly spaced. The specific distance between two adjacent Hall sensors 7 can be set according to actual conditions, and this embodiment does not impose any limitation on this.

[0076] It should be emphasized that the arrangement of the Hall sensors 7 in this embodiment can be in an array form, and of course it can also be arranged in other ways, such as arranged in sequence along the length direction of the first detection element 4, etc., and can be specifically set according to the actual touch mode supported, and this embodiment does not limit this.

[0077] Furthermore, in order to enable the detection element provided with the touch surface 3 to produce a more obvious deformation when being touched, in this embodiment, the second detection element 5 further includes a substrate 6, and the Hall sensor 7 is provided on the side of the substrate 6 facing away from the magnetic member, and the substrate 6 is made of a soft material; and / or

[0078] The magnetic component is made of soft material.

[0079] Continue as Figure 3 As shown, if the touch surface 3 is set on the first detection element 4 in this embodiment, the magnetic part in the first detection element 4 can be made of soft material, such as silicone, and in order to make the magnetic part magnetic, magnetic material can be added to the silicone.

[0080] For example, because silicone rubber is formed by vulcanizing two liquids mixed in a mold of a specific shape, in this embodiment, magnetic materials such as neodymium iron boron magnetic powder can be added to the silicone rubber before it is formed. After magnetization, the magnetic component is formed, thereby achieving both good deformation and magnetic properties to generate a magnetic field.

[0081] For the second detection element 5, a substrate 6 can be provided to carry the above-mentioned Hall sensor 7, that is, the substrate 6 is provided on the side of the Hall sensor 7 facing away from the magnetic component. The substrate 6 can be a hard material or other material that is not easy to deform, such as plastic (or directly use the above-mentioned PCB board with a processor), etc., so as to ensure the stability of the distance between the Hall sensor 7 and the first detection element 4.

[0082] As another implementation method, if the touch surface 3 in this embodiment is set on the second detection element 5, in order to make the second sensor deform when the touch surface 3 is exposed to pressure, the substrate 6 in the second detection element 5 can be set to a soft material, such as the above-mentioned silicone, and the Hall sensor 7 can be set on the soft material.

[0083] At this time, for the first detection element 4 , a hard material may be used, for example, magnetic material may be added when forming plastic, so as to ensure the stability of the distance between the Hall sensor 7 and the first detection element 4 .

[0084] In this embodiment Figure 3 The first detection element 4 is silicone with magnetic material added, and the second detection element 5 can be the PCB board equipped with the processor as the aforementioned substrate 6. A Hall effect sensor 7 is mounted on this substrate 6 for illustration. The side of the silicone facing away from the Hall effect sensor 7 is the touch surface 3, which faces the outside of the temple. In actual use, when a user's finger contacts the touch surface 3, the silicone deforms toward the Hall effect sensor 7. The Hall effect sensor 7 then collects the magnetic field and transmits it to the processor to control the corresponding function.

[0085] The control button 1 in this embodiment includes two spaced-apart detection elements, one of which can emit a magnetic field toward the other, while the other can collect that magnetic field. One detection element is formed with a touch surface 3, which, when touched, deforms toward the other detection element. Different touch methods applied to touch surface 3 produce different deformations, and the magnetic field change information associated with these deformations also differs. Therefore, in actual use, this embodiment can obtain the collected magnetic field and determine magnetic field change information based on that magnetic field. Based on this magnetic field change information, the user's current touch method can be determined, and corresponding function control can be performed according to that current touch method. Thus, a single control button 1 can be used to implement different control functions through different touch methods.

[0086] At the same time, compared with the existing direct use of capacitive button touch control, first, the capacitive button is large in size and cannot be well set on the frame 2, while the Hall sensor 7 in this embodiment is smaller in size and can be better integrated into the frame 2; secondly, the touch surface 3 of the capacitive button is hard. If the user does not set a corresponding mark (such as a protrusion, etc.) on the touch surface 3 when touching it, the user cannot accurately find the position of the capacitive button, and it is easy to fail to touch it. The present embodiment adopts a soft material method, which can be effectively distinguished from the hard material of the frame 2. This obvious physical difference allows the user to find the touch area accurately at the first time without groping during operation, greatly reducing the difficulty of operation and improving the accuracy and success rate of operation; and the capacitive button does not directly bring operation feedback when the user touches it, while the present embodiment adopts the form of soft material, which can cause the material to deform when the user touches it, thereby completing the operation feedback to the user and improving the user's operation experience.

[0087] It should also be emphasized that capacitive buttons require direct user contact, so touch operations may not work properly when the user's hands are wet or wearing gloves. However, this embodiment uses a deformation method to achieve control through slight deformation, which is not affected by these factors, adapting to more complex usage environments and providing users with a more convenient operation experience. In addition, because different magnetic field change information corresponds to different touch methods in this embodiment, a richer range of command control can be provided when designing control functions.

[0088] Reference Figure 4 , Figure 4 This is a flow chart of the second embodiment of the control method of the present application. Based on the above-mentioned first embodiment, the second embodiment of the control method of the present application is proposed.

[0089] Considering that the accuracy of determining the corresponding current touch mode according to the magnetic field change information by using the preset touch mapping relationship table may be low, Figure 4 As shown, in this embodiment, the step of determining the user's current touch mode based on the magnetic field change information includes:

[0090] Step S21: determining pressure change information at each position on the touch surface 3 based on the magnetic field change information.

[0091] It should be noted that the aforementioned pressure change information may be information about changes in pressure values at various locations on the touch surface 3 when the user's finger touches the touch surface 3. Since the touch surface 3 deforms under the pressure applied by the user's finger when touched, it can be understood that different touch modes result in different pressure changes at various locations on the touch surface 3, and thus different deformations of the touch surface 3. Under different deformations, the relative distance between the two detection elements varies, and thus, the magnetic field change information also varies. Therefore, based on this, the aforementioned processing can first determine the pressure value changes at various locations on the touch surface 3 based on the magnetic field change information, which serves as the aforementioned pressure change information.

[0092] In order to accurately obtain pressure information at each position on the touch surface 3 based on the magnetic field change information, in this embodiment, the step of determining the pressure change information at each position on the touch surface 3 based on the magnetic field change information includes:

[0093] Step S211: determining the current pressure value of each position on the touch surface 3 based on the magnetic field change information.

[0094] It is understandable that the current pressure value may be the pressure value at the current moment when the touch surface 3 is touched. To obtain the current pressure value, in this embodiment, the step of determining the current pressure value at each position on the touch surface 3 based on the magnetic field change information includes:

[0095] Step S2111: determining the current magnetic field strength of the magnetic field in each dimension based on the magnetic field change information.

[0096] It should be noted that the Hall sensor 7 in this embodiment can be a three-dimensional Hall sensor 7, that is, a sensor that can simultaneously measure the magnetic field strength in the X, Y, and Z directions. Furthermore, in actual use, the processor can determine the current magnetic field strength of each Hall sensor 7 in the X, Y, and Z dimensions based on the magnetic field change information corresponding to the location of each Hall sensor 7.

[0097] Step S2112: obtaining a magnetic field intensity vector modulus according to the current magnetic field intensity in each dimension, and determining a displacement of the current touch area on the touch surface 3 according to a preset displacement relationship based on the magnetic field intensity vector modulus.

[0098] It is understood that the magnetic field intensity vector modulus may be the vector value corresponding to the current magnetic field in each dimension. The preset displacement relationship may be the corresponding relationship between the magnetic field intensity vector modulus and the displacement. The displacement may be the distance that each position of the detection element emitting the magnetic field moves toward the detection element collecting the magnetic field under the action of pressure, that is, the distance that the current touch area on the touch surface 3 moves toward the second detection element 5 when the first detection element 4 is touched.

[0099] It should be emphasized that, since there is a certain linear relationship between different displacement amounts and the modulus of the magnetic field intensity vector, the above-mentioned preset displacement relationship can be obtained in advance through modeling or other methods, and this embodiment does not limit this.

[0100] In actual use, the processor can determine the current magnetic field strength of each Hall sensor 7 in the three dimensions of X, Y, and Z according to the current magnetic field distribution corresponding to the position of each Hall sensor 7. Then, the magnetic field strength vector modulus of the magnetic field at each Hall sensor 7 is obtained according to the current magnetic field strength in each dimension. For example, the current magnetic field strength in the X dimension collected by a Hall sensor 7 is recorded as , the current magnetic field strength in the Y dimension is recorded as , the current magnetic field strength in the Z dimension is recorded as , then the corresponding magnetic field intensity vector is recorded as H, .

[0101] After obtaining the magnetic field intensity vector value, the magnetic field intensity vector value is substituted into the above-mentioned preset displacement relationship formula to obtain the displacement amount of the current touch area on the touch surface 3.

[0102] Step S2113: determining a current pressure value of the current touch area based on the displacement, and determining a current pressure value of each position on the touch surface 3 based on the current pressure value of the current touch area.

[0103] It should be understood that since there is a certain correspondence between displacement and pressure, in this embodiment, a preset displacement mapping table can be constructed based on the displacement corresponding to each pressure value. In actual use, the preset mapping table can be queried based on the displacement to obtain the current pressure value of the current touch area. Of course, other methods such as convolutional neural network models or linear regression models can also be used, but this embodiment does not elaborate on these.

[0104] After obtaining the current pressure value of the current touch area, the current pressure value of each position on the touch surface 3 can be obtained.

[0105] Step S212 : determining pressure change information of each position on the touch surface 3 according to the current pressure value of each position on the touch surface 3 .

[0106] After obtaining the current pressure value of each position on the touch surface 3, the processor can count the current pressure value of each position on the touch surface 3 during the period when the user's finger touches the touch surface 3, thereby obtaining the pressure change information of each position on the touch surface 3 during the period when the user's finger touches the touch surface 3.

[0107] Step S22: determining the user's current touch trajectory according to the pressure change information through a preset trajectory determination model, wherein the preset trajectory determination model is obtained by model training through sample touch trajectories and sample pressure change information at each position on the touch surface 3.

[0108] It is understood that the preset trajectory determination model is obtained through model training using sample touch trajectories and sample pressure change information at various locations on the touch surface 3. That is, in this embodiment, the initial trajectory determination model can be pre-trained using sample touch trajectories and sample pressure change information at various locations on the touch surface 3 to obtain the preset trajectory determination model. In actual use, the sample pressure change information at various locations on the touch surface 3 can then be input into the preset trajectory determination model to obtain the corresponding current touch trajectory.

[0109] It is also understandable that the initial trajectory determination model can be any model with learning capabilities, such as a convolutional neural network model. Furthermore, since there is a linear relationship between different touch trajectories and the pressure change information at various locations on the touch surface 3, the initial trajectory determination model can also be any linear model. This embodiment does not impose any limitation on this.

[0110] During training, the processor may first obtain sample pressure change information at various locations on the touch surface 3 and obtain corresponding sample touch trajectories. To ensure accuracy, the obtained sample pressure change information may be preprocessed. This preprocessing may include, but is not limited to, data cleaning, outlier removal, missing value filling, and normalization. The sample touch trajectories and preprocessed sample pressure change information are then input into the initial trajectory determination model for training, thereby obtaining the aforementioned preset trajectory determination model.

[0111] It should be emphasized that if the initial trajectory determination model used is a convolutional neural network model, forward propagation and backpropagation can be performed during training to update the model parameters. The specific convolutional neural network structure can be customized according to actual conditions. If the initial trajectory determination model used is a linear model, linear regression methods such as least squares can be used during training. Of course, other regression methods can also be used, and this embodiment does not limit this.

[0112] Step S23: determining the current touch mode of the user based on the current touch trajectory.

[0113] Since the touch tracks formed by the user's finger on the touch surface 3 are different under different touch modes, this embodiment can determine the user's current touch mode according to the current touch track after obtaining the current touch track.

[0114] In this embodiment, the pressure change information at each location on the touch surface 3 can be first determined based on the magnetic field change information. Then, the user's current touch trajectory can be determined based on the pressure change information using a preset trajectory determination model. Finally, the user's current touch mode can be determined based on the current touch trajectory. Compared to directly using a preset touch mapping table, using a preset trajectory determination model can improve the accuracy of touch mode determination.

[0115] Reference Figure 5 , Figure 5 This is a flow chart of the third embodiment of the control method of the present application. Based on the above embodiments, the third embodiment of the control method of the present application is proposed.

[0116] Considering that the current pressure value of the current touch area obtained above is the average pressure value of the area, in order to obtain the current pressure value distribution at a more specific position, the accuracy of the pressure change information is improved. Figure 5 As shown, in this embodiment, the step of determining the current pressure value of each position on the touch surface 3 based on the current pressure value of the current touch area includes:

[0117] Step S21131: Divide the current touch area into grids.

[0118] It should be noted that the current touch area may be the area of the touch surface 3 touched by the user. In this embodiment, after obtaining the current touch area, the current touch area may be divided into grids. For ease of understanding, refer to Figure 6 , Figure 6 This is a schematic diagram of grid division in the third embodiment of the control method of this application. In this embodiment, the current touch area can be divided into grids.

[0119] It should be emphasized that since the Hall sensors 7 in this embodiment are arranged in an array, when performing grid division in this embodiment, each Hall sensor 7 in the current touch area can be divided into the top corners of the grid. Figure 7 , Figure 7 This is a schematic diagram of specific division in the third embodiment of the control method of this application, as shown in FIG. Figure 7 As shown, if there are four Hall sensors 7 in the current touch area, which are respectively recorded as A1 to A4, then A1 to A4 can be respectively divided into the top corners of the grid when dividing the grid.

[0120] Step S21132: Obtain the elastic modulus and Poisson's ratio of the detection element that receives the magnetic field, and perform finite element analysis based on the grid division result, the elastic modulus, the Poisson's ratio and the current pressure value of the current touch area to obtain the current pressure value of each target position.

[0121] After meshing, the elastic modulus and Poisson's ratio of the detection element receiving the magnetic field, namely, the elastic modulus and Poisson's ratio of the first detection element 4, can be obtained. Both the elastic modulus and Poisson's ratio can be obtained in advance by measurement. Finite element analysis is then performed using pre-set finite element analysis software based on the meshing results, the elastic modulus, the Poisson's ratio, and the current pressure value of the current touch area, thereby obtaining the current pressure value at the target location.

[0122] It should be noted that the preset finite element analysis software can be selected based on actual circumstances and is not limited in this embodiment. The target position can be a vertex of a grid, i.e., the position corresponding to the Hall sensor 7. After finite element analysis, the pressure value of each vertex on the grid can be obtained as the current pressure value of the target position, that is, the current pressure value of the positions corresponding to A1 to A4 on the first detection element 4 is obtained.

[0123] Step S21133: performing interpolation processing on the current pressure value of the target position, and determining the pressure change information of each position on the touch surface 3 based on the interpolation result.

[0124] Since there is a certain distance between nodes, for example, there is a certain distance between A1 and A2, after obtaining the current pressure value of the target position, interpolation processing can be performed according to the coordinates of each adjacent target position and the corresponding current pressure value, and the pressure change information of each position on the touch surface 3 is determined based on the interpolation result. Figure 8 , Figure 8 This is a flow chart of interpolation processing in the third embodiment of the control method of this application. Figure 8 As shown, the above-mentioned step of interpolating the current pressure value of the target position and determining the pressure change information of each position on the touch surface 3 based on the interpolation result includes:

[0125] Step S211331: Acquire the position coordinates of the adjacent target positions, and determine the position coordinates of the middle position between the adjacent target positions based on the position coordinates of the target positions.

[0126] It can be understood that the above-mentioned intermediate position may be a position in the middle between adjacent target positions.

[0127] In actual use, the processor can perform interpolation processing on two adjacent target positions, that is, first determine the position coordinates of the middle position based on the position coordinates of the adjacent target positions. Figure 7As shown, for example, A1 and A2, the position coordinates of the target position corresponding to A1 are marked as (x1, y1), and the position coordinates of the target position corresponding to A2 are (x2, y1). This is because A1 and A2 are at the same horizontal coordinate, so both are y1. The current pressure value of the target position corresponding to A1 is P1, and the current pressure value of the target position corresponding to A2 is P2.

[0128] Furthermore, when performing interpolation, if the middle position B1 between A1 and A2 is defined, the position coordinates of the middle position B1 ((x2-x1) / 2, y1) can be obtained based on the position coordinates (x1, y1) of the target position corresponding to A1 and the position coordinates (x2, y1) of the target position corresponding to A2.

[0129] Step S211332: Obtain interpolation coefficients based on the position coordinates of the intermediate position and the position coordinates of the adjacent target position.

[0130] It should be understood that the above interpolation coefficients may be coefficients used during interpolation. After obtaining the position coordinates of the intermediate position B1 ((x2-x1) / 2, y1), the interpolation coefficients may be obtained based on the position coordinates of the intermediate position B1 ((x2-x1) / 2, y1), the position coordinates of the target position corresponding to A1 (x1, y1), and the position coordinates of the target position corresponding to A2 (x2, y1). That is, the interpolation coefficients are ((x2-x1) / 2)-x1) / (x2-x1).

[0131] It should be emphasized that the above interpolation coefficient calculation process is based on the target position corresponding to A1 and the target position corresponding to A2 being on the same x-axis. If they are on the same y-axis (for example, A1 and A3), the process is similar and will not be elaborated in this embodiment.

[0132] Step S211333: obtaining the current pressure value of the adjacent target position, and determining the current pressure value of the intermediate position according to the interpolation coefficient and the current pressure value of the adjacent target position;

[0133] After obtaining the interpolation coefficient, the current pressure value of the target position corresponding to A1 is P1, and the current pressure value of the target position corresponding to A2 is P2. Then, according to the interpolation coefficient ((x2-x1) / 2)-x1) / (x2-x1), the current pressure value of the target position corresponding to A1 is P1, and the current pressure value of the target position corresponding to A2 is P2, the current pressure value of the intermediate position B1 is obtained.

[0134] Specifically, the current pressure value of the middle position B1 = P1 + ((x2-x1) / 2)-x1) / (x2-x1)×(P2-P1).

[0135] For example, if the position coordinates of the target position corresponding to A1 are (10, 10), the current pressure value P1 of the target position corresponding to A1 is 0.89N, and the position coordinates of the target position corresponding to A2 are (20, 10), and the current pressure value P1 of the target position corresponding to A2 is 0.98N, then according to the above process, the interpolation coefficient obtained is ((20-10) / 2)-10) / (20-10)=0.5, and the current pressure value of the intermediate position B1 is 0.89+0.5×(0.98-0.89)=0.935N.

[0136] Step S211334: performing interpolation processing on the current pressure values of the adjacent target positions according to the current pressure value of the middle position, and determining the pressure change information of each position on the touch surface 3 based on the interpolation result.

[0137] After obtaining the current pressure value of the middle position, it can be used as the current pressure value of the middle part of the current pressure value of the adjacent target position to complete the interpolation of the adjacent current pressure values. Similarly, the current pressure values of all adjacent nodes are interpolated in the same way as above, that is, the same way as above is used to determine Figure 7 The current pressure value of the middle position B2 between the target positions corresponding to A3 and A4, the current pressure value of the middle position B3 between the target positions corresponding to A1 and A3, the current pressure value of the middle position B4 between the target positions corresponding to A2 and A4, and the current pressure value of the middle position B5 between the target positions corresponding to A1 and A4 are obtained. The current pressure value of each position within the current touch area can then be obtained based on the interpolation result. For areas outside the current touch area, the corresponding current pressure value is 0. Finally, the current pressure value of each position on the touch surface 3 can be obtained, thereby obtaining the pressure change information of each position on the touch surface 3.

[0138] In addition, to achieve the above-mentioned purpose, an embodiment of the present application also proposes a control button 1, which includes two detection elements arranged at intervals, wherein a touch surface 3 is formed on the side of one detection element facing away from the other detection element, and when the touch surface 3 is touched, it deforms toward the direction of the other detection element, and one detection element is used to emit a magnetic field to the other detection element.

[0139] As an embodiment, the detection element includes a first detection element 4 and a second detection element 5, the first detection element 4 is a magnetic component, and the second detection element 5 includes a Hall sensor 7, and the Hall sensor 7 is used to collect the magnetic field emitted by the magnetic component.

[0140] As an implementation manner, there are multiple Hall sensors 7 , and the multiple Hall sensors 7 are evenly spaced apart.

[0141] As an embodiment, the second detection element 5 further includes a substrate 6, the Hall sensor 7 is provided on the substrate 6 on a side facing away from the magnetic component, and the substrate 6 is made of a soft material; and / or

[0142] The magnetic component is made of soft material.

[0143] It should be noted that other embodiments or specific implementations of the control button 1 described in this application can refer to the above-mentioned method embodiments and will not be repeated here.

[0144] In addition, to achieve the above-mentioned purpose, the embodiment of the present application further proposes a pair of smart glasses. In this embodiment, the smart glasses include:

[0145] Frame 2;

[0146] As described above, the control button 1 is provided on the mirror frame 2;

[0147] A processor is electrically connected to the control button 1 , and is used to execute the steps of the control method described above.

[0148] It should be noted that other embodiments or specific implementations of the smart glasses described in this application can refer to the above-mentioned method embodiments and will not be repeated here.

[0149] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or system comprising the element.

[0150] The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0151] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the existing technology, can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as a read-only memory image (ROM) / random access memory (RAM), a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0152] The above are only preferred embodiments of the present application and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the description and drawings of this application, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A control method, characterized in that: The method is applied to smart glasses equipped with a control button, wherein the control button includes two detection elements spaced apart from each other, wherein a touch surface is formed on a side of one detection element facing away from the other detection element, and when the touch surface is touched, it deforms toward the other detection element, and the one detection element is configured to emit a magnetic field toward the other detection element; The method comprises: determining magnetic field change information according to the magnetic field; determining a current touch mode of the user based on the magnetic field change information, and performing corresponding function control according to the current touch mode; The step of determining the user's current touch mode based on the magnetic field change information includes: determining the current magnetic field strength of the magnetic field in each dimension based on the magnetic field change information; Obtaining a magnetic field intensity vector modulus based on the current magnetic field intensity in each dimension, and determining a displacement of the current touch area on the touch surface according to a preset displacement relationship based on the magnetic field intensity vector modulus, where the displacement is a distance that each position of the detection element emitting the magnetic field moves toward the detection element collecting the magnetic field under the action of pressure; determining a current pressure value of the current touch area based on the displacement, and determining a current pressure value of each position on the touch surface based on the current pressure value of the current touch area; determining pressure change information at each position on the touch surface according to current pressure values at each position on the touch surface; determining the user's current touch trajectory based on the pressure change information using a preset trajectory determination model, wherein the preset trajectory determination model is obtained by training a model using sample touch trajectories and sample pressure change information at various positions on the touch surface; A current touch mode of the user is determined based on the current touch trajectory.

2. The control method according to claim 1, wherein: The detection element includes a first detection element and a second detection element. The first detection element is a magnetic component. The second detection element includes a Hall sensor. The Hall sensor is used to collect the magnetic field emitted by the magnetic component.

3. The control method according to claim 2, wherein: There are multiple Hall sensors, and the multiple Hall sensors are evenly spaced.

4. The control method according to claim 2, wherein: The second detection element further includes a substrate, the Hall sensor is arranged on a side of the substrate facing away from the magnetic component, and the substrate is made of a soft material; and / or The magnetic component is made of soft material.

5. The control method according to claim 1, wherein: The step of determining the current pressure value of each position on the touch surface based on the current pressure value of the current touch area includes: Dividing the current touch area into grids; Obtaining an elastic modulus and a Poisson's ratio of the detection element that receives the magnetic field, and performing finite element analysis based on a grid division result, the elastic modulus, the Poisson's ratio, and a current pressure value of the current touch area to obtain a current pressure value at each target position; An interpolation process is performed on the current pressure value of the target position, and pressure change information of each position on the touch surface is determined based on the interpolation result.

6. A control button applied to the control method according to any one of claims 1 to 5, characterized in that: The control button includes two detection elements arranged at intervals, wherein a touch surface is formed on the side of one detection element facing away from the other detection element, and when the touch surface is touched, it deforms toward the other detection element, and one detection element is used to emit a magnetic field toward the other detection element.

7. A smart glasses, characterized in that: The smart glasses include: Frames; The control button according to claim 6, wherein the control button is provided on the mirror frame; A processor is electrically connected to the control button, and the processor is used to execute the steps of the control method according to any one of claims 1 to 5.

Images