Vibration prompting method applied to AR glasses icon switching operation

Abstract

The invention relates to a vibration prompting method applied to AR glasses icon switching operation, and belongs to the technical field of augmented reality. Comprising the following steps: when a key is pressed down, generating an initial prompt signal, and converting the initial prompt signal into a driving voltage signal to drive a motor to vibrate; when the key is continuously pressed down, rhythm vibration signals are continuously generated and converted into driving voltage signals to be output; and when the key is loosened, the generation of the rhythm vibration signal is stopped. The method has the advantages that multi-level tactile feedback is provided, so that the interactive experience of a user during icon switching is remarkably improved, the dependence on visual feedback is reduced, and the user is helped to more accurately select a target in an environment with insufficient light or overload visual information.

Description

Technical Field

[0001] The present invention belongs to the technical field of augmented reality, and particularly relates to a vibration prompt method for icon switching operations applied to AR glasses. Background Art

[0002] With the rapid development of augmented reality (AR) technology, AR glasses, as a new type of wearable device, have gradually been widely used in many fields such as medical treatment, education, industry, and entertainment. When using AR glasses, users often need to frequently perform icon switching operations to access different functions and information. Icon switching operation refers to the process in which users select different icons to execute specific functions or access information by means of clicking, haptic feedback, gesture control, voice commands, etc.

[0003] Currently, traditional icon switching methods mainly rely on visual feedback, and users need to select and confirm operations by gazing or gestures. Traditional icon switching methods rely too much on visual feedback, which may cause it difficult for users to accurately select targets in complex environments, especially in situations of insufficient light or overloaded visual information. This method may cause inconvenience or misoperation in some cases. To improve the accuracy of selection and user experience, vibrotactile feedback technology has been introduced into AR glasses to enhance the realism and immersion of interaction through haptic feedback.

[0004] Vibrotactile feedback technology is an important technology applied to human-computer interaction, which enables people to perceive and operate virtual objects through touch. Combined with visual and auditory feedback technologies, it helps people obtain more abundant information and feelings, and improves the quality of interaction with the virtual world, and has broad application prospects in fields such as education and teaching, medical and health, and entertainment games.

[0005] The application of vibrotactile feedback in AR glasses mainly relies on external devices (such as controllers, haptic gloves) or built-in vibration modules. For example, the 2017 paper "Dwell+: Multi-Level Mode Selection Using Vibrotactile Cues" proposed a method for implementing multi-level Dwell selection using rapid haptic feedback. This technology is applicable to smartphones, smartwatches, styli, and head-mounted display devices (HMDs). The designed vibrotactile signal in the paper consists of a three-beat signal composed of one long vibration and two short vibrations. However, users may miss the first vibration during the operation, thus reducing the accuracy of the operation. Summary of the Invention

[0006] The present invention provides a vibration prompt method for icon switching operations applied to AR glasses to solve the problem that traditional icon switching methods rely too much on visual feedback, which may cause it difficult for users to accurately select targets in environments with insufficient light or overloaded visual information.

[0007] The technical solution adopted by the present invention includes the following steps:

[0008] (1) When the button is just pressed, a starting prompt signal S 1 is generated, and the starting prompt signal S 1 is converted into a drive voltage signal V 1 , and the drive voltage signal V 1 is output to the motor for vibration;

[0009] (2) When the button is continuously pressed during the entire period, a rhythm vibration signal S 2 is continuously generated, and the rhythm vibration signal S 2 is converted into a drive voltage signal V 2 , and the drive voltage signal V 2 is output to the motor for vibration;

[0010] (3) When the button is released, the generation of the rhythm vibration signal S 2 is stopped, and the output of the drive voltage signal V 2 to the motor is stopped.

[0011] In step (1) of the present invention, the specific method for generating the starting prompt signal S 1 is as follows:

[0012] The starting prompt signal S 1 is a non-periodic signal with a finite length. The specific formula for the starting prompt signal S 1 is:

[0013]

[0014] where M max is the maximum amplitude of the signal, f is the frequency of the signal, D 1 , D 2 , D 3 are the durations of the signal, and the parameters k 1 , k 2 determine the steepness of the curve, and t is the time variable.

[0015] In the present invention, the frequency f of the starting prompt signal S 1 increases linearly during the output period, that is:

[0016]

[0017] where [f 1 , f 2 is the value range of the signal frequency f.

[0018] In step (1) of the present invention, the starting prompt signal S1 Convert to drive voltage signal V 1 The specific method is as follows:

[0019] Starting prompt signal S 1 First, convert it to an analog signal through the DA module, and then convert this analog signal to the drive voltage signal V through the power amplifier 1 .

[0020] In step (1) of the present invention, the drive voltage signal V 1 Is output to the motor for vibration. The specific method is as follows:

[0021] Start outputting the drive voltage signal V at the moment the button is pressed 1 , that is, the left end of the drive voltage signal V 1 Is aligned with the moment when the button is pressed. When the finite-length drive voltage signal V 1 Is output completely, stop inputting any signal.

[0022] In step (2) of the present invention, generating the rhythm vibration signal S 2 The specific method is as follows:

[0023] Rhythm vibration signal S 2 Consists of multiple identical waveforms with a period of L repeating on the time axis at intervals of T 1 , where each period T is divided into two parts. The first part is a single sine signal with a time length of L, and the second part is a stationary signal with a length of T 1 , that is, T = L + T 1 ;

[0024] The described rhythm vibration signal S 2 The specific formula is:

[0025]

[0026] Among them, L is the period of the single sine signal, M is the amplitude of the single sine signal, and D is the time when the first sine signal appears.

[0027] In step (2) of the present invention, converting the rhythm vibration signal S 2 To the drive voltage signal V 2 The specific method is as follows:

[0028] Rhythm vibration signal S 2 First, convert it to an analog signal through the DA module, and then convert this analog signal to the drive voltage signal V through the power amplifier 2 .

[0029] In step (2) of the present invention, the drive voltage signal V 2The specific method of outputting to the motor for vibration is as follows:

[0030] The driving voltage signal V 2 Each period T in is synchronized with the cursor movement on the screen. That is, at the moment when the cursor on the screen switches from one icon to the next icon each time, a period T of the driving voltage signal starts to be output;

[0031] The corresponding relationship between the actual number of vibrations perceived by the user and the icon switching: When the button is continuously pressed, when the user feels the first vibration and immediately releases the hand, the cursor will select the first icon; when feeling the second vibration and immediately releasing the hand, the cursor selects the second icon; and so on. When feeling the nth vibration and immediately releasing the hand, the cursor selects the nth icon.

[0032] The device for vibration prompt in the icon switching operation of the AR glasses of the present invention includes: a signal generation module, a power amplifier, a vibration actuator, and AR glasses, where:

[0033] The signal generation module includes a computer and a DA module. The computer is used to generate a target signal, and this target signal is converted into an analog signal through the DA module;

[0034] The power amplifier is used to amplify the analog signal output from the DA module and output the amplified driving voltage signal V 2 to the vibration actuator;

[0035] The vibration actuator includes a vibration motor and an independent button, and is used to receive the driving voltage signal V output by the power amplifier in real time 2 and provide corresponding vibration tactile feedback;

[0036] The AR glasses are used to provide visual prompts and display icon switching.

[0037] The generation of the target signal using the computer in the present invention includes a start prompt signal S 1 and a rhythm vibration signal S 2 .

[0038] The present invention has the following beneficial effects:

[0039] (1), The present invention simulates the dynamic characteristics of auditory signals (such as short pulses, increasing / decreasing amplitudes), and is deeply coupled with the user's auditory cognitive habits. Based on this, the characteristics of the start prompt signal are designed, specifically manifested as:

[0040] Short pulse signal: The short characteristic of the start prompt signal imitates the rapidly rising / falling waveform in the alarm sound and has the characteristics of rapid rise and fall. This kind of signal can quickly attract attention and stimulate the individual's alertness.

[0041] Dynamic amplitude change: By adopting a progressive intensity adjustment of musical tension (such as crescendo), it guides the user to establish an expected model of "an event is about to occur", effectively reducing the anxiety before operation and improving the attention concentration at the same time.

[0042] (2) The starting prompt signal and rhythm vibration signal proposed by the present invention provide multi-level tactile feedback, significantly enhancing the user's interaction experience when switching icons.

[0043] (3) The vibration prompt method proposed by the present invention reduces the user's visual dependence in icon switching. In an environment with insufficient light or overloaded visual information, it is often difficult for users to accurately select the target. Through the vibration prompt technology, this invention reduces the dependence on visual feedback. Especially in the case of limited vision and hearing, it can still ensure smooth and precise operation.

[0044] (4) By providing clear tactile feedback, the user can more clearly confirm the selected icon, reducing the risk of misoperation, thereby improving the accuracy and efficiency of the operation.

[0045] (5) The vibration prompt method proposed by the present invention adopts a low-cost vibration feedback prototype, which is convenient for integration and implementation on existing AR devices, reducing the threshold for technology promotion. Description of the Drawings

[0046] Figure 1 is the flowchart of the present invention;

[0047] Figure 2 is the schematic diagram of the starting prompt signal S 1 ;

[0048] Figure 3 is the schematic diagram of the rhythm vibration signal S 2 ;

[0049] Figure 4 is the corresponding relationship diagram between the actual number of vibrations perceived by the user and icon switching;

[0050] Figure 5 is the vibration prompt device diagram applied to the icon switching operation of AR glasses. Detailed Embodiment

[0051] As Figure 1 shown, it includes the following steps:

[0052] (1) When the button is just pressed, generate the starting prompt signal S 1 , convert the starting prompt signal S 1 into a drive voltage signal V 1 , and output the drive voltage signal V 1 to the motor for vibration;

[0053] (2) While the button is continuously pressed, a rhythm vibration signal S is continuously generated 2 , and the rhythm vibration signal S 2 is converted into a drive voltage signal V 2 , and the drive voltage signal V 2 is output to the motor for vibration;

[0054] (3) When the button is released, the generation of the rhythm vibration signal S stops 2 , and the output of the drive voltage signal V to the motor stops 2 .

[0055] The specific method for generating the start prompt signal S in step (1) of the present invention is as follows: 1 :

[0056] The start prompt signal S 1 is a non-periodic signal with a finite length. The specific formula for the start prompt signal S 1 is:

[0057]

[0058] where M max is the maximum amplitude of the signal, f is the frequency of the signal, D 1 , D 2 , D 3 are the durations of the signal, and the parameters k 1 , k 2 determine the steepness of the curve, and t is the time variable.

[0059] During the output period, the frequency f of the start prompt signal S increases linearly, that is: 1 :

[0060]

[0061] where [f 1 , f 2 is the value range of the signal frequency f.

[0062] The schematic diagram of the start prompt signal S of the present invention is as shown in 1 Figure 2 . The present invention simulates the dynamic characteristics of auditory signals (such as short pulses, increasing / decreasing amplitudes, rhythm), which is deeply coupled with the user's auditory cognitive habits. Therefore, the characteristics of the start prompt signal are designed, specifically manifested as:

[0063] Short pulse signal: The short characteristic of the start prompt signal imitates the waveform of rapid rise and fall in an alarm sound, and has the characteristics of rapid rise and fall. This kind of signal can quickly attract attention and stimulate the individual's alertness.​

[0064] Dynamic amplitude change: By adopting a progressive intensity adjustment of music tension (such as crescendo), it guides users to establish an expected model of "an event is about to occur", effectively reducing the anxiety before operation and improving the attention concentration at the same time.

[0065] The starting prompt signal of the present invention shows an exponential amplitude increase in the rising section (time constant τ 1 =D 1 -0 = 0.2 s), and an exponential amplitude decay is implemented in the falling section (time constant τ 2 =D 3 -D 2 = 0.3 s), and this envelope enables users to generate a subjective sense of time of "about to start".

[0066] The present invention optimizes the parameters of a starting prompt signal S based on the human tactile perception characteristics and the vibrator frequency response characteristics. The specific implementation method is as follows: 1 The parameters are optimized, and the specific implementation method is as follows:

[0067] 1), S 1 Frequency: According to the research on human tactile neurophysiology, the sensitive frequency band of tactile perception is 50 - 250 Hz; the effective frequency response range of this device is 80 - 300 Hz. Generally, low frequencies make people feel heavy or stable, while high frequencies may be more tense or sharp. The process of transitioning from low frequency to high frequency simulates the acceleration of the heartbeat or the increase in the sense of tension. Set the working frequency of the starting prompt signal S 1 to linearly increase from 80 Hz to 120 Hz, that is: , f 2 = 120 Hz, f 1 = 80 Hz, so that it is within the human tactile sensitive frequency band and the effective frequency response range of the device.

[0068] 2), S 1 Amplitude: According to the research on human tactile neurophysiology, the amplitude of tactile vibration should not exceed 0.5 - 2.5 m / s². Excessive amplitude may not only cause discomfort to users but also pose a risk of damaging the vibrator. In actual experiments, it is found that the amplitude of the starting prompt signal S 1 and the rhythmic vibration signal S 1 differs by 3 times or more, that is , so that users can distinguish the two signals. The present invention sets the amplitude ratio of the starting prompt signal and the rhythmic vibration signal to 1:3, forming a 1:3 amplitude gradient difference.

[0069] 3), S 1 Duration: The starting prompt signal S 1is a non-periodic signal with a finite length. If the duration of the signal is too long, it will reduce the efficiency of icon switching and make users prone to fatigue. If the duration of the signal is too short, users will not have enough time to react. The duration of the starting prompt signal of the present invention is set to 0.6 s.

[0070] In step (1) of the present invention, the starting prompt signal S 1 is converted into a drive voltage signal V 1 The specific method is as follows:

[0071] The starting prompt signal S 1 is first converted into an analog signal through a DA module, and then the analog signal is converted into a drive voltage signal V through a power amplifier 1 .

[0072] In step (1), the drive voltage signal V 1 is output to the motor for vibration. The specific method is as follows:

[0073] The drive voltage signal V starts to be output at the moment when the button is pressed 1 , that is, the left end of the drive voltage signal V 1 is aligned with the moment when the button is pressed. When the finite-length drive voltage signal V 1 is completely output, any signal input is stopped.

[0074] In step (2) of the present invention, the specific method for generating the rhythm vibration signal S 2 is as follows:

[0075] The schematic diagram of the rhythm vibration signal S 2 is as shown in Figure 3 . The rhythm vibration signal S 2 is composed of multiple identical waveforms with a period of L repeating on the time axis at intervals of T 1 . Each period T is divided into two parts. The first part is a single sine signal with a time length of L, and the second part is a stationary signal with a length of T 1 , that is, T = L + T 1 ;

[0076] The specific formula of the rhythm vibration signal S 2 is as follows:

[0077]

[0078] where L is the period of the single sine signal, M is the amplitude of the single sine signal, and D is the time when the first sine signal appears.

[0079] The present invention simulates the dynamic characteristics of auditory signals (such as short pulses, rhythm), which is deeply coupled with the auditory cognitive habits of users. Thus, the rhythm vibration signal S is designed2 The characteristics are specifically manifested as follows:

[0080] Clear rhythm: Through the periodic pulse waveform, our vibration signal has a clear rhythm, similar to the ticking sound of a countdown. A signal with a clear rhythm can help users better grasp the time.

[0081] In step (2) of the present invention, the rhythm vibration signal S 2 is converted into a drive voltage signal V 2 The specific method is as follows:

[0082] The rhythm vibration signal S 2 is first converted into an analog signal through the DA module, and then the analog signal is converted into a drive voltage signal V through a power amplifier. 2 .

[0083] In step (2) of the present invention, the drive voltage signal V 2 is output to the motor for vibration. The specific method is as follows:

[0084] Each period T in the drive voltage signal V 2 is synchronized with the cursor movement on the screen, that is, each time the cursor on the screen switches from one icon to the next icon, a period T of the drive voltage signal starts to be output;

[0085] The corresponding relationship between the actual number of vibrations perceived by the user and the icon switching is as Figure 4 shown. When the button is continuously pressed, when the user feels the first vibration appear and immediately releases the hand, the cursor will select the first icon; when the user feels the second vibration appear and immediately releases the hand, the cursor selects the second icon; and so on. When the user feels the nth vibration appear and immediately releases the hand, the cursor selects the nth icon.

[0086] The vibration prompting device applied to the icon switching operation of the AR glasses according to the present invention is as Figure 5 shown, and specifically includes: a signal generation module, a power amplifier, a vibration actuator, and an AR glasses, wherein:

[0087] The signal generation module includes a computer and a DA module 502. The computer is used to generate a target signal 501, including: a start prompt signal S 1 and a rhythm vibration signal S 2 , and the start prompt signal S 1 and the rhythm vibration signal S 2 are converted into analog signals through the DA module;

[0088] The power amplifier 503 is used to amplify the analog signal output from the DA module 502 and output the amplified drive voltage signal V 2 to the vibration actuator;

[0089] The vibration actuator includes a vibration motor 505 and an independent button 504 for receiving the drive voltage signal V output in real time by the power amplifier 503 2 , and providing corresponding vibration haptic feedback;

[0090] The AR glasses are used to provide visual cues and display icon switching.

Claims

1. A vibration prompt method for AR glasses icon switching operation, characterized in that: The following steps are involved: (1) When the key is just pressed, a start prompt signal S1 is generated, the start prompt signal S1 is converted into a drive voltage signal V1, and the drive voltage signal V1 is output to the motor for vibration; (2) When the key is continuously pressed, the rhythm vibration signal S2 is continuously generated, the rhythm vibration signal S2 is converted into a driving voltage signal V2, and the driving voltage signal V2 is output to the motor for vibration; (3) When the key is released, the rhythm vibration signal S2 stops being generated, and the drive voltage signal V2 stops being output to the motor.

2. A vibration prompt method for AR glasses icon switching operation according to claim 1, characterized in that: The specific method of generating the start prompt signal S1 in step (1) is: The start prompt signal S1 is a non-periodic signal of finite length. The specific formula of the start prompt signal S1 is: ; Among them, M max is the maximum amplitude of the signal, f is the frequency of the signal, D1, D2, D3 are the duration of the signal, parameters k1 and k2 determine the steepness of the curve, and t is the time variable.

3. A vibration prompt method for AR glasses icon switching operation according to claim 2, characterized in that: The frequency f of the start prompt signal S1 during the output period increases linearly, that is: ; Wherein, [f1, f2] is the value range of the signal frequency f.

4. The vibration prompt method for AR glasses icon switching operation according to claim 1, characterized in that: The specific method of converting the start prompt signal S1 into the driving voltage signal V1 in step (1) is as follows: The start prompt signal S1 is first converted into an analog signal through the DA module, and then the analog signal is converted into a driving voltage signal V1 through a power amplifier.

5. A vibration prompt method for AR glasses icon switching operation according to claim 4, characterized in that: The specific method of step (1) outputting the driving voltage signal V1 to the motor for vibration is as follows: The drive voltage signal V1 starts to be outputted at the moment the key is pressed, that is, the left end of the drive voltage signal V1 is aligned with the moment when the key is pressed. When the drive voltage signal V1 of a limited length is outputted, any signal is stopped from being inputted.

6. The vibration prompt method for AR glasses icon switching operation according to claim 1, characterized in that: The specific method of generating the rhythm vibration signal S2 in step (2) is: The rhythmic vibration signal S2 is composed of a plurality of identical waveforms with a period of L that are repeated at intervals of T1 on the time axis, wherein each period T is divided into two parts, the first part being a single sinusoidal signal with a time length of L, and the second part being a stationary signal with a length of T1, that is, T=L+T1; The specific formula of the rhythm vibration signal S2 is: ; Wherein, L is the period of a single sinusoidal signal, M is the amplitude of a single sinusoidal signal, and D is the time when the first sinusoidal signal appears.

7. The vibration prompt method for AR glasses icon switching operation according to claim 1, characterized in that: The specific method of converting the rhythm vibration signal S2 into the driving voltage signal V2 in step (2) is as follows: The rhythm vibration signal S2 is first converted into an analog signal through the DA module, and then the analog signal is converted into a driving voltage signal V2 through a power amplifier.

8. The vibration prompt method for AR glasses icon switching operation according to claim 7, characterized in that: The specific method of step (2) outputting the driving voltage signal V2 to the motor for vibration is as follows: Each cycle T of the driving voltage signal V2 is synchronized with the movement of the cursor on the screen, that is, each time the cursor on the screen switches from one icon to the next, a cycle T of the driving voltage signal is output; The correspondence between the actual number of vibrations perceived by the user and the icon switching: when the button is pressed continuously, the user releases the button immediately when he feels the first vibration, and the cursor will select the first icon; he releases the button immediately when he feels the second vibration, and the cursor selects the second icon; and so on, he releases the button immediately when he feels the nth vibration, and the cursor selects the nth icon.

9. The vibration prompt method for AR glasses icon switching operation according to claim 1, characterized in that: The device for providing a vibration prompt for an AR glasses icon switching operation includes: a signal generating module, a power amplifier, a vibration actuator and AR glasses, wherein: The signal generation module includes a computer and a DA module, and the computer is used to generate a target signal, and the target signal is converted into an analog signal by the DA module; The power amplifier is used to amplify the analog signal output from the DA module, and output the amplified driving voltage signal V2 to the vibration actuator; The vibration actuator includes a vibration motor and an independent button, which is used to receive the driving voltage signal V2 output by the power amplifier in real time and provide corresponding vibration tactile feedback; The AR glasses are used to provide visual cues and display icon switches.

10. A vibration prompt method for AR glasses icon switching operation according to claim 9, characterized in that: The target signal generated by using a computer includes a start prompt signal S1 and a rhythm vibration signal S2.

Images