An XR hands-free application navigation method and system based on micro-head movement

Abstract

The present application relates to the technical field of human-computer interaction, and particularly relates to an XR hands-free application navigation method based on micro-head movement, which comprises the following steps: waking up an XR system main interface through a head-up angle and a head-up time, constructing a geometric relationship between a user's head and the XR system main interface at the end of the wake-up of the XR system main interface; according to a micro-head rotation signal of the user, controlling a head control pointer to select into a corresponding application program; entering a selection mode or a navigation mode according to a real-time head position and a reference position, and a navigation icon is generated or disappears in the process of mutual switching between the selection mode and the navigation mode; and the present application further discloses an XR hands-free application navigation system based on micro-head movement. The present application solves the problems of user fatigue and motion sickness caused by large-amplitude or rapid head movement in the prior art, and can complete XR application full-process navigation at a comfortable speed through micro-head movement, thereby improving physiological comfort.

Description

Technical Field

[0001] This invention relates to the field of human-computer interaction technology, and in particular to an XR hands-free application navigation method and system based on micro-head motion. Background Technology

[0002] With the increasing popularity of lightweight XR head-mounted displays, users often need to operate similar applications on smartphones in XR environments, such as news reading and short video browsing. However, existing interaction technologies have the following significant drawbacks:

[0003] Limitations of gesture interaction: Current mainstream mid-air gestures and controller interaction solutions become significantly less feasible when users' hands are occupied (e.g., holding objects) or when prolonged use causes upper limb fatigue (i.e., the "gorilla arm" effect); for users with limited upper limb function, such interaction methods are almost unusable.

[0004] Bottlenecks in the applicability of voice control: Although voice interaction frees up your hands, it is prone to privacy leaks in public spaces and is significantly affected by environmental noise, causing a sharp drop in voice recognition accuracy and making it difficult to operate stably in real-world scenarios.

[0005] Physiological and social costs of head interaction: Existing head posture-based interaction systems (such as HeadGesture and CrossEdge) rely on large-angle rotations (such as the cursor needing to move to the edge of the screen) or high motion thresholds to trigger commands, forcing users to continuously perform high-intensity neck movements, which not only aggravates muscle fatigue but also easily induces cybersickness. At the same time, such movements appear abrupt in public environments and violate social norms.

[0006] Visual interference from concurrent tasks: Traditional edge interaction mechanisms force users to shift their gaze from the main content area to the screen edge to perform navigation, resulting in increased cognitive load and fragmented visual attention, which seriously weakens the continuity and efficiency of immersive content consumption. Summary of the Invention

[0007] To address the aforementioned issues, this invention provides a method and system for XR hands-free application navigation based on micro-head movements. This method solves the problems of user fatigue and motion sickness caused by large or rapid head movements in existing XR hands-free interaction technologies. It enables the entire XR application navigation process to be completed at a comfortable speed through minute head movements, thereby improving physiological comfort.

[0008] To achieve the above objectives, the technical solution adopted by the present invention is as follows:

[0009] A hands-free navigation method for XR applications based on micro-head motion includes the following steps:

[0010] S1. The XR headset monitors the user's head tilt angle and tilt time in real time. When the tilt angle and tilt time reach the corresponding threshold, the XR system main interface is activated. The geometric relationship between the user's head and the XR system main interface is constructed at the moment the XR system main interface is activated. The XR system main interface is displayed in the XR headset.

[0011] S2. The XR headset controls the head control pointer based on the user's minute head rotation signals to select and enter the corresponding application;

[0012] S3. Based on the real-time head position and the geometric relationship, enter the selection mode or navigation mode. During the switching between the selection mode and the navigation mode, the navigation icon is generated or disappears. In the selection mode, the head control pointer is used for target selection, and the navigation icon remains in a disappeared state. In the navigation mode, the navigation icon converges into a tight, static halo, and navigation instructions are executed through the head control pointer.

[0013] S4. If the determination result of step S3 is that it is in selection mode, the user moves the head control pointer into a selectable target area. When the head control pointer stays in this selectable target for a period of time that reaches the selection threshold, this selectable target is selected. If the determination result of step S3 is that it is in navigation mode, the XR head display moves the head control pointer into a navigation icon area according to the user's slight head rotation signal, so as to execute the navigation command represented by this navigation icon.

[0014] Further, in step S1, when the head-up angle is greater than the wake-up threshold angle and the head-up time is continuously greater than the wake-up time threshold, the condition for waking up the XR system main interface is met. The head-up angle is calculated as follows:

[0015] Formula (1)

[0016] in, The angle of the head up; Let Y be the component of the head-oriented unit vector along the vertical Y-axis, and P be the vertical pitch component of the head-oriented vector. It is obtained by calculating the unit vector of the head orientation, and the method for calculating the unit vector of the head orientation is as follows:

[0017] Formula (2)

[0018] in, Let be the unit vector of the head orientation. This represents the component of the unit vector pointing towards the head on the horizontal X-axis. This represents the component of the head-facing unit vector on the horizontal Z-axis.

[0019] 3. The XR hands-free application navigation method based on micro-head motion according to claim 2, characterized in that: in step S1, the geometric relationship construction step includes:

[0020] S1.1 At the moment the XR system's main interface wake-up ends, record the current three-dimensional coordinates of the head as the reference position. ;

[0021] S1.2 Calculate the unit vector of the horizontal component of the user's head orientation at the instant the XR system's main interface wake-up ends. ;

[0022] S1.3 Based on the summoning distance of the navigation icon The critical position of the user's head at the instant the navigation icon appears is calculated. ;

[0023] S1.4 Based on the switching distance between the selected mode and the navigation mode The critical position of the user's head at the instant when the navigation icons completely converge is calculated. ;

[0024] S1.5 The XR headset renders and displays the main interface of the XR system, and the orientation of the main interface of the XR system is perpendicular to the unit vector. .

[0025] Further, in step S1.2, the horizontal unit vector The calculation method is as follows:

[0026] Formula (3)

[0027] in, The unit vector of the horizontal component of the head orientation; for The X-axis component, ; for The Y-axis component; for Z-axis component, ;

[0028] In step S1.3, the critical position The calculation method is as follows:

[0029] Formula (4)

[0030] The critical position The component form is:

[0031]

[0032] Formula (5)

[0033]

[0034] in, , , The critical positions are respectively 3D coordinates; , , These are the three-dimensional coordinates of the reference position;

[0035] In step S1.4, the critical position The calculation method is as follows:

[0036] Formula (6)

[0037] The critical position The component form is:

[0038]

[0039] Formula (7)

[0040]

[0041] in, , , The critical positions are respectively The three-dimensional coordinates.

[0042] Further, in step S3, the horizontal projection distance is calculated based on the real-time head position and the reference position, and the interaction state is switched using the horizontal projection distance. The method for calculating the horizontal projection distance is as follows:

[0043] Formula (8)

[0044] in, This is the horizontal projection distance; , These are the X-axis and Y-axis coordinates of the head's real-time position, respectively.

[0045] when The selected mode is active, and the real-time head position is located at the reference position. With the critical position Between, or the real-time head position is located at the reference position. rear;

[0046] when The navigation mode is active, and the real-time head position exceeds the navigation convergence threshold. ;

[0047] The switching process between the selection mode and the navigation mode is an interactive transition state, when The time is the interactive transition state, and in the interactive transition state, the navigation icons begin to appear and dynamically converge.

[0048] Furthermore, in step S3, the navigation icons surround the head control pointer, and the navigation icons are arranged in four directions: up, down, left, and right. When there is one navigation icon in each of the four directions, each navigation icon converges independently; when there are multiple navigation icons in each of the four directions, each group of navigation icons converges as a whole.

[0049] Furthermore, in step S3, the dynamic convergence calculation method for the navigation icons is as follows:

[0050] Formula (9)

[0051] in, The degree of convergence of the navigation icons is defined as follows: The different states of the degree of convergence of the navigation icons are:

[0052] When this happens, the navigation icon is hidden;

[0053] When the navigation icon first appears, the distance between the center of the navigation icon and the head control pointer is... ;

[0054] At that time, the navigation icon continuously converges towards the direction of the head control pointer, and the distance between the center of the navigation icon and the head control pointer is... , The distance between the center of each navigation icon and the head control pointer when the navigation icons are fully converged;

[0055] At that time, the navigation icons are completely gathered, forming a closed square area, and the distance between the center of each navigation icon and the head control pointer is [missing information]. .

[0056] Further, in step S3, the method for hiding the head control pointer in the selection mode includes the following steps:

[0057] S3.1 Calculate the fluctuation range of head position within the time window:

[0058] Formula (10)

[0059] in, The horizontal projection distance, The horizontal fluctuation range of the head position within the time window; This represents the maximum horizontal projection distance within the time window. This represents the minimum horizontal projection distance within the time window.

[0060] S3.2 Based on the horizontal fluctuation amplitude and duration of the head position within the time window, determine whether the static viewing condition is met. When the static viewing condition is met, hide the head control pointer; when the static viewing condition is not met, display the head control pointer. and duration At that time, the condition of static viewing is met, and The position fluctuation threshold, For time windows.

[0061] Furthermore, in step S2, the XR headset moves the head control pointer into the target application icon area on the XR system main interface based on the user's slight head rotation signal. When the head control pointer remains within the application icon for a certain period of time, the corresponding application is entered.

[0062] A hands-free XR application navigation system based on micro-head motion, for executing a hands-free XR application navigation method based on micro-head motion, characterized in that it includes:

[0063] The posture acquisition module is used to acquire the user's head position data through the XR headset;

[0064] The wake-up module is used to acquire data from the posture acquisition module and to determine and execute whether to wake up the main interface of the XR system.

[0065] Reference and orientation calculation module, used for the reference position The horizontal unit vector The critical position The critical position Calculation;

[0066] The rendering module is used to render the main interface of the XR system, so that the orientation of the main interface of the XR system is perpendicular to the unit vector. ;

[0067] The application entry module is used to confirm whether to enter the application based on the hover time of the head control pointer;

[0068] An interaction state determination module is used to determine and select the selection mode or the navigation mode;

[0069] A navigation icon aggregation rendering module is used for the aggregation control of the navigation icons during the interactive transition state;

[0070] The navigation icon selection module is used in the navigation mode to determine whether to select the corresponding navigation icon based on the time the head control pointer hovers over the navigation icon;

[0071] The hidden module is used for determining and executing the hiding of the head control pointer.

[0072] The beneficial effects of this invention are:

[0073] This invention eliminates the need for hand operation, controllers, gestures, and voice interaction, allowing for comfortable navigation of the entire XR application process solely through minimal head movements. It supports use by individuals with hand obstruction or upper limb disabilities, and its interactive actions are natural and discreet in public settings, demonstrating strong accessibility and compatibility with various XR applications such as news reading, short videos, social media, and shopping. By reducing the head rotation amplitude and speed required for interaction (by 50%–81%), the risk of motion sickness is reduced by 6–10 times, effectively alleviating neck fatigue from prolonged use and significantly reducing dizziness, motion sickness, and other physiological discomforts, thus meeting the needs for extended immersive viewing. The XR system's main interface is activated by a head-raising motion, with five core parameters simultaneously determined at the moment of activation: wake-up timing, head reference position, horizontal orientation unit vector, navigation convergence critical position, and main interface orientation. The timing is unique, and the posture is drift-free; furthermore, the XR main interface orientation is perpendicular to the unit vector. The interface is designed to align with natural human viewing habits, ensuring a stable and comfortable visual experience. It achieves smooth and unambiguous switching between navigation modes, transition states, and selection modes. Navigation icons are arranged around the head control pointer in four directions (up, down, left, and right), conforming to human intuition and lowering the learning curve. The initial display distance of icons is defined differently for single-icon and multi-icon scenarios, resulting in a neat and orderly layout that effectively reduces accidental touches. Application icons and navigation icons on the XR system's main interface are strictly distinguished; the navigation icon automatically hides when entering selection mode, resulting in a clean and organized interface. Furthermore, based on head position fluctuation detection, the head control pointer is adaptively hidden when the user is stationary, preventing the pointer from obscuring interface content and ensuring an immersive reading and viewing experience. Attached Figure Description

[0074] Figure 1 This is a flowchart of a preferred embodiment of the present invention.

[0075] Figure 2 This is a flowchart of a preferred embodiment of the present invention, showing the process of waking up from the main interface of an XR system to entering an application.

[0076] Figure 3 This is a preferred embodiment of the present invention. , , A schematic diagram of the geometric relationship of the main interface of the XR system.

[0077] Figure 4 This is a schematic diagram of the dynamic aggregation process of navigation icons according to a preferred embodiment of the present invention.

[0078] Figure 5 This is a schematic diagram of the structure of a navigation icon according to a preferred embodiment of the present invention.

[0079] Figure 6 This is a schematic diagram illustrating the use of a news application software according to a preferred embodiment of the present invention.

[0080] Figure 7 This is a schematic diagram of a preferred embodiment of the present invention using a short video application software. Detailed Implementation

[0081] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0082] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.

[0083] Please also see Figures 1 to 7 A preferred embodiment of the present invention provides a hands-free XR application navigation method based on micro-head motion, comprising the following steps:

[0084] S1. The XR headset monitors the user's head tilt angle and tilt time in real time. When the tilt angle and tilt time reach the corresponding threshold, the XR system main interface is activated. The geometric relationship between the user's head and the XR system main interface is constructed at the moment the XR system main interface is activated and the XR system main interface is displayed in the XR headset.

[0085] In step S1, when the head-up angle is greater than the wake-up threshold angle and the head-up time is continuously greater than the wake-up time threshold, the condition for waking up the XR system's main interface is met. The head-up angle is calculated as follows:

[0086] Formula (1)

[0087] in, The angle of the head up; Let Y be the component of the head-oriented unit vector along the vertical Y-axis, and P be the vertical pitch component of the head-oriented vector. It is obtained by calculating the unit vector of head orientation, and the method for calculating the unit vector of head orientation is as follows:

[0088] Formula (2)

[0089] in, Let be the unit vector representing the direction the head is facing. This represents the component of the unit vector pointing towards the head on the horizontal X-axis. This represents the component of the head-facing unit vector on the horizontal Z-axis.

[0090] When the wake-up conditions are met—namely, the head-up angle being greater than the wake-up threshold angle and the head-up time being continuously greater than the wake-up time threshold—the wake-up phase of the XR system's main interface is determined to have ended. At the moment the wake-up phase ends, the geometric relationship between the user's head and the XR system's main interface is simultaneously constructed to ensure precise timing and no posture drift. In this embodiment, the wake-up threshold angle is 35°, and the wake-up time threshold is 2 seconds.

[0091] In step S1, the steps for constructing the geometric relations include:

[0092] S1.1 At the moment the XR system's main interface wake-up ends, record the current three-dimensional coordinates of the head as the reference position. .

[0093] S1.2 Calculate the unit vector of the horizontal component of the user's head orientation at the instant the XR system's main interface wake-up ends. .

[0094] In step S1.2, the horizontal unit vector The calculation method is as follows:

[0095] Formula (3)

[0096] in, The unit vector for the horizontal component of the head orientation; for The X-axis component, ; for The Y-axis component; for Z-axis component, .

[0097] In this embodiment, the horizontal projection vector is: Horizontal projection vector magnitude: The horizontal projection vector is normalized to obtain the components of the horizontal component unit vector, thus obtaining... .

[0098] S1.3 Based on the call distance of the navigation icon Calculate the critical position of the user's head at the instant the navigation icon appears. .

[0099] In step S1.3, the critical position The calculation method is as follows:

[0100] Formula (4)

[0101] Critical position The component form is:

[0102]

[0103] Formula (5)

[0104]

[0105] in, , , These are the critical positions. 3D coordinates; , , These are the three-dimensional coordinates of the reference position.

[0106] S1.4 Based on the switching distance between the selection mode and the navigation mode Calculate the critical position of the user's head at the moment when the navigation icons completely converge. .

[0107] In step S1.4, the critical position The calculation method is as follows:

[0108] Formula (6)

[0109] Critical position The component form is:

[0110]

[0111] Formula (7)

[0112]

[0113] in, , , These are the critical positions. The three-dimensional coordinates.

[0114] The S1.5XR headset renders and displays the main XR system interface, with the main interface oriented perpendicular to the unit vector. .

[0115] , , The geometric relationship of the XR system's main interface orientation, such as... Figure 3 As shown, in the initial state of this embodiment, the user's upper body remains upright. When the user looks up, the head position changes. When the user's head tilts up at an angle greater than or equal to the wake-up threshold angle and the duration exceeds the wake-up time threshold, the XR system's main interface is activated. A reference position is established at the moment the wake-up phase ends. The unit vector of the horizontal component of the orientation of the part Critical position The calculations enable wake-up, reference position, horizontal orientation vector, and critical position. The orientation of the XR system's main interface is determined synchronously, with a unique timing and no posture drift. When you look up to wake up the XR system's main interface, the orientation of the XR system's main interface is uniquely determined by the horizontal orientation of your head at the moment of wake-up. The interface posture is stable and natural, conforming to the natural viewing direction of the human eye, and providing a comfortable experience.

[0116] The S2.XR headset controls the head control pointer based on the user's minute head rotation signals, allowing the user to select and enter the corresponding application.

[0117] like Figure 2 As shown, in step S2, the XR headset moves the head control pointer into the target application icon area on the XR system main interface based on the user's slight head rotation signal. When the head control pointer remains within the application icon for a certain period of time, the corresponding application is entered.

[0118] The logic for entering the application in this embodiment is as follows:

[0119] After the XR system's main interface is displayed, the pointer controlled by the head is displayed normally;

[0120] Users can move a pointer controlled by their head into the target application icon area by making tiny head movements;

[0121] If the pointer controlled by the head remains within the application icon for 1 second, it is considered that entry has been confirmed.

[0122] The system opens the interactive interface of the corresponding application.

[0123] S3. Based on the real-time head position and geometric relationships, the system enters either selection mode or navigation mode. During the switching between selection mode and navigation mode, navigation icons are generated or disappear. In selection mode, the head control pointer is used for target selection, and the navigation icons remain invisible. In navigation mode, the navigation icons converge into a tight, static halo, and navigation commands are executed through the head control pointer. In this embodiment, the navigation icons are generated in a converging manner or disappear in a diverging manner.

[0124] In step S3, the navigation icons surround the head control pointer and are arranged in four directions: up, down, left, and right. When there is one navigation icon in each of the four directions, each navigation icon converges independently; when there are multiple navigation icons in each of the four directions, each group of navigation icons converges as a whole.

[0125] In this embodiment, the navigation icons are arranged around the head control pointer in four directions: up, down, left, and right. The distance between the first appearance is strictly distinguished by single or multiple icons, which conforms to human intuition and has a low operating threshold.

[0126] In step S3, the horizontal projection distance is calculated based on the real-time head position and the reference position. The interactive state is switched based on the horizontal projection distance. The calculation method for the horizontal projection distance is as follows:

[0127] Formula (8)

[0128] in, This is the horizontal projection distance; , These are the X-axis and Y-axis coordinates of the real-time head position, respectively.

[0129] Formula (8) represents the real-time head position. Relative to reference position In the horizontal unit vector The one-dimensional directional projection distance along the direction line is used to quantify the degree of forward movement of the head.

[0130] when The current mode is selected, and the real-time position of the head is at the reference position. With critical position Between, or the real-time head position is located at the reference position Behind; at this time, the head control pointer is used for target selection, and the navigation icons remain completely hidden to avoid interface redundancy. The head's real-time position is...

[0131] when The device is currently in navigation mode, and its real-time head position exceeds the navigation convergence threshold. At this point, the navigation icons in all four directions converge, forming a closed square area, and the system officially enters navigation mode. Users can then control the pointer with their heads to execute various navigation commands.

[0132] The process of switching between selection mode and navigation mode is an interactive transition state. This is an interactive transition state, during which navigation icons begin to appear and dynamically converge; during the interactive transition state, the header is located at... Point and Between points; at this time the user's head reaches Point (i.e.) When the navigation icon appears, it gradually converges dynamically towards the head control pointer. This state is only used to connect the selection state and the navigation state, and navigation commands are not executed.

[0133] In step S3, the dynamic convergence calculation method for navigation icons is as follows:

[0134] Formula (9)

[0135] in, The degree of convergence of navigation icons is as follows:

[0136] When this happens, the navigation icons are hidden;

[0137] When the navigation icon first appears, the distance between the center of the navigation icon and the head control pointer is... ;

[0138] At that time, the navigation icons continuously converge towards the direction of the head control pointer, and the distance between the center of the navigation icon and the head control pointer is... , When the navigation icons are fully converged, the distance between the center of each navigation icon and the head control pointer; the distance between the center of each navigation icon and the head control pointer, and The side length of the navigation icon;

[0139] At that time, the navigation icons have completely converged, forming a closed square area, and the distance between the center of each navigation icon and the head control pointer is [missing information]. .

[0140] In this embodiment, the navigation icons are arranged neatly around the head control pointer in four directions: up, down, left, and right. This conforms to human operating intuition, ensures intuitive and convenient operation, and reduces the user's learning cost.

[0141] In this embodiment, the instruction execution logic is as follows:

[0142] Select status ( The head control pointer is displayed normally. Users select application icons or content items by gazing at them. At this time, the navigation icons remain completely hidden, allowing users to focus on selecting functions.

[0143] Transition state ( The navigation icons appear gradually in four directions: up, down, left, and right, and dynamically converge towards the head control pointer. In this state, no navigation commands are executed; only the state transition is completed.

[0144] Navigation status ( The navigation icons are fully gathered, forming a closed square area. Once the head control pointer enters the navigation icon area, it can execute various navigation commands such as page scrolling and content switching, with precise and rapid response.

[0145] When the user's head rewinds to When this happens, the system immediately exits navigation mode, the navigation icons stop converging and gradually disperse, returning to a transitional state;

[0146] As the user's head continues to scroll back... When the system returns to the selection state, the navigation icons are completely hidden, restoring the target selection function and achieving reversible state switching.

[0147] In this embodiment, the APP icon and navigation icon on the XR system's main interface are clearly distinguished. The navigation icon disappears when selecting a mode, resulting in a clean and simple interface suitable for various XR applications such as news, short videos, social media, and shopping. Furthermore, the navigation icon is defined by distance and scene for the first time, with a neat layout that reduces the risk of accidental touches. A smooth transition between selection and navigation modes is achieved through interactive transition states, with unambiguous transitions in between. The navigation icon in this embodiment is as follows: Figure 5 As shown.

[0148] In step S3, the method for hiding the head control pointer in selection mode includes the following steps:

[0149] S3.1 Calculate the fluctuation range of head position within the time window:

[0150] Formula (10)

[0151] in, The horizontal fluctuation range of the head position within the time window; Same as the definition in formula (8), and for the three-dimensional position of the head. In the horizontal vector One-dimensional projected distance in the direction; This represents the maximum value of the header position within the time window. This represents the minimum head position within the time window.

[0152] S3.2 Based on the horizontal fluctuation amplitude and duration of the head position within the time window, determine whether the static viewing condition is met. If the static viewing condition is met, hide the head control pointer; if the static viewing condition is not met, display the head control pointer. and duration At that time, the condition of static viewing is met, and The position fluctuation threshold, For time windows.

[0153] In this embodiment, the system determines whether the user is in a static viewing state by measuring the fluctuation amplitude and duration of the head position within the time window. When the static viewing condition is met, the system automatically hides the head control pointer to avoid obscuring the application content and enhance the user's viewing immersion. When the static viewing condition is not met, the head control pointer is displayed normally to ensure that the user can perform target selection operations at any time without operation delay.

[0154] S4. If the determination result of step S3 is that it is in selection mode, the user moves the head control pointer into a selectable target area. When the head control pointer stays in this selectable target for a period of time that reaches the selection threshold, this selectable target is selected. If the determination result of step S3 is that it is in navigation mode, the XR head display moves the head control pointer into a navigation icon area according to the user's slight head rotation signal, so as to execute the navigation command represented by this navigation icon.

[0155] This embodiment also discloses an XR hands-free application navigation system based on micro-head motion to execute an XR hands-free application navigation method based on micro-head motion, including:

[0156] The posture acquisition module is used to acquire the user's head position data through the XR headset;

[0157] The wake-up module is used to acquire data from the posture acquisition module and to determine and execute whether to wake up the main interface of the XR system.

[0158] Reference and orientation calculation module, used for the reference position The horizontal unit vector The critical position The critical position Calculation;

[0159] The rendering module is used to render the main interface of the XR system, so that the orientation of the main interface of the XR system is perpendicular to the unit vector. ;

[0160] The application entry module is used to confirm whether to enter the application based on the hover time of the head control pointer;

[0161] An interaction state determination module is used to determine and select the selection mode or the navigation mode;

[0162] A navigation icon aggregation rendering module is used for the aggregation control of the navigation icons during the interactive transition state;

[0163] The navigation icon selection module is used in the navigation mode to determine whether to select the corresponding navigation icon based on the time the head control pointer hovers over the navigation icon;

[0164] The hidden module is used for determining and executing the hiding of the head control pointer.

[0165] In this embodiment, as Figure 6 As shown, the news application has one navigation icon in each of the four directions, and the process of using the news application is as follows:

[0166] When the user's head-up angle is ≥35° and the wake-up time threshold is maintained, the XR system's main interface wake-up phase ends, and the system synchronously triggers subsequent reference position and vector calculations.

[0167] The system synchronously determines the reference position. Horizontal component unit vector Critical position and critical position ,distance and And the main interface of the XR system (interface orientation and...) Vertically, ensuring parameter uniformity and stable attitude;

[0168] The user moves the head control pointer into the news application icon area by making a small head turn and holds it there for 1 second. After the system confirms the user's operation, it opens the news application's interactive interface.

[0169] Select status ( The navigation icons are completely hidden, and users can use the pointer above to select different news content. The interface is simple and unobtrusive.

[0170] Transition state ( ≤ ≤ When the head reaches point( When the navigation icons first appear, they are arranged in four directions: top, bottom, left, and right. The distance between the center of each icon and the head control pointer is [missing information]. and followed The value increases and continues to converge towards the pointer; the convergence process is smooth and without pauses, during the transition state. =0.

[0171] Navigation status ( ): The navigation icons in all four directions converge, forming a closed square area and a tight, static halo. Users can use the head-mounted pointer to perform navigation operations such as scrolling through news content within the same article, going to the previous article, the next article, and returning to the main interface. The operation is precise and efficient. On the main interface of the news app, the navigation functions are swipe up, swipe down, swipe left, and swipe right. After entering an article, the navigation is swipe up, swipe down, return to the previous page, and return to the top.

[0172] Still viewing: When the user is in a selection state ( When watching news content, if the head position fluctuates... And duration The head control pointer automatically hides to avoid obscuring the news text; when the head fluctuates and no longer meets the static condition, the pointer immediately displays normally, making it easy for users to reselect the target content, balancing immersion and ease of operation.

[0173] like Figure 7 As shown, the short video application has multiple navigation icons in each of its four directions. The usage process of the short video application is as follows:

[0174] The application entry process is the same as that of news applications: the user looks up at an angle of ≥35° and maintains this position for a specified time threshold to activate the XR system's main interface; the system then simultaneously determines the reference position. Horizontal component unit vector Critical position and critical position ,distance and And the main interface of the XR system (interface orientation and...) (Vertical), users can use their head to control the pointer and gaze at the short video application icon for 1 second to enter the short video application's interactive interface;

[0175] Transition state ( ≤ ≤ When the head reaches point( When the navigation icon first appears, it is arranged in four directions: top, bottom, left, and right. Each direction contains one navigation icon and one function icon (e.g., top: "Previous Video" and "Like"; bottom: "Next Video" and "Share"; left: "Rewind" and "Pause"; right: "Fast Forward" and "Comment"). All icons in each direction are treated as a single unit, with the center of the unit positioned a certain distance from the top control pointer. As the K value increases, the entire array converges towards the pointer, resulting in a neat and orderly layout.

[0176] Navigation status ( The navigation icons in all four directions converge into a closed square halo; users can move the head control pointer to the corresponding navigation icon or function icon area to execute the corresponding command (such as entering the "Like" icon area to complete the short video like operation; entering the "Fast Forward" icon area to execute the short video fast forward operation), with a fast response and no accidental touches;

[0177] Still viewing: When a user is watching a short video, if they are in a selection state ( And the head remains still. And duration The head-controlled pointer automatically hides, not obstructing the video view and enhancing the viewing immersion; if you need to switch videos or perform other operations, the pointer will immediately reappear when you slightly turn your head, ensuring convenient operation and balancing viewing experience with operational needs.

[0178] In this embodiment, the XR system main interface wake-up, reference position, horizontal orientation vector, navigation critical position, and XR system main interface orientation are determined synchronously, with unique timing and stable posture. This effectively avoids interface offset or command mis-triggering caused by step-by-step calculation, and improves interaction accuracy.

[0179] The XR system's main interface is oriented perpendicular to the horizontal unit vector, perfectly matching the natural viewing direction of the human eye. This significantly improves user comfort during extended use, reduces eye strain, and is suitable for prolonged viewing scenarios such as news and short videos. The XR system's main interface strictly distinguishes between application icons and navigation icons; the navigation icons are completely hidden when selected, avoiding redundant interface elements. Combined with the automatic pointer hiding function, this significantly enhances the user's immersive experience when viewing content. The navigation icon convergence distance is adjusted according to... The rules change dynamically, and for the first time, the distance is uniform and the convergence process is smooth, which not only ensures the regularity of the layout, but also reduces the probability of accidental touches and improves the accuracy and smoothness of the interaction.

[0180] Requires only minimal head movements throughout the entire process, eliminating the need for large head rotations. This reduces head rotation by 50%–81%, effectively reducing neck fatigue and improving the user experience. Based on horizontal projection distance-based state determination logic, it significantly reduces the required head movement speed, lowering the risk of motion sickness by 6–10 times, making it suitable for extended use by various groups. It achieves fully hands-free operation, eliminating the need for controllers, gestures, or voice interaction, adapting to special scenarios such as when hands are occupied or upper limb disabilities exist. Furthermore, when used in public places, user movements are naturally concealed, effectively protecting user privacy.

Claims

1. A hands-free XR application navigation method based on micro-head motion, characterized in that, Includes the following steps: S1. The XR headset monitors the user's head tilt angle and tilt time in real time. When the tilt angle and tilt time reach the corresponding threshold, the XR system main interface is activated. The geometric relationship between the user's head and the XR system main interface is constructed at the moment the XR system main interface is activated. The XR system main interface is displayed in the XR headset. S2. The XR headset controls the head control pointer based on the user's minute head rotation signals to select and enter the corresponding application; S3. Based on the real-time head position and the geometric relationship, enter the selection mode or navigation mode. During the switching between the selection mode and the navigation mode, the navigation icon is generated or disappears. In the selection mode, the head control pointer is used for target selection, and the navigation icon remains in the disappeared state. In the navigation mode, the navigation icon converges into a tight, static halo, and navigation instructions are executed through the head control pointer. S4. If the determination result of step S3 is that it is in selection mode, the user moves the head control pointer into a selectable target area. When the head control pointer stays in this selectable target for a period of time that reaches the selection threshold, this selectable target is selected. If the determination result of step S3 is that it is in navigation mode, the XR head display moves the head control pointer into a navigation icon area according to the user's slight head rotation signal, so as to execute the navigation command represented by this navigation icon.

2. The XR hands-free application navigation method based on micro-head motion according to claim 1, characterized in that: In step S1, when the head-up angle is greater than the wake-up threshold angle and the head-up time is continuously greater than the wake-up time threshold, the conditions for waking up the XR system main interface are met. The head-up angle is calculated as follows: Official (1) in, The angle of the head up; Let Y be the component of the head-oriented unit vector along the vertical Y-axis, and P be the vertical pitch component of the head-oriented vector. It is obtained by calculating the unit vector of the head orientation, and the method for calculating the unit vector of the head orientation is as follows: Official (2) in, Let be the unit vector of the head orientation. This represents the component of the unit vector pointing towards the head on the horizontal X-axis. This represents the component of the head-facing unit vector on the horizontal Z-axis.

3. The XR hands-free application navigation method based on micro-head motion according to claim 2, characterized in that: In step S1, the steps for constructing the geometric relationship include: S1.1 At the moment the XR system's main interface wake-up ends, record the current three-dimensional coordinates of the head as the reference position. ; S1.2 Calculate the unit vector of the horizontal component of the user's head orientation at the instant the XR system's main interface wake-up ends. ; S1.3 Based on the summoning distance of the navigation icon The critical position of the user's head at the instant the navigation icon appears is calculated. ; S1.4 Based on the switching distance between the selected mode and the navigation mode The critical position of the user's head at the instant when the navigation icons completely converge is calculated. ; S1.5 The XR headset renders and displays the main interface of the XR system, and the orientation of the main interface of the XR system is perpendicular to the unit vector. .

4. The XR hands-free application navigation method based on micro-head motion according to claim 3, characterized in that: In step S1.2, the horizontal unit vector The calculation method is as follows: Official (3) in, The unit vector of the horizontal component of the head orientation; for The X-axis component, ; for The Y-axis component; for Z-axis component, ; In step S1.3, the critical position The calculation method is as follows: Official (4) The critical position The component form is: Official (5) in, , , The critical positions are respectively 3D coordinates; , , These are the three-dimensional coordinates of the reference position; In step S1.4, the critical position The calculation method is as follows: Official (6) The critical position The component form is: Official (7) in, , , The critical positions are respectively The three-dimensional coordinates.

5. The XR hands-free application navigation method based on micro-head motion according to claim 4, characterized in that: In step S3, the horizontal projection distance is calculated based on the real-time head position and the reference position. The interaction state is switched using the horizontal projection distance. The method for calculating the horizontal projection distance is as follows: Official (8) in, This is the horizontal projection distance; , These are the X-axis and Y-axis coordinates of the head's real-time position, respectively. when The selected mode is active, and the real-time head position is located at the reference position. With the critical position Between, or the real-time head position is located at the reference position. rear; when The navigation mode is active, and the real-time head position exceeds the navigation convergence threshold. ; The switching process between the selection mode and the navigation mode is an interactive transition state, when The time is the interactive transition state, and in the interactive transition state, the navigation icons begin to appear and dynamically converge.

6. The XR hands-free application navigation method based on micro-head motion according to claim 5, characterized in that: In step S3, the navigation icons surround the head control pointer, and the navigation icons are arranged in four directions: up, down, left, and right. When there is one navigation icon in each of the four directions, each navigation icon converges independently; when there are multiple navigation icons in each of the four directions, each group of navigation icons converges as a whole.

7. The XR hands-free application navigation method based on micro-head motion according to claim 5, characterized in that: In step S3, the dynamic convergence calculation method for the navigation icons is as follows: Official (9) in, The degree of convergence of the navigation icons is defined as follows: The different states of the degree of convergence of the navigation icons are: When this happens, the navigation icon is hidden; When the navigation icon first appears, the distance between the center of the navigation icon and the head control pointer is... ; At that time, the navigation icon continuously converges towards the direction of the head control pointer, and the distance between the center of the navigation icon and the head control pointer is... , The distance between the center of each navigation icon and the head control pointer when the navigation icons are fully converged; At that time, the navigation icons are completely gathered, forming a closed square area, and the distance between the center of each navigation icon and the head control pointer is [missing information]. .

8. The XR hands-free application navigation method based on micro-head motion according to claim 5, characterized in that: In step S3, the method for hiding the head control pointer in the selection mode includes the following steps: S3.1 Calculate the fluctuation range of head position within the time window: Official (10) in, The horizontal projection distance, The horizontal fluctuation range of the head position within the time window; This represents the maximum horizontal projection distance within the time window. This represents the minimum horizontal projection distance within the time window. S3.2 Based on the horizontal fluctuation amplitude and duration of the head position within the time window, determine whether the static viewing condition is met. When the static viewing condition is met, hide the head control pointer; when the static viewing condition is not met, display the head control pointer. and duration At that time, the condition of static viewing is met, and The position fluctuation threshold, For time windows.

9. The XR hands-free application navigation method based on micro-head motion according to claim 1, characterized in that: In step S2, the XR headset moves the head control pointer into the target application icon area on the XR system main interface based on the user's slight head rotation signal. When the head control pointer remains within the application icon for a certain period of time, the corresponding application is entered.

10. A hands-free XR application navigation system based on micro-head motion, for executing the hands-free XR application navigation method based on micro-head motion as described in any one of claims 1-9, characterized in that, include: The posture acquisition module is used to acquire the user's head position data through the XR headset; The wake-up module is used to acquire data from the posture acquisition module and to determine and execute whether to wake up the main interface of the XR system. Reference and orientation calculation module, used for the reference position The horizontal unit vector The critical position The critical position Calculation; The rendering module is used to render the main interface of the XR system, so that the orientation of the main interface of the XR system is perpendicular to the unit vector. ; The application entry module is used to confirm whether to enter the application based on the hover time of the head control pointer; An interaction state determination module is used to determine and select the selection mode or the navigation mode; A navigation icon aggregation rendering module is used for the aggregation control of the navigation icons during the interactive transition state; The navigation icon selection module is used in the navigation mode to determine whether to select the corresponding navigation icon based on the time the head control pointer hovers over the navigation icon; The hidden module is used for determining and executing the hiding of the head control pointer.

Images