Dynamic adaptive navigation method and system, computer equipment and storage medium

Abstract

According to the dynamic adaptive navigation method and system, the computer equipment and the storage medium, dynamic adaptive navigation can be carried out on user interface interaction element focuses facing a limited input scene, and interaction elements of all windows of a user interface can be obtained to form a user interface interaction element set; performing visibility judgment on each interaction element in the set to obtain a visible interaction element set which is located at the top layer of the main window of the user interface and is available, based on the visible interaction element set, obtaining interaction elements in a non-focus state in four calculation spaces in four navigation directions by taking the interaction element in the focus state as a center, and according to a distance increasing mode of the interaction elements in the non-focus state and the interaction elements in the focus state, the interaction elements with the minimum distances in the four directions are found out as new interaction elements in the focus state selected along the navigation direction according to the interaction intention, so that the focus navigation function can be realized, and the dynamic navigation effect is improved.

Description

Technical Field

[0001] The present invention relates to the field of user interface interaction control, and in particular to a dynamic adaptive navigation method, system, computer equipment and storage medium for user interface interaction element focus in a restricted input scenario. Background Art

[0002] A graphical user interface (GUI) is a computer user interface based on graphical display. It allows users to perform tasks by operating various interactive elements on the user interface with the help of input devices. It is a human-computer interaction scenario.

[0003] However, some human-computer interaction scenarios exist where input devices are limited. Examples include medical devices that only support keyboard and arrow keys, in-vehicle systems that disable touchscreens while driving, and smart TVs that rely on remote controls. In these scenarios, users cannot use direct input devices like a mouse or touchscreen and can only navigate the user interface focus through discrete input methods (such as arrow keys, the Tab key, or voice commands). This significantly reduces the efficiency of interactive elements. Furthermore, as the basic units of human-computer interaction, the layout structure and dynamic changes of interactive elements in the user interface (such as buttons, input boxes, and sliders) directly affect the focus navigation experience.

[0004] Existing focus navigation solutions (such as those that manually pre-set navigation paths during software development, those based on nearest neighbor strategies, vertical and horizontal area segmentation, and static tab order) generally suffer from three major flaws: First, they cannot adapt to dynamic updates such as the real-time addition and deletion of interface elements or layout changes; second, mechanical navigation paths are inconsistent with user perception; and third, cross-platform adaptation requires repeated development, resulting in increased costs. Consequently, cross-platform development costs are high, and focus navigation for dynamic user interface interactive elements is ineffective. Summary of the Invention

[0005] The present invention provides a dynamic adaptive navigation method, system, computer device and storage medium to serve software developers and end users. It aims to solve problems such as high cross-platform adaptation cost of focus navigation function and difficulty in implementing focus navigation function in a dynamically customizable user interface during the software development stage; and to solve problems such as operational obstacles under limited human-computer interface interactive input conditions and the mismatch between focus navigation logic / results and end user cognition / expectations during the software use stage.

[0006] In order to achieve the above object, the technical solution of the present invention is: In one embodiment, a dynamic adaptive navigation method is provided, comprising: Start the user interface, obtain the normal display of the main window of the user interface containing interactive elements, and determine whether the software deployment / operation environment belongs to the restricted input scenario; If the software deployment / operation environment belongs to a restricted input scenario, obtaining the user interface display terminal parameters and the user interface interactive element set; Performing visibility judgment on each interactive element in the user interface interactive element set, and obtaining a set of visible interactive elements that are at the top level of the user interface main window and are available; Reading the visible interactive element set information, performing a four-directional computational space splitting operation based on the user interface display terminal parameters, splitting the non-focused interactive elements into four computational spaces along the four navigation directions of upward, downward, left, and right, with the focused interactive element as the center, and sorting them in ascending order of spacing; Determine whether there is an interaction intention of the terminal user in the current cycle. If so, determine the type of interaction intention and select an interactive element in a non-focus state with the smallest distance along the navigation direction as the new interactive element in the focused state, and update the navigation visualization content of the user interface interactive element. If not, enter the next cycle; Periodically loop to determine whether there is an end-user interaction intention in the current cycle until the user interface is closed / destroyed / covered / minimized.

[0007] In one embodiment, determining whether the software deployment / operation environment belongs to a restricted input scenario includes: In response to starting a user interface, if it is impossible to locate, switch, or operate interactive elements of the user interface using a mouse or touch screen, determining whether the user interface belongs to a restricted input scenario, wherein the restricted input scenario includes but is not limited to: limited input dimension, limited control granularity, and limited feedback method; The input dimension is limited in that the user interface only supports discrete navigation switching input, and the discrete navigation switching input includes input modes of numeric direction keys, arrow direction keys, Tab keys, and custom keys; The control granularity is limited because the user interface lacks pixel-level precision positioning and switching capabilities; The feedback method is limited in that the user interface cannot provide continuous interactive signals.

[0008] In one embodiment, obtaining the user interface display terminal parameters and the user interface interactive element set includes: Get the display resolution of the user interface display terminal and the width value in the display resolution With height value , using a two-dimensional vector Proforma records; Take the upper left corner of the main window of the user interface as the origin of the screen coordinate system, the rightward direction along the width of the main window of the user interface as the positive X axis of the screen coordinate system, and the downward direction along the height of the main window of the user interface as the positive Y axis of the screen coordinate system, obtain the screen coordinates of the interactive element associated with the current focus in the main window of the user interface and perform data normalization processing. The normalization processing method is as follows: ,in , x is the screen coordinate value of the current interactive element on the X axis, y is the screen coordinate value of the current interactive element on the Y axis, The screen coordinates (x, y) of the interactive element associated with the current focus are normalized; The screen coordinates of the interactive elements in all display windows in the user interface are normalized and then aggregated to form the user interface interactive element set.

[0009] In one embodiment, determining the visibility of each interactive element in the user interface interactive element set to obtain a set of visible interactive elements that are at the top level of the user interface main window and are available includes: Obtaining the coordinate position of each interactive element in the set of visible interactive elements; emitting a light beam ray toward the coordinate position of the interactive element, obtaining a ray intersection result array, and comparing whether the first selectable object in the ray intersection result array and the interactive element are the same object; if so, determining that the interactive element is on the top layer; otherwise, determining that the interactive element is on the bottom layer; All interactive elements at the top level are recorded in the form of a top-level node unit list structure to form a set of available interactive elements at the top level of the user interface main window. The top-level node unit list structure includes interactive elements associated with the current focus and screen coordinate position data of the interactive elements associated with the current focus.

[0010] In one embodiment, the reading of the visible interactive element set information, performing a four-directional computational space splitting operation based on the user interface display terminal parameters, splitting the non-focused interactive elements into four computational spaces along the four directions of navigation (up, down, left, and right) with the focused interactive element as the center, and sorting them in increasing order of spacing includes: Read the screen coordinate position data of each interactive element in the set of visible interactive elements and perform normalization processing to form the coordinate value of the interactive element in the non-focus state. , where i is the serial number; Taking the interactive element in focus as the center, the upper calculation space UpSpace, the lower calculation space DownSpace, the left calculation space LeftSpace and the right calculation space RightSpace are constructed along the four directions of upward, downward, left and right navigation. Get the normalized coordinate value of the interactive element in focus , obtain the coordinate value of the interactive element in the non-focus state in the visible interactive element set ; like , add the interactive element to the upper computing space UpSpace; like , add the interactive element to the down calculation space DownSpace; like , add the interactive element to the left calculation space LeftSpace; like , add the interactive element to the right calculation space RightSpace; Using a calculation space representing a navigation direction as the scope, the adaptive function is used to calculate the value of each interactive element to be calculated and sort them to find the minimum distance; The interactive elements with the minimum spacing along the four directions of upward, downward, left and right navigation with the interactive element in the focused state as the center and the interactive elements in the focused state are recorded in the form of an adaptive navigation data list structure.

[0011] In one embodiment, taking a calculation space representing a navigation direction as a range, calculating the value of each interactive element to be calculated by an adaptive function and sorting and finding the minimum distance includes: Using a calculation space representing a navigation direction as the range, obtain the angle between the line connecting the interactive element to be calculated and the focus interactive element and the navigation direction axis. ; Get the normalized vertical distance of the interactive element to be calculated perpendicular to the navigation direction axis ; Get the normalized axial distance of the interactive element to be calculated parallel to the navigation direction axis ; Calling the adaptive function The three values ​​are comprehensively calculated to obtain the value, where the adaptive function is: ;in represents three non-negative weights whose sum is 1; by The interactive element with the smallest value is the optimal solution.

[0012] In one embodiment, the method further comprises: Monitoring whether there is an update event for the user interface interactive element, where the types of the user interface interactive element update event include: interactive element addition event, interactive element reduction event, and interactive element modification event; The triggering condition of the interactive element addition event is: a sub-window containing a new interactive element pops up in the top layer of the main window of the user interface or / and an interactive element in a disabled state is activated or / and an interactive element covered by other sub-windows is displayed; The triggering condition of the interactive element reduction event is: the sub-window containing the interactive element in the top layer of the main window of the user interface is destroyed / closed / hidden / covered, etc. or / and the interactive element in the activated state is disabled or / and the interactive element is covered by other sub-windows; The triggering condition of the interactive element change event is: the screen coordinate position of the interactive element in the top layer of the main window of the user interface changes or / and the interface depth value of the interactive element changes or / and the type of the interactive element changes; In response to an update event of the user interface interactive element, the minimum spacing between the interactive elements in the four directions of navigation up, down, left and right, and the interactive element in the focus state is recalculated, and the adaptive navigation data list structure is updated.

[0013] In one embodiment, a dynamic adaptive navigation system is further provided for implementing the dynamic adaptive navigation method described above. The dynamic adaptive navigation system includes: A data storage module is used to cache user interface display terminal parameters, user interface interactive element sets, and adaptive navigation data; User interface module, used to obtain user interface display terminal parameters, types and location data of interactive elements; User interface interactive element management module, used for registration management and visibility determination of user interface interactive elements; The user interface update event monitoring module is used to capture the user interface layout update event and control the triggering of navigation data calculation; Navigation data calculation module, used for recalculation and update of adaptive navigation data cache; The user interaction intention input monitoring module is used to collect the terminal user's operation intention on the user interface and realize the focus switching and operation of interactive elements; The interactive element focus navigation visualization module is used to present the spatial properties of the focus interactive element in the user interface in real time.

[0014] In one embodiment, a computer device is further provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the above methods when executing the computer program.

[0015] In one embodiment, a computer-readable storage medium is further provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of any of the methods described above are implemented.

[0016] Through the present application, dynamic adaptive navigation of the focus of user interface interactive elements for restricted input scenarios can be achieved, and interactive elements of all windows of the user interface can be obtained to form a user interface interactive element set. By performing visibility judgment on each interactive element in the user interface interactive element set, a set of visible interactive elements that are at the top level of the user interface main window and are available is obtained. Based on the visible interactive element set, the interactive elements in the non-focus state in four calculation spaces along the four directions of navigation up, down, left and right are obtained with the interactive element in the focused state as the center. Then, the interactive elements in the non-focus state and the interactive elements in the focused state are sorted in increasing order according to the distance between the interactive elements in the non-focus state and the interactive elements in the focused state to find the interactive element with the smallest distance in the four directions as the new interactive element in the focused state selected along the navigation direction according to the interaction intention. This can realize the focus navigation function and improve the focus navigation effect of dynamic user interface interactive elements. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings: Figure 1 This is a diagram showing the implementation and application overview of dynamic adaptive navigation of the focus of interactive elements in the user interface according to an embodiment of the present invention; Figure 2 This is a schematic diagram of a user interface interactive element update event type according to an embodiment of the present invention; Figure 3 A flowchart for developing and implementing the dynamic adaptive focus navigation function according to an embodiment of the present invention; Figure 4 This is an architecture diagram of a dynamic adaptive navigation system for user interface interactive element focus according to an embodiment of the present invention; Figure 5 This is a schematic diagram of normalization processing of user interface interaction elements according to an embodiment of the present invention; Figure 6 Schematic diagram of a calculation space segmentation result based on the focus navigation switching direction according to an embodiment of the present invention; Figure 7 Schematic diagram of calculation of interactive element value based on fitness function according to an embodiment of the present invention; Figure 8 This is a flowchart of the dynamic adaptive navigation system for user interface interactive element focus according to an embodiment of the present invention. DETAILED DESCRIPTION

[0018] The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0019] Example 1 This embodiment discloses a dynamic adaptive navigation method and system. Figure 1 , demonstrating the overall process of implementation and application of a dynamic adaptive navigation system for user interface interactive element focus for restricted input scenarios provided by the present invention.

[0020] The restricted input scenario refers to an environment where the end user cannot use direct positioning input devices such as mechanical / optical mice or electronic screens with touch functions to locate, switch, and operate user interface interactive elements. Its characteristics include but are not limited to: 1. Limited input dimensions: Only discrete navigation switching inputs such as numeric direction keys, arrow direction keys, Tab key, and custom keys are supported. These are used to monitor the end user's intention to select and operate up / down / left / right on interactive elements in the user interface. 2. Limited control granularity: Lack of pixel-level precise positioning and switching capabilities; 3. Limited feedback methods: Unable to provide continuous interactive signals such as hover state detection.

[0021] The restricted input scenarios include, but are not limited to, typical situations: a disinfected environment in which touch operations are disabled in medical equipment; locking the touch screen during driving in a vehicle system; smart TVs that are only equipped with a remote control; industrial control systems that restrict the use of a mouse; electronic games based on controller interaction, etc.

[0022] The user interface refers to the graphical human-computer interaction interface containing interactive elements built by software developers based on business needs using development tools / platforms.

[0023] The development tool / platform can be a game engine such as Unity3D, Unreal Engine, Godot, or a GUI framework such as WinForms, WPF, or QT. This embodiment uses the Unity3D game engine and the C# programming language as preferred implementation methods for explanation. The graphical human-computer interaction interface is presented through a display terminal device, and its display resolution adaptation range covers multiple specifications from 640×360 pixels to 3840×2160 pixels (4K UHD), including but not limited to: 1. Common resolutions for mobile terminals: 720×1280 (HD), 1080×1920 (FHD), etc. 2. Typical specifications of desktop monitors: 1920×1080 (FHD), 2560×1440 (QHD), etc. 3. Large-size display devices: 3840×2160 (4K UHD), etc. 4. Custom size display device: w × h.

[0024] The interactive element refers to an independent functional unit in the user interface that can respond to focus navigation, which can be divided into basic controls and composite controls. Basic interactive element controls include buttons, input boxes, switches, sliders, scroll bars, etc.; composite interactive element controls include drop-down menus, scroll rectangles, tables, lists, trees, calendars, etc.

[0025] In this embodiment, software developers can use the built-in UGUI module or NGUI plug-in of the Unity3D engine to perform user interface layout design, interaction logic binding and other tasks.

[0026] The focus dynamic adaptive navigation refers to the dynamic changes in the interface layout structure caused by the simultaneous existence of static preset interactive elements and dynamically updated interactive elements in the user interface, which makes the traditional fixed navigation path unable to meet the user's expected focus switching operation needs. Therefore, a real-time dynamic focus navigation mechanism is established. The specific implementation method of this mechanism will be discussed in conjunction with the appendix of the manual. Figure 4 , Attachment Figure 5 , Attachment Figure 6 , Attachment Figure 7 , Attachment Figure 8 Further details are given.

[0027] Refer to the attached Figure 2 , showing three types of update events of the dynamic interactive elements in the user interface of the present invention, as follows: 1. Interactive element addition event: The trigger condition for this event can be that a sub-window containing interactive elements pops up from the main window of the user interface. For example, an account registration sub-interface pops up in a platform user interface. On this interface, there are button interactive elements named "Register" and "Clear", and input box interactive elements named "Account", "Password", and "Second Password". In addition, the interactive element addition event will be triggered when an interactive element in the interface that is in an inactive / disabled state becomes active / enabled. For example, when the user does not check a user agreement, the "Register" button is in an unclickable state. When the user checks it, the button becomes clickable.

[0028] 2. Interactive element reduction event: This event can be triggered by the destruction / closing / deletion / hiding of a sub-window containing interactive elements in the main window of the user interface. For example, after a user completes the account registration service on a certain platform, the registration sub-interface containing interactive elements such as buttons, input boxes, and switches will automatically disappear.

[0029] 3. Interactive Element Change Event: This event triggers three conditions: a change in the position of an interactive element, a change in the depth of an interactive element, and a change in the type of an interactive element. For example, from the position perspective, a user drags an interactive point on a slider, triggering an interactive element change event in real time. From the depth perspective, an interactive element already in the main window of the user interface is covered by a newly popped-up sub-window. From the type perspective, an interactive element originally a button on the user interface is changed to a switch.

[0030] Refer to the attached Figure 3 , shows the basic process for software developers to implement dynamic adaptive navigation function of user interface interactive elements focus.

[0031] Step 1: Technology selection: Select appropriate development tools / platforms / methods based on business functional requirements. This example uses the Unity3D 3D visualization application development engine with C# high-level programming language as the main development language; Step 2: Software Implementation: Follow development rules to build a software system with user interaction capabilities. In this embodiment, software developers need to master RectTransform components, UI components, Layout components, Events components, etc. In addition, software developers need to be familiar with the basic knowledge of Unity3D UI development, such as UI object hierarchy design, UI rendering mechanism, and UI interaction event binding; Step 3: Scenario judgment: Determine whether the software system deployment / operation environment meets the restricted input scenario characteristics. If so, proceed to the next step; if not, switch to the regular software system development process; Step 4: Principle Learning: Master the principles of a dynamic adaptive navigation system for user interface interactive element focus in limited input scenarios provided by the present invention; Step 5: Navigation Implementation: Based on the principles disclosed in the present invention, a dynamic adaptive navigation function of the focus of the interactive elements of the user interface is implemented, wherein the functional carrier can exist in the form of a plug-in, an assembly, a dynamic link library, etc. This embodiment adopts the Assembly Definition assembly definition method to realize the modular development of the dynamic adaptive navigation function; Step 6 Functional integration: Integrate the focus dynamic adaptive navigation function into the software system built in step 2.

[0032] Refer to the attached Figure 4 , presents the architecture of a dynamic adaptive navigation system for user interface interaction element focus in constrained input scenarios, which consists of data and processing logic modules.

[0033] The data in the dynamic adaptive navigation system architecture of the user interface interactive element focus includes three types: 1. User interface displays terminal parameters: the data structure uses a two-dimensional vector Form record, where , Both are non-negative finite natural numbers, representing the width and height of the main window of the user interface, in pixels. This parameter is used to normalize the screen coordinate position data of the interactive elements. The process can be referred to in the attached Figure 5 Further understanding.

[0034] With the upper left corner of the main window of the user interface as the origin of the screen coordinate system (different development platforms have different setting standards, whichever is the more appropriate), the rightward direction along the width of the main window of the user interface is the positive X axis of the screen coordinate system, and the downward direction along the height of the main window of the user interface is the positive Y axis of the screen coordinate system. The normalized mathematical formula for the screen coordinate position data of interactive elements is as follows: in .

[0035] 2. Collection of visible interactive elements in the user interface: the data structure uses a list <topnodeunit>The TopNodeUnit structure in this embodiment includes two variables, Node and Position, which represent the interactive element associated with the current focus and the screen coordinate position data of the focus element.

[0036] 3. Adaptive navigation data cache: the data structure uses List <nodenavi>The NodeNavi structure records the optimal focus navigation switching data for a certain interactive element after calculation. In this embodiment, the NodeNavi structure includes five variables: Node, UpNode, DownNode, LeftNode, and RightNode, which represent the interactive element associated with the current focus, the optimal interactive element after the focus switches upward, the optimal interactive element after the focus switches downward, the optimal interactive element after the focus switches to the left, and the optimal interactive element after the focus switches to the right.

[0037] The processing logic modules in the user interface interactive element focus dynamic adaptive navigation system architecture include six types: user interface interface module, user interface interactive element management module, user interface update event monitoring module, navigation data calculation module, user interaction intention input monitoring module, and interactive element focus navigation visualization module.

[0038] The user interface module is used to obtain user interface display terminal parameters, types of interactive elements and location data.

[0039] In this embodiment, to obtain the user interface display terminal parameters, you can access the width and height static properties in the Screen class under the UnityEngine namespace; to obtain / reference the interactive element type, you can use the Button, Dropdown, InputField, ScrollRect, Scrollbar, Slider, and Toggle classes under the UnityEngine.UI namespace, and the parent classes of these classes are all Selectable classes; to obtain the interactive element position data, you can access the Selectable class under the UnityEngine.UI namespace, and the specific code statement is selectable.targetGraphic.transform.position.

[0040] The user interface interactive element management module is used for registration management and visibility determination of user interface interactive elements.

[0041] In this embodiment, with the help of the OnEnable event and the OnDisable event in the Unity3D script life cycle, the registration logic and the unregistration logic of the interactive elements are executed in sequence, thereby realizing the unified management of the interactive elements of the user interface.

[0042] When an increment event occurs on an interactive element, the element is automatically marked as eligible for navigation calculation, and when a decrement event occurs, the element is marked as unavailable for navigation calculation; In this embodiment, each interactive element marked as capable of navigation calculation constitutes an interactive element set. At this time, a visibility check operation is required to remove interactive elements in the set that do not meet the visibility conditions, ensuring that all interactive elements in the set are at the top level of the main window of the user interface. The basic method of the visibility check operation is as follows: In the Unity3D engine, first obtain the coordinate position of the interactive element, then call the EventSystem.current.RaycastAll method in the UnityEngine.EventSystems namespace to emit Ray rays towards the coordinate position, obtain the ray intersection result array RaycastResult, and finally compare the first Selectable object in RaycastResult and the interactive element to see if they are the same object. If so, it means that the interactive element is at the top level, and vice versa.

[0043] In particular, if the interactive element is of Toggle type, you need to compare the first Selectable object in the RaycastResult with the graphic.gameObject property of the interactive object; otherwise, compare the first Selectable object in the RaycastResult with the targetGraphic.gameObject property of the interactive object.

[0044] The user interface update event monitoring module is used to capture the user interface layout update event and control the triggering and execution of the navigation data calculation module.

[0045] In this embodiment, the capture of user interface layout update events adopts a dual triggering mechanism of Unity3D script life cycle event function and UI Framework framework event. Specifically: for interface elements based on UIBehaviour, the Awake, OnEnable, Start, OnDisable and OnDestroy callback functions in the UIBehaviour life cycle are used to monitor layout changes in real time; for custom UGUI frameworks such as UI Framework, the OnEnter, OnPause, OnResume, and OnExit callback functions in the BasePanel window base class are used to monitor window status changes in real time.

[0046] The two mechanisms are processed collaboratively through an EventBus (EB) instance built on UnityEngine.Events.UnityEvent. When any channel detects a layout change, it triggers the navigation data calculation module to recalculate and update the navigation data cache.

[0047] The above mechanism can automatically calculate navigation data due to the addition, hiding or state change of interface elements, ensuring that end users can efficiently locate the target interactive elements in any interface state.

[0048] The navigation data calculation module is used to recalculate and update the adaptive navigation data cache, ensuring that the adaptive navigation data cache adapts to the dynamically changing user interface and provides end users with a good interactive element focus switching operation experience.

[0049] In this embodiment, the List output by the user interface interactive element management module is first read. <topnodeunit>The user interface is a collection of visible interactive elements. The screen coordinate position data is then normalized. Then, the calculation space UpSpace, DownSpace, LeftSpace and RightSpace are constructed along the four directions of navigation: Up↑ / Down↓ / Left← / Right→. The process can be referred to in the attached figure. Figure 6 Further understanding.

[0050] The upper left corner of the main window of the user interface is taken as the origin of the UV coordinate system, the rightward direction along the width of the main window of the user interface is taken as the positive U axis of the UV coordinate system, and the downward direction along the height of the main window of the user interface is taken as the positive V axis of the UV coordinate system. The specific process of constructing the calculation space is as follows.

[0051] The normalized coordinates of the interactive element in focus are known to be The coordinate value of the interactive element in the non-focus state is .

[0052] like , the interactive element is added to the computing space UpSpace; like , the interactive element is added to the calculation space DownSpace; like , the interactive element is added to the calculation space LeftSpace; like , the interactive element is added to the computation space RightSpace.

[0053] The data structure of the calculation space adopts List <topnodeunit>Form record.

[0054] After completing the construction of calculation space UpSpace, DownSpace, LeftSpace and RightSpace, the interactive element value calculation and sorting operation based on fitness function is performed. The process can be referred to the attached Figure 7 Further understanding.

[0055] In a certain calculation space, taking the navigation switching direction Dir axis as the reference, first calculate the angle between the line connecting the current focus interactive element and the candidate interactive element and the Dir axis (Unit: degree), then calculate the normalized vertical distance of the candidate interactive element perpendicular to the Dir axis (dimensionless), then calculate the normalized axial distance of the candidate interaction element parallel to the Dir axis (dimensionless), and finally the interactive element values ​​are calculated and sorted through adaptive functions.

[0056] The adaptive function calculation method is as follows: in .

[0057] In this embodiment, 、 、 The weights are all , The smaller the value, the more optimal the candidate interactive element is, that is, the optimal target element when the current focus interactive element switches focus along the navigation direction axis Dir.

[0058] In the specific implementation code, some extended methods in the System.Linq namespace, such as OrderBy, ToList, and First, can be used for fast calculation and solution.

[0059] The user interaction intention input monitoring module is used to collect the terminal user's operation intention on the user interface to achieve the two purposes of interactive element focus switching and interactive element operation.

[0060] In this embodiment, the old input system or the new input system (New InputSystem) built into the Unity3D engine or a combination of the two is used to collect the terminal user's interactive operation intention. Specifically: For the old input system, this is achieved through methods such as GetKeyDown / Up, GetButtonDown / Up, GetMouseButtonDown / Up, GetAxis, and GetAxisRaw provided by the Input class in the UnityEngine namespace. For example, the C# code statement Input.GetKeyDown(KeyCode.RightArrow) collects the event of the right arrow key being pressed on the keyboard.

[0061] For the new input system, first install it through Unity3D's built-in Package Manager. Next, use the visual editor to create the input mapping file resource Input Actions. Then create a new Action Map configuration named "User". Then create five new Actions: GoUp, GoDown, GoLeft, GoRight, and Execute. At the same time, perform input source Binding operations on each Action, and then save the current mapping table. Finally, in the C# code, reference the UnityEngine.InputSystem namespace and use classes such as InputActionAsset to implement the associated reference between the user interaction intention collection logic and the Action.

[0062] As for the combination of the two methods, the Unity3D engine supports the coexistence of the new and old input systems for related implementation.

[0063] To meet cross-platform adaptation requirements, this embodiment adopts a new input system to realize the collection of user interaction intentions. This solution abstracts the input device layer and uniformly processes the interaction signals of various physical input devices (including but not limited to keyboards, game controllers and voice devices), ensuring that user operation intentions can be accurately captured on different deployment platforms.

[0064] The interactive element focus navigation visualization module is used to present the spatial properties of the focused interactive element in the user interface (including position coordinates, geometric shape, size ratio, etc.) in real time, ensuring that end users can quickly identify and locate the interactive element component that currently has focus.

[0065] In this embodiment, when the Unity3D engine UGUI module is used, the focus frame effect with state transition is achieved through the combination of the Image component and the Animator controller. Other methods can also be used to achieve the focus visualization effect.

[0066] The user interface interactive element focus dynamic adaptive navigation system described in the present invention is implemented based on the Unity3D engine. Its complete operation process can be found in the attached Figure 8 Further understanding.

[0067] The entire operation process can be roughly divided into three stages: the initial startup stage of the system user interface, the first initialization stage of the dynamic adaptive navigation system, and the periodic operation stage of the dynamic adaptive navigation system.

[0068] During the initial startup phase of the system user interface, the process specifically includes: 1. Start the software, display the main user interface window containing interactive elements normally, and perform related operations; 2. Determine the necessity of the focus navigation function. If the software deployment / operation environment belongs to a restricted input scenario, execute the next stage; otherwise, do not execute.

[0069] In the first initialization phase of the dynamic adaptive navigation system, the process specifically includes: 1. Start the user interface module to obtain the width and height data of the user interface display terminal and the interactive element information; 2. Start the user interface interactive element management module, perform the user interface interactive element registration operation, and realize the association and binding between all interactive elements in the user interface and the dynamic adaptive navigation system; perform the user interface interactive element visibility determination and determine the interactive element set currently at the top level of the user interface; 3. Start the navigation data calculation module, read the user interface interactive element set information; perform the calculation space segmentation operation based on four directions; perform interactive element value calculation and search based on the fitness function; update the adaptive navigation data cache; 4. Start the interactive element focus navigation visualization module to update the current interactive element focus position and visualization effect of the system user interface; 5. Start the user interface update event monitoring module and the user interaction intention input monitoring module in sequence; 6. Complete the first initialization of the dynamic adaptive navigation system.

[0070] During the periodic operation phase of the dynamic adaptive navigation system, the process specifically includes: 1. Execute the user interface update event monitoring module to determine whether new interactive elements have been added to the user interface; determine whether interactive elements have been reduced in the user interface; and determine whether the attributes of interactive elements in the user interface have changed. If a user interface update event is detected, the navigation data calculation module and the interactive element focus navigation visualization module will be executed in sequence. Otherwise, the navigation data calculation module and the interactive element focus navigation visualization module will be skipped and the user interaction intention input monitoring module will be executed directly. 2. Execute the navigation data calculation module to read the user interface interactive element set information; perform a four-directional computational space segmentation operation; perform interactive element value calculation and search based on the fitness function; and update the adaptive navigation data cache. After the navigation data calculation module is executed, the interactive element focus navigation visualization module is first executed to refresh the user interface focus visualization effect, and then the user interaction intention input monitoring module is executed; 3. Execute the user interaction intention input monitoring module to determine whether there is a terminal user interaction intention in the current cycle. If so, further determine the interaction intention type and execute the interactive element focus navigation visualization module to refresh the user interface. If not, skip the interactive element focus navigation visualization module and directly enter the next cycle; 4. Repeat the above process periodically until the software system user interface is closed / destroyed / covered / minimized.

[0071] In this embodiment, the above system operation processes are all driven by Unity3D script life cycle event functions.

[0072] In this embodiment, a dynamic adaptive navigation method is provided, which mainly includes the following steps: 1. System startup and parameter acquisition: Start the user interface and dynamic adaptive navigation system; obtain the user interface display terminal parameters (window width w and height h) and interactive element set; real-time filter the set of available interactive elements at the top level of the user interface main window; 2. Dynamic event response and navigation calculation: In response to events such as the addition, deletion, or modification of interactive elements in the user interface (see claim 3 for details on the triggering conditions), navigation data recalculation is triggered; the screen coordinates of interactive elements are normalized based on terminal parameters; the calculation space is divided along the up / down / left / right directions (in the UV coordinate system, the V axis divides the upper and lower space, and the U axis divides the left and right space) with the focus element as the reference; within a single directional calculation space, the values ​​of candidate interactive elements are calculated using a three-dimensional fitness function, and the interactive element with the best value is the optimal navigation target in that navigation direction; after traversing all directional spaces, the navigation data cache is updated; 3. User intent execution and visualization: Respond to discrete input events such as the user's arrow keys and Tab key; switch focus based on the navigation data cache and update the focus highlight effect of interactive elements in real time; continuously monitor user interface interactive element update events and end-user input, and repeatedly execute steps 1, 2, and 3 above until the interface is closed or minimized.

[0073] The dynamic adaptive navigation method mainly includes: a dynamic event-driven mechanism for user interface interactive elements, a four-directional computational space segmentation, an interactive element optimization based on a three-dimensional fitness function, and a modular dynamic adaptive navigation system architecture and operation mechanism that supports cross-platform deployment.

[0074] The present invention has the advantages of real-time response to dynamic user interfaces, navigation paths that conform to end-user cognition, and reduced development costs. It provides an efficient focus navigation solution for restricted input scenarios such as medical equipment / vehicle systems / smart TVs, and can be widely used in graphical user interface application scenarios such as game engines, industrial control, and smart terminals.

[0075] The beneficial effects of the present invention are as follows: 1. Update navigation paths in real time through dynamic event-driven (add / subtract / modify events), adapting to dynamic user interfaces such as pop-ups and element state changes; 2. Use four-way space segmentation to reduce the global computational complexity from down to , improve real-time performance; 3. Using normalization processing and three-dimensional fitness function calculation to update the navigation data cache can ensure that the focus navigation switching results meet the end user's cognitive expectations; 4. Modular architecture supports cross-platform integration (Unity3D / WPF / QT, etc.), reducing development costs.

[0076] Example 2 Embodiment 2 includes all the technical features of embodiment 1.

[0077] In this embodiment, a dynamic adaptive navigation method is provided, which includes: Start the user interface, obtain the normal display of the main window of the user interface containing interactive elements, and determine whether the software deployment / operation environment belongs to the restricted input scenario; If the software deployment / operation environment belongs to a restricted input scenario, obtaining the user interface display terminal parameters and the user interface interactive element set; Performing visibility judgment on each interactive element in the user interface interactive element set, and obtaining a set of visible interactive elements that are at the top level of the user interface main window and are available; Reading the visible interactive element set information, performing a four-directional computational space splitting operation based on the user interface display terminal parameters, splitting the non-focused interactive elements into four computational spaces along the four navigation directions of upward, downward, left, and right, with the focused interactive element as the center, and sorting them in ascending order of spacing; Determine whether there is an interaction intention of the terminal user in the current cycle. If so, determine the type of interaction intention and select an interactive element in a non-focus state with the smallest distance along the navigation direction as the new interactive element in the focused state, and update the navigation visualization content of the user interface interactive element. If not, enter the next cycle; Periodically loop to determine whether there is an end-user interaction intention in the current cycle until the user interface is closed / destroyed / covered / minimized.

[0078] In this embodiment, determining whether the software deployment / operation environment belongs to a restricted input scenario includes: In response to starting a user interface, if it is impossible to locate, switch, or operate interactive elements of the user interface using a mouse or touch screen, determining whether the user interface belongs to a restricted input scenario, wherein the restricted input scenario includes but is not limited to: limited input dimension, limited control granularity, and limited feedback method; The input dimension is limited in that the user interface only supports discrete navigation switching input, and the discrete navigation switching input includes input modes of numeric direction keys, arrow direction keys, Tab keys, and custom keys; The control granularity is limited because the user interface lacks pixel-level precision positioning and switching capabilities; The feedback method is limited in that the user interface cannot provide continuous interactive signals.

[0079] In this embodiment, obtaining the user interface display terminal parameters and the user interface interactive element set includes: Get the display resolution of the user interface display terminal and the width value in the display resolution With height value , using a two-dimensional vector Proforma records; Take the upper left corner of the main window of the user interface as the origin of the screen coordinate system, the rightward direction along the width of the main window of the user interface as the positive X axis of the screen coordinate system, and the downward direction along the height of the main window of the user interface as the positive Y axis of the screen coordinate system, obtain the screen coordinates of the interactive element associated with the current focus in the main window of the user interface and perform data normalization processing. The normalization processing method is as follows: ,in , x is the screen coordinate value of the current interactive element on the X axis, y is the screen coordinate value of the current interactive element on the Y axis, The screen coordinates (x, y) of the interactive element associated with the current focus are normalized; The screen coordinates of the interactive elements in all display windows in the user interface are normalized and then aggregated to form the user interface interactive element set.

[0080] In this embodiment, determining the visibility of each interactive element in the user interface interactive element set to obtain a set of visible interactive elements that are at the top level of the user interface main window and are available includes: Obtaining the coordinate position of each interactive element in the set of visible interactive elements; emitting a light beam ray toward the coordinate position of the interactive element, obtaining a ray intersection result array, and comparing whether the first selectable object in the ray intersection result array and the interactive element are the same object; if so, determining that the interactive element is on the top layer; otherwise, determining that the interactive element is on the bottom layer; All interactive elements at the top level are recorded in the form of a top-level node unit list structure to form a set of available interactive elements at the top level of the user interface main window. The top-level node unit list structure includes interactive elements associated with the current focus and screen coordinate position data of the interactive elements associated with the current focus.

[0081] In this embodiment, the reading of the visible interactive element set information, performing a four-directional computational space splitting operation based on the user interface display terminal parameters, splitting the non-focused interactive elements into four computational spaces along the four navigation directions of upward, downward, left, and right with the focused interactive element as the center, and sorting them in ascending order of spacing includes: Read the screen coordinate position data of each interactive element in the set of visible interactive elements and perform normalization processing to form the coordinate value of the interactive element in the non-focus state. , where i is the serial number; Taking the interactive element in focus as the center, the upper calculation space UpSpace, the lower calculation space DownSpace, the left calculation space LeftSpace and the right calculation space RightSpace are constructed along the four directions of upward, downward, left and right navigation. Get the normalized coordinate value of the interactive element in focus , obtain the coordinate value of the interactive element in the non-focus state in the visible interactive element set ; like , add the interactive element to the upper computing space UpSpace; like , add the interactive element to the down calculation space DownSpace; like , add the interactive element to the left calculation space LeftSpace; like , add the interactive element to the right calculation space RightSpace; Using a calculation space representing a navigation direction as the scope, the adaptive function is used to calculate the value of each interactive element to be calculated and sort them to find the minimum distance; The interactive elements with the minimum spacing along the four directions of upward, downward, left and right navigation with the interactive element in the focused state as the center and the interactive elements in the focused state are recorded in the form of an adaptive navigation data list structure.

[0082] In this embodiment, taking a calculation space representing a navigation direction as a range, calculating the value of each interaction element to be calculated by an adaptive function and sorting and finding the minimum distance includes: Using a calculation space representing a navigation direction as the range, obtain the angle between the line connecting the interactive element to be calculated and the focus interactive element and the navigation direction axis. ; Get the normalized vertical distance of the interactive element to be calculated perpendicular to the navigation direction axis ; Get the normalized axial distance of the interactive element to be calculated parallel to the navigation direction axis ; Calling the adaptive function The three values ​​are comprehensively calculated to obtain the value, where the adaptive function is: ;in represents three non-negative weights whose sum is 1; by The interactive element with the smallest value is the optimal solution.

[0083] In this embodiment, the method further includes: Monitoring whether there is an update event for the user interface interactive element, where the types of the user interface interactive element update event include: interactive element addition event, interactive element reduction event, and interactive element modification event; The triggering condition of the interactive element addition event is: a sub-window containing a new interactive element pops up in the top layer of the main window of the user interface or / and an interactive element in a disabled state is activated or / and an interactive element covered by other sub-windows is displayed; The triggering condition of the interactive element reduction event is: the sub-window containing the interactive element in the top layer of the main window of the user interface is destroyed / closed / hidden / covered, etc. or / and the interactive element in the activated state is disabled or / and the interactive element is covered by other sub-windows; The triggering condition of the interactive element change event is: the screen coordinate position of the interactive element in the top layer of the main window of the user interface changes or / and the interface depth value of the interactive element changes or / and the type of the interactive element changes; In response to an update event of the user interface interactive element, the minimum spacing between the interactive elements in the four directions of navigation up, down, left and right, and the interactive element in the focus state is recalculated, and the adaptive navigation data list structure is updated.

[0084] In this embodiment, a dynamic adaptive navigation system is further provided for implementing the dynamic adaptive navigation method described above. The dynamic adaptive navigation system includes: A data storage module is used to cache user interface display terminal parameters, user interface interactive element sets, and adaptive navigation data; User interface module, used to obtain user interface display terminal parameters, types and location data of interactive elements; User interface interactive element management module, used for registration management and visibility determination of user interface interactive elements; The user interface update event monitoring module is used to capture the user interface layout update event and control the triggering of navigation data calculation; Navigation data calculation module, used for recalculation and update of adaptive navigation data cache; The user interaction intention input monitoring module is used to collect the terminal user's operation intention on the user interface and realize the focus switching and operation of interactive elements; The interactive element focus navigation visualization module is used to present the spatial properties of the focus interactive element in the user interface in real time.

[0085] In this embodiment, a computer device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the above methods when executing the computer program.

[0086] In this embodiment, a computer-readable storage medium is further provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of any of the methods described above are implemented.

[0087] Through the present application, dynamic adaptive navigation of the focus of user interface interactive elements for restricted input scenarios can be achieved, and interactive elements of all windows of the user interface can be obtained to form a user interface interactive element set. By performing visibility judgment on each interactive element in the user interface interactive element set, a set of visible interactive elements that are at the top level of the user interface main window and are available is obtained. Based on the visible interactive element set, the interactive elements in the non-focus state in four calculation spaces along the four directions of navigation up, down, left and right are obtained with the interactive element in the focused state as the center. Then, the interactive elements in the non-focus state and the interactive elements in the focused state are sorted in increasing order according to the distance between the interactive elements in the non-focus state and the interactive elements in the focused state to find the interactive element with the smallest distance in the four directions as the new interactive element in the focused state selected along the navigation direction according to the interaction intention. This can realize the focus navigation function and improve the focus navigation effect of dynamic user interface interactive elements.

[0088] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.< / topnodeunit> < / topnodeunit> < / nodenavi> < / topnodeunit>

Claims

1. A dynamic adaptive navigation method, characterized in that: include: Start the user interface, obtain the normal display of the main window of the user interface containing interactive elements, and determine whether the software deployment / operation environment belongs to the restricted input scenario; If the software deployment / operation environment belongs to a restricted input scenario, obtaining the user interface display terminal parameters and the user interface interactive element set; Performing visibility judgment on each interactive element in the user interface interactive element set, and obtaining a set of visible interactive elements that are at the top level of the user interface main window and are available; Reading the visible interactive element set information, performing a four-directional computational space splitting operation based on the user interface display terminal parameters, splitting the non-focused interactive elements into four computational spaces along the four navigation directions of upward, downward, left, and right, with the focused interactive element as the center, and sorting them in ascending order of spacing; Determine whether there is an interaction intention of the terminal user in the current cycle. If so, determine the type of interaction intention and select an interactive element in a non-focus state with the smallest distance along the navigation direction as the new interactive element in the focused state, and update the navigation visualization content of the user interface interactive element. If not, enter the next cycle; Periodically loop to determine whether there is an end-user interaction intention in the current cycle until the user interface is closed / destroyed / covered / minimized.

2. The dynamic adaptive navigation method according to claim 1, characterized in that: Determining whether the software deployment / operation environment belongs to a restricted input scenario includes: In response to starting a user interface, if it is impossible to locate, switch, or operate interactive elements of the user interface using a mouse or touch screen, determining whether the user interface belongs to a restricted input scenario, wherein the restricted input scenario includes but is not limited to: limited input dimension, limited control granularity, and limited feedback method; The input dimension is limited in that the user interface only supports discrete navigation switching input, and the discrete navigation switching input includes input modes of numeric direction keys, arrow direction keys, Tab keys, and custom keys; The control granularity is limited because the user interface lacks pixel-level precision positioning and switching capabilities; The feedback method is limited in that the user interface cannot provide continuous interactive signals.

3. The dynamic adaptive navigation method according to claim 1, characterized in that: The acquiring of the user interface display terminal parameters and the user interface interactive element set includes: Get the display resolution of the user interface display terminal and the width value in the display resolution With height value , using a two-dimensional vector Proforma records; Take the upper left corner of the main window of the user interface as the origin of the screen coordinate system, the rightward direction along the width of the main window of the user interface as the positive X axis of the screen coordinate system, and the downward direction along the height of the main window of the user interface as the positive Y axis of the screen coordinate system, obtain the screen coordinates of the interactive element associated with the current focus in the main window of the user interface and perform data normalization processing. The normalization processing method is as follows: ,in , x is the screen coordinate value of the current interactive element on the X axis, y is the screen coordinate value of the current interactive element on the Y axis, The screen coordinates (x, y) of the interactive element associated with the current focus are normalized; The screen coordinates of the interactive elements in all display windows in the user interface are normalized and then aggregated to form the user interface interactive element set.

4. The dynamic adaptive navigation method according to claim 1, characterized in that: The step of determining the visibility of each interactive element in the user interface interactive element set to obtain a set of visible interactive elements that are located at the top level of the user interface main window and are available includes: Obtaining the coordinate position of each interactive element in the set of visible interactive elements; emitting a light beam ray toward the coordinate position of the interactive element, obtaining a ray intersection result array, and comparing whether the first selectable object in the ray intersection result array and the interactive element are the same object; if so, determining that the interactive element is on the top layer; otherwise, determining that the interactive element is on the bottom layer; All interactive elements at the top level are recorded in the form of a top-level node unit list structure to form a set of available interactive elements at the top level of the user interface main window. The top-level node unit list structure includes interactive elements associated with the current focus and screen coordinate position data of the interactive elements associated with the current focus.

5. The dynamic adaptive navigation method according to claim 4, characterized in that: The reading of the visible interactive element set information, performing a four-directional computational space splitting operation according to the user interface display terminal parameters, splitting the interactive elements in a non-focused state into four computational spaces along the four directions of navigation upward, downward, left, and right with the interactive element in focus as the center, and sorting them in increasing order of spacing includes: Read the screen coordinate position data of each interactive element in the set of visible interactive elements and perform normalization processing to form the coordinate value of the interactive element in the non-focus state. , where i is the serial number; Taking the interactive element in focus as the center, the upper calculation space UpSpace, the lower calculation space DownSpace, the left calculation space LeftSpace and the right calculation space RightSpace are constructed along the four directions of upward, downward, left and right navigation. Get the normalized coordinate value of the interactive element in focus , obtain the coordinate value of the interactive element in the non-focus state in the visible interactive element set ; like , add the interactive element to the upper computing space UpSpace; like , add the interactive element to the down calculation space DownSpace; like , add the interactive element to the left calculation space LeftSpace; like , add the interactive element to the right calculation space RightSpace; Using a calculation space representing a navigation direction as the scope, the adaptive function is used to calculate the value of each interactive element to be calculated and sort them to find the minimum distance; The interactive elements with the minimum spacing along the four directions of upward, downward, left and right navigation with the interactive element in the focused state as the center and the interactive elements in the focused state are recorded in the form of an adaptive navigation data list structure.

6. The dynamic adaptive navigation method according to claim 5, characterized in that: The step of calculating the value of each interactive element to be calculated by using an adaptive function and sorting and finding the minimum distance using a calculation space representing a navigation direction includes: Using a calculation space representing a navigation direction as the range, obtain the angle between the line connecting the interactive element to be calculated and the focus interactive element and the navigation direction axis. ; Get the normalized vertical distance of the interactive element to be calculated perpendicular to the navigation direction axis ; Get the normalized axial distance of the interactive element to be calculated parallel to the navigation direction axis ; Calling the adaptive function The three values ​​are comprehensively calculated to obtain the value, where the adaptive function is: ;in represents three non-negative weights whose sum is 1; by The interactive element with the smallest value is the optimal solution.

7. The dynamic adaptive navigation method according to claim 5, characterized in that: The method further comprises: Monitoring whether there is an update event for the user interface interactive element, where the types of the user interface interactive element update event include: interactive element addition event, interactive element reduction event, and interactive element modification event; The triggering condition of the interactive element addition event is: a sub-window containing a new interactive element pops up in the top layer of the main window of the user interface or / and an interactive element in a disabled state is activated or / and an interactive element covered by other sub-windows is displayed; The triggering condition of the interactive element reduction event is: the sub-window containing the interactive element in the top layer of the main window of the user interface is destroyed / closed / hidden / covered, etc. or / and the interactive element in the activated state is disabled or / and the interactive element is covered by other sub-windows; The triggering condition of the interactive element change event is: the screen coordinate position of the interactive element in the top layer of the main window of the user interface changes or / and the interface depth value of the interactive element changes or / and the type of the interactive element changes; In response to an update event of the user interface interactive element, the minimum spacing between the interactive elements in the four directions of navigation up, down, left and right, and the interactive element in the focus state is recalculated, and the adaptive navigation data list structure is updated.

8. A dynamic adaptive navigation system, used to implement the dynamic adaptive navigation method according to any one of claims 1 to 7, characterized in that: The dynamic adaptive navigation system includes: A data storage module is used to cache user interface display terminal parameters, user interface interactive element sets, and adaptive navigation data; User interface module, used to obtain user interface display terminal parameters, types and location data of interactive elements; User interface interactive element management module, used for registration management and visibility determination of user interface interactive elements; The user interface update event monitoring module is used to capture the user interface layout update event and control the triggering of navigation data calculation; Navigation data calculation module, used for recalculation and update of adaptive navigation data cache; The user interaction intention input monitoring module is used to collect the terminal user's operation intention on the user interface and realize the focus switching and operation of interactive elements; The interactive element focus navigation visualization module is used to present the spatial properties of the focus interactive element in the user interface in real time.

9. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images