A method, apparatus, system, device, and medium for dynamic mouse adjustment.

Abstract

This application discloses a method, device, system, equipment, and medium for dynamic mouse adjustment. The method includes acquiring a game screen through smart glasses and acquiring target key elements in the game screen; acquiring the mouse operation flow corresponding to the target key elements and determining a mouse parameter adjustment strategy based on the mouse operation flow; and adjusting the mouse parameters according to the mouse parameter adjustment strategy to make the mouse parameters adapt to the mouse operation flow. This application constructs a collaborative working mechanism between smart glasses and mouse peripherals through data interaction between smart glasses and electronic devices, giving full play to the advantages of the multimodal perception capabilities of smart glasses. It realizes the assistance of smart glasses in adjusting mouse parameters, reducing the frequency of manual adjustments by players. This can improve the adaptability of mouse parameters to game scenarios and enhance the game immersion and competitive performance of gamers.

Description

Technical Field

[0001] This application relates to the field of mouse technology, and in particular to a method, device, system, equipment, and medium for dynamic adjustment of a mouse. Background Technology

[0002] With the rapid development of esports and immersive gaming, players' demands for precision and responsiveness in game controls are constantly increasing. Traditional gaming mouse sensitivity relies solely on manual adjustment by the user and cannot adaptively adjust in real time according to the game scene, target movement, and changes in player attention, severely limiting operational flexibility and responsiveness.

[0003] As a novel interactive device, smart glasses possess multimodal sensing capabilities such as cameras and sensors, enabling functions like eye tracking, posture detection, and environmental awareness. However, current technology lacks an effective data interaction and collaborative control mechanism between smart glasses and gaming mice, preventing the use of their sensory information for the dynamic control of gaming peripherals.

[0004] Therefore, existing technologies suffer from insufficient collaboration between smart glasses and mouse peripherals, making it impossible to use smart glasses to assist in adjusting mouse parameters in order to achieve automatic adaptation to game scenarios. Summary of the Invention

[0005] The technical problem to be solved by this application is to provide a method, device, system, equipment and medium for dynamic adjustment of a mouse, in order to address the shortcomings of the existing technology, and solve the problem of insufficient coordination between smart glasses and mouse peripherals, so as to realize the adjustment of mouse parameters assisted by smart glasses.

[0006] To address the aforementioned technical problems, the first aspect of this application provides a method for dynamically adjusting a mouse, wherein the method specifically includes:

[0007] The game screen is captured through smart glasses, and key target elements in the game screen are obtained.

[0008] Obtain the mouse operation flow corresponding to the target key element, and determine the mouse parameter adjustment strategy based on the mouse operation flow;

[0009] Adjust the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation process.

[0010] The aforementioned mouse dynamic adjustment method, wherein obtaining the target key elements in the game screen specifically includes:

[0011] Obtain the preset game operation strategy corresponding to the game screen, and read the preset key elements in the preset game operation strategy;

[0012] In the game screen, select candidate key elements corresponding to the preset key elements, and obtain the importance data of the candidate key elements. The importance data includes one or more of the following: correlation with the preset key elements, user behavior data, and gaze data.

[0013] Based on the importance data, the target key element is selected from the candidate key elements.

[0014] The aforementioned mouse dynamic adjustment method, wherein the process of acquiring gaze data specifically includes:

[0015] Acquire eye-tracking data captured by the smart glasses when acquiring the game screen;

[0016] Based on the eye-tracking data, the user's gaze duration and / or gaze frequency on the candidate key elements are obtained to obtain gaze data.

[0017] The mouse dynamic adjustment method, wherein the correlation with the preset key element includes the similarity between the candidate key element and the preset key element and / or the positional overlap between the candidate key element and the preset key element.

[0018] The aforementioned mouse dynamic adjustment method, wherein the importance data includes relevance to preset key elements, user behavior data, and gaze data; the step of selecting a target key element from the candidate key elements based on the importance data specifically includes:

[0019] Obtain the correlation with preset key elements, the weight coefficients corresponding to user behavior data and gaze data, and the influence intensity coefficients corresponding to the user behavior data and gaze data.

[0020] Based on the obtained weight coefficients and influence intensity coefficients, the relevance of the candidate key elements to the preset key elements, user behavior data, and gaze data are weighted and combined to obtain the importance score of the candidate key elements.

[0021] The target key element is selected from the candidate key elements based on the importance score.

[0022] The aforementioned mouse dynamic adjustment method, wherein the mouse operation process for obtaining the target key element specifically includes:

[0023] Obtain the preset game operation strategy corresponding to the game screen;

[0024] The target key element is used as the preset key element in the preset game operation strategy to predict the mouse operation process of performing game operations according to the preset game operation strategy.

[0025] The aforementioned mouse dynamic adjustment method, wherein obtaining the preset game operation strategy corresponding to the game screen specifically includes:

[0026] Identify the game type corresponding to the game screen;

[0027] Select a preset game operation strategy for the game screen based on the game type.

[0028] The mouse dynamic adjustment method, wherein determining the mouse parameter adjustment strategy based on the mouse operation flow specifically includes:

[0029] In the mouse operation process, at least one target mouse operation is selected, and the triggering condition of the mouse operation is obtained;

[0030] Configure mouse parameters for the target mouse operation, and form a mouse parameter adjustment strategy based on the mouse parameters and the triggering conditions.

[0031] The mouse dynamic adjustment method, wherein the mouse parameter adjustment strategy includes at least one mouse parameter group, the mouse parameter group including mouse parameters and triggering conditions; adjusting the mouse parameters according to the mouse parameter adjustment strategy to adapt the mouse parameters to the mouse operation process specifically includes:

[0032] Monitor the triggering conditions in the mouse parameter adjustment strategy;

[0033] When the trigger condition is detected to be met, the mouse parameters corresponding to the trigger condition are obtained, and the mouse parameters are configured based on the mouse parameters to adjust the mouse parameters.

[0034] The mouse dynamic adjustment method, wherein the mouse parameters include one or more of the following: sensitivity, polling rate, acceleration, scan rate, and button response parameters.

[0035] The aforementioned mouse dynamic adjustment method further includes:

[0036] After obtaining the target key element, monitor the reminder event corresponding to the target key element;

[0037] When an alert event is detected, a notification is issued via smart glasses. The notification may include one or more of the following: visual alerts, tactile alerts, and auditory alerts.

[0038] The mouse dynamic adjustment method, wherein before adjusting the mouse parameters according to the mouse parameter adjustment strategy to adapt the mouse parameters to the mouse operation process, the method further includes:

[0039] Get the current mouse position and the positional relationship between the target key element;

[0040] If the positional relationship meets the preset adjustment requirements, then the mouse parameters are adjusted according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation process.

[0041] If the positional relationship does not meet the preset adjustment requirements, the mouse parameter adjustment strategy is discarded.

[0042] A second aspect of this application provides a dynamic mouse adjustment device, wherein the dynamic mouse adjustment device specifically includes:

[0043] The acquisition module is used to acquire game screens through smart glasses and acquire target key elements in the game screens;

[0044] The determination module is used to obtain the mouse operation flow corresponding to the target key element, and determine the mouse parameter adjustment strategy based on the mouse operation flow;

[0045] The adjustment module is used to adjust the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation process.

[0046] A third aspect of this application provides a dynamic mouse adjustment system, wherein the dynamic mouse adjustment system includes smart glasses and an electronic device, and the electronic device is externally equipped with a mouse;

[0047] The smart glasses are used to capture game screens, obtain target key elements in the game screens, obtain mouse operation flows corresponding to the target key elements, determine mouse parameter adjustment strategies based on the mouse operation flows, and send the mouse parameter adjustment strategies to electronic devices.

[0048] The electronic device is used to adjust mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation process.

[0049] A fourth aspect of this application provides a computer-readable storage medium storing one or more programs that can be executed by one or more processors to implement the steps in any of the above-described mouse dynamic adjustment methods.

[0050] A fifth aspect of this application provides a terminal device comprising: a processor and a memory;

[0051] The memory stores a computer-readable program that can be executed by the processor;

[0052] When the processor executes the computer-readable program, it implements the steps in any of the above-described mouse dynamic adjustment methods.

[0053] Beneficial effects:

[0054] 1. This application establishes a collaborative working mechanism between smart glasses and a mouse peripheral through data interaction between smart glasses and electronic devices. It fully leverages the multimodal perception capabilities of smart glasses, enabling "bypass control" of mouse parameters by assisting with parameter adjustment. This avoids running additional real-time analysis programs on electronic devices running games or other applications, thereby maximizing the release of CPU / GPU resources and ensuring the smoothness and stability of games and other applications—a technical effect difficult to achieve with purely software solutions. Simultaneously, it reduces the frequency of manual adjustments by players, enhancing game immersion and competitive performance.

[0055] 2. In determining the target key elements, this application makes full use of the game screen and eye movement data collected by smart glasses, and combines it with preset game operation strategies and user behavior data to improve the accuracy of the selection of target key elements, thereby further improving the accuracy of mouse parameter adjustment.

[0056] 3. This application uses a preset game operation strategy to predict the movement trajectory, and based on the movement trajectory, predicts the mouse operation requirements to form a mouse operation process. Then, according to the mouse operation process, the mouse parameter adjustment strategy is set so that the mouse parameter adjustment strategy meets the mouse operation requirements, thereby realizing dynamic adaptation of mouse parameters and improving the smoothness and response efficiency of game operation. Attached Figure Description

[0057] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0058] Figure 1 A schematic diagram of the dynamic mouse adjustment system provided in this application embodiment.

[0059] Figure 2 A flowchart of a mouse dynamic adjustment method provided in an embodiment of this application.

[0060] Figure 3 A schematic diagram of the mouse dynamic adjustment device provided in the embodiments of this application.

[0061] Figure 4 A schematic block diagram of the terminal device provided in the embodiments of this application. Detailed Implementation

[0062] This application provides a method, apparatus, system, device, and medium for dynamic mouse adjustment. To make the objectives, technical solutions, and effects of this application clearer and more explicit, the following detailed description is provided with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only for explaining this application and are not intended to limit this application.

[0063] Those skilled in the art will understand that, unless specifically stated otherwise, the singular forms “a,” “an,” “the,” and “the” used herein may also include the plural forms. It should be further understood that the term “comprising” as used in this application means the presence of the stated features, integers, steps, operations, elements, and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. It should be understood that when we say an element is “connected” or “coupled” to another element, it can be directly connected or coupled to the other element, or there may be intermediate elements. Furthermore, “connected” or “coupled” as used herein can include wireless connections or wireless coupling. The term “and / or” as used herein includes all or any units and all combinations of one or more associated listed items.

[0064] It will be understood by those skilled in the art that, unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains. It should also be understood that terms such as those defined in general dictionaries should be understood to have the same meaning as in the context of the prior art, and should not be interpreted in an idealized or overly formal sense unless specifically defined as herein.

[0065] It should be understood that the sequence number and size of each step in this embodiment do not imply the order of execution. The execution order of each process is determined by its function and internal logic, and should not constitute any limitation on the implementation process of this application embodiment.

[0066] With the rapid development of esports and immersive gaming, players' demands for precision and responsiveness in game controls are constantly increasing. Traditional gaming mice rely solely on manual adjustment by the user, failing to adapt in real-time to changes in game scenarios, target movement, and player attention, severely limiting operational flexibility and responsiveness. This manifests in the following ways:

[0067] 1. High operation latency: Traditional mouse peripherals require manual movement and clicking, and the response speed is limited by the user's reaction time, which can easily lead to operation lag, especially in high-speed game scenarios.

[0068] 2. Unintelligent Sensitivity Adjustment: While existing mouse firmware supports adjusting core parameters via host computer software—for example, users can manually adjust mouse parameters in advance through the driver—the current adjustment methods lack real-time and adaptive capabilities. They cannot dynamically adjust in real-time according to actual game scenarios and user needs, affecting the mouse's operational accuracy and efficiency. For example, DPI (dots per inch) or CPI (counts per inch) affects cursor movement speed; polling rate affects cursor movement smoothness and response latency; acceleration parameters affect the user experience; and scan rate affects the mouse's positioning stability in high-speed movement or complex scenarios.

[0069] As a novel interactive device, smart glasses possess multimodal sensing capabilities, including cameras and sensors, enabling functions such as eye tracking, posture detection, and environmental awareness. However, current technologies lack an effective data interaction and collaborative control mechanism between smart glasses and gaming mice. This prevents the use of their sensory information for dynamic adjustment of gaming peripherals. For example, image data and eye-tracking data collected by smart glasses are not integrated into the mouse parameter adjustment process. Therefore, it is impossible to utilize game scene content (such as enemy positions and movement trajectories) and eye-tracking data collected by the smart glasses for joint decision-making on mouse parameters, thus hindering dynamic adjustment of mouse parameters.

[0070] Therefore, existing technologies suffer from insufficient collaboration between smart glasses and mouse peripherals, making it impossible to use smart glasses to assist in adjusting mouse parameters in order to achieve automatic adaptation to game scenarios.

[0071] In this embodiment, the game screen is acquired through smart glasses, and key target elements within the game screen are obtained. The mouse operation flow corresponding to the key target elements is acquired, and a mouse parameter adjustment strategy is determined based on the mouse operation flow. The mouse parameters are then adjusted according to the mouse parameter adjustment strategy to ensure the mouse parameters are adapted to the mouse operation flow. This application constructs a collaborative working mechanism between smart glasses and mouse peripherals through data interaction between smart glasses and other electronic devices. It fully leverages the multimodal perception capabilities of smart glasses, enabling the adjustment of mouse parameters with the assistance of smart glasses, reducing the frequency of manual adjustments by the player. This improves the adaptability of mouse parameters to the game scene and enhances the player's immersion in the game, thereby improving their competitive performance.

[0072] An application environment diagram of the mouse dynamic adjustment method provided in this application embodiment can be shown as follows: Figure 1 As shown. (Refer to...) Figure 1The mouse dynamic adjustment system includes smart glasses 110 and an electronic device 120, with a mouse externally mounted on the electronic device 120. The smart glasses 110 and the electronic device 120 are connected via a network. The electronic device 120 can be a desktop terminal or a mobile terminal; specifically, the mobile terminal can be at least one of a mobile phone, tablet computer, or laptop computer. The electronic device 120 is used to run a game. The smart glasses 110 is used to acquire the game screen displayed on the electronic device's screen, acquire target key elements in the game screen, acquire the mouse operation flow corresponding to the target key elements, determine a mouse parameter adjustment strategy based on the mouse operation flow, and send the mouse parameter adjustment strategy to the electronic device. The electronic device adjusts the mouse parameters according to the mouse parameter adjustment strategy to adapt the mouse parameters to the mouse operation flow.

[0073] It should be noted that when the peripheral mouse of the electronic device is a smart mouse, the smart glasses can communicate with the mouse. After obtaining the mouse parameter adjustment strategy, the smart glasses send the strategy to the mouse, which then adjusts its parameters according to the strategy to adapt the mouse parameters to the mouse operation process. This ensures that the mouse parameter adjustment process does not consume any resources of the electronic device, avoids interference with game operation, and guarantees the smoothness and stability of the game. Furthermore, the smart glasses can dynamically update key target elements and their corresponding mouse operation processes based on real-time collected game scene changes and user behavior, thereby achieving continuous optimization and adaptation of mouse parameters.

[0074] The target key elements are not all elements in the game screen, but dynamic elements that are highly relevant to the current game task and are selected based on multi-dimensional data such as preset game operation strategies and user behavior.

[0075] The application content will be further explained below with reference to the accompanying drawings and the description of the embodiments.

[0076] This embodiment provides a method for dynamically adjusting the mouse, such as... Figure 2 As shown, the method for dynamically adjusting the mouse specifically includes:

[0077] S10. Obtain the game screen through smart glasses and obtain the target key elements in the game screen.

[0078] Specifically, the game visuals are captured by the smart glasses as they photograph the game scene within the user's field of vision. For example, the game visuals may be captured by the smart glasses as they photograph the display interface of an electronic device running the game within the user's field of vision. The smart glasses are see-through type, meaning that when worn, ambient visible light can pass through the lenses, allowing the wearer to see the surrounding environment normally. Furthermore, the smart glasses can capture images of the surrounding environment to obtain the game visuals displayed on the screen of an electronic device within the user's field of vision.

[0079] In one embodiment, the smart glasses may include a smart glasses body and a camera module. The smart glasses body serves as the basic carrier of the smart glasses and may include a frame, temples connected to the frame, and lenses installed within the frame. The temples can be worn on either side of the user's head to secure the smart glasses. The lenses are transparent lenses, allowing visible light to pass through while simultaneously overlaying image information onto the user's actual field of vision. When gamers wear the smart glasses, in addition to seeing the external environment, they can also see notification information transparently overlaid by the smart glasses, effectively superimposing the notification information into the gamer's field of vision.

[0080] The camera module is integrated into the smart glasses themselves. For example, a camera module can be embedded in the front of the frame to capture game footage. The game footage is obtained by capturing images of the display interface of the electronic device running the game, such as the screen display of the player wearing the smart glasses. The camera module can be a high-definition wide-angle camera, a panoramic camera, or other cameras with high-quality shooting capabilities; this embodiment does not impose specific limitations. Only one specific example is given here: in this example, the camera module includes two high-definition wide-angle cameras, a left camera and a right camera, which are symmetrically mounted parallel to each other on the left and right sides of the front of the frame to cover a large area of ​​the game scene and ensure comprehensive and clear video data capture.

[0081] In some embodiments, after capturing a game screen, the smart glasses can determine a target key element in the game screen, acquire one or more steps of the mouse operation flow corresponding to the target key element, and determine a mouse parameter adjustment strategy based on the mouse operation flow. For this purpose, the smart glasses may also include a main control chip integrated into the smart glasses body, such as embedded in the temple or frame. This main control chip is connected to a camera module, receives the game screen captured by the camera module, and executes one or more steps of determining a target key element in the game screen, acquiring the mouse operation flow corresponding to the target key element, and determining a mouse parameter adjustment strategy based on the mouse operation flow. The main control chip can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0082] In one embodiment, during the process of using smart glasses to assist in dynamic mouse adjustments, eye-tracking data captured by the smart glasses can also be utilized. For this purpose, the smart glasses may further include an eye-tracking module integrated into the smart glasses body, used to monitor the user's eye movement trajectory and gaze point position in real time to obtain gaze data. The eye-tracking module is connected to the main control chip and can send the collected gaze data to the main control chip, allowing the main control chip to use this gaze data to assist in dynamic mouse adjustments. The eye-tracking module may include infrared LEDs and an image sensor, and employs PCCR (pupil-corneal reflection) technology to accurately acquire gaze point coordinates, pupil changes, blink frequency, etc. It can be understood that when using eye-tracking data during the process of using smart glasses to assist in dynamic mouse adjustments, the main control chip also analyzes the eye-tracking data to obtain gaze data, and then forms importance data based on the gaze data, user behavior data, and the correlation with preset key elements determined based on the game screen. Finally, based on the importance data, the target key elements in the game screen are obtained.

[0083] Furthermore, during the process of dynamically adjusting the mouse with the assistance of smart glasses, the smart glasses can also provide auxiliary reminders to the user. Specifically, after acquiring a target key element, the smart glasses monitor the reminder event corresponding to that key element; when a reminder event is detected, the smart glasses issue a reminder. The monitoring process for the reminder event can be executed by the main control chip or by an electronic device connected to the smart glasses, with the reminder operation performed through the smart glasses. For this purpose, the smart glasses can also include a multimodal prompting unit, integrated into the smart glasses body and connected to the main control chip. The multimodal prompting unit receives reminder information sent by the main control chip. This reminder information can be generated by the main control chip or generated and sent to the main control chip by an electronic device connected to the smart glasses. After receiving the reminder information, the multimodal prompting unit provides multimodal prompts according to the reminder information. These multimodal prompts include, but are not limited to, visual prompts, such as flashing icons or text of a preset color on the lenses; auditory prompts, such as playing preset sound effects or voice prompts; and tactile prompts, such as generating slight vibrations through the smart glasses. By using multimodal prompts, we can provide gamers with timely and effective game assistance in all aspects, helping them to participate in the game better.

[0084] Based on this, in some embodiments, the multimodal prompting unit may include an AI display unit, a tactile prompting unit, and an auditory prompting unit, all of which are connected to the main control chip. The auditory prompting unit may include a speaker, or a microphone array and a speaker, both integrated into the smart glasses body. For example, the microphone array and speaker can be embedded around the frame or temples to capture audio data through the microphone array and play auditory prompts through the speaker. The microphone array can be an omnidirectional microphone array, a directional microphone array, or other microphone arrays with high sensitivity and low noise characteristics; this embodiment does not impose specific limitations. Only one specific example is given here: in this example, the microphone array consists of four omnidirectional microphones arranged in a square around the frame to accurately capture audio data from multiple directions in the game scene, reducing blind spots in audio acquisition and ensuring the integrity and accuracy of the audio data.

[0085] The AI ​​display unit can employ technologies such as optical waveguides or Micro-OLED to transparently overlay visual alerts onto the lenses, providing visual cues to gamers wearing the smart glasses. For example, when a player approaches an enemy, the AI ​​display unit can display a green player icon on the lenses; when a player triggers a key skill, the AI ​​display unit can display the cooldown time of that skill on the lenses.

[0086] The haptic feedback unit, which can be a piezoelectric ceramic or an electromagnetic vibrator, is used to provide haptic feedback to the player according to the haptic cues in the reminder message. This haptic feedback unit supports haptic feedback of varying intensities. When the main control chip generates a reminder message, if a haptic feedback is required according to that message, the haptic feedback unit will generate a vibration of appropriate intensity based on the type of haptic feedback in the reminder message. For example, when the player approaches an enemy, the haptic feedback unit can generate a slight vibration to alert the player; when the player triggers a key skill or completes an important task, the haptic feedback unit can generate a strong vibration to provide the player with direct feedback.

[0087] Furthermore, since the smart glasses communicate with the peripheral mouse's electronic device or smart mouse, the smart glasses may also include a first communication module. This communication module can be a Wi-Fi communication module, a Bluetooth communication module, a ZigBee communication module, a cellular network communication module, an NFC communication module, etc., and this embodiment does not impose specific limitations. Of course, the peripheral mouse's electronic device or smart mouse is equipped with a second communication module corresponding to the first communication module in the smart glasses. The smart glasses and the peripheral mouse's electronic device or smart mouse establish a communication connection through the first and second communication modules.

[0088] In one embodiment, the game screen includes game elements, which may include characters, enemies, items, obstacles, etc. The target key element is a game element within the game screen, and this target key element is an element of user focus; for example, the target key element may be an enemy, a target object, an interactive button, etc.

[0089] In one embodiment, obtaining the target key elements in the game screen specifically includes:

[0090] S11. Obtain the preset game operation strategy corresponding to the game screen, and read the preset key elements in the preset game operation strategy;

[0091] S12. Select the candidate key element corresponding to the preset key element in the game screen, and obtain the importance data of the candidate key element.

[0092] S13. Select the target key element from the candidate key elements based on the importance data.

[0093] In step S11, the preset game operation strategy is a pre-set operation guide or tactical plan corresponding to the game screen. The preset game operation strategy includes key elements that players may pay attention to during the game. Key elements are related to the core gameplay, such as enemies, important items, or interactive buttons. A preset game operation strategy database is pre-built, which includes several preset game operation strategy sets. Each preset game operation strategy set corresponds to a type of game or a specific game, and includes several preset game operation strategies for that type of game or specific game. Each preset game operation strategy can be an operation guide corresponding to a key element.

[0094] For example, the preset game operation strategy database includes preset game operation strategy sets for shooting games and preset game operation strategy sets for action games. The preset game operation strategy set for shooting games includes one preset game operation strategy: "Quickly identify enemy targets, rapidly move the mouse to a fixed position, stably approach and hover over the target area, and execute the shooting operation." The preset game operation strategy set for action games includes one preset game operation strategy: "When a preset icon is detected, it is determined to be an efficient skill. When the skill cooldown time reaches a preset time, remind the player to quickly move the mouse to a fixed position, and control the mouse to stably approach and hover over the target area to execute the skill release operation."

[0095] Furthermore, it should be noted that the preset game operation strategy can be continuously optimized through machine learning. For example, by analyzing the historical operation data of a large number of players in the same game scenario, a strategy model can be trained using a deep learning model; or, for a specific player, a personalized dynamic strategy can be generated by learning their personal operation habits and preferences over a long period of time.

[0096] Therefore, in one embodiment, obtaining the preset game operation strategy corresponding to the game screen specifically includes:

[0097] Identify the game type corresponding to the game screen;

[0098] Select a preset game operation strategy for the game screen based on the game type.

[0099] Specifically, game genres can include role-playing games, strategy games, and shooting games, among others. The game genre identification process matches game screenshots with a pre-defined game database to identify the game name corresponding to the screenshot, and finally determines the game genre corresponding to that name. The pre-built game database includes game data, such as game interface images, the corresponding game genres, and the correspondence between game genres and pre-defined game operation strategy sets. Furthermore, a pre-integrated game operation strategy database can be incorporated into the game database, meaning the pre-defined game database directly stores the pre-defined game operation strategy sets corresponding to different game genres.

[0100] For example, for shooting games, a preset game database stores the game data of the shooting game. The game data includes the game interface, the shooting game, and the preset game operation strategy corresponding to the shooting game. The preset game operation strategy is "quickly identify enemy targets, quickly move the mouse to a fixed position, stably approach and stay in the target area, and execute the shooting operation."

[0101] Of course, in practical applications, other methods can also be used to identify the game type corresponding to the game screen. For example, the game screen can be input into a pre-trained game type recognition model, and the game type recognition model can output the game type corresponding to the game screen. Alternatively, an image recognition model can be used to identify the game elements in the game screen, and then the identified game elements can be input into a pre-trained game type recognition model, and the game type recognition model can output the game type corresponding to the game screen.

[0102] Furthermore, after obtaining the game type, the corresponding preset game operation strategy can be searched in the preset game operation strategy database using that game type as the search index. The searched preset game operation strategy can be one or more. When there are multiple preset game operation strategies, the target key element is determined for each preset game operation strategy, and the process for determining the target key element is the same for each preset game operation strategy. Therefore, this explanation will use the search for a single preset game operation strategy as an example.

[0103] For example, if the game type is identified as a shooting game, a preset game operation strategy is found in the preset game operation strategy database based on the shooting game type. The preset game operation strategy is "quickly identify enemy targets, quickly move the mouse to a fixed position, steadily approach and stay in the target area, and perform shooting operation".

[0104] It's understandable that preset game operation strategies include preset key elements. For example, if the preset game operation strategy is "quickly identify enemy targets, rapidly move the mouse to a fixed position, steadily approach and stay in the target area, and execute the shooting operation," then the preset key element is the enemy target. Therefore, after obtaining the preset game operation strategy, the preset key elements can be read from it.

[0105] Furthermore, in step S12, after obtaining the preset key elements, candidate key elements are selected from the game screen based on the preset key elements. For example, when the preset key element is an enemy target, all enemy targets in the game screen can be identified to obtain candidate key elements. The selection process for candidate key elements can be as follows: using the preset key elements as conditional information, the game screen as input data, and a conditional recognition model to identify the game screen and output the identified candidate key elements. The target recognition model can be built based on deep learning algorithms and trained using a large amount of labeled game screen data to improve its recognition accuracy and generalization ability. For example, in shooting games, the target recognition model can identify candidate key elements such as enemy targets, weapons, and cover.

[0106] Importance data reflects the degree of importance of candidate key elements, serving as the basis for users to select target key elements from among them. Candidate key elements include multi-dimensional data information, such as relevance to preset key elements, user behavior data, and gaze data. Relevance to preset key elements can be determined through semantic analysis or feature matching, and may include the similarity between candidate and preset key elements and / or the degree of positional overlap between them. User behavior data may include mouse history data, such as a gamer's historical operation records (e.g., number of clicks), click frequency, or dwell time. Gaze data is derived from eye-tracking data captured by smart glasses and reflects the player's level of attention to candidate key elements, such as gaze duration and gaze frequency.

[0107] In one embodiment, the process of acquiring the gaze data specifically includes:

[0108] Acquire eye-tracking data captured by the smart glasses when acquiring the game screen;

[0109] Based on the eye movement count, the fixation duration and / or fixation frequency corresponding to the candidate key elements are obtained to obtain fixation data.

[0110] Specifically, eye-tracking data acquisition relies on the eye-tracking module built into the smart glasses, which can accurately capture the player's eye movement trajectory and gaze point. Gaze duration is the length of time the player's eyes linger on candidate key elements, and gaze frequency is the number of times the player gazes at a candidate key element per unit of time. Analyzing gaze duration and gaze frequency quantifies the player's attention to candidate key elements, thus providing a reference for importance data. For example, if a candidate key element has a long gaze duration and a high gaze frequency, it indicates that the candidate key element may be highly important to the player.

[0111] The gaze data is obtained by analyzing and processing eye-tracking data. Specifically, after acquiring the eye-tracking data, a pre-trained eye-tracking data analysis model is used to analyze the eye-tracking data to determine the player's gaze focus in the game screen. Then, combined with the positional information of candidate key elements, the gaze duration and gaze frequency of each candidate key element are calculated.

[0112] Furthermore, in step S13 above, after obtaining the importance data of the candidate key elements, the importance score of the candidate key elements can be determined based on the importance data, and then the target key element can be selected from the candidate key elements according to the importance score.

[0113] In one embodiment, the importance data includes relevance to preset key elements, user behavior data, and gaze data; the selection of the target key element from the candidate key elements based on the importance data specifically includes:

[0114] Obtain the correlation with preset key elements, the weight coefficients corresponding to user behavior data and gaze data, and the influence intensity coefficients corresponding to the user behavior data and gaze data.

[0115] Based on the obtained weight coefficients and influence intensity coefficients, the relevance of the candidate key elements to the preset key elements, user behavior data, and gaze data are weighted and combined to obtain the importance score of the candidate key elements.

[0116] The target key element is selected from the candidate key elements based on the importance score.

[0117] Specifically, weighting coefficients reflect the relative importance of data items in the importance score. These data items include relevance to preset key elements, user behavior data, and attention data. The weighting coefficients for each data item can be set according to the actual application scenario and needs, or automatically learned through a training model. For example, in a game scenario, user behavior data has higher reference value for selecting target key elements, thus it can be assigned a higher weighting coefficient; while in another game scenario, attention data is more crucial for selecting target key elements, thus it can be assigned a higher weighting coefficient. The influence strength coefficient is used to adjust the actual role of the data items to ensure that the importance score more accurately reflects the true importance of the candidate key elements.

[0118] It should be noted that during the weighted combination process, to eliminate the influence of different units or numerical ranges on the calculation results, normalization can be performed on each data item. For example, the relevance to preset key elements, user behavior data, and gaze data may differ by orders of magnitude, and direct weighted combination may cause some factors to be ignored. Therefore, before calculation, each data item can be uniformly mapped to the same numerical range, such as [0,1], to ensure that each factor can participate fairly in the scoring calculation.

[0119] In one specific embodiment, the weighted combination formula for the importance score can be:

[0120] ,

[0121] in, Indicates importance score, Indicates the relevance to preset key elements. This represents the number of clicks in user behavior data. This represents the click frequency in user behavior data. This indicates the fixation duration in the fixation data. This indicates the fixation frequency in the fixation data. Indicates the weighting coefficient. This represents the influence intensity coefficient.

[0122] Furthermore, after obtaining the importance scores, candidate key elements can be sorted from highest to lowest importance score, and one or more candidate key elements with the highest importance scores can be selected as the target key element. If multiple candidate key elements have the same importance score, the final target key element can be determined through random selection, priority rules, or other predetermined strategies.

[0123] This application embodiment selects target key elements through multi-dimensional comprehensive evaluation. This not only improves the accuracy and rationality of the selection of target key elements, but also enhances the flexibility and adaptability of the system, enabling it to better meet the needs of complex and ever-changing game environments.

[0124] It should be noted that in practical applications, other methods can also be used to obtain target key elements. For example, target element categories can be preset, and after capturing the game screen, game element recognition can be performed on the game screen to obtain the element category of each game element in the game screen. Then, target key elements can be selected from all game elements based on the preset target element categories.

[0125] S20. Obtain the mouse operation flow corresponding to the target key element, and determine the mouse parameter adjustment strategy based on the mouse operation flow.

[0126] Specifically, the mouse operation flow is a process in which the player is about to perform an action when the target key element is used as a preset key element in the preset game operation strategy. In this context, the mouse operation flow is formed by predicting the player's actions based on the preset game operation strategy after using the target key element as a preset key element; that is, the mouse operation flow is a predictive operation flow.

[0127] In one embodiment, the process of obtaining the mouse operation corresponding to the target key element specifically includes:

[0128] Obtain the preset game operation strategy corresponding to the game screen;

[0129] The target key element is used as the preset key element in the preset game operation strategy to predict the mouse operation process of performing game operations according to the preset game operation strategy.

[0130] Specifically, the preset game operation strategy includes preset key elements. After obtaining the target key element, it is used as a preset key element in the preset game operation strategy to form a preset game operation strategy regarding the target key element. Then, the mouse operations of the player during gameplay can be predicted according to this preset game operation strategy regarding the target key element to form a mouse operation flow. For example, the mouse operation flow is to first move the mouse quickly, and then move the mouse steadily after it reaches a preset position.

[0131] Furthermore, the mouse parameter adjustment strategy is a scheme to adjust mouse parameters according to the mouse operation process. Specifically, mouse parameters include one or more of the following: sensitivity, polling rate, acceleration, scan rate, and button response parameters. These mouse parameters can work together through firmware algorithms (such as sensor data processing and button pre-pressure calibration) and software settings (such as driver customization and in-game sensitivity) to affect the mouse's operating accuracy, response speed, and stability, ultimately influencing the user's "feel" (such as "responsiveness," "stability," and "click feedback").

[0132] After acquiring the mouse operation flow, the mouse parameters can be dynamically adjusted to suit the needs of gamers based on the predicted operation steps and rhythm in the preset game operation strategy. For example, sensitivity and acceleration can be increased during phases requiring rapid mouse movement, while sensitivity and acceleration can be decreased during phases requiring stable mouse movement to ensure precise operation.

[0133] In one embodiment, determining the mouse parameter adjustment strategy based on the mouse operation flow specifically includes:

[0134] In the mouse operation process, at least one target mouse operation is selected, and the triggering condition of the mouse operation is obtained;

[0135] Configure mouse parameters for the target mouse operation, and form a mouse parameter adjustment strategy based on the mouse parameters and the triggering conditions.

[0136] Specifically, the target mouse operation is the step that requires adjusting mouse parameters. In other words, there are several mouse operations within the mouse operation flow, and adjusting mouse parameters is necessary when executing each operation. For example, if the mouse operation flow involves quickly moving the mouse and then stabilizing it after reaching a preset position, then the target mouse operation is the step corresponding to the start of the quick mouse movement and the step that initiates the stable movement. Therefore, when selecting the target mouse operation within the mouse operation flow, one can select the mouse operation corresponding to the moment when the mouse operation mode changes, or one can pre-set selection criteria for the mouse operation and then select the mouse operation that meets those criteria within the mouse operation flow. Furthermore, in practical applications, historical real mouse operation flows corresponding to this mouse operation flow can be obtained. Using these historical real mouse operation flows as prior knowledge, a large model can be used to select the target mouse operation within this mouse operation flow.

[0137] The trigger condition is the specific situation or state required to execute the target mouse operation during gameplay. For example, the trigger condition could be the moment the mouse begins to move, or the distance between the mouse and the target key element reaching a preset distance threshold. This trigger condition is used to adjust mouse parameters. It can be a selection condition for the target mouse operation; for example, when selecting a target mouse operation, the selection condition is read and then used as the trigger condition. Therefore, the mouse parameter adjustment strategy includes mouse parameters and trigger conditions, and this strategy can include one set of mouse parameters and trigger conditions, or multiple sets of mouse parameters and trigger conditions. In other words, mouse parameters can be adjusted once or multiple times during the mouse operation process.

[0138] For example, if the mouse operation process involves first moving the mouse at high speed, and then, when the distance between the mouse and the target key element reaches a preset distance threshold, steadily approaching the target key element and stopping in the target area corresponding to the target key element, then the mouse parameter adjustment includes two sets of mouse parameters and triggering conditions. One set of mouse parameters and triggering conditions consists of the mouse parameters in racing mode and the start time of the mouse's high-speed movement. The other set of mouse parameters and triggering conditions consists of the mouse parameters in stable mode and the distance between the mouse and the target key element reaching the preset distance threshold.

[0139] It should be noted that mouse parameter adjustment strategies can include only mouse parameters, or, in addition to mouse parameters and triggering conditions, other constraints, such as the mouse movement direction being the target key element.

[0140] In one embodiment, when configuring mouse parameters for the target mouse operation, mouse parameters can be selected from a preset mouse parameter set. This preset mouse parameter set is pre-set and includes several mouse parameter modes, each corresponding to specific mouse parameters. Then, when selecting mouse parameters from the preset mouse parameter set for the target mouse operation, the mouse parameter model required by the target mouse operation can be determined first, and the corresponding mouse parameters for that mouse parameter mode can be used as the mouse parameters for the target mouse operation.

[0141] In one embodiment, mouse parameters include sensitivity, polling rate, acceleration, scan rate, and button response parameters. Mouse parameter modes include a normal parameter mode, a racing parameter mode, and a stable parameter mode. The mouse parameters for sensitivity, polling rate, acceleration, scan rate, and button response parameters in each mouse parameter mode can be:

[0142] Sensitivity (DPI, dots per inch) is a mouse parameter that determines cursor movement speed. It represents the number of coordinate points the sensor samples per inch and is directly related to the "physical distance the mouse moves" and the "distance the cursor moves on the screen" (e.g., 1000 DPI means the mouse moves 1 inch, and the cursor moves 1000 pixels, etc.).

[0143] Daily parameter mode: Medium DPI (800-1200), balancing accuracy and movement efficiency;

[0144] Racing parameter mode: Medium-high DPI (800-1600) with quick switching;

[0145] Stable parameter mode: Low DPI (400-800) to ensure aiming accuracy (avoid "drifting").

[0146] Polling rate, which affects cursor smoothness and response latency, is the frequency (in Hz) at which the mouse reports its position data to the computer. A higher frequency results in smoother cursor movement and lower response latency.

[0147] Daily parameter mode: 1000Hz meets daily needs (latency is about 1ms);

[0148] Racing parameter mode: Game scenarios typically use a high polling rate (4000-8000Hz) to reduce "input latency" (e.g., 8K polling rate means 8000 data reports per second with a latency of approximately 0.125ms).

[0149] Stable parameter mode: Game scenarios typically use a high polling rate (4000-8000Hz) to reduce "input latency" (e.g., an 8K polling rate means 8000 data reports per second with a latency of approximately 0.125ms).

[0150] Acceleration is a key variable affecting operational consistency. It relates the cursor movement distance to the mouse's physical movement speed (e.g., with acceleration enabled, the cursor will move further when the mouse is moved quickly than when it is moved slowly).

[0151] Daily parameter mode: Acceleration off;

[0152] Racing parameter mode: Enable acceleration;

[0153] Stable parameter mode: Acceleration off;

[0154] Scan rate (frame rate) is a low-level parameter that affects the tracking accuracy of a sensor. It is the number of image frames captured by the sensor per second (unit: FPS). The higher the frame rate, the more accurately the sensor recognizes the mousepad texture, especially during fast movements (such as "flicking the mouse"), and the less likely it is to drop frames.

[0155] Daily parameter mode: 5000-10000 FPS;

[0156] Racing parameter mode: High scan rate (10000-20000FPS);

[0157] Stable parameter mode: 5000-10000 FPS.

[0158] Key response parameters are core factors affecting click feedback, including Actuation Force, Debounce Time, and Pre-travel. Debounce Time can be adjusted in real-time via firmware.

[0159] Daily parameter mode: High image stabilization latency (≤5ms);

[0160] Racing parameter mode: Low anti-shake latency (5≤10ms);

[0161] Stable parameter mode: High anti-shake latency (≤5ms).

[0162] In one embodiment, mouse parameters include sensitivity, polling rate, acceleration, scan rate, and button response parameters. Mouse parameter modes include daily parameter mode, racing parameter mode, stable parameter mode, RPG pathfinding parameter mode, and RPG dialogue parameter mode. In the daily parameter mode, racing parameter mode, stable parameter mode, RPG pathfinding parameter mode, and RPG dialogue parameter mode, the sensitivity, polling rate, acceleration, scan rate, and button response parameters can be as shown in Table 1.

[0163] Table 1. Parameters for Sensitivity, Rate of Return, Acceleration, Scan Rate, and Key Response

[0164]

[0165] It should be noted that the two embodiments described above only provide specific examples of mouse parameters and do not limit the mouse parameters. In practical applications, mouse parameters in the mouse parameter adjustment strategy can be set according to the actual situation. Furthermore, large-scale model learning games and toys can be used to form formal mouse parameter patterns and the corresponding mouse parameters for those patterns.

[0166] S30. Adjust the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation process.

[0167] Specifically, adjusting mouse parameters according to the aforementioned mouse parameter adjustment strategy means adjusting the mouse parameters according to this strategy while the player is performing actions targeting a key element in the game. Of course, in practical applications, if the player's actual target is not a key element, the mouse parameters will not be adjusted according to this strategy. Alternatively, the mouse parameters can remain unchanged, or a new mouse parameter adjustment strategy can be determined based on the player's actual target, and the mouse parameters will be adjusted according to the new strategy.

[0168] In one embodiment, the mouse parameter adjustment strategy includes at least one mouse parameter group, which includes mouse parameters and trigger conditions. Therefore, adjusting the mouse parameters according to the mouse parameter adjustment strategy to adapt the mouse parameters to the mouse operation process specifically includes:

[0169] Monitor the triggering conditions in the mouse parameter adjustment strategy;

[0170] When the trigger condition is detected to be met, the mouse parameters corresponding to the trigger condition are obtained, and the mouse parameters are configured based on the mouse parameters to adjust the mouse parameters.

[0171] Specifically, when monitoring trigger conditions, the system monitors mouse operation-related status data in real time during gameplay. This data can include mouse movement direction, mouse movement trajectory, and the distance between the mouse and target key elements. Based on this data, it determines whether the trigger condition is met. For example, if the trigger condition is that the distance between the mouse and the target key element reaches a preset distance threshold, then when this threshold is detected, the trigger condition is considered met. Then, upon detecting that the trigger condition is met, the system acquires the corresponding mouse parameters and configures the mouse settings accordingly.

[0172] For example, when the mouse parameter adjustment includes two sets of mouse parameters and trigger conditions, one set of mouse parameters and trigger conditions is the mouse parameters in racing mode and the starting moment when the mouse begins to move at high speed, and the other set of mouse parameters and trigger conditions is the mouse parameters in stable mode and the distance between the mouse and the target key element reaches a preset distance threshold, the mouse parameters will be adjusted twice when playing the game according to the mouse operation process. The first adjustment is to adjust the mouse parameters to the mouse parameters in racing mode so that the cursor can quickly approach the target key element; the second adjustment is to adjust the mouse parameters to the mouse parameters in stable mode to ensure accurate clicking.

[0173] In a specific shooting game implementation, the target key element is assumed to be the "enemy player". The mouse parameter adjustment strategy includes two parameter groups: the trigger condition for parameter group A (high DPI, high polling rate) is "the mouse starts moving towards the enemy player"; the trigger condition for parameter group B (low DPI, high polling rate, acceleration off) is "the distance between the mouse cursor and the enemy player model on the screen is less than 50 pixels".

[0174] The monitoring process is as follows: the smart glasses continuously analyze the game screen and calculate the real-time distance D between the mouse cursor and the enemy player. When the mouse displacement vector is detected pointing towards the enemy player and the displacement speed exceeds a preset threshold V, trigger condition A is deemed met, and the electronic device immediately switches the mouse parameters to high DPI mode. Subsequently, when the real-time distance D is less than 50 pixels for the first time, trigger condition B is deemed met, and the electronic device immediately switches the mouse parameters to a low DPI stable aiming mode. Through this phased dynamic parameter adjustment, a perfect combination of 'rapid aiming' and 'precise aiming' is achieved.

[0175] It should be noted that when the mouse parameter adjustment strategy only includes mouse parameters, adjusting the mouse parameters according to the strategy means that the mouse parameters are adjusted immediately after the strategy is generated. Specifically, when the mouse parameter adjustment strategy includes one mouse parameter, that mouse parameter is automatically configured. When the strategy includes multiple mouse parameters, the game player can interact with the smart glasses to select a target mouse parameter from the multiple parameters, and that target mouse parameter is automatically configured.

[0176] In addition, in practical applications, to avoid operation lag or accidental touches caused by frequent switching of mouse parameters, it is possible to check whether the current time meets the preset adjustment requirements before obtaining the mouse parameter adjustment strategy or before adjusting the mouse parameters based on the mouse parameter adjustment strategy. The preset adjustment requirements can be that the distance between the mouse position and the target key element is greater than a set distance threshold, etc.

[0177] For example, before adjusting the mouse parameters according to the mouse parameter adjustment strategy to adapt the mouse parameters to the mouse operation process, the method further includes:

[0178] Get the current mouse position and the positional relationship between the target key element;

[0179] If the positional relationship meets the preset adjustment requirements, then the mouse parameters are adjusted according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation process.

[0180] If the positional relationship does not meet the preset adjustment requirements, the mouse parameter adjustment strategy is discarded.

[0181] Specifically, the preset adjustment requirements are pre-set. For example, the preset adjustment requirements could be set to a distance greater than 200 pixels between the mouse position and the target key element on the screen, providing sufficient adjustment time for mouse parameters (i.e., the movement time between the mouse moving to the set position corresponding to the target key element). For example, in a shooting game, if the player's mouse cursor is very close to the enemy player (e.g., less than 200 pixels away), adjusting the parameters at this time might cause the cursor to suddenly change speed, affecting aiming accuracy. Therefore, in this case, the mouse parameter adjustment strategy should be discarded, and the current parameters should remain unchanged. Conversely, if the player's mouse cursor is far from the enemy player (e.g., more than 200 pixels away), the mouse parameters are adjusted according to the aforementioned mouse parameter adjustment strategy to optimize subsequent fast movement or precise aiming.

[0182] Furthermore, it should be noted that the mouse parameter adjustment method provided in this application is a cyclical process. Specifically, after completing one mouse parameter adjustment, the system re-enters the mouse operation flow analysis phase, that is, it re-executes the steps of identifying the mouse operation flow, determining the target key elements, generating a new mouse parameter adjustment strategy, and adjusting the parameters according to the strategy. This cyclical mechanism ensures that the mouse parameters are always dynamically adapted to the current operation needs of the game player. For example, in a shooting game, after the player completes aiming and shooting at an enemy target, the system automatically analyzes the next possible target key elements (such as a new enemy player, item pickup point, etc.), and based on the new target key elements and the expected mouse operation flow, regenerates and applies the corresponding mouse parameter adjustment strategy, thereby achieving continuous optimization of mouse performance throughout the game.

[0183] In summary, this embodiment provides a method for dynamic mouse adjustment. The method includes acquiring a game screen through smart glasses and acquiring target key elements in the game screen; acquiring the mouse operation flow corresponding to the target key elements and determining a mouse parameter adjustment strategy based on the mouse operation flow; and adjusting the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters adapt to the mouse operation flow. This application constructs a collaborative working mechanism between smart glasses and mouse peripherals through data interaction between smart glasses and electronic devices, fully leveraging the advantages of the multimodal perception capabilities of smart glasses. It enables mouse parameter adjustment assisted by smart glasses, reducing the frequency of manual adjustments by players. This improves the adaptability of mouse parameters to the game scene and enhances the game immersion and competitive performance of players.

[0184] Based on the above-described mouse dynamic adjustment method, this embodiment provides a mouse dynamic adjustment device, such as... Figure 3 As shown, the mouse dynamic adjustment device specifically includes:

[0185] The acquisition module 100 is used to acquire the game screen through smart glasses and acquire the target key elements in the game screen;

[0186] The determination module 200 is used to obtain the mouse operation flow corresponding to the target key element, and determine the mouse parameter adjustment strategy based on the mouse operation flow;

[0187] The adjustment module 300 is used to adjust the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation process.

[0188] Based on the above-described mouse dynamic adjustment method, this embodiment provides a computer-readable storage medium storing one or more programs that can be executed by one or more processors to implement the steps in the mouse dynamic adjustment method described in the above embodiment.

[0189] Based on the above-described dynamic mouse adjustment method, this application also provides a terminal device, such as... Figure 4 As shown, it includes at least one processor 20; a display screen 21; and a memory 22, and may also include a communications interface 23 and a bus 24. The processor 20, display screen 21, memory 22, and communications interface 23 can communicate with each other via the bus 24. The display screen 21 is configured to display a preset user guide interface in the initial setup mode. The communications interface 23 can transmit information. The processor 20 can invoke logical instructions in the memory 22 to execute the methods described in the above embodiments.

[0190] Furthermore, the logical instructions in the aforementioned memory 22 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium.

[0191] The memory 22, as a computer-readable storage medium, can be configured to store software programs, computer-executable programs, such as program instructions or modules corresponding to the methods in the embodiments of this disclosure. The processor 20 executes functional applications and data processing by running the software programs, instructions, or modules stored in the memory 22, thereby implementing the methods in the above embodiments.

[0192] The memory 22 may include a program storage area and a data storage area. The program storage area may store the operating system and application programs required for at least one function; the data storage area may store data created based on the use of the terminal device. Furthermore, the memory 22 may include high-speed random access memory (RAM) and non-volatile memory. Examples include various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks, as well as transient storage media.

[0193] Furthermore, the specific process of loading and executing multiple instruction processors in the aforementioned storage medium and terminal device has been described in detail in the above method, and will not be repeated here.

[0194] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for dynamically adjusting a mouse, characterized in that, The aforementioned method for dynamically adjusting the mouse specifically includes: The game screen is captured through smart glasses, and key target elements in the game screen are obtained. Obtain the mouse operation flow corresponding to the target key element, and determine the mouse parameter adjustment strategy based on the mouse operation flow; Adjust the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation process; Specifically, obtaining the target key elements in the game screen includes: Obtain importance data associated with candidate key elements in the game screen, wherein the importance data includes the correlation with preset key elements, user behavior data based on the mouse, and gaze data based on the smart glasses; Obtain the weight coefficients corresponding to the relevance with preset key elements, user behavior data, and gaze data, as well as the influence intensity coefficients corresponding to the user behavior data and gaze data, wherein the influence intensity coefficients are used to adjust the actual effect intensity of the data items corresponding to the user behavior data and gaze data. The importance score of the candidate key element is obtained by weighting the correlation with the preset key element, the user behavior data adjusted by the influence intensity coefficient, and the gaze data adjusted by the influence intensity coefficient based on the obtained weight coefficient. The target key element is selected from the candidate key elements based on the importance score.

2. The mouse dynamic adjustment method according to claim 1, characterized in that, The acquisition of the target key elements in the game screen also includes: Obtain the preset game operation strategy corresponding to the game screen, and read the preset key elements in the preset game operation strategy; Select the candidate key element corresponding to the preset key element in the game screen.

3. The mouse dynamic adjustment method according to claim 2, characterized in that, The process of acquiring the gaze data specifically includes: Obtain eye-tracking data captured by the smart glasses when acquiring the game screen; Based on the eye-tracking data, the user's gaze duration and / or gaze frequency on the candidate key elements are obtained to obtain gaze data.

4. The mouse dynamic adjustment method according to claim 2, characterized in that, The correlation with the preset key element includes the similarity between the candidate key element and the preset key element and / or the positional overlap between the candidate key element and the preset key element.

5. The mouse dynamic adjustment method according to claim 1, characterized in that, The specific mouse operation process for obtaining the target key element includes: Obtain the preset game operation strategy corresponding to the game screen; The target key element is used as the preset key element in the preset game operation strategy to predict the mouse operation process of performing game operations according to the preset game operation strategy.

6. The mouse dynamic adjustment method according to claim 2 or 5, characterized in that, The specific steps of obtaining the preset game operation strategy corresponding to the game screen include: Identify the game type corresponding to the game screen; Select a preset game operation strategy for the game screen based on the game type.

7. The mouse dynamic adjustment method according to claim 1, characterized in that, The specific steps of determining the mouse parameter adjustment strategy based on the mouse operation process include: In the mouse operation process, at least one target mouse operation is selected, and the triggering condition of the mouse operation is obtained; Configure mouse parameters for the target mouse operation, and form a mouse parameter adjustment strategy based on the mouse parameters and the triggering conditions.

8. The mouse dynamic adjustment method according to claim 1, characterized in that, The mouse parameter adjustment strategy includes at least one mouse parameter group, which includes mouse parameters and trigger conditions; adjusting the mouse parameters according to the mouse parameter adjustment strategy to adapt the mouse parameters to the mouse operation process specifically includes: Monitor the triggering conditions in the mouse parameter adjustment strategy; When the trigger condition is detected to be met, the mouse parameters corresponding to the trigger condition are obtained, and the mouse parameters are configured based on the mouse parameters to adjust the mouse parameters.

9. The mouse dynamic adjustment method according to claim 1, characterized in that, The mouse parameters include one or more of the following: sensitivity, polling rate, acceleration, scan rate, and button response parameters.

10. The mouse dynamic adjustment method according to claim 1, characterized in that, The method further includes: After obtaining the target key element, monitor the reminder event corresponding to the target key element; When an alert event is detected, a notification is issued via smart glasses. The notification may include one or more of the following: visual alerts, tactile alerts, and auditory alerts.

11. The mouse dynamic adjustment method according to claim 1, characterized in that, Before adjusting the mouse parameters according to the mouse parameter adjustment strategy to adapt the mouse parameters to the mouse operation process, the method further includes: Get the current mouse position and the positional relationship between the target key element; If the positional relationship meets the preset adjustment requirements, then the mouse parameters are adjusted according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation process. If the positional relationship does not meet the preset adjustment requirements, the mouse parameter adjustment strategy is discarded.

12. A dynamic adjustment device for a mouse, characterized in that, The aforementioned dynamic mouse adjustment device specifically includes: The acquisition module is used to acquire game screens through smart glasses and acquire target key elements in the game screens; The determination module is used to obtain the mouse operation flow corresponding to the target key element, and determine the mouse parameter adjustment strategy based on the mouse operation flow; The adjustment module is used to adjust the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation process. Specifically, obtaining the target key elements in the game screen includes: Obtain importance data associated with candidate key elements in the game screen, wherein the importance data includes the correlation with preset key elements, user behavior data based on the mouse, and gaze data based on the smart glasses; Obtain the weight coefficients corresponding to the relevance with preset key elements, user behavior data, and gaze data, as well as the influence intensity coefficients corresponding to the user behavior data and gaze data, wherein the influence intensity coefficients are used to adjust the actual effect intensity of the data items corresponding to the user behavior data and gaze data. The weighted coefficients obtained from the baseline are weighted and combined with the relevance of the candidate key element, the user behavior data adjusted by the influence intensity coefficient, and the gaze data adjusted by the influence intensity coefficient to obtain the importance score of the candidate key element. The target key element is selected from the candidate key elements based on the importance score.

13. A dynamic mouse adjustment system, characterized in that, The mouse dynamic adjustment system includes smart glasses and an electronic device, with a mouse externally mounted on the electronic device; The smart glasses are used to capture game screens, obtain target key elements in the game screens, obtain mouse operation flows corresponding to the target key elements, determine mouse parameter adjustment strategies based on the mouse operation flows, and send the mouse parameter adjustment strategies to electronic devices. The electronic device is used to adjust mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation process. Specifically, obtaining the target key elements in the game screen includes: Obtain importance data associated with candidate key elements in the game screen, wherein the importance data includes the correlation with preset key elements, user behavior data based on the mouse, and gaze data based on the smart glasses; Obtain the weight coefficients corresponding to the relevance with preset key elements, user behavior data, and gaze data, as well as the influence intensity coefficients corresponding to the user behavior data and gaze data, wherein the influence intensity coefficients are used to adjust the actual effect intensity of the data items corresponding to the user behavior data and gaze data. The importance score of the candidate key element is obtained by weighting the correlation with the preset key element, the user behavior data adjusted by the influence intensity coefficient, and the gaze data adjusted by the influence intensity coefficient based on the obtained weight coefficient. The influence intensity coefficient is used to adjust the actual effect of the data item. The target key element is selected from the candidate key elements based on the importance score.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores one or more programs, which can be executed by one or more processors to implement the steps in the mouse dynamic adjustment method as described in any one of claims 1-11.

15. A terminal device, characterized in that, include: Processor and memory; The memory stores a computer-readable program that can be executed by the processor; When the processor executes the computer-readable program, it implements the steps of the mouse dynamic adjustment method as described in any one of claims 1-11.

Images