Mouse dynamic adjustment method, device, system, equipment and medium

Abstract

The invention discloses a mouse dynamic adjustment method, device, system and equipment and a medium, and the method comprises the steps: obtaining a game picture through intelligent glasses, and obtaining a target key element in the game picture; obtaining a mouse operation process corresponding to the target key element, and determining a mouse parameter adjustment strategy based on the mouse operation process; and performing mouse parameter adjustment according to the mouse parameter adjustment strategy so as to enable the mouse parameters to adapt to the mouse operation process. Through data interaction between the intelligent glasses and the electronic equipment, a cooperative working mechanism of the intelligent glasses and the mouse peripheral is constructed, the advantage of the multi-mode perception capability of the intelligent glasses is fully played, the mouse parameter adjustment is assisted through the intelligent glasses, the manual adjustment frequency of a player is reduced, and the user experience is improved. In this way, on one hand, the adaptation degree of the mouse parameters and the game scene can be improved, and on the other hand, the game immersion of the game player is improved, and the game player is helped to improve the competitive performance in the game.

Description

A method, apparatus, system, device, and medium for dynamic mouse adjustment. Technical Field

[0001] This application relates to the field of mouse technology, and in particular to a method, device, system, equipment, and medium for dynamic adjustment of a mouse. Background Technology

[0002] With the rapid development of esports and immersive gaming, players' demands for precision and responsiveness in game controls are constantly increasing. Traditional gaming mouse sensitivity relies solely on manual adjustment by the user and cannot adaptively adjust in real time according to the game scene, target movement, and changes in player attention, severely limiting operational flexibility and responsiveness.

[0003] As a novel interactive device, smart glasses possess multimodal sensing capabilities such as cameras and sensors, enabling functions like eye tracking, posture detection, and environmental awareness. However, current technology lacks an effective data interaction and collaborative control mechanism between smart glasses and gaming mice, preventing the use of their sensory information for the dynamic control of gaming peripherals.

[0004] Therefore, existing technologies suffer from insufficient collaboration between smart glasses and mouse peripherals, making it impossible to use smart glasses to assist in adjusting mouse parameters in order to achieve automatic adaptation to game scenarios. Summary of the Invention

[0005] The technical problem to be solved by this application is to provide a method, device, system, equipment and medium for dynamic adjustment of a mouse, in order to address the shortcomings of the existing technology, and solve the problem of insufficient coordination between smart glasses and mouse peripherals, so as to realize the adjustment of mouse parameters assisted by smart glasses.

[0006] To address the aforementioned technical problems, the first aspect of this application provides a method for dynamically adjusting a mouse, wherein the method specifically includes: acquiring a game screen through smart glasses and acquiring target key elements in the game screen; acquiring the mouse operation flow corresponding to the target key elements and determining a mouse parameter adjustment strategy based on the mouse operation flow; and adjusting the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation flow.

[0007] The mouse dynamic adjustment method, wherein obtaining the target key element in the game screen specifically includes: obtaining a preset game operation strategy corresponding to the game screen, and reading preset key elements in the preset game operation strategy; selecting candidate key elements corresponding to the preset key elements in the game screen, and obtaining importance data of the candidate key elements, wherein the importance data includes one or more of the following: correlation with the preset key elements, user behavior data, and gaze data; and selecting the target key element from the candidate key elements based on the importance data.

[0008] The mouse dynamic adjustment method, wherein the process of acquiring gaze data specifically includes: acquiring eye movement data captured by the smart glasses when acquiring the game screen; and acquiring the user's gaze duration and / or gaze frequency on the candidate key elements based on the eye movement data to obtain gaze data.

[0009] The mouse dynamic adjustment method, wherein the correlation with the preset key element includes the similarity between the candidate key element and the preset key element and / or the positional overlap between the candidate key element and the preset key element.

[0010] The mouse dynamic adjustment method, wherein the importance data includes relevance to preset key elements, user behavior data, and gaze data; the step of selecting a target key element from candidate key elements based on the importance data specifically includes: obtaining the weight coefficients corresponding to the relevance to preset key elements, user behavior data, and gaze data, and the influence intensity coefficients corresponding to the user behavior data and gaze data; weighting and combining the relevance to preset key elements, user behavior data, and gaze data based on the obtained weight coefficients and influence intensity coefficients to obtain an importance score for the candidate key elements; and selecting a target key element from the candidate key elements based on the importance score.

[0011] The mouse dynamic adjustment method, wherein obtaining the mouse operation process corresponding to the target key element specifically includes: obtaining the preset game operation strategy corresponding to the game screen; using the target key element as the preset key element in the preset game operation strategy, and predicting the mouse operation process of performing game operations according to the preset game operation strategy.

[0012] The mouse dynamic adjustment method, wherein obtaining the preset game operation strategy corresponding to the game screen specifically includes: identifying the game type corresponding to the game screen; and selecting the preset game operation strategy for the game screen according to the game type.

[0013] The mouse dynamic adjustment method, wherein determining the mouse parameter adjustment strategy based on the mouse operation flow specifically includes: selecting at least one target mouse operation in the mouse operation flow and obtaining the triggering condition of the mouse operation; configuring mouse parameters for the target mouse operation, and forming a mouse parameter adjustment strategy based on the mouse parameters and the triggering condition.

[0014] The mouse dynamic adjustment method includes a mouse parameter adjustment strategy comprising at least one mouse parameter group, wherein the mouse parameter group includes mouse parameters and trigger conditions; the step of adjusting the mouse parameters according to the mouse parameter adjustment strategy to adapt the mouse parameters to the mouse operation process specifically includes: monitoring the trigger conditions in the mouse parameter adjustment strategy; when the trigger conditions are detected to be met, obtaining the mouse parameters corresponding to the trigger conditions, and configuring the mouse parameters based on the mouse parameters to adjust the mouse parameters.

[0015] The mouse dynamic adjustment method, wherein the mouse parameters include one or more of the following: sensitivity, polling rate, acceleration, scan rate, and button response parameters.

[0016] The mouse dynamic adjustment method further includes: after acquiring the target key element, monitoring the reminder event corresponding to the target key element; when the reminder event is detected, providing a reminder through smart glasses, wherein the reminder includes one or more of visual reminders, tactile reminders, and auditory reminders.

[0017] The mouse dynamic adjustment method further includes, before adjusting the mouse parameters according to the mouse parameter adjustment strategy to adapt the mouse parameters to the mouse operation process, the method further includes: obtaining the positional relationship between the current mouse position and the target key element; if the positional relationship meets the preset adjustment requirements, then adjusting the mouse parameters according to the mouse parameter adjustment strategy to adapt the mouse parameters to the mouse operation process; if the positional relationship does not meet the preset adjustment requirements, then discarding the mouse parameter adjustment strategy.

[0018] A second aspect of this application provides a mouse dynamic adjustment device, wherein the mouse dynamic adjustment device specifically includes: an acquisition module, used to acquire a game screen through smart glasses and acquire target key elements in the game screen; a determination module, used to acquire the mouse operation flow corresponding to the target key elements and determine a mouse parameter adjustment strategy based on the mouse operation flow; and an adjustment module, used to adjust the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation flow.

[0019] A third aspect of this application provides a dynamic mouse adjustment system, wherein the dynamic mouse adjustment system includes smart glasses and an electronic device, and the electronic device is externally equipped with a mouse; the smart glasses are used to capture game screens, obtain target key elements in the game screens, obtain mouse operation flows corresponding to the target key elements, determine mouse parameter adjustment strategies based on the mouse operation flows, and send the mouse parameter adjustment strategies to the electronic device; the electronic device is used to adjust mouse parameters according to the mouse parameter adjustment strategies so that the mouse parameters are adapted to the mouse operation flows.

[0020] A fourth aspect of this application provides a computer-readable storage medium storing one or more programs that can be executed by one or more processors to implement the steps in any of the above-described mouse dynamic adjustment methods.

[0021] A fifth aspect of this application provides a terminal device comprising: a processor and a memory; the memory storing a computer-readable program executable by the processor; and the processor executing the computer-readable program to implement the steps of any of the above-described mouse dynamic adjustment methods.

[0022] Beneficial effects: 1. This application establishes a collaborative working mechanism between smart glasses and mouse peripherals through data interaction between smart glasses and electronic devices. It fully leverages the multimodal perception capabilities of smart glasses, enabling "bypass control" of mouse parameters by assisting with parameter adjustment. This avoids running additional real-time analysis programs on electronic devices running games or other applications, thereby maximizing the release of CPU / GPU resources and ensuring the smoothness and stability of games and other applications—a technical effect difficult to achieve with purely software solutions. Simultaneously, it reduces the frequency of manual adjustments by players, enhancing game immersion and competitive performance.

[0023] 2. In determining the target key elements, this application makes full use of the game screen and eye movement data collected by smart glasses, and combines it with preset game operation strategies and user behavior data to improve the accuracy of the selection of target key elements, thereby further improving the accuracy of mouse parameter adjustment.

[0024] 3. This application uses a preset game operation strategy to predict the movement trajectory, and based on the movement trajectory, predicts the mouse operation requirements to form a mouse operation process. Then, according to the mouse operation process, the mouse parameter adjustment strategy is set so that the mouse parameter adjustment strategy meets the mouse operation requirements, thereby realizing dynamic adaptation of mouse parameters and improving the smoothness and response efficiency of game operation. Attached Figure Description

[0025] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0026] Figure 1 is a schematic diagram of the dynamic mouse adjustment system provided in an embodiment of this application.

[0027] Figure 2 is a flowchart of the mouse dynamic adjustment method provided in an embodiment of this application.

[0028] Figure 3 is a schematic block diagram of the mouse dynamic adjustment device provided in the embodiment of this application.

[0029] Figure 4 is a schematic block diagram of the terminal device provided in the embodiment of this application. Detailed Implementation

[0030] This application provides a method, apparatus, system, device, and medium for dynamic mouse adjustment. To make the objectives, technical solutions, and effects of this application clearer and more explicit, the following detailed description is provided with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only for explaining this application and are not intended to limit this application.

[0031] Those skilled in the art will understand that, unless specifically stated otherwise, the singular forms “a,” “an,” “the,” and “the” used herein may also include the plural forms. It should be further understood that the term “comprising” as used in this application means the presence of the stated features, integers, steps, operations, elements, and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. It should be understood that when we say an element is “connected” or “coupled” to another element, it can be directly connected or coupled to the other element, or there may be intermediate elements. Furthermore, “connected” or “coupled” as used herein can include wireless connections or wireless coupling. The term “and / or” as used herein includes all or any units and all combinations of one or more associated listed items.

[0032] It will be understood by those skilled in the art that, unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains. It should also be understood that terms such as those defined in general dictionaries should be understood to have the same meaning as in the context of the prior art, and should not be interpreted in an idealized or overly formal sense unless specifically defined as herein.

[0033] It should be understood that the sequence number and size of each step in this embodiment do not imply the order of execution. The execution order of each process is determined by its function and internal logic, and should not constitute any limitation on the implementation process of this application embodiment.

[0034] With the rapid development of esports and immersive gaming, players' demands for precision and responsiveness in game operations are constantly increasing. Traditional gaming mouse sensitivity relies solely on manual adjustment by the user, failing to adapt in real-time to changes in game scenarios, target movement, and player attention, severely limiting operational flexibility and responsiveness. Specifically, this manifests in the following problems: 1. High latency: Traditional mouse peripherals require manual movement and clicking, with response speed limited by user reaction time, especially prone to causing operational lag in high-speed gaming scenarios.

[0035] 2. Unintelligent Sensitivity Adjustment: While existing mouse firmware supports adjusting core parameters via host computer software—for example, users can manually adjust mouse parameters in advance through the driver—the current adjustment methods lack real-time and adaptive capabilities. They cannot dynamically adjust in real-time according to actual game scenarios and user needs, affecting the mouse's operational accuracy and efficiency. For example, DPI (dots per inch) or CPI (counts per inch) affects cursor movement speed; polling rate affects cursor movement smoothness and response latency; acceleration parameters affect the user experience; and scan rate affects the mouse's positioning stability in high-speed movement or complex scenarios.

[0036] As a novel interactive device, smart glasses possess multimodal sensing capabilities, including cameras and sensors, enabling functions such as eye tracking, posture detection, and environmental awareness. However, current technologies lack an effective data interaction and collaborative control mechanism between smart glasses and gaming mice. This prevents the use of their sensory information for dynamic adjustment of gaming peripherals. For example, image data and eye-tracking data collected by smart glasses are not integrated into the mouse parameter adjustment process. Therefore, it is impossible to utilize game scene content (such as enemy positions and movement trajectories) and eye-tracking data collected by the smart glasses for joint decision-making on mouse parameters, thus hindering dynamic adjustment of mouse parameters.

[0037] Therefore, existing technologies suffer from insufficient collaboration between smart glasses and mouse peripherals, making it impossible to use smart glasses to assist in adjusting mouse parameters in order to achieve automatic adaptation to game scenarios.

[0038] In this embodiment, the game screen is acquired through smart glasses, and key target elements within the game screen are obtained. The mouse operation flow corresponding to the key target elements is acquired, and a mouse parameter adjustment strategy is determined based on the mouse operation flow. The mouse parameters are then adjusted according to the mouse parameter adjustment strategy to ensure the mouse parameters are adapted to the mouse operation flow. This application constructs a collaborative working mechanism between smart glasses and mouse peripherals through data interaction between smart glasses and other electronic devices. It fully leverages the multimodal perception capabilities of smart glasses, enabling the adjustment of mouse parameters with the assistance of smart glasses, reducing the frequency of manual adjustments by the player. This improves the adaptability of mouse parameters to the game scene and enhances the player's immersion in the game, thereby improving their competitive performance.

[0039] An application environment diagram of the mouse dynamic adjustment method provided in this application embodiment can be shown in Figure 1. Referring to Figure 1, the mouse dynamic adjustment system includes smart glasses 110 and an electronic device 120, with a mouse externally mounted on the electronic device 120. The smart glasses 110 and the electronic device 120 are connected via a network. The electronic device 120 can be a desktop terminal or a mobile terminal, specifically at least one of a mobile phone, tablet computer, or laptop computer. The electronic device 120 is used to run a game. The smart glasses 110 is used to acquire the game screen displayed on the electronic device's display interface, acquire target key elements in the game screen, acquire the mouse operation flow corresponding to the target key elements, determine a mouse parameter adjustment strategy based on the mouse operation flow, and send the mouse parameter adjustment strategy to the electronic device. The electronic device is used to adjust the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters adapt to the mouse operation flow.

[0040] It should be noted that when the peripheral mouse of the electronic device is a smart mouse, the smart glasses can communicate with the mouse. After obtaining the mouse parameter adjustment strategy, the smart glasses send the strategy to the mouse, which then adjusts its parameters according to the strategy to adapt the mouse parameters to the mouse operation process. This ensures that the mouse parameter adjustment process does not consume any resources of the electronic device, avoids interference with game operation, and guarantees the smoothness and stability of the game. Furthermore, the smart glasses can dynamically update key target elements and their corresponding mouse operation processes based on real-time collected game scene changes and user behavior, thereby achieving continuous optimization and adaptation of mouse parameters.

[0041] The target key elements are not all elements in the game screen, but dynamic elements that are highly relevant to the current game task and are selected based on multi-dimensional data such as preset game operation strategies and user behavior.

[0042] The application content will be further explained below with reference to the accompanying drawings and through the description of the embodiments.

[0043] This embodiment provides a method for dynamic mouse adjustment, as shown in Figure 2. The method specifically includes: S10, acquiring the game screen through smart glasses and acquiring the target key elements in the game screen.

[0044] Specifically, the game visuals are captured by the smart glasses as they photograph the game scene within the user's field of vision. For example, the game visuals may be captured by the smart glasses as they photograph the display interface of an electronic device running the game within the user's field of vision. The smart glasses are see-through type, meaning that when worn, ambient visible light can pass through the lenses, allowing the wearer to see the surrounding environment normally. Furthermore, the smart glasses can capture images of the surrounding environment to obtain the game visuals displayed on the screen of an electronic device within the user's field of vision.

[0045] In one embodiment, the smart glasses may include a smart glasses body and a camera module. The smart glasses body serves as the basic carrier of the smart glasses and may include a frame, temples connected to the frame, and lenses installed within the frame. The temples can be worn on either side of the user's head to secure the smart glasses. The lenses are transparent lenses, allowing visible light to pass through while simultaneously overlaying image information onto the user's actual field of vision. When gamers wear the smart glasses, in addition to seeing the external environment, they can also see notification information transparently overlaid by the smart glasses, effectively superimposing the notification information into the gamer's field of vision.

[0046] The camera module is integrated into the smart glasses themselves. For example, a camera module can be embedded in the front of the frame to capture game footage. The game footage is obtained by capturing images of the display interface of the electronic device running the game, such as the screen display of the player wearing the smart glasses. The camera module can be a high-definition wide-angle camera, a panoramic camera, or other cameras with high-quality shooting capabilities; this embodiment does not impose specific limitations. Only one specific example is given here: in this example, the camera module includes two high-definition wide-angle cameras, a left camera and a right camera, which are symmetrically mounted parallel to each other on the left and right sides of the front of the frame to cover a large area of ​​the game scene and ensure comprehensive and clear video data capture.

[0047] In some embodiments, after capturing a game screen, the smart glasses can determine a target key element in the game screen, acquire one or more steps of the mouse operation flow corresponding to the target key element, and determine a mouse parameter adjustment strategy based on the mouse operation flow. For this purpose, the smart glasses may also include a main control chip integrated into the smart glasses body, such as embedded in the temple or frame. This main control chip is connected to a camera module, receives the game screen captured by the camera module, and executes one or more steps of determining a target key element in the game screen, acquiring the mouse operation flow corresponding to the target key element, and determining a mouse parameter adjustment strategy based on the mouse operation flow. The main control chip can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0048] In one embodiment, during the process of using smart glasses to assist in dynamic mouse adjustments, eye-tracking data captured by the smart glasses can also be utilized. For this purpose, the smart glasses may further include an eye-tracking module integrated into the smart glasses body, used to monitor the user's eye movement trajectory and gaze point position in real time to obtain gaze data. The eye-tracking module is connected to the main control chip and can send the collected gaze data to the main control chip, allowing the main control chip to use this gaze data to assist in dynamic mouse adjustments. The eye-tracking module may include infrared LEDs and an image sensor, and employs PCCR (pupil-corneal reflection) technology to accurately acquire gaze point coordinates, pupil changes, blink frequency, etc. It can be understood that when using eye-tracking data during the process of using smart glasses to assist in dynamic mouse adjustments, the main control chip also analyzes the eye-tracking data to obtain gaze data, and then forms importance data based on the gaze data, user behavior data, and the correlation with preset key elements determined based on the game screen. Finally, based on the importance data, the target key elements in the game screen are obtained.

[0049] Furthermore, during the process of dynamically adjusting the mouse with the assistance of smart glasses, the smart glasses can also provide auxiliary reminders to the user. Specifically, after acquiring a target key element, the smart glasses monitor the reminder event corresponding to that key element; when a reminder event is detected, the smart glasses issue a reminder. The monitoring process for the reminder event can be executed by the main control chip or by an electronic device connected to the smart glasses, with the reminder operation performed through the smart glasses. For this purpose, the smart glasses can also include a multimodal prompting unit, integrated into the smart glasses body and connected to the main control chip. The multimodal prompting unit receives reminder information sent by the main control chip. This reminder information can be generated by the main control chip or generated and sent to the main control chip by an electronic device connected to the smart glasses. After receiving the reminder information, the multimodal prompting unit provides multimodal prompts according to the reminder information. These multimodal prompts include, but are not limited to, visual prompts, such as flashing icons or text of a preset color on the lenses; auditory prompts, such as playing preset sound effects or voice prompts; and tactile prompts, such as generating slight vibrations through the smart glasses. By using multimodal prompts, we can provide gamers with timely and effective game assistance in all aspects, helping them to participate in the game better.

[0050] Based on this, in some embodiments, the multimodal prompting unit may include an AI display unit, a tactile prompting unit, and an auditory prompting unit, all of which are connected to the main control chip. The auditory prompting unit may include a speaker, or a microphone array and a speaker, both integrated into the smart glasses body. For example, the microphone array and speaker can be embedded around the frame or temples to capture audio data through the microphone array and play auditory prompts through the speaker. The microphone array can be an omnidirectional microphone array, a directional microphone array, or other microphone arrays with high sensitivity and low noise characteristics; this embodiment does not impose specific limitations. Only one specific example is given here: in this example, the microphone array consists of four omnidirectional microphones arranged in a square around the frame to accurately capture audio data from multiple directions in the game scene, reducing blind spots in audio acquisition and ensuring the integrity and accuracy of the audio data.

[0051] The AI ​​display unit can employ technologies such as optical waveguides or Micro-OLED to transparently overlay visual alerts onto the lenses, providing visual cues to gamers wearing the smart glasses. For example, when a player approaches an enemy, the AI ​​display unit can display a green player icon on the lenses; when a player triggers a key skill, the AI ​​display unit can display the cooldown time of that skill on the lenses.

[0052] The haptic feedback unit, which can be a piezoelectric ceramic or an electromagnetic vibrator, is used to provide haptic feedback to the player according to the haptic cues in the reminder message. This haptic feedback unit supports haptic feedback of varying intensities. When the main control chip generates a reminder message, if a haptic feedback is required according to that message, the haptic feedback unit will generate a vibration of appropriate intensity based on the type of haptic feedback in the reminder message. For example, when the player approaches an enemy, the haptic feedback unit can generate a slight vibration to alert the player; when the player triggers a key skill or completes an important task, the haptic feedback unit can generate a strong vibration to provide the player with direct feedback.

[0053] Furthermore, since the smart glasses communicate with the peripheral mouse's electronic device or smart mouse, the smart glasses may also include a first communication module. This communication module can be a Wi-Fi communication module, a Bluetooth communication module, a ZigBee communication module, a cellular network communication module, an NFC communication module, etc., and this embodiment does not impose specific limitations. Of course, the peripheral mouse's electronic device or smart mouse is equipped with a second communication module corresponding to the first communication module in the smart glasses. The smart glasses and the peripheral mouse's electronic device or smart mouse establish a communication connection through the first and second communication modules.

[0054] In one embodiment, the game screen includes game elements, which may include characters, enemies, items, obstacles, etc. The target key element is a game element within the game screen, and this target key element is an element of user focus; for example, the target key element may be an enemy, a target object, an interactive button, etc.

[0055] In one embodiment, obtaining the target key element in the game screen specifically includes: S11, obtaining the preset game operation strategy corresponding to the game screen, and reading the preset key element in the preset game operation strategy; S12, selecting the candidate key element corresponding to the preset key element in the game screen, and obtaining the importance data of the candidate key element.

[0056] S13. Select the target key element from the candidate key elements based on the importance data.

[0057] In step S11, the preset game operation strategy is a pre-set operation guide or tactical plan corresponding to the game screen. The preset game operation strategy includes key elements that players may pay attention to during the game. Key elements are related to the core gameplay, such as enemies, important items, or interactive buttons. A preset game operation strategy database is pre-built, which includes several preset game operation strategy sets. Each preset game operation strategy set corresponds to a type of game or a specific game, and includes several preset game operation strategies for that type of game or specific game. Each preset game operation strategy can be an operation guide corresponding to a key element.

[0058] For example, the preset game operation strategy database includes preset game operation strategy sets for shooting games and preset game operation strategy sets for action games. The preset game operation strategy set for shooting games includes one preset game operation strategy: "Quickly identify enemy targets, rapidly move the mouse to a fixed position, stably approach and hover over the target area, and execute the shooting operation." The preset game operation strategy set for action games includes one preset game operation strategy: "When a preset icon is detected, it is determined to be an efficient skill. When the skill cooldown time reaches a preset time, remind the player to quickly move the mouse to a fixed position, and control the mouse to stably approach and hover over the target area to execute the skill release operation."

[0059] Furthermore, it should be noted that the preset game operation strategy can be continuously optimized through machine learning. For example, by analyzing the historical operation data of a large number of players in the same game scenario, a strategy model can be trained using a deep learning model; or, for a specific player, a personalized dynamic strategy can be generated by learning their personal operation habits and preferences over a long period of time.

[0060] Therefore, in one embodiment, obtaining the preset game operation strategy corresponding to the game screen specifically includes: identifying the game type corresponding to the game screen; and selecting a preset game operation strategy for the game screen based on the game type.

[0061] Specifically, game genres can include role-playing games, strategy games, and shooting games, among others. The game genre identification process matches game screenshots with a pre-defined game database to identify the game name corresponding to the screenshot, and finally determines the game genre corresponding to that name. The pre-built game database includes game data, such as game interface images, the corresponding game genres, and the correspondence between game genres and pre-defined game operation strategy sets. Furthermore, a pre-integrated game operation strategy database can be incorporated into the game database, meaning the pre-defined game database directly stores the pre-defined game operation strategy sets corresponding to different game genres.

[0062] For example, for shooting games, a preset game database stores the game data of the shooting game. The game data includes the game interface, the shooting game, and the preset game operation strategy corresponding to the shooting game. The preset game operation strategy is "quickly identify enemy targets, quickly move the mouse to a fixed position, stably approach and stay in the target area, and execute the shooting operation."

[0063] Of course, in practical applications, other methods can also be used to identify the game type corresponding to the game screen. For example, the game screen can be input into a pre-trained game type recognition model, and the game type recognition model can output the game type corresponding to the game screen. Alternatively, an image recognition model can be used to identify the game elements in the game screen, and then the identified game elements can be input into a pre-trained game type recognition model, and the game type recognition model can output the game type corresponding to the game screen.

[0064] Furthermore, after obtaining the game type, the corresponding preset game operation strategy can be searched in the preset game operation strategy database using that game type as the search index. The searched preset game operation strategy can be one or more. When there are multiple preset game operation strategies, the target key element is determined for each preset game operation strategy, and the process for determining the target key element is the same for each preset game operation strategy. Therefore, this explanation will use the search for a single preset game operation strategy as an example.

[0065] For example, if the game type is identified as a shooting game, a preset game operation strategy is found in the preset game operation strategy database based on the shooting game type. The preset game operation strategy is "quickly identify enemy targets, quickly move the mouse to a fixed position, steadily approach and stay in the target area, and perform shooting operation".

[0066] It's understandable that preset game operation strategies include preset key elements. For example, if the preset game operation strategy is "quickly identify enemy targets, rapidly move the mouse to a fixed position, steadily approach and stay in the target area, and execute the shooting operation," then the preset key element is the enemy target. Therefore, after obtaining the preset game operation strategy, the preset key elements can be read from it.

[0067] Furthermore, in step S12, after obtaining the preset key elements, candidate key elements are selected from the game screen based on the preset key elements. For example, when the preset key element is an enemy target, all enemy targets in the game screen can be identified to obtain candidate key elements. The selection process for candidate key elements can be as follows: using the preset key elements as conditional information, the game screen as input data, and a conditional recognition model to identify the game screen and output the identified candidate key elements. The target recognition model can be built based on deep learning algorithms and trained using a large amount of labeled game screen data to improve its recognition accuracy and generalization ability. For example, in shooting games, the target recognition model can identify candidate key elements such as enemy targets, weapons, and cover.

[0068] Importance data reflects the degree of importance of candidate key elements, serving as the basis for users to select target key elements from among them. Candidate key elements include multi-dimensional data information, such as relevance to preset key elements, user behavior data, and gaze data. Relevance to preset key elements can be determined through semantic analysis or feature matching, and may include the similarity between candidate and preset key elements and / or the degree of positional overlap between them. User behavior data may include mouse history data, such as a gamer's historical operation records (e.g., number of clicks), click frequency, or dwell time. Gaze data is derived from eye-tracking data captured by smart glasses and reflects the player's level of attention to candidate key elements, such as gaze duration and gaze frequency.

[0069] In one embodiment, the process of acquiring gaze data specifically includes: acquiring eye movement data captured by the smart glasses when acquiring the game screen; and acquiring the gaze duration and / or gaze frequency corresponding to the candidate key elements based on the eye movement data to obtain gaze data.

[0070] Specifically, eye-tracking data acquisition relies on the eye-tracking module built into the smart glasses, which can accurately capture the player's eye movement trajectory and gaze point. Gaze duration is the length of time the player's eyes linger on candidate key elements, and gaze frequency is the number of times the player gazes at a candidate key element per unit of time. Analyzing gaze duration and gaze frequency quantifies the player's attention to candidate key elements, thus providing a reference for importance data. For example, if a candidate key element has a long gaze duration and a high gaze frequency, it indicates that the candidate key element may be highly important to the player.

[0071] The gaze data is obtained by analyzing and processing eye-tracking data. Specifically, after acquiring the eye-tracking data, a pre-trained eye-tracking data analysis model is used to analyze the eye-tracking data to determine the player's gaze focus in the game screen. Then, combined with the positional information of candidate key elements, the gaze duration and gaze frequency of each candidate key element are calculated.

[0072] Furthermore, in step S13 above, after obtaining the importance data of the candidate key elements, the importance score of the candidate key elements can be determined based on the importance data, and then the target key element can be selected from the candidate key elements according to the importance score.

[0073] In one embodiment, the importance data includes relevance to preset key elements, user behavior data, and gaze data; the step of selecting a target key element from the candidate key elements based on the importance data specifically includes: obtaining the weight coefficients corresponding to the relevance to preset key elements, user behavior data, and gaze data, as well as the influence intensity coefficients corresponding to the user behavior data and gaze data; weighting and combining the relevance to preset key elements, user behavior data, and gaze data based on the obtained weight coefficients and influence intensity coefficients to obtain an importance score for the candidate key elements; and selecting a target key element from the candidate key elements based on the importance score.

[0074] Specifically, weighting coefficients reflect the relative importance of data items in the importance score. These data items include relevance to preset key elements, user behavior data, and attention data. The weighting coefficients for each data item can be set according to the actual application scenario and needs, or automatically learned through training a model. For example, in a game scenario, user behavior data has higher reference value for selecting target key elements, thus it can be assigned a higher weighting coefficient; while in another game scenario, attention data is more crucial for selecting target key elements, thus it can be assigned a higher weighting coefficient. The influence strength coefficient is used to adjust the actual role of the data items to ensure that the importance score more accurately reflects the true importance of the candidate key elements.

[0075] It should be noted that during the weighted combination process, to eliminate the influence of different units or numerical ranges on the calculation results, normalization can be performed on each data item. For example, the relevance to preset key elements, user behavior data, and gaze data may differ by orders of magnitude, and direct weighted combination may cause some factors to be ignored. Therefore, before calculation, each data item can be uniformly mapped to the same numerical range, such as [0,1], to ensure that each factor can participate fairly in the scoring calculation.

[0076] In one specific embodiment, the weighted combination formula for the importance score can be: ,in, Indicates importance score, Indicates the relevance to preset key elements. This represents the number of clicks in user behavior data. This represents the click frequency in user behavior data. This indicates the fixation duration in the fixation data. This indicates the fixation frequency in the fixation data. Indicates the weighting coefficient. This represents the influence intensity coefficient.

[0077] Furthermore, after obtaining the importance scores, candidate key elements can be sorted from highest to lowest importance score, and one or more candidate key elements with the highest importance scores can be selected as the target key element. If multiple candidate key elements have the same importance score, the final target key element can be determined through random selection, priority rules, or other predetermined strategies.

[0078] This application embodiment selects target key elements through multi-dimensional comprehensive evaluation. This not only improves the accuracy and rationality of the selection of target key elements, but also enhances the flexibility and adaptability of the system, enabling it to better meet the needs of complex and ever-changing game environments.

[0079] It should be noted that in practical applications, other methods can also be used to obtain target key elements. For example, target element categories can be preset, and after capturing the game screen, game element recognition can be performed on the game screen to obtain the element category of each game element in the game screen. Then, target key elements can be selected from all game elements based on the preset target element categories.

[0080] S20. Obtain the mouse operation flow corresponding to the target key element, and determine the mouse parameter adjustment strategy based on the mouse operation flow.

[0081] Specifically, the mouse operation flow is a process in which the player is about to perform an action when the target key element is used as a preset key element in the preset game operation strategy. In this context, the mouse operation flow is formed by predicting the player's actions based on the preset game operation strategy after using the target key element as a preset key element; that is, the mouse operation flow is a predictive operation flow.

[0082] In one embodiment, obtaining the mouse operation process corresponding to the target key element specifically includes: obtaining the preset game operation strategy corresponding to the game screen; using the target key element as the preset key element in the preset game operation strategy, and predicting the mouse operation process of performing game operations according to the preset game operation strategy.

[0083] Specifically, the preset game operation strategy includes preset key elements. After obtaining the target key element, it is used as a preset key element in the preset game operation strategy to form a preset game operation strategy regarding the target key element. Then, the mouse operations of the player during gameplay can be predicted according to this preset game operation strategy regarding the target key element to form a mouse operation flow. For example, the mouse operation flow is to first move the mouse quickly, and then move the mouse steadily after it reaches a preset position.

[0084] Furthermore, the mouse parameter adjustment strategy is a scheme to adjust mouse parameters according to the mouse operation process. Specifically, mouse parameters include one or more of the following: sensitivity, polling rate, acceleration, scan rate, and button response parameters. These mouse parameters can work together through firmware algorithms (such as sensor data processing and button pre-pressure calibration) and software settings (such as driver customization and in-game sensitivity) to affect the mouse's operating accuracy, response speed, and stability, ultimately influencing the user's "feel" (such as "responsiveness," "stability," and "click feedback").

[0085] After acquiring the mouse operation flow, the mouse parameters can be dynamically adjusted to suit the needs of gamers based on the predicted operation steps and rhythm in the preset game operation strategy. For example, sensitivity and acceleration can be increased during phases requiring rapid mouse movement, while sensitivity and acceleration can be decreased during phases requiring stable mouse movement to ensure precise operation.

[0086] In one embodiment, determining the mouse parameter adjustment strategy based on the mouse operation flow specifically includes: selecting at least one target mouse operation in the mouse operation flow and obtaining the triggering condition of the mouse operation; configuring mouse parameters for the target mouse operation and forming a mouse parameter adjustment strategy based on the mouse parameters and the triggering condition.

[0087] Specifically, the target mouse operation is the step that requires adjusting mouse parameters. In other words, there are several mouse operations within the mouse operation flow, and adjusting mouse parameters is necessary when executing each operation. For example, if the mouse operation flow involves quickly moving the mouse and then stabilizing it after reaching a preset position, then the target mouse operation is the step corresponding to the start of the quick mouse movement and the step that initiates the stable movement. Therefore, when selecting the target mouse operation within the mouse operation flow, one can select the mouse operation corresponding to the moment when the mouse operation mode changes, or one can pre-set selection criteria for the mouse operation and then select the mouse operation that meets those criteria within the mouse operation flow. Furthermore, in practical applications, historical real mouse operation flows corresponding to this mouse operation flow can be obtained. Using these historical real mouse operation flows as prior knowledge, a large model can be used to select the target mouse operation within this mouse operation flow.

[0088] The trigger condition is the specific situation or state required to execute the target mouse operation during gameplay. For example, the trigger condition could be the moment the mouse begins to move, or the distance between the mouse and the target key element reaching a preset distance threshold. This trigger condition is used to adjust mouse parameters. It can be a selection condition for the target mouse operation; for example, when selecting a target mouse operation, the selection condition is read and then used as the trigger condition. Therefore, the mouse parameter adjustment strategy includes mouse parameters and trigger conditions, and this strategy can include one set of mouse parameters and trigger conditions, or multiple sets of mouse parameters and trigger conditions. In other words, mouse parameters can be adjusted once or multiple times during the mouse operation process.

[0089] For example, if the mouse operation process involves first moving the mouse at high speed, and then, when the distance between the mouse and the target key element reaches a preset distance threshold, steadily approaching the target key element and stopping in the target area corresponding to the target key element, then the mouse parameter adjustment includes two sets of mouse parameters and triggering conditions. One set of mouse parameters and triggering conditions consists of the mouse parameters in racing mode and the start time of the mouse's high-speed movement. The other set of mouse parameters and triggering conditions consists of the mouse parameters in stable mode and the distance between the mouse and the target key element reaching the preset distance threshold.

[0090] It should be noted that mouse parameter adjustment strategies can include only mouse parameters, or, in addition to mouse parameters and triggering conditions, other constraints, such as the mouse movement direction being the target key element.

[0091] In one embodiment, when configuring mouse parameters for the target mouse operation, mouse parameters can be selected from a preset mouse parameter set. This preset mouse parameter set is pre-set and includes several mouse parameter modes, each corresponding to specific mouse parameters. Then, when selecting mouse parameters from the preset mouse parameter set for the target mouse operation, the mouse parameter model required by the target mouse operation can be determined first, and the corresponding mouse parameters for that mouse parameter mode can be used as the mouse parameters for the target mouse operation.

[0092] In one embodiment, mouse parameters include sensitivity, polling rate, acceleration, scan rate, and button response parameters. Mouse parameter modes include daily parameter mode, racing parameter mode, and stable parameter mode. The mouse parameters for sensitivity, polling rate, acceleration, scan rate, and button response in each mouse parameter mode can be: Sensitivity (DPI, dots per inch), a mouse parameter used to determine cursor movement speed, is the number of coordinate points sampled per inch by the sensor, directly related to the "physical distance the mouse moves" and the "distance the cursor moves on the screen" (e.g., 1000 DPI means the mouse moves 1 inch, the cursor moves 1000 pixels, etc.). Daily parameter mode: medium DPI (800-1200), balancing accuracy and movement efficiency; Racing parameter mode: medium-high DPI (800-1600) for quick switching; Stable parameter mode: low DPI (400-800) to ensure aiming accuracy (avoiding "drift").

[0093] Polling rate affects cursor smoothness and response latency. It is the frequency (in Hz) at which the mouse reports its position data to the computer. The higher the frequency, the smoother the cursor movement and the lower the response latency. In everyday use mode, 1000Hz meets daily needs (latency approximately 1ms). In racing mode, high polling rates (4000-8000Hz) are typically used in gaming scenarios to reduce input latency (e.g., an 8K polling rate means 8000 data reports per second, with a latency of approximately 0.125ms). In stable mode, high polling rates (4000-8000Hz) are typically used in gaming scenarios to reduce input latency (e.g., an 8K polling rate means 8000 data reports per second, with a latency of approximately 0.125ms).

[0094] Acceleration is a key variable affecting operational consistency. It relates the cursor movement distance to the mouse's physical movement speed (e.g., with acceleration enabled, the cursor will move further when moving the mouse quickly than when moving it slowly). The parameters are: Normal mode: Acceleration off; Racing mode: Acceleration on; Stable mode: Acceleration off. Scan rate (frame rate) is a low-level parameter affecting sensor tracking accuracy. It is the number of image frames captured by the sensor per second (in FPS). A higher frame rate results in more accurate recognition of the mousepad texture, especially during fast movements (such as "flicking"), reducing the likelihood of dropped frames. The parameters are: Normal mode: 5000-10000 FPS; Racing mode: High scan rate (10000-20000 FPS); Stable mode: 5000-10000 FPS.

[0095] Key response parameters are core factors affecting click feedback, including Actuation Force, Debounce Time, and Pre-travel. Debounce Time can be adjusted in real time via firmware. The parameters are as follows: Normal parameter mode: High Debounce Time (≤5ms); Racing parameter mode: Low Debounce Time (≤10ms); Stable parameter mode: High Debounce Time (≤5ms).

[0096] In one embodiment, mouse parameters include sensitivity, polling rate, acceleration, scan rate, and button response parameters. Mouse parameter modes include daily parameter mode, racing parameter mode, stable parameter mode, RPG pathfinding parameter mode, and RPG dialogue parameter mode. In the daily parameter mode, racing parameter mode, stable parameter mode, RPG pathfinding parameter mode, and RPG dialogue parameter mode, the sensitivity, polling rate, acceleration, scan rate, and button response parameters can be as shown in Table 1.

[0097] Table 1. Parameters for Sensitivity, Rate of Return, Acceleration, Scan Rate, and Key Response

[0098] It should be noted that the two embodiments described above only provide specific examples of mouse parameters and do not limit the mouse parameters. In practical applications, mouse parameters in the mouse parameter adjustment strategy can be set according to the actual situation. Furthermore, large-scale model learning games and toys can be used to form formal mouse parameter patterns and the corresponding mouse parameters for those patterns.

[0099] S30. Adjust the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation process.

[0100] Specifically, adjusting mouse parameters according to the aforementioned mouse parameter adjustment strategy means adjusting the mouse parameters according to this strategy while the player is performing actions targeting a key element in the game. Of course, in practical applications, if the player's actual target is not a key element, the mouse parameters will not be adjusted according to this strategy. Alternatively, the mouse parameters can remain unchanged, or a new mouse parameter adjustment strategy can be determined based on the player's actual target, and the mouse parameters will be adjusted according to the new strategy.

[0101] In one embodiment, the mouse parameter adjustment strategy includes at least one mouse parameter group, which includes mouse parameters and trigger conditions. Therefore, adjusting the mouse parameters according to the mouse parameter adjustment strategy to adapt the mouse parameters to the mouse operation process specifically includes: monitoring the trigger conditions in the mouse parameter adjustment strategy; when a trigger condition is detected to be met, obtaining the mouse parameters corresponding to the trigger condition, and configuring the mouse parameters based on the mouse parameters to adjust the mouse parameters.

[0102] Specifically, when monitoring trigger conditions, the system monitors mouse operation-related status data in real time during gameplay. This data can include mouse movement direction, mouse movement trajectory, and the distance between the mouse and target key elements. Based on this data, it determines whether the trigger condition is met. For example, if the trigger condition is that the distance between the mouse and the target key element reaches a preset distance threshold, then when this threshold is detected, the trigger condition is considered met. Then, upon detecting that the trigger condition is met, the system acquires the corresponding mouse parameters and configures the mouse settings accordingly.

[0103] For example, when the mouse parameter adjustment includes two sets of mouse parameters and trigger conditions, one set of mouse parameters and trigger conditions is the mouse parameters in racing mode and the starting moment when the mouse begins to move at high speed, and the other set of mouse parameters and trigger conditions is the mouse parameters in stable mode and the distance between the mouse and the target key element reaches a preset distance threshold, the mouse parameters will be adjusted twice when playing the game according to the mouse operation process. The first adjustment is to adjust the mouse parameters to the mouse parameters in racing mode so that the cursor can quickly approach the target key element; the second adjustment is to adjust the mouse parameters to the mouse parameters in stable mode to ensure accurate clicking.

[0104] In a specific shooting game implementation, the target key element is assumed to be the "enemy player". The mouse parameter adjustment strategy includes two parameter groups: the trigger condition for parameter group A (high DPI, high polling rate) is "the mouse starts moving towards the enemy player"; the trigger condition for parameter group B (low DPI, high polling rate, acceleration off) is "the distance between the mouse cursor and the enemy player model on the screen is less than 50 pixels".

[0105] The monitoring process is as follows: the smart glasses continuously analyze the game screen and calculate the real-time distance D between the mouse cursor and the enemy player. When the mouse displacement vector is detected pointing towards the enemy player and the displacement speed exceeds a preset threshold V, trigger condition A is deemed met, and the electronic device immediately switches the mouse parameters to high DPI mode. Subsequently, when the real-time distance D is less than 50 pixels for the first time, trigger condition B is deemed met, and the electronic device immediately switches the mouse parameters to a low DPI stable aiming mode. Through this phased dynamic parameter adjustment, a perfect combination of 'rapid aiming' and 'precise aiming' is achieved.

[0106] It should be noted that when the mouse parameter adjustment strategy only includes mouse parameters, adjusting the mouse parameters according to the strategy means that the mouse parameters are adjusted immediately after the strategy is generated. Specifically, when the mouse parameter adjustment strategy includes one mouse parameter, that mouse parameter is automatically configured. When the strategy includes multiple mouse parameters, the game player can interact with the smart glasses to select a target mouse parameter from the multiple parameters, and that target mouse parameter is automatically configured.

[0107] In addition, in practical applications, to avoid operation lag or accidental touches caused by frequent switching of mouse parameters, it is possible to check whether the current time meets the preset adjustment requirements before obtaining the mouse parameter adjustment strategy or before adjusting the mouse parameters based on the mouse parameter adjustment strategy. The preset adjustment requirements can be that the distance between the mouse position and the target key element is greater than a set distance threshold, etc.

[0108] For example, before adjusting the mouse parameters according to the mouse parameter adjustment strategy to make the mouse parameters adapt to the mouse operation process, the method further includes: obtaining the positional relationship between the current mouse position and the target key element; if the positional relationship meets the preset adjustment requirements, then adjusting the mouse parameters according to the mouse parameter adjustment strategy to make the mouse parameters adapt to the mouse operation process; if the positional relationship does not meet the preset adjustment requirements, then discarding the mouse parameter adjustment strategy.

[0109] Specifically, the preset adjustment requirements are pre-set. For example, the preset adjustment requirements could be set to a distance greater than 200 pixels between the mouse position and the target key element on the screen, providing sufficient adjustment time for mouse parameters (i.e., the movement time between the mouse moving to the set position corresponding to the target key element). For example, in a shooting game, if the player's mouse cursor is very close to the enemy player (e.g., less than 200 pixels away), adjusting the parameters at this time might cause the cursor to suddenly change speed, affecting aiming accuracy. Therefore, in this case, the mouse parameter adjustment strategy should be discarded, and the current parameters should remain unchanged. Conversely, if the player's mouse cursor is far from the enemy player (e.g., more than 200 pixels away), the mouse parameters are adjusted according to the aforementioned mouse parameter adjustment strategy to optimize subsequent fast movement or precise aiming.

[0110] Furthermore, it should be noted that the mouse parameter adjustment method provided in this application is a cyclical process. Specifically, after completing one mouse parameter adjustment, the system re-enters the mouse operation flow analysis phase, that is, it re-executes the steps of identifying the mouse operation flow, determining the target key elements, generating a new mouse parameter adjustment strategy, and adjusting the parameters according to the strategy. This cyclical mechanism ensures that the mouse parameters are always dynamically adapted to the current operation needs of the game player. For example, in a shooting game, after the player completes aiming and shooting at an enemy target, the system automatically analyzes the next possible target key elements (such as a new enemy player, item pickup point, etc.), and based on the new target key elements and the expected mouse operation flow, regenerates and applies the corresponding mouse parameter adjustment strategy, thereby achieving continuous optimization of mouse performance throughout the game.

[0111] In summary, this embodiment provides a method for dynamic mouse adjustment. The method includes acquiring a game screen through smart glasses and acquiring target key elements in the game screen; acquiring the mouse operation flow corresponding to the target key elements and determining a mouse parameter adjustment strategy based on the mouse operation flow; and adjusting the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters adapt to the mouse operation flow. This application constructs a collaborative working mechanism between smart glasses and mouse peripherals through data interaction between smart glasses and electronic devices, fully leveraging the advantages of the multimodal perception capabilities of smart glasses. It enables mouse parameter adjustment assisted by smart glasses, reducing the frequency of manual adjustments by players. This improves the adaptability of mouse parameters to the game scene and enhances the game immersion and competitive performance of players.

[0112] Based on the above-described mouse dynamic adjustment method, this embodiment provides a mouse dynamic adjustment device, as shown in Figure 3. The mouse dynamic adjustment device specifically includes: an acquisition module 100, used to acquire a game screen through smart glasses and acquire target key elements in the game screen; a determination module 200, used to acquire the mouse operation flow corresponding to the target key elements and determine a mouse parameter adjustment strategy based on the mouse operation flow; and an adjustment module 300, used to adjust the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation flow.

[0113] Based on the above-described mouse dynamic adjustment method, this embodiment provides a computer-readable storage medium storing one or more programs that can be executed by one or more processors to implement the steps in the mouse dynamic adjustment method described in the above embodiment.

[0114] Based on the above-described dynamic mouse adjustment method, this application also provides a terminal device, as shown in FIG4, which includes at least one processor 20; a display screen 21; and a memory 22, and may further include a communications interface 23 and a bus 24. The processor 20, display screen 21, memory 22, and communications interface 23 can communicate with each other via the bus 24. The display screen 21 is configured to display a preset user guide interface in the initial setup mode. The communications interface 23 can transmit information. The processor 20 can call logical instructions in the memory 22 to execute the methods described in the above embodiments.

[0115] Furthermore, the logical instructions in the aforementioned memory 22 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium.

[0116] The memory 22, as a computer-readable storage medium, can be configured to store software programs, computer-executable programs, such as program instructions or modules corresponding to the methods in the embodiments of this disclosure. The processor 20 executes functional applications and data processing by running the software programs, instructions, or modules stored in the memory 22, thereby implementing the methods in the above embodiments.

[0117] The memory 22 may include a program storage area and a data storage area. The program storage area may store the operating system and application programs required for at least one function; the data storage area may store data created based on the use of the terminal device. Furthermore, the memory 22 may include high-speed random access memory (RAM) and non-volatile memory. Examples include various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks, as well as transient storage media.

[0118] Furthermore, the specific process of loading and executing multiple instruction processors in the aforementioned storage medium and terminal device has been described in detail in the above method, and will not be repeated here.

[0119] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for dynamically adjusting a mouse, characterized in that, The mouse dynamic adjustment method specifically includes: acquiring a game screen through smart glasses and acquiring target key elements in the game screen; acquiring the mouse operation flow corresponding to the target key elements and determining a mouse parameter adjustment strategy based on the mouse operation flow; adjusting the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation flow.

2. The mouse dynamic adjustment method according to claim 1, characterized in that, The specific steps of obtaining the target key element in the game screen include: obtaining a preset game operation strategy corresponding to the game screen, and reading preset key elements in the preset game operation strategy; selecting candidate key elements corresponding to the preset key elements in the game screen, and obtaining importance data of the candidate key elements, wherein the importance data includes one or more of the following: correlation with the preset key elements, user behavior data, and gaze data; and selecting the target key element from the candidate key elements based on the importance data.

3. The mouse dynamic adjustment method according to claim 2, characterized in that, The process of acquiring gaze data specifically includes: acquiring eye movement data captured by the smart glasses when acquiring the game screen; and acquiring the user's gaze duration and / or gaze frequency on the candidate key elements based on the eye movement data to obtain gaze data.

4. The mouse dynamic adjustment method according to claim 2, characterized in that, The correlation with the preset key element includes the similarity between the candidate key element and the preset key element and / or the positional overlap between the candidate key element and the preset key element.

5. The mouse dynamic adjustment method according to any one of claims 2-4, characterized in that, The importance data includes relevance to preset key elements, user behavior data, and attention data. The selection of a target key element from the candidate key elements based on the importance data specifically includes: obtaining the weight coefficients corresponding to the relevance to preset key elements, user behavior data, and attention data, as well as the influence intensity coefficients corresponding to the user behavior data and attention data; weighting and combining the relevance to preset key elements, user behavior data, and attention data based on the obtained weight coefficients and influence intensity coefficients to obtain an importance score for the candidate key element; and selecting a target key element from the candidate key elements based on the importance score.

6. The mouse dynamic adjustment method according to claim 1, characterized in that, The specific steps of obtaining the mouse operation process corresponding to the target key element include: obtaining the preset game operation strategy corresponding to the game screen; using the target key element as the preset key element in the preset game operation strategy, and predicting the mouse operation process of performing game operations according to the preset game operation strategy.

7. The mouse dynamic adjustment method according to claim 2 or 6, characterized in that, The step of obtaining the preset game operation strategy corresponding to the game screen specifically includes: identifying the game type corresponding to the game screen; and selecting a preset game operation strategy for the game screen based on the game type.

8. The mouse dynamic adjustment method according to claim 1, characterized in that, The specific steps of determining the mouse parameter adjustment strategy based on the mouse operation process include: selecting at least one target mouse operation in the mouse operation process and obtaining the triggering conditions of the mouse operation; configuring mouse parameters for the target mouse operation and forming a mouse parameter adjustment strategy based on the mouse parameters and the triggering conditions.

9. The mouse dynamic adjustment method according to claim 1, characterized in that, The mouse parameter adjustment strategy includes at least one mouse parameter group, which includes mouse parameters and trigger conditions. The step of adjusting the mouse parameters according to the mouse parameter adjustment strategy to adapt the mouse parameters to the mouse operation process specifically includes: monitoring the trigger conditions in the mouse parameter adjustment strategy; when the trigger conditions are detected to be met, obtaining the mouse parameters corresponding to the trigger conditions, and configuring the mouse parameters based on the mouse parameters to adjust the mouse parameters.

10. The mouse dynamic adjustment method according to claim 1, characterized in that, The mouse parameters include one or more of the following: sensitivity, polling rate, acceleration, scan rate, and button response parameters.

11. The mouse dynamic adjustment method according to claim 1, characterized in that, The method further includes: after acquiring the target key element, monitoring the reminder event corresponding to the target key element; when the reminder event is detected, providing a reminder through smart glasses, wherein the reminder includes one or more of visual reminders, tactile reminders, and auditory reminders.

12. The mouse dynamic adjustment method according to claim 1, characterized in that, Before adjusting the mouse parameters according to the mouse parameter adjustment strategy to make the mouse parameters adapt to the mouse operation process, the method further includes: obtaining the positional relationship between the current mouse position and the target key element; if the positional relationship meets the preset adjustment requirements, then adjusting the mouse parameters according to the mouse parameter adjustment strategy to make the mouse parameters adapt to the mouse operation process; if the positional relationship does not meet the preset adjustment requirements, then discarding the mouse parameter adjustment strategy.

13. A dynamic adjustment device for a mouse, characterized in that, The aforementioned mouse dynamic adjustment device specifically includes: an acquisition module, used to acquire a game screen through smart glasses and acquire target key elements in the game screen; a determination module, used to acquire the mouse operation flow corresponding to the target key elements and determine a mouse parameter adjustment strategy based on the mouse operation flow; and an adjustment module, used to adjust the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation flow.

14. A dynamic mouse adjustment system, characterized in that, The aforementioned dynamic mouse adjustment system includes smart glasses and an electronic device, with a mouse externally mounted on the electronic device. The smart glasses are used to capture game footage, obtain target key elements in the game footage, obtain the mouse operation flow corresponding to the target key elements, determine a mouse parameter adjustment strategy based on the mouse operation flow, and send the mouse parameter adjustment strategy to the electronic device. The electronic device is used to adjust the mouse parameters according to the mouse parameter adjustment strategy so that the mouse parameters are adapted to the mouse operation flow.

15. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores one or more programs, which can be executed by one or more processors to implement the steps in the mouse dynamic adjustment method as described in any one of claims 1-12.

16. A terminal device, characterized in that, include: A processor and a memory; the memory stores a computer-readable program that can be executed by the processor; when the processor executes the computer-readable program, it implements the steps of the mouse dynamic adjustment method as described in any one of claims 1-12.

Images