An input device

Abstract

The application provides an input device, comprising: a first mouse, provided with a cockpit structure at the bottom, used for collecting first motion data of a motion object when a first preset condition is met, and generating first event data based on the first motion data, and sending the first event data, the first event data being used for a receiving end of the first event data to execute an operation corresponding to the first event data; and a second mouse, detachably arranged in the cockpit structure, used for collecting second motion data of the motion object when a second preset condition is met, and generating an operation type and operation parameters based on the second motion data and a motion mapping library, and sending the operation type and operation parameters to the receiving end, so that the receiving end executes an operation corresponding to the operation type and operation parameters. The first mouse integrated with the cockpit structure and the detachable second mouse make the single device have two independent input modes, thereby improving the selectivity and flexibility of user control.

Description

Technical Field

[0001] This application relates to the field of computer technology, and more particularly to an input device. Background Technology

[0002] As an important tool for human-computer interaction, the way the mouse is operated directly affects the user experience. Traditional mice need to be placed on a work surface for use, and limited commands are triggered by mechanical buttons. Their functions are limited, and prolonged use can easily lead to hand fatigue. Summary of the Invention

[0003] This application provides an input device to at least solve the above-mentioned technical problems existing in the prior art.

[0004] According to a first aspect of this application, an input device is provided, the input device comprising: The first mouse has a cockpit structure on the bottom, which is used to collect first motion data of a moving object when the first preset conditions are met, and generate first event data based on the first motion data and send the first event data. The first event data is used for the receiving end of the first event data to perform an operation corresponding to the first event data. The second mouse is detachably installed in the cockpit structure and is used to collect second motion data of the moving object when the second preset conditions are met. Based on the second motion data and the motion mapping library, it generates an operation type and operation parameters and sends the operation type and operation parameters to the receiving end. The operation type and operation parameters are used for the receiving end to perform the operation corresponding to the operation type and operation parameters.

[0005] In one possible implementation, the first preset condition is that the first mouse is in a working state of moving on the control panel; The second preset condition is that the second mouse is in an active state that is separated from the cockpit structure and is powered on.

[0006] In one possible implementation, the motion mapping library stores multiple reference motion feature data and the operation type corresponding to each reference motion feature data; The generation of operation type and operation parameters based on the second motion data and motion mapping library includes: Based on the second motion data, determine the pose data of the moving object in space; The pose data is compared with multiple reference motion feature data stored in the motion mapping library to determine the matching reference motion feature data. The corresponding operation type is determined based on the matched baseline motion feature data; Based on the pose data, determine the operation parameters corresponding to the operation type.

[0007] In one possible implementation, the second mouse is used for: The receiver receives the operation execution result sent by the receiving end; wherein the operation execution result is generated by the receiving end after calling the operating system interface to trigger the corresponding application to execute the operation corresponding to the operation type and the operation parameters based on the operation type and the operation parameters; The operation execution result is associated with and stored in conjunction with the corresponding operation type, operation parameters, and second motion data.

[0008] In one possible implementation, the second mouse is used for: The receiver receives a re-identification command to re-acquire the second motion data of the moving object. The re-identification instruction is information generated by the receiving end when it detects that the confirmation of the operation result by the moving object does not meet expectations.

[0009] In one possible implementation, the second mouse is used for: The accumulated execution results of multiple operations, along with the second motion data, operation type, and operation parameters corresponding to each operation execution result, are uploaded to the cloud via the receiving end. This allows the cloud to iteratively optimize the motion mapping library based on the multiple operation execution results and the second motion data, operation type, and operation parameters corresponding to each operation execution result, using a pre-trained type recognition model, and generate updated firmware. The updated firmware includes a new motion mapping library. The receiver receives the updated firmware downloaded and transmitted from the cloud, and updates the motion mapping library to the new motion mapping library based on the updated firmware.

[0010] In one possible implementation, the second mouse includes: A gyroscope is used to collect the rotational motion data; An accelerometer is used to collect the linear motion data.

[0011] In one embodiment, the cockpit structure is provided with a magnetic attraction component and charging contacts; The magnetic attachment component is used to magnetically fix the second mouse to the cockpit structure; The charging contact is used to contact the corresponding contact on the second mouse when the second mouse is fixed inside the cockpit structure, so as to enable the first mouse to charge the second mouse.

[0012] In one possible implementation, the first mouse has a built-in first battery, a first charging management module, and a charging interface; the second mouse has a built-in second battery and a second charging management module. The charging interface is used to connect to an external power source to power the first mouse based on the external power source; When the second mouse is fixed inside the cockpit structure, the charging contact is electrically connected to the first charging management module and the second charging module, so that the first battery can charge the second battery through the first charging management module, the charging contact, and the second charging module; The second charging management module is used to power the second mouse through the second battery.

[0013] In one possible implementation, the second mouse has a built-in first Bluetooth module; When the second mouse is fixed inside the cockpit structure, the first Bluetooth module is in standby mode; When the second mouse meets the second preset condition, the first Bluetooth module establishes a communication connection with the receiving end to enable communication between the second mouse and the receiving end.

[0014] The input device of this application, by setting up a first mouse with a cockpit structure at the bottom and a second mouse detachably installed within the cockpit structure, enables a single device to simultaneously possess two independent input methods, improving the user's choice and flexibility in operation. Furthermore, by introducing a motion mapping library only on the second mouse end, it avoids the burden and scenario limitations caused by deploying a motion mapping library on the terminal and participating in operation type recognition.

[0015] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this application, nor is it intended to limit the scope of this application. Other features of this application will become readily apparent from the following description. Attached Figure Description

[0016] The above and other objects, features, and advantages of exemplary embodiments of this application will become readily apparent from the following detailed description taken in conjunction with the accompanying drawings. Several embodiments of this application are illustrated in the drawings by way of example and not limitation, in which: In the accompanying drawings, the same or corresponding reference numerals indicate the same or corresponding parts.

[0017] Figure 1 A schematic diagram of the composition structure of the input device provided in an embodiment of this application is shown; Figure 2 A schematic diagram illustrating the dual-operation mode of the input device provided in an embodiment of this application is shown; Figure 3 A schematic diagram illustrating the interaction process between the second mouse and the receiving end provided in an embodiment of this application is shown. Figure 4A schematic diagram of the firmware update process provided in an embodiment of this application is shown; Figure 5 A hardware architecture diagram of the input device provided in an embodiment of this application is shown. Detailed Implementation

[0018] To make the objectives, features, and advantages of this application more apparent and understandable, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0019] In the field of computer peripherals, the mouse, as a mainstream human-computer interaction input device, significantly impacts users' work and entertainment efficiency through its user experience. Traditional mice rely on the control panel for displacement detection and command input, and can only trigger limited commands through mechanical buttons. The gesture operation is monotonous, and long-term use can easily lead to hand muscle strain, resulting in "mouse hand," failing to meet diverse control needs.

[0020] While touch mice eliminate mechanical buttons and expand the types of trigger commands, their reliance on a console limits their operational flexibility, making them unsuitable for mobile work or console-less scenarios. Newer ring-type control mice, while overcoming console limitations and achieving spatial control flexibility and significantly reducing device size, generally suffer from complex command systems, high user memorization costs, and insufficient gesture recognition accuracy. These issues not only reduce the user experience but also hinder the market penetration of these new types of mice. Therefore, to address the aforementioned technical problems, this application provides an input device.

[0021] Figure 1 A schematic diagram of the composition structure of the input device provided in an embodiment of this application is shown.

[0022] refer to Figure 1 This application provides an input device, which includes a first mouse and a second mouse.

[0023] The first mouse has a cockpit structure at its bottom, which is used to collect first motion data of the moving object when the first preset conditions are met, generate first event data based on the first motion data, and send the first event data. The first event data is used to enable the receiving end of the first event data to perform the operation corresponding to the first event data.

[0024] Specifically, the first mouse can be a traditional mouse, retaining the appearance, structure, and functions of a traditional mouse. It supports grip-based operation, and this compatibility design increases user acceptance of the improved mouse and facilitates wider adoption. To allow for flexible switching between dual operation modes, the first mouse has a housing structure 03 on its bottom. This housing structure 03 is used to detachably house a second mouse (e.g., a ring mouse). The shape of the housing structure 03 matches the shape of the second mouse, ensuring a close fit when the second mouse is placed inside. This not only facilitates carrying and storage but also protects the second mouse from dust and water damage. When the second mouse is removed from the housing structure 03, the first mouse can still be used as an independent traditional mouse, and the second mouse can also be used as an independent input device. Specific recesses can be provided on both sides of the housing structure 03, allowing users to easily place and remove the second mouse, improving usability.

[0025] The first mouse is used to operate when a first preset condition is met. The first preset condition refers to the state in which the first mouse is in its normal working mode, such as when the first mouse is placed on a work surface (such as a desktop, mouse pad, etc.) and moved and operated by the user. In this state, the first mouse collects displacement data relative to the work surface in real time through its internal displacement detection module (such as a photoelectric sensor), and collects operation data of the user on the first mouse buttons (including left button, right button, scroll wheel, etc.) through its internal button detection module. The above displacement data and operation data together constitute the first motion data.

[0026] The first mouse is also used to generate corresponding first event data based on the collected first motion data. Specifically, the first main control unit (e.g., MCU) inside the first mouse processes the first motion data and converts it into standardized input events that the receiving end can recognize and process, i.e., first event data. The first event data includes at least mouse movement events generated based on displacement data (containing information on the amount of cursor movement in the horizontal and vertical directions), and mouse button events generated based on button click operation data (including single-click events, double-click events, scroll wheel events, etc.). The first mouse sends the generated first event data to the receiving end through its built-in communication module (e.g., Bluetooth module or 2.4GHz wireless module).

[0027] In one embodiment of this application, the receiving end can be a terminal device communicatively connected to the first mouse, such as a personal computer, laptop, tablet computer, smart TV, or other electronic device with display and processing capabilities. After receiving the first event data, the receiving end performs corresponding operations based on the type of the first event data. For example, when the first event data is a mouse movement event, the receiving end parses the movement amount information and moves the cursor a corresponding distance and direction on the display interface; when the first event data is a mouse click or double-click event, the receiving end triggers the function corresponding to the icon, control, or area currently pointed to by the cursor (e.g., selecting an icon, opening a file, confirming an operation, etc.); when the first event data is a scroll wheel event, the receiving end controls the content of the currently active window to scroll up and down. Through the above method, the first mouse, when meeting the first preset conditions, can achieve the same input control functions as a traditional mouse.

[0028] The second mouse is detachably installed inside the cockpit structure. When the second preset conditions are met, it is used to collect the second motion data of the moving object, generate operation type and operation parameters based on the second motion data and the motion mapping library, and send the operation type and operation parameters to the receiving end. The operation type and operation parameters are used by the receiving end to perform the operation corresponding to the operation type and operation parameters.

[0029] Specifically, the second mouse can be a ring-shaped mouse, which can be worn on any finger or toe of the user to achieve spatial control. The second mouse operates when a second preset condition is met. The second preset condition refers to the second mouse being in an active state, separated from the cockpit structure 03 and powered on. That is, the second mouse is removed from the cockpit structure 03 of the first mouse and has been activated and is ready to work. In this state, the second mouse collects second motion data of the moving object (i.e., the user) through its internal sensor module. The second motion data represents the dynamic motion data of the moving object in three-dimensional space, that is, all the movements of the moving object in the air, including data on the movement and rotation of the moving object in the air.

[0030] In one embodiment of this application, the second mouse internally includes at least a second main control unit (e.g., a microcontroller unit (MCU), a storage module, and a first Bluetooth module. When the second mouse is fixed within the cockpit structure, the first Bluetooth module is in standby mode. When the second mouse meets a second preset condition, the first Bluetooth module establishes a communication connection with the receiving end to enable communication between the second mouse and the receiving end. The storage module pre-stores a motion mapping library, which contains multiple pre-configured operation types and standardized data templates corresponding to each operation type. The motion mapping library supports a wide range of operation types, incorporating user-friendly and easy-to-use gestures to achieve efficient and personalized operation of the terminal device. The standardized data templates represent a direct comparison benchmark for identifying the user's actual operation type, including standard motion characteristic data corresponding to various operation types, such as preset movement direction, movement amplitude, movement speed, rotation angle, number of rotations, and rotation speed.

[0031] After acquiring the second motion data, the second main control unit processes the data to conform to the standardized data template format and compares it with the motion mapping library to obtain the matching operation type. The operation type characterizes the category of spatial motion performed by the moving object, such as click, click + move, continuous double-click, swipe left, swipe right, swipe up and down, clockwise rotation, counter-clockwise rotation, and hand-drawing. Users can input symbols, letters, and graphics through hand-drawing gestures, such as drawing an X, a checkmark, or a triangle.

[0032] The operation type only indicates the category of action, such as swiping, rotating, or clicking. However, in actual execution, it is also necessary to know the specific quantitative information required to perform this type of action, such as the direction and distance of swiping, the angle and number of rotations, and the coordinates of the click location. Therefore, in addition to identifying the operation type, it is also necessary to obtain the operation parameters corresponding to the operation type. The operation parameters are the specific quantitative information required to perform the action corresponding to the operation type, which can be extracted directly by solving the second motion data. After obtaining the operation type and operation parameters, the second main control unit sends the operation type and operation parameters to the receiving end through the first Bluetooth module.

[0033] After receiving the operation type and operation parameters, the receiving end can identify the meaning of the operation type and operation parameters, and call the corresponding function interface of its own operating system or application to execute the operation corresponding to the operation type and operation parameters.

[0034] It should be noted that the receiving end can recognize the meaning of the operation type and operation parameters because the receiving end acquires the corresponding parsing capabilities when the second mouse first establishes a communication connection with it. Specifically, after the second mouse successfully pairs with the receiving end for the first time, the receiving end will automatically pop up a prompt message, guiding the moving object to download and install the corresponding driver. This driver has the following functions: First, it is used for device identification and initialization of the second mouse, ensuring that the receiving end can correctly identify the device type and communication protocol of the second mouse. Second, it is used for protocol conversion, converting the physical electrical signals sent by the second mouse into standard instructions that the receiving end's operating system can parse, thereby establishing a correspondence between the operation type and operation parameters and the specific operation (function). For example, when the operation type is "click", it selects a target according to the operation parameters; when the operation type is "click + move", it selects multiple targets according to the operation parameters; when the operation type is "double-click", it opens the target according to the operation parameters; when the operation type is "left swipe", it controls the cursor to move to the left or flip the target to the left according to the operation parameters; when the operation type is "...", it selects the target ... When swiping right, the cursor moves to the right or flips the target to the right, depending on the operation parameters. When the operation type is "swiping up and down," the cursor moves up and down or scrolls the target, depending on the operation parameters. When the operation type is "rotating clockwise," the target is zoomed in, depending on the operation parameters. When the operation type is "rotating counterclockwise," the target is zoomed out, depending on the operation parameters. When the operation type is "drawing an X," the target is closed, depending on the operation parameters. When the operation type is "drawing a √," the target is opened, depending on the operation parameters. When the operation type is "drawing a △," the device screen is locked, depending on the operation parameters. Thirdly, it is used to establish a communication channel with a remote server (cloud), laying the foundation for subsequent firmware information upload and download.

[0035] In one embodiment of this application, the motion mapping library can be a basic version or an iteratively updated version. Specifically, when the second mouse is first used, since sufficient personalized operation data has not yet been accumulated, its motion mapping library is a basic version, pre-configured by the initial firmware information, used to provide basic operation type recognition capabilities and to perform benchmark comparison of motion features when the moving object first uses the second mouse. After multiple uses and the accumulation of a certain amount of operation data, the motion mapping library can be updated based on this data to form an iteratively updated version, so that it can adapt to the operating habits of different moving objects and improve the accuracy of operation type recognition, thereby optimizing the user experience.

[0036] Thus, this embodiment of the application, while being compatible with users' traditional mouse usage habits, innovatively embeds a miniaturized ring mouse, supporting two mouse control methods: the mouse can be placed on a platform for operation, or the ring mouse can be removed for independent operation. The ring can be worn on any finger / toe, and the control targets support various terminal devices such as computers, monitors, and iPads, greatly enriching the choices and flexibility of mouse use for various user groups, alleviating the work pressure on the index finger / shoulder and neck when using a traditional mouse, and is especially convenient for people with disabilities and mobile application scenarios. At the same time, this application only introduces a motion mapping library on the second mouse end, and the second mouse independently completes the acquisition of second motion data, the identification of operation types, and the generation of operation parameters. The receiving end only needs to establish the correspondence between operation types and operation parameters and specific operations through the driver program to execute the corresponding functions, avoiding the problems of limited application scenarios and reduced flexibility caused by the terminal introducing a motion mapping library and participating in the operation type identification process.

[0037] Figure 2 A schematic diagram illustrating the dual-operation modes of the input device provided in this application embodiment is shown. To further understand the two operation modes of this application, the following is in conjunction with... Figure 2 Let's illustrate this with a specific application example.

[0038] like Figure 2 As shown, the input device provided in this application supports two operation modes: Mode 1 is traditional handheld mouse control, where the first mouse moves on the control panel and communicates with the terminal device (such as a personal computer, tablet, smart TV, etc.) via Bluetooth; Mode 2 is a novel joint-worn mouse control, where a second mouse is removed from the cockpit structure 03 and worn on the user's fingers or toes for movement control in space, also communicating with the terminal device via Bluetooth. The terminal device can connect to a cloud server via the Internet or Wi-Fi for subsequent data interaction and iterative optimization of the motion mapping library. By combining these two methods, users can flexibly choose the control mode according to the usage scenario, achieving a diverse interactive experience.

[0039] In one embodiment of this application, a motion mapping library stores multiple reference motion feature data and an operation type corresponding to each reference motion feature data. The process of generating operation types and operation parameters based on second motion data and the motion mapping library includes: determining the pose data of a moving object in space based on the second motion data; comparing the pose data with multiple reference motion feature data stored in the motion mapping library to determine matching reference motion feature data; determining the corresponding operation type based on the matching reference motion feature data; and determining the operation parameters corresponding to the operation type based on the pose data.

[0040] Specifically, the second motion data includes rotational motion data and linear motion data. After receiving the rotational and linear motion data, the second main control unit performs fusion calculations on these two types of data to obtain the pose data of the moving object in space. The pose data includes position data and orientation data. Position data reflects the displacement changes of the moving object in three-dimensional space, while orientation data reflects the orientation angle changes of the moving object. Together, they constitute a complete description of the user's spatial motion. The second main control unit then compares the determined position and orientation data with multiple reference motion feature data stored in the motion mapping library. The reference motion feature data are standardized data templates formed after feature extraction from various typical spatial motions, and each reference motion feature data corresponds to a unique operation type. Through comparison, the second main control unit finds the reference motion feature data that best matches the current position and orientation data, and then determines the corresponding operation type.

[0041] Furthermore, the second main control unit also extracts operation parameters related to the operation type based on the real-time calculated position and attitude data. For example, for sliding actions, the direction and distance of sliding can be calculated based on the displacement change in the position data; for rotation actions, the direction and number of rotations can be calculated based on the angle change in the attitude data; for click actions, the click action and click position can be determined based on the instantaneous acceleration peak in the position and attitude data. The specific parameter extraction process can refer to the data processing method of a conventional ring mouse, and will not be elaborated here.

[0042] In one embodiment of this application, the second mouse includes: a gyroscope for acquiring rotational motion data; and an accelerometer for acquiring linear motion data.

[0043] In one embodiment of this application, the second mouse is used to: receive the operation execution result sent by the receiving end; wherein the operation execution result is generated by the receiving end after calling the operating system interface to trigger the corresponding application to execute the operation corresponding to the operation type and operation parameters based on the operation type and operation parameters; and the operation execution result is associated and stored with the corresponding operation type, operation parameters and second motion data.

[0044] Specifically, after receiving the operation type and parameters sent by the second mouse, the receiving end calls the operating system interface based on the operation type and parameters, triggering the corresponding application to execute the operation corresponding to the operation type and parameters. For example, when the operation type is represented as "swipe left," the receiving end calls the system interface scrolling interface, causing the content of the currently active window to slide to the left according to the operation parameters; when the operation type is represented as "click," the receiving end, combined with the operation parameters, triggers the selection function of the icon or control pointed to by the cursor. After the operation is completed, the receiving end generates the corresponding operation execution result, which reflects whether the operation was successfully executed and the specific details of the execution. The receiving end then sends the operation execution result to the second mouse. After receiving the operation execution result, the second mouse associates it with the operation type, operation parameters, and the collected second motion data corresponding to this operation, and stores it in the local storage module. In this way, the second mouse can continuously accumulate the complete data link of each user operation, including the original motion data, the identified operation type, operation parameters, and the final operation execution result, thereby providing a data foundation for subsequent updates to the motion mapping library.

[0045] In one embodiment of this application, the second mouse is used to: receive a re-identification instruction sent by the receiving end to realize the re-acquisition of the second motion data of the moving object; wherein, the re-identification instruction is information generated by the receiving end when it detects that the confirmation of the operation result by the moving object does not meet expectations.

[0046] Specifically, after the receiving end performs the corresponding operation based on the operation type and operation parameters, the moving object will confirm the operation result. If the moving object believes that the operation result does not meet the expected intent, such as a mismatch in interface scrolling distance, an incorrect selected target, or an inappropriate scaling degree, the receiving end will generate a re-identification command when it detects that the moving object's confirmation does not meet expectations, and send the command to the second mouse. After receiving the re-identification command, the second mouse re-enters the acquisition state and re-acquires the second motion data currently being performed by the moving object. Subsequently, the second mouse regenerates the operation type and operation parameters based on the re-acquired second motion data and the motion mapping library, and sends the newly obtained operation type and operation parameters back to the receiving end for the receiving end to execute the corresponding operation.

[0047] In this way, when the operation result does not meet the user's expectations, the second mouse can correct it in time through the re-identification mechanism, ensuring that the recognition result of the operation type is closer to the user's actual intention.

[0048] Figure 3 A schematic diagram illustrating the interaction flow between the second mouse and the receiving end provided in an embodiment of this application is shown. To further explain the working process of this application, the following is combined with... Figure 3To illustrate this, we will use a specific application example, where the second mouse is a ring mouse that is worn on the finger.

[0049] like Figure 3 As shown, the interaction workflow between the second mouse and the receiving end of this application is as follows: The user's finger, wearing the ring mouse, makes spatial movements. The ring mouse detects the joint movement, position, and other information through its internal gyroscope and accelerometer, and collects the second motion data (S01). The ring mouse compares the collected second motion data with the gesture database (i.e., motion mapping library) pre-set in the Flash firmware of its storage module, identifies the corresponding operation type, and extracts the operation parameters (S02). The ring mouse sends the identified gesture electrical signal information (i.e., operation type and operation parameters) to the receiving end via Bluetooth (S03). The operating system of the receiving end parses the received operation type and operation parameters, parses the gesture command, and triggers the corresponding application (APP) (S04). The application executes the operation corresponding to the operation type and operation parameters (S05). After the operation is completed, the receiving end ends the operation and reports the operation execution result (S06), and simultaneously feeds back the operation execution result to the ring mouse via Bluetooth (S07). The ring mouse receives the feedback result and associates it with the corresponding operation type, operation parameters, and second motion data, storing it in Flash (S08). After receiving the operation result, the user confirms whether the result matches the original intention of the gesture (S09); if it does not meet expectations, the receiving end can generate a re-recognition command and send it to the ring mouse to trigger the re-acquisition and recognition process.

[0050] In one embodiment of this application, the second mouse includes a second main control unit, which is configured to: upload accumulated and stored multiple operation execution results and the second motion data, operation type and operation parameters corresponding to each operation execution result to the cloud via a receiving end, so that the cloud can iteratively optimize the motion mapping library and generate updated firmware based on the multiple operation execution results and the second motion data, operation type and operation parameters corresponding to each operation execution result using a pre-trained type recognition model, and the updated firmware includes a new motion mapping library; receive the updated firmware downloaded and transmitted from the cloud by the receiving end, and update the motion mapping library to the new motion mapping library based on the updated firmware.

[0051] Specifically, during daily use, the second mouse continuously accumulates the complete data chain of each user operation through the process described in the aforementioned embodiments, including the second motion data collected each time, the identified operation type, operation parameters, and the operation execution result fed back by the receiving end. This data is stored in the local storage module of the second mouse. When the accumulated stored data reaches a certain amount, or when the second mouse establishes a communication connection with the receiving end and meets preset conditions (such as idle time period, power connection, etc.), the second main control unit of the second mouse uploads this accumulated data to the cloud (remote server) through the receiving end.

[0052] A type recognition model trained using deep learning and other technologies is pre-deployed in the cloud. Upon receiving multiple uploaded operation execution results along with their corresponding second motion data, operation types, and operation parameters, the cloud uses this type recognition model to analyze and train this data. This process identifies the potential patterns between the user's operating habits, motion characteristics, and operation types, thereby iteratively optimizing the existing motion mapping library and generating updated firmware containing the new motion mapping library. The new motion mapping library can more accurately adapt to the user's personalized motion characteristics, improving the accuracy of operation type recognition.

[0053] After the firmware update is generated, it is stored in the cloud and awaits retrieval by the receiving end. The receiving end communicates with the cloud, periodically polling it via the internet, or downloading the updated firmware from the cloud via Over-the-Air (OTA) technology after receiving a push notification, and then transmitting it to the second mouse via Bluetooth or other communication methods. The second main control unit of the second mouse receives the updated firmware and updates its locally stored motion mapping library to the new one. In subsequent use, the second mouse will identify the operation type based on the updated motion mapping library.

[0054] In one embodiment of this application, the training process of the type recognition model and the iterative optimization process of the motion mapping library based on the type recognition model are as follows: 1) Type recognition model training First, an initial training dataset is constructed. This dataset is obtained by collecting raw sensor data from a large number of different moving objects performing various preset operation types. The raw sensor data includes at least gyroscope and accelerometer data. The collected raw sensor data is then preprocessed, including filtering and denoising, motion segmentation, data augmentation, and normalization, to form standardized training samples.

[0055] Secondly, a type recognition model is constructed. The type recognition model adopts a two-stream convolutional neural network architecture, including a spatial feature extraction stream and a temporal feature extraction stream. The spatial feature extraction stream uses a one-dimensional convolutional network to process single-frame sensor data to extract spatial features at each time step; the temporal feature extraction stream uses a recurrent neural network to capture the temporal dependencies between multiple frames of data; after fusing the features extracted from the two streams, the probability distribution of each operation type is output through a fully connected layer.

[0056] Finally, the type recognition model was trained using the initial training dataset. During training, a weighted cross-entropy loss function was used to address the imbalance of operation types, and a center loss function was added to improve the aggregation of similar motion features. The AdamW optimizer and cosine annealing learning rate scheduling strategy were used for parameter optimization. Through multiple iterations of training, the type recognition model learned the optimal baseline motion features corresponding to different operation types. After training, the type recognition model was deployed to the cloud for subsequent iterative optimization of the motion mapping library.

[0057] 2) Iterative optimization of the motion mapping library based on a type recognition model The cloud receives multiple operation execution results uploaded by the second mouse, along with the corresponding second motion data, operation type, and operation parameters for each result. The cloud uses a pre-trained type recognition model to analyze the second motion data, extracting motion features and associating these features with the operation type, operation type, and operation execution result. Through continuous analysis, the type recognition model identifies the personalized movement habits of different motion objects and the feature differences of the same operation type when performed by different users. Based on this, the baseline motion feature data stored in the motion mapping library is optimized and adjusted to better match the actual operation characteristics of each operation type.

[0058] After optimization and adjustments, an updated firmware containing the new motion mapping library is generated in the cloud and transmitted to the second mouse via OTA technology to update the locally stored motion mapping library. Through this method, the motion mapping library continuously iterates as user frequency increases, thereby continuously improving the accuracy of the second mouse's operation type recognition.

[0059] Thus, this embodiment of the application, through an end-to-cloud collaborative mechanism, uploads the second motion data collected by the second mouse, the identified operation type, operation parameters, and operation execution results to the cloud via the receiving end. Combined with deep learning technology, the data is trained in the cloud to continuously optimize the motion mapping library. The optimized firmware is then sent back to the second mouse via OTA technology, enabling iterative updates to the motion mapping library. By moving the power-intensive and demanding deep learning model training process to the cloud, the complexity of the hardware design within the second mouse is effectively reduced, comprehensively ensuring its miniaturization, low power consumption, and intelligence. The cloud trains user data based on a deep learning framework, continuously optimizing the motion mapping library by learning the differences between user operating habits and actual execution results. This improves the sensitivity and accuracy of operation type recognition, ultimately enabling the rapid and accurate issuance of control commands that conform to user intent, enhancing user experience and interaction efficiency. Through the above process, this application can continuously learn the user's personalized operating habits, strengthening the accuracy of operation type recognition, and providing users with an increasingly precise and smooth control experience over long-term use.

[0060] Figure 4 A schematic diagram of the firmware update process provided in an embodiment of this application is shown. To further understand the firmware iterative update process of this application, the following is combined with... Figure 4 To illustrate this, we will take a specific application example. This specific application example uses a second mouse as a ring mouse to interact with the terminal device (receiving end) and the cloud to perform the first firmware update, that is, from the initial firmware version (firmware 1) to the updated firmware version (firmware 2).

[0061] like Figure 4 As shown, the firmware iteration update process for the second mouse is as follows: The ring mouse establishes a communication connection with the terminal device via Bluetooth. For the first connection, the terminal device needs to install the corresponding driver, which is used for device identification, protocol conversion, and subsequent communication with the cloud. After the connection is established, the ring mouse sends its current firmware 1 information to the terminal device via Bluetooth. Upon receiving the information, the terminal device, if connected to the internet, uploads the firmware 1 information to the cloud.

[0062] The cloud receives firmware 1 information and calls a pre-deployed gesture recognition deep learning model to parse, train, and optimize the motion mapping library (shown as a data mapping set in the diagram) and related data in firmware 1. It adjusts the baseline motion feature data in the motion mapping library to form an updated motion mapping library. The cloud then determines whether a new firmware version (firmware 2) has been generated. If the optimized motion mapping library is an improvement over the initial version, the cloud generates a new firmware version 2.

[0063] The terminal device periodically polls the cloud to check for new firmware information for the ring mouse. When a new firmware version 2 is detected, the terminal device downloads firmware 2 from the cloud and transmits it to the ring mouse via Bluetooth. After receiving the new firmware, the ring mouse updates its local motion mapping library. If the cloud determines that no new firmware has been generated, the process ends, and the terminal device will check again during the next polling.

[0064] In this way, through the above process, the ring mouse achieves automatic firmware iteration and updates without the need for manual operation by the user, ensuring that the accuracy of operation type recognition continues to improve with the accumulation of usage data.

[0065] In one embodiment of this application, a magnetic suction component and a charging contact are provided inside the cockpit structure; the magnetic suction component is used to magnetically attach and fix the second mouse inside the cockpit structure; the charging contact is used to contact the corresponding contact on the second mouse when the second mouse is fixed inside the cockpit structure, so as to enable the first mouse to charge the second mouse.

[0066] For details, please refer to Figure 1 The bottom of the cockpit structure 03 is equipped with a magnetic suction assembly consisting of multiple magnets for attracting and fixing the ring mouse, and is equipped with a charging contact 04 for charging the ring mouse. The charging contact 04 is a metal contact.

[0067] Figure 5 A hardware architecture diagram of the input device provided in an embodiment of this application is shown.

[0068] In one embodiment of this application, the first mouse has a built-in first battery, a first charging management module, and a charging interface; the second mouse has a built-in second battery and a second charging management module; the charging interface is used to connect to an external power source to power the first mouse based on the external power source; when the second mouse is fixed in the cockpit structure, the charging contacts are electrically connected to the first charging management module and the second charging management module so that the first battery can charge the second battery through the first charging management module, the charging contacts, and the second charging management module; the second charging management module is used to power the second mouse through the second battery.

[0069] like Figure 5 and Figure 1As shown, the first mouse internally includes a first main control unit (MCU), a first battery (Battery1), a first charging management module (Charger1), a charging interface 02 (USB interface), a photoelectric detection module, a scroll wheel / button / LED module, a wireless / Bluetooth module, a reset module, a clock module, and a power conversion module (Buck, LDO / LS). The reset module is used to reset and initialize the first main control unit and peripheral circuits in the event of power-on or abnormal operation of the first mouse, ensuring the system starts operating from a defined state. The clock module provides a precise timing reference for the first main control unit, ensuring synchronous operation between modules and accurate data processing. The charging interface 02 is used to connect to an external power source. When an external power source is connected, it charges the first battery through the first charging management module and converts the voltage required by each functional module (Buck step-down, LDO / LS low-dropout linear regulator) to power the first main control unit, photoelectric detection module, scroll wheel / button / LED module, wireless / Bluetooth module, reset module, and clock module. When no external power source is connected, the first battery provides operating voltage to each functional module through the first charging management module and the power conversion module.

[0070] The second mouse internally houses a second main control unit (MCU), a second battery (Battery2), a second charging management module (Charger2), an accelerometer / gyroscope sensor module, a wireless / Bluetooth module, a storage module (Flash), a reset module, a clock module, and a power conversion module (Buck, LDO / LS). The reset module initializes the second main control unit and peripheral circuits upon power-up or in case of malfunction. The clock module provides a precise timing reference for the second main control unit, ensuring the synchronization and accuracy of sensor data acquisition, processing, and communication. The second battery provides operating voltage to the accelerometer / gyroscope, second main control unit, wireless / Bluetooth module, and storage module through the second charging management module and power conversion module.

[0071] Combination Figure 1 As shown in the cockpit structure 03, when the second mouse is fixed inside the cockpit structure 03 at the bottom of the first mouse, the charging contact 04 provided inside the cockpit contacts the corresponding contact 04 on the second mouse (considered the same point as the charging contact), thus establishing an electrical connection between the first and second mice. At this time, the charging contact 04 electrically connects the first charging management module inside the first mouse with the second charging management module inside the second mouse, enabling the first battery to charge the second battery through the first charging management module, the charging contact 04, and the second charging management module.

[0072] Thus, through the above hardware architecture, the first mouse can be powered and charged by an external power source, and can also provide charging support for the second mouse when it is housed in the cockpit; the second mouse can be powered by its built-in second battery when used independently, and automatically replenishes its power when it is placed in the cockpit, ensuring its battery life as an independent input device.

[0073] refer to Figure 1 In one embodiment of this application, a reset button 05 is provided on the casing of the first mouse. The reset button 05 is electrically connected to the first main control unit inside the first mouse. When the communication connection between the second mouse and the receiving end is abnormal, the user presses the button to trigger a reset signal. The first main control unit transmits the reset signal to the second mouse via the charging contact 04 in the cockpit structure 03 or wirelessly, so as to reset the communication state of the second mouse and re-establish the connection.

[0074] The second mouse has a pressure button 06 on its surface. This pressure button 06 is electrically connected to the second main control unit inside the second mouse and is used to control the gesture control function of the second mouse to be turned on or off through program code. When the user needs to perform activities that may cause accidental triggering, such as typing or playing musical instruments, the gesture recognition function can be temporarily turned off by pressing the pressure button 06 to avoid functional conflicts with the above activities; when gesture control needs to be restored, pressing the pressure button 06 again will turn it back on.

[0075] The second mouse also has an LED indicator 07 on its surface. This indicator 07 is electrically connected to the second main control unit and is used to indicate the Bluetooth connection status and remaining battery level of the second mouse using different colors or flashing patterns. For example, it can be displayed as a slow flash when Bluetooth is not connected, a solid light when Bluetooth is connected, and a fast flashing red light when the battery is low, so that the user can know the working status of the device in a timely manner.

[0076] According to embodiments of this application, this application also provides an electronic device and a cloud platform.

[0077] In this system, the electronic device, acting as the receiving end of the input device, such as a personal computer, laptop, tablet, or smart TV, establishes a communication connection with the first mouse and / or the second mouse. It receives first event data sent by the first mouse and / or operation types and parameters sent by the second mouse, and executes operations corresponding to the first event data or operation types and parameters. Simultaneously, the electronic device also installs the driver when the second mouse is first connected, establishes the correspondence between operation types and specific operations, and serves as a communication medium between the second mouse and the cloud, forwarding data uploaded by the second mouse to the cloud and transmitting updated firmware downloaded from the cloud to the second mouse.

[0078] The cloud is used to deploy a pre-trained type recognition model, receive multiple operation execution results uploaded by the second mouse forwarded by the electronic device, as well as the second motion data, operation type and operation parameters corresponding to each operation execution result, use the type recognition model to iteratively optimize the received data, generate updated firmware containing a new motion mapping library, and provide it to the electronic device for download.

[0079] It should be noted that the specific working mechanism and interaction process between the electronic device and the cloud can be found in the description of the interaction between the receiving end and the cloud in the above-mentioned input device embodiment. The implementation method is consistent with the working method of the corresponding parts of the receiving end and the cloud in the input device embodiment. For details, please refer to... Figures 1-5 The corresponding textual explanations will not be repeated here.

[0080] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this application can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this application can be achieved, and this is not limited herein.

[0081] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "a plurality of" means two or more, unless otherwise explicitly specified.

[0082] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An input device, characterized in that, The input device includes: The first mouse has a cockpit structure on the bottom, which is used to collect first motion data of a moving object when the first preset conditions are met, and generate first event data based on the first motion data and send the first event data. The first event data is used for the receiving end of the first event data to perform an operation corresponding to the first event data. The second mouse is detachably installed in the cockpit structure and is used to collect second motion data of the moving object when the second preset conditions are met. Based on the second motion data and the motion mapping library, it generates an operation type and operation parameters and sends the operation type and operation parameters to the receiving end. The operation type and operation parameters are used for the receiving end to perform the operation corresponding to the operation type and operation parameters.

2. The input device according to claim 1, characterized in that, The first preset condition is that the first mouse is in a working state of moving on the control panel; The second preset condition is that the second mouse is in an active state that is separated from the cockpit structure and is powered on.

3. The input device according to claim 1, characterized in that, The motion mapping library stores multiple reference motion feature data and the operation type corresponding to each reference motion feature data; The generation of operation type and operation parameters based on the second motion data and motion mapping library includes: Based on the second motion data, determine the pose data of the moving object in space; The pose data is compared with multiple reference motion feature data stored in the motion mapping library to determine the matching reference motion feature data. The corresponding operation type is determined based on the matched baseline motion feature data; Based on the pose data, determine the operation parameters corresponding to the operation type.

4. The input device according to claim 1, characterized in that, The second mouse is used for: The receiver receives the operation execution result sent by the receiving end; wherein the operation execution result is generated by the receiving end after calling the operating system interface to trigger the corresponding application to execute the operation corresponding to the operation type and the operation parameters based on the operation type and the operation parameters; The operation execution result is associated with and stored in conjunction with the corresponding operation type, operation parameters, and second motion data.

5. The input device according to claim 4, characterized in that, The second mouse is used for: The receiver receives a re-identification command to re-acquire the second motion data of the moving object. The re-identification instruction is information generated by the receiving end when it detects that the confirmation of the operation result by the moving object does not meet expectations.

6. The input device according to claim 4, characterized in that, The second mouse is used for: The accumulated execution results of multiple operations, along with the second motion data, operation type, and operation parameters corresponding to each operation execution result, are uploaded to the cloud via the receiving end. This allows the cloud to iteratively optimize the motion mapping library based on the multiple operation execution results and the second motion data, operation type, and operation parameters corresponding to each operation execution result, using a pre-trained type recognition model, and generate updated firmware. The updated firmware includes a new motion mapping library. The receiver receives the updated firmware downloaded and transmitted from the cloud, and updates the motion mapping library to the new motion mapping library based on the updated firmware.

7. The input device according to claim 3, characterized in that, The second mouse includes: A gyroscope is used to collect the rotational motion data; An accelerometer is used to collect the linear motion data.

8. The input device according to claim 1, characterized in that, The cockpit structure is equipped with magnetic components and charging contacts; The magnetic attachment component is used to magnetically fix the second mouse to the cockpit structure; The charging contact is used to contact the corresponding contact on the second mouse when the second mouse is fixed inside the cockpit structure, so as to enable the first mouse to charge the second mouse.

9. The input device according to claim 8, characterized in that, The first mouse has a built-in first battery, a first charging management module, and a charging interface; the second mouse has a built-in second battery and a second charging module. The charging interface is used to connect to an external power source to power the first mouse based on the external power source; When the second mouse is fixed inside the cockpit structure, the charging contact is electrically connected to the first charging management module and the second charging management module, so that the first battery can be charged through the first charging management module, the charging contact, and the second charging management module; The second charging management module is used to power the second mouse through the second battery.

10. The input device according to claim 1, characterized in that, The second mouse has a built-in first Bluetooth module; When the second mouse is fixed inside the cockpit structure, the first Bluetooth module is in standby mode; When the second mouse meets the second preset conditions, the first Bluetooth module establishes a communication connection with the receiving end to enable communication between the second mouse and the receiving end through the established communication connection.

Images