Keyboard pointing stick assisted control method and system based on multi-source sensing data

Abstract

This invention discloses a keyboard pointing stick assisted control method and system based on multi-source sensor data, belonging to the field of computer input device technology. The method includes real-time acquisition of multi-source sensor data, real-time environmental compensation of the sensor data, data fusion to identify user operation intentions, and generation of cursor control commands based on a user adaptive control model. The system includes a pointing stick module, a sensing unit, a signal processing unit, and a microcontroller unit, and can also be equipped with a host computer driver program. This invention effectively counteracts multi-source environmental interference, improves the control accuracy and stability of the pointing stick, accurately identifies user operation intentions, achieves adaptive matching to user operating habits, and completes the modular integration of related functional units of the pointing stick. It is suitable for cursor control of integrated keyboard pointing sticks in laptops, can replace traditional mice to achieve efficient cursor operation control, and significantly improves the user experience and adaptability of the pointing stick.

Description

Technical Field

[0001] This invention relates to the field of computer input device technology, specifically to a keyboard pointing stick-assisted control method and system based on multi-source sensor data. Background Technology

[0002] The integrated pointing stick (commonly known as the "red dot") is a key input device for laptops, designed to achieve efficient and precise cursor control within a limited space. Traditional pointing sticks primarily rely on piezoresistive or capacitive sensors to detect the direction and force of user presses and convert them into cursor displacement signals. With the increasing complexity of mobile work scenarios, users are placing higher demands on the pointing stick's operational stability, accuracy, and personalized adaptability in various environments.

[0003] To address the issues of sensitivity and limited functionality in traditional pointing sticks, various improvement solutions have been proposed in existing technologies. For example, patent publication number CN104866147A discloses a capacitive finger navigation module and its manufacturing method, which simultaneously detects finger pressing and displacement operations using the same set of electrodes, achieving dual-mode detection of pressure and displacement. Other existing technologies have constructed capacitive sensing pointing sticks by setting multiple sensor electrodes and control components, aiming to reduce device thickness and improve sensing sensitivity. These technical solutions have enriched the detection dimensions or optimized the structure of pointing sticks to some extent, but their core focus remains on single or limited types of signal detection at the hardware level.

[0004] However, none of the aforementioned existing technical solutions systematically address a key issue: the control accuracy and long-term stability of the pointing stick significantly decrease in real-world, complex usage scenarios (such as changes in ambient temperature, keyboard substrate deformation, and differences in user operating habits). Specifically, existing solutions lack real-time compensation capabilities for multi-source environmental interference (such as temperature drift and mechanical stress), and cannot adaptively adjust according to the user's personalized operating mode. This results in cursor control being prone to drift, jitter, or inconsistent response, ultimately affecting the user experience.

[0005] Therefore, there is an urgent need in this field for a pointing stick control method and system that can integrate multi-source sensor data and has real-time environmental compensation and user adaptation capabilities, so as to improve the control accuracy and reliability of the pointing stick under complex working conditions. Summary of the Invention

[0006] The purpose of this invention is to overcome the shortcomings of existing technologies and provide a keyboard pointing stick auxiliary control method and system based on multi-source sensor data. By collecting multi-source sensor data such as pressure, capacitance, and temperature of the pointing stick and implementing real-time environmental compensation, the compensated data is fused to accurately identify the user's operation intention. The cursor control command is generated by combining the adaptive control model built based on the user's historical data. At the same time, the sensor zero-point calibration is periodically performed to offset environmental interference, adapt to user operating habits, and improve the control accuracy, stability, and human-computer interaction experience of the pointing stick.

[0007] To solve the above-mentioned technical problems, the present invention provides the following technical solution: On one hand, a keyboard pointing stick-assisted control method based on multi-source sensor data, applied to an input device including a pointing stick module, includes the following steps: Step 1: Real-time acquisition of multi-source sensor data from the pointing stick module, wherein the multi-source sensor data includes at least first pressure sensor data, second capacitance sensor data and third temperature sensor data; Step 2: Perform real-time environmental compensation on the multi-source sensor data. The real-time environmental compensation includes at least temperature drift correction of the first pressure sensor data based on the third temperature sensor data. Step 3: The first pressure sensor data after environmental compensation is fused with the second capacitance sensor data, and the user's current operating intention state for the pointing stick module is identified based on the fusion result. Step four: Based on the identified current operation intention state and the pre-stored user adaptive control model, generate the corresponding cursor control command, wherein the user adaptive control model is a set of personalized control parameters generated based on the user's historical operation data.

[0008] By integrating multi-source sensor data and performing real-time environmental compensation, environmental interference can be effectively offset, improving the accuracy and stability of the pointing stick control.

[0009] Furthermore, in step one, the multi-source sensing data also includes fourth strain sensing data; In step two, the real-time environmental compensation also includes dynamically adjusting the coordinate mapping relationship of the pointing stick module based on the fourth strain sensing data.

[0010] By introducing strain sensing data and dynamically adjusting the coordinate mapping, the effects of keyboard deformation can be compensated, enhancing control consistency under complex physical conditions.

[0011] Furthermore, in step three, identifying the user's current operational intent state regarding the pointing stick module based on the fusion result specifically includes: The second capacitance sensing data is compared with a preset capacitance threshold, and the first pressure sensing data is compared with a preset pressure threshold. Based on the comparison results, the current operation intention state is divided into one of the following: away state, hovering state, light touch state, press and move state, and strong press state.

[0012] By comparing and judging the combined pressure and capacitance data, it is possible to accurately distinguish the different operating intentions of the user and achieve a more intuitive control response.

[0013] Furthermore, in step four, the generation of the user adaptive control model includes: Collect the pressure data sequence and the corresponding cursor speed data sequence generated by the user operating the pointing stick module over a period of time; Based on the pressure data sequence and cursor velocity data sequence, a personalized pressure-cursor velocity response curve for the user is obtained by fitting. The personalized pressure-cursor speed response curve is stored as the core parameter of the user adaptive control model.

[0014] By collecting historical user data and fitting personalized response curves, the pointing stick's feel can be adapted to the usage habits of different users.

[0015] Furthermore, before acquiring multi-source sensor data in real time, the method also includes: periodically acquiring baseline data of each sensor in a non-operational state, and using the baseline data to adaptively calibrate the zero point of the corresponding sensor.

[0016] By periodically and automatically calibrating the sensor baseline, long-term drift of the sensor signal can be eliminated, maintaining the long-term reliability and accuracy of the pointing stick.

[0017] On the other hand, the keyboard pointing stick auxiliary control system based on multi-source sensor data is applicable to keyboard pointing stick auxiliary control methods based on multi-source sensor data. The system consists of: A pointing stick module integrated on a keyboard circuit board, the pointing stick module including a base and an operating cap disposed on the base; A sensing unit is disposed inside or below the base and is used to collect multi-source sensing data. The sensing unit includes at least a pressure sensor array for collecting first pressure sensing data, a capacitive sensor array for collecting second capacitance sensing data, and a temperature sensor for collecting third temperature sensing data. A signal processing unit, electrically connected to the sensing unit, is used to perform analog-to-digital conversion and preprocessing on the multi-source sensing data; The microcontroller unit is connected to the main control circuit of the signal processing unit and the keyboard, respectively, and is configured to execute the method.

[0018] By integrating a multi-source sensing unit with a microcontroller unit that executes the method, high-precision, adaptive pointing stick control can be achieved at the hardware system level.

[0019] Furthermore, the pressure sensor array includes four miniature pressure sensors arranged in a cross shape; The capacitive sensor array includes a plurality of capacitive sensing points arranged around the pressure sensor array. The temperature sensor is attached to the back of the base.

[0020] Among them, the cross-shaped distribution of pressure sensors and the surrounding capacitive sensing points enable comprehensive detection of the operating status from multiple dimensions, providing a foundation for accurate data fusion.

[0021] Furthermore, the base of the pointing stick module is a multilayer composite circuit board structure, and the sensing unit and signal processing unit are integrated on the multilayer composite circuit board structure through surface mount technology.

[0022] By integrating the sensing unit onto a multi-layer composite circuit board, modular high-density packaging can be achieved, improving the system's structural reliability and production consistency.

[0023] Furthermore, the microcontroller unit has a built-in hardware filter for filtering the digital signal output by the signal processing unit.

[0024] By preprocessing the signal through a built-in hardware filter, noise can be effectively suppressed, improving the reliability of subsequent data fusion and intent recognition results.

[0025] Furthermore, the system also includes a host computer driver that is communicatively connected to the microcontroller unit. The host computer driver is used to provide a human-machine interface so that the user can configure the relevant parameters of the user adaptive control model or enable or disable the adaptive learning function.

[0026] Among them, by providing a host computer driver with configurable parameters, users can be given control over the adaptive learning function, thereby improving the system's applicability and user experience.

[0027] Compared with existing technologies, this keyboard pointing stick-assisted control method and system based on multi-source sensor data has the following advantages: I. This invention collects multi-source sensor data from the pointing stick module and performs real-time environmental compensation. Simultaneously, it periodically collects sensor baseline data before data acquisition to complete zero-point adaptive calibration. Temperature drift correction is performed on pressure sensor data based on temperature sensor data. Furthermore, it dynamically adjusts the coordinate mapping relationship based on strain sensor data. This effectively counteracts multi-source environmental interference such as ambient temperature changes and keyboard substrate deformation, solving the problem of traditional pointing sticks lacking real-time environmental interference compensation capabilities. It also eliminates long-term sensor signal drift, thereby improving the pointing stick's control accuracy and long-term stability in complex usage scenarios. This prevents cursor drift, jitter, or inconsistent response, ensuring the reliability of the pointing stick's detection and control under various working conditions.

[0028] Second, this invention fuses environmentally compensated pressure sensing data with capacitive sensing data, accurately identifying the user's operational intent based on the data fusion result. Simultaneously, it constructs a user-adaptive control model based on historical user operation data, fitting a personalized pressure-cursor speed response curve. Furthermore, it includes a host computer driver program to support user configuration of system parameters. This allows for precise differentiation of different user operational intents, avoiding misjudgments caused by single-sensor data detection. It also ensures the pointing stick's tactile feel aligns with different users' personalized operating habits and grants users autonomy in configuring system parameters. This enhances the human-computer interaction experience of pointing stick control, reduces the misjudgment rate of operational intent, strengthens the system's adaptability to different users, and achieves a more intuitive cursor control response.

[0029] Other advantages, objectives and features of the invention will be set forth in part in the description which follows, and in part will be apparent to those skilled in the art from the following examination or study, or may be learned from the practice of the invention. Attached Figure Description

[0030] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are merely some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without any creative effort.

[0031] Figure 1 This is a schematic diagram of the overall system structure of the present invention; Figure 2 This is a flowchart of the control method of the present invention. Detailed Implementation

[0032] To further illustrate the technical means and effects of the present invention in achieving its intended purpose, the following detailed description of the specific implementation methods, structures, features, and effects of the present invention, in conjunction with the accompanying drawings and preferred embodiments, is provided below.

[0033] Example This embodiment aims to elaborate on a keyboard pointing stick-assisted control method and system based on multi-source sensor data. This method and system are applicable to integrated keyboard pointing sticks (hereinafter referred to as pointing sticks) in laptops. Relying on domestically developed high-precision circuit board manufacturing and metal surface chrome plating processes, the process precision of the core components of the pointing stick is matched with that of similar products in the prior art. Furthermore, optimizations have been achieved in sensor detection sensitivity and environmental adaptability. It can be directly integrated into the laptop keyboard circuit board as a cursor control input component to replace traditional mouse operation. The following detailed explanation covers the specific implementation of the system structure and the specific implementation of the control method.

[0034] The keyboard pointing stick auxiliary control system based on multi-source sensor data in this embodiment is integrated into the main body of the laptop keyboard. The core relies on a high-precision fabricated multilayer composite circuit board structure to realize the modular integration of each functional unit. The system as a whole includes a pointing stick module, a sensing unit, a signal processing unit, and a microcontroller unit. In some optional embodiments, the system also includes a host computer driver that communicates with the microcontroller unit. Figure 1 This is a schematic diagram of the overall structure of the keyboard pointing stick auxiliary control system based on multi-source sensor data of the present invention. The diagram clearly shows the composition and interconnection of each unit of the system. Each unit is packaged and integrated using high-precision technology developed in mainland China. The chrome plating process of the pointing stick's operating cap solves the problems of insufficient plating uniformity and low wear resistance of traditional mainland processes. The surface mount technology of the multilayer composite circuit board enables high-density and precise arrangement of the sensing units and signal processing units, effectively reducing signal transmission loss and improving overall detection sensitivity. The specific implementation of each unit is as follows: The pointing stick module is integrated into a pre-set position on the keyboard circuit board and is the core component for direct user operation. It includes a base and an operating cap. The entire manufacturing process of this module utilizes high-precision technology from mainland China, achieving a level of process precision comparable to existing products of the same technology. Figure 1 As shown, the pointing stick module serves as the operating end of the system, and its base is the supporting foundation of the entire system. The operating cap protrudes from the keyboard surface, making it convenient for users to press and move the keys.

[0035] Base: The base is a multi-layer composite circuit board structure, manufactured using domestically developed high-precision lamination and wiring technology. The inter-layer alignment accuracy and line width / spacing accuracy of the circuit board reach the same level as similar products in the existing technology. It can be configured as a 4-layer composite structure according to actual product requirements. Each layer is functionally divided into a sensing signal layer, a power supply layer, a ground layer, and a control signal layer. The sensing signal layer transmits the raw sensing data collected by the sensing unit; the power supply layer provides stable power to each unit; the ground layer suppresses signal interference; and the control signal layer transmits control commands and feedback signals from the microcontroller unit. The multi-layer composite circuit board structure of the base provides a high-density integrated carrier for the sensing unit and signal processing unit, and through a reasonable inter-layer layout, it reduces crosstalk between different types of signals, improving the stability of signal transmission.

[0036] Operating Cap: The operating cap is the part that the user directly contacts and presses. Its outer surface is treated with an electrodeposition chrome plating process that has been mastered domestically. The plating thickness is uniform and the surface roughness is low, which not only improves the consistency of the tactile feel during operation, but also enhances the wear resistance of the operating cap, avoiding the problem of deterioration in the operating feel due to surface wear after long-term use. The operating cap is detachably connected to the base, and its bottom abuts against the pressure sensor array of the sensing unit. The user's pressing and moving actions on the operating cap can be directly transmitted to the sensing unit, realizing accurate detection of the operation actions.

[0037] It is understandable that the base of the pointing stick module, as the core load-bearing structure of the entire system, relies on the high-precision manufacturing process of its multi-layer composite circuit board to achieve accurate acquisition and transmission of multi-source sensor data. The mainland process has solved the problems of low integration and large signal interference in traditional circuit board structures by optimizing lamination parameters and wiring processes, thus providing hardware support for subsequent sensing detection and data processing.

[0038] The sensing unit is located inside the base and is arranged in conjunction with the sensing signal layer. It is used to acquire multi-source sensing data in real time, including at least a pressure sensor array, a capacitance sensor array, and a temperature sensor. In some optional embodiments, the sensing unit also includes a strain sensor. Each sensor is precisely integrated onto the multilayer composite circuit board of the base using a surface mount process. The mounting pads have high alignment accuracy, and there are no issues with cold solder joints or false solder joints, effectively reducing the contact resistance of signal transmission and improving the sensitivity of sensing data acquisition. The specific implementation of each sensor is as follows: Pressure Sensor Array: The pressure sensor array comprises four miniature pressure sensors arranged in a cross shape. These four sensors correspond to the front, back, left, and right directions, respectively, and are evenly distributed around the center of the base, abutting against the bottom of the operating cap. These miniature pressure sensors employ high-sensitivity piezoresistive sensors, with detection accuracy matching that of similar sensing elements in existing technology. They can collect pressure data in real time from different directions when the user presses the operating cap, i.e., the first pressure sensing data, which reflects the direction and force of the user's press. The cross-shaped distribution enables detection of omnidirectional pressing motions of the operating cap, and the detection data from the four sensors can be cross-validated, reducing errors from a single sensor and improving the accuracy of pressure detection.

[0039] Capacitive sensor array: The capacitive sensor array includes multiple capacitive sensing points arranged around the pressure sensor array. In this embodiment, the number of capacitive sensing points is set to 8, which are uniformly arranged in a circle around the center of the pressure sensor array, with the spacing between adjacent capacitive sensing points being consistent. The capacitive sensing points are metal electrodes printed on the sensing signal layer of the base, fabricated using high-precision photolithography and etching processes. The electrodes have high accuracy in size and spacing, and can collect capacitance change data between the user's finger and the sensing points in real time, i.e., second capacitive sensing data. This data can reflect the relative position and contact state of the user's finger and the pointing stick. The surrounding arrangement can detect the user's finger approach and contact actions from all directions, and the capacitance data from multiple sensing points can be comprehensively judged to determine the user's operating state, improving the accuracy of contact detection.

[0040] Temperature Sensor: The temperature sensor is a surface-mount thermistor sensor, attached to the back of the base and in close contact with the circuit board. It can collect real-time ambient temperature data around the pointing stick module, i.e., third-party temperature sensing data. This data reflects the impact of ambient temperature changes on the pressure sensor array. The temperature sensor's mounting position avoids the heat-generating areas of the circuit board, ensuring that the collected temperature data reflects the actual ambient temperature of the pointing stick module, providing accurate environmental parameters for subsequent temperature drift correction.

[0041] Strain Sensors: The strain sensors are patch-type resistance strain gauges, four of which are positioned at the edges of the base, corresponding to the four corners of the base. They can collect real-time deformation data of the multi-layer composite circuit board of the base, i.e., the fourth strain sensing data. This data reflects the physical deformation of the pointing stick base caused by factors such as keyboard substrate deformation and external vibrations. The strain sensors are mounted using a high-precision bonding process to ensure a tight fit between the strain gauge and the circuit board surface, accurately capturing minute deformations of the circuit board and providing data support for subsequent dynamic adjustments of the coordinate mapping relationship.

[0042] The signal processing unit is electrically connected to the sensing unit and is integrated onto a multilayer composite circuit board on the base using surface mount technology. Its placement is close to the sensing unit, such as... Figure 1 As shown, the signal processing unit and the sensing unit are integrated in close proximity, shortening the transmission distance of the sensing data and reducing signal attenuation and interference during transmission. The signal processing unit is a dedicated signal conditioning chip that integrates analog-to-digital conversion circuits, signal amplification circuits, and filtering circuits. Its core function is to perform analog-to-digital conversion and preprocessing on the multi-source sensing data collected by the sensing unit. The specific implementation process is as follows: The raw sensing data collected by the sensing unit is an analog signal. This analog signal first enters the signal amplification circuit, which linearly amplifies the weak analog signal. The amplification factor is set according to the output signal characteristics of each sensor to ensure that the amplified signal is within the effective detection range of the analog-to-digital conversion circuit. The amplified analog signal then enters the filtering circuit, which filters out high-frequency noise in the signal, reducing detection errors caused by environmental electromagnetic interference. Finally, the amplified and filtered analog signal enters the analog-to-digital conversion circuit, which converts the analog signal into a digital signal and transmits it to the microcontroller unit for further processing.

[0043] It is understandable that the signal processing unit is a key link connecting the sensing unit and the microcontroller unit. Its preprocessing of sensing data can improve the quality of digital signals and provide an accurate and stable data source for subsequent data processing by the microcontroller unit. Its close-range, high-precision integration with the sensing unit further reduces signal loss and improves the overall sensing and detection sensitivity.

[0044] The microcontroller unit is electrically connected to the signal processing unit and the main control circuit of the keyboard, and is also integrated onto the multilayer composite circuit board of the base using a surface mount process, such as... Figure 1 As shown, the microcontroller unit, as the control core of the system, is electrically connected to the signal processing unit and the keyboard main control circuit to realize data reception and command transmission. The microcontroller unit adopts a low-power, high-speed microcontroller chip, which has a built-in hardware filter and is configured to execute the pointing stick-assisted control method of this embodiment.

[0045] Hardware Filter: The built-in hardware filter of the microcontroller is an RC low-pass filter. Its filter cutoff frequency is set according to the transmission frequency of the sensor data. It can perform secondary filtering on the digital signal output by the signal processing unit, effectively suppressing high-frequency noise in the digital signal, further improving the purity of the signal, and ensuring the accuracy of subsequent data processing and intent recognition.

[0046] Data processing and control command generation: The microcontroller receives digital sensor data preprocessed by the signal processing unit. Following the control method of this embodiment, it completes a series of operations including environmental compensation, data fusion, operation intent recognition, and control command generation. The generated cursor control commands are then transmitted to the keyboard's main control circuit, which in turn transmits the commands to the laptop's host computer, ultimately controlling the cursor movement. Simultaneously, the microcontroller can store core parameters of the user's adaptive control model, various preset thresholds, and sensor baseline data, providing data support for data processing.

[0047] In this embodiment, the system also includes a host computer driver program that communicates with the microcontroller unit, such as... Figure 1 As shown, the host computer driver is installed on the laptop host and interacts with the microcontroller unit via a communication protocol. Its core function is to provide a human-machine interface for users to configure system parameters and control functions. Specifically, the host computer driver's human-machine interface provides a parameter configuration entry point. Users can adjust detection parameters such as capacitance threshold and pressure threshold according to their own operating habits, and can also fine-tune the relevant parameters of the user adaptive control model. At the same time, the interface also has an enable / disable button for the adaptive learning function. Users can choose whether to enable the system's adaptive learning function as needed. When the function is disabled, the system will generate cursor control commands according to the default control parameters.

[0048] Understandably, the settings of the host computer driver improve the system's applicability, allowing the system to adapt to the operating habits of different users, further enhancing the user experience. Moreover, its communication method adopts the universal USBHID protocol, eliminating the need for additional communication modules and reducing the hardware complexity of the system.

[0049] The keyboard pointing stick assisted control method based on multi-source sensor data in this embodiment is applied to the above-mentioned pointing stick assisted control system. This method achieves high-precision cursor control of the pointing stick by real-time acquisition of multi-source sensor data, environmental compensation, data fusion to identify operation intentions, and generating control commands in combination with user adaptive control models. Furthermore, relying on the high-precision hardware structure of the system, the sensitivity and stability of the control are further improved. Figure 2 This is a flowchart of the keyboard pointing stick assisted control method based on multi-source sensor data of the present invention. The diagram clearly shows the various steps and execution order of the control method. Before real-time acquisition of multi-source sensor data, the system first completes the zero-point adaptive calibration of the sensors, and then sequentially executes the steps of multi-source sensor data acquisition, real-time environmental compensation, data fusion to identify operation intentions, and generating cursor control commands. The specific implementation process, implementation method and function of each step are described in detail below, and the key parameters and processes involved, such as thresholds and model generation, are clearly explained to ensure the feasibility of the technical solution.

[0050] Before acquiring multi-source sensor data in real time, the system periodically acquires baseline data from each sensor in a non-operational state, and uses this baseline data to adaptively calibrate the zero point of the corresponding sensor, such as... Figure 2 As shown, this step is the preliminary initialization step of the control method, which is the basis for ensuring the accuracy of subsequent sensor data acquisition.

[0051] Baseline Data Acquisition: The system is set with a fixed calibration cycle, which is 30 minutes in this embodiment. When the system is in an inactive state, i.e., when the pointing stick module is not subjected to any pressing or contact action by the user, the microcontroller unit controls the sensing unit to acquire the output data of the pressure sensor array, capacitance sensor array, temperature sensor, and strain sensor in this state, as the baseline data of each sensor. Specifically, the baseline data of the pressure sensor array is the zero-pressure output value in the no-press state; the baseline data of the capacitance sensor array is the initial capacitance value in the state without a finger approaching; the baseline data of the temperature sensor is the initial resistance value at the current ambient temperature; and the baseline data of the strain sensor is the initial resistance value in the state without circuit board deformation.

[0052] Zero-point adaptive calibration: The microcontroller stores the acquired baseline data in its internal storage and compares the real-time data from each sensor with the baseline data. Using the baseline data as a reference, the zero point of the sensors is calibrated to eliminate zero-point drift caused by long-term use or environmental changes. For example, after prolonged use, a pressure sensor array may experience a shift in its zero-pressure output value. Baseline data calibration corrects the sensor's output value to the actual pressure value, ensuring the accuracy of the initial pressure sensing data.

[0053] It is understandable that periodic zero-point adaptive calibration can eliminate long-term drift of sensor signals, maintain the long-term reliability and accuracy of the pointing stick, avoid detection errors caused by sensor zero-point offset, and provide accurate raw data for subsequent environmental compensation and data fusion.

[0054] After completing the sensor zero-point adaptive calibration, the system enters normal operation. The microcontroller unit controls the sensing unit to collect multi-source sensor data from the pointing stick module in real time, such as... Figure 2 As shown, this step is the data source acquisition stage of the control method. The multi-source sensor data includes at least the first pressure sensor data, the second capacitance sensor data, and the third temperature sensor data. In some optional embodiments, it also includes the fourth strain sensor data.

[0055] First-stage pressure sensing data acquisition: The pressure sensor array detects the magnitude and direction of the user's pressure on the operating cap in real time. The detected analog pressure signal is transmitted to the signal processing unit. After amplification, filtering, and analog-to-digital conversion by the signal processing unit, it is converted into digital pressure data, i.e., the first-stage pressure sensing data, and transmitted to the microcontroller unit. This data contains independent pressure values ​​from four cross-shaped distributed sensors. The direction of the user's press can be determined by the difference in pressure values ​​from the four sensors, and the intensity of the user's press can be determined by the magnitude of the pressure values.

[0056] Secondary capacitive sensing data acquisition: The capacitive sensor array detects the capacitance changes between the user's finger and each capacitive sensing point in real time. The detected analog capacitance signal is transmitted to the signal processing unit, where it is preprocessed and converted into digital capacitance data, i.e., secondary capacitive sensing data, which is then transmitted to the microcontroller unit. This data contains the real-time capacitance value of each capacitive sensing point. By observing changes in capacitance values, the relative position of the user's finger and the pointing stick can be determined, such as whether the finger is close to or in contact with the operating cap.

[0057] Third-level temperature sensing data acquisition: The temperature sensor detects the ambient temperature around the pointing stick module in real time, and transmits the detected analog temperature signal to the signal processing unit. After preprocessing, it is converted into digital temperature data, i.e., the third-level temperature sensing data, and then transmitted to the microcontroller unit. This data is the real-time ambient temperature value, which can reflect the impact of ambient temperature changes on the detection characteristics of the pressure sensor array.

[0058] Fourth strain sensing data acquisition: The strain sensor detects the deformation of the multilayer composite circuit board of the base in real time, and transmits the detected analog strain signal to the signal processing unit. After preprocessing, it is converted into digital strain data, namely the fourth strain sensing data, and then transmitted to the microcontroller unit. This data is the real-time deformation value of the circuit board, which can reflect the influence of factors such as keyboard substrate deformation and external vibration on the physical state of the pointing stick module.

[0059] In this embodiment, the sampling frequency of the sensing unit is set to 100Hz. This sampling frequency can ensure real-time detection of user operation actions without causing excessive processing load on the microcontroller unit due to excessive sampling frequency. At the same time, relying on the high-precision hardware structure of the system, the sampling sensitivity of the sensing unit is slightly improved compared with the traditional existing pointing stick, which can accurately capture the user's slight pressing and moving actions, providing a more detailed data source for subsequent operation intention recognition.

[0060] The microcontroller receives multi-source sensor data acquired by the sensing unit and preprocessed by the signal processing unit, and performs real-time environmental compensation on it, such as... Figure 2As shown, this step follows the multi-source sensor data acquisition step. Its core function is to counteract the interference of environmental factors and physical deformation on the sensor data, improve the accuracy of the sensor data, and provide reliable basic data for subsequent data fusion. Real-time environmental compensation includes at least temperature drift correction of the first pressure sensor data based on the third temperature sensor data. In some optional implementations, it also includes dynamically adjusting the coordinate mapping relationship of the pointer module based on the fourth strain sensor data. The specific implementation process of each compensation operation is as follows: Temperature Drift Correction: The detection characteristics of piezoresistive pressure sensors are significantly affected by ambient temperature. Changes in ambient temperature cause the sensor's output value to drift, i.e., temperature drift. Therefore, temperature drift correction is needed for the first pressure sensing data based on third-party temperature sensing data. The specific implementation process is as follows: The microcontroller unit internally stores the temperature characteristic curve of the pressure sensor array. This curve represents the correspondence between the temperature and pressure output correction coefficient calibrated at the factory. The microcontroller unit matches the corresponding pressure output correction coefficient from the temperature characteristic curve based on real-time acquired third-party temperature sensing data. This correction coefficient is then applied to the first pressure sensing data to linearly correct the output value of each pressure sensor. The calculation formula is: Corrected pressure value = Original pressure value × Correction coefficient. This method eliminates the influence of ambient temperature changes on pressure detection, ensuring that the first pressure sensing data accurately reflects the user's actual pressing pressure.

[0061] Dynamic Adjustment of Coordinate Mapping: Factors such as keyboard substrate deformation and external vibrations can cause minute deformations in the multi-layer composite circuit board of the pointing stick base, leading to a shift in the cursor control coordinates of the pointing stick. Therefore, it is necessary to dynamically adjust the coordinate mapping relationship of the pointing stick module based on fourth strain sensor data. The specific implementation process is as follows: The microcontroller unit stores the original coordinate mapping relationship of the pointing stick module, which corresponds to the pressure data from the pressure sensor array and the cursor movement coordinates. Based on the real-time acquired fourth strain sensor data, the microcontroller unit calculates the influence coefficient of the circuit board deformation on the coordinate mapping, and then dynamically corrects the original coordinate mapping relationship according to this influence coefficient, adjusting the corresponding ratio of pressure data and cursor movement coordinates. For example, when the circuit board deforms in a certain direction, the microcontroller unit will adjust the coordinate mapping ratio in that direction accordingly to offset the cursor coordinate shift caused by the deformation, ensuring that the direction and distance of cursor movement are consistent with the user's pressing operation.

[0062] It is understandable that real-time environmental compensation is a key step in improving the control accuracy of the pointing stick. This step can effectively counteract the interference of external factors such as ambient temperature and circuit board deformation, solving the problem of decreased control accuracy of traditional pointing sticks in complex usage scenarios. Furthermore, relying on the system's high-precision strain and temperature sensors, the accuracy and real-time performance of the compensation operation are further improved.

[0063] The microcontroller fuses the environmentally compensated first pressure sensor data with the second capacitive sensor data, and identifies the user's current operational intent regarding the pointing stick module based on the fusion result. Figure 2 As shown, this step follows the real-time environment compensation step. Its core is to accurately determine the user's operational behavior through comprehensive analysis of multi-source data, providing a basis for generating subsequent cursor control commands. The data fusion method is feature-layer fusion, which extracts the core features of two types of data for comprehensive judgment. Specifically, the process involves comparing the second capacitance sensor data with a preset capacitance threshold, and comparing the first pressure sensor data after environmental compensation with a preset pressure threshold. Based on the results of the two comparisons, the current operational intent state is categorized into one of the following: distance state, hovering state, light touch state, press-and-move state, or hard press state.

[0064] In this embodiment, preset capacitance and pressure thresholds are explicitly set, and these thresholds can be fine-tuned by the user according to their operating habits via a host computer driver. The specific threshold settings are as follows: the capacitance threshold is set to 1.2 times the baseline capacitance value, where the baseline capacitance value is the baseline data of the capacitance sensor array; the pressure threshold is divided into a light touch pressure threshold and a hard press pressure threshold, with the light touch pressure threshold set to 10 kPa and the hard press pressure threshold set to 200 kPa. The specific recognition and determination conditions for each operating intention state are as follows: Distant state: When the second capacitance sensor data is less than the preset capacitance threshold and the first pressure sensor data is zero, it is determined that the user's current operation intention is in a distant state, that is, the user's finger is not close to the pointing stick module and there is no operation intention.

[0065] Hovering state: When the second capacitance sensor data is greater than or equal to the preset capacitance threshold and the first pressure sensor data is zero, the user's current operation intention is determined to be a hovering state, that is, the user's finger is close to the pointing stick module, but does not touch or press the operation cap, and has no actual pressing operation intention.

[0066] Touch state: The second capacitance sensor data is greater than or equal to the preset capacitance threshold, and the first pressure sensor data is greater than zero and less than the touch pressure threshold. The user's current operation intention is determined to be a touch state, that is, the user's finger touches the operation cap, but only makes a slight press, and there is no intention to move the cursor.

[0067] Press-and-move state: When the second capacitive sensing data is greater than or equal to the preset capacitive threshold, and the first pressure sensing data is greater than or equal to the light touch pressure threshold and less than the heavy press pressure threshold, the user's current operation intention state is determined to be the press-and-move state, that is, the user's finger presses the operation cap and intends to move the cursor. This state is the core working state of the pointing stick.

[0068] Forced Press State: When the second capacitive sensing data is greater than or equal to the preset capacitive threshold and the first pressure sensing data is greater than or equal to the forceful press pressure threshold, the user's current operation intention state is determined to be a forceful press state, that is, the user's finger presses the operating cap forcefully. This state can be mapped to the left-click or right-click function of the mouse. The specific mapping relationship can be configured through the host computer driver.

[0069] After identifying the user's current operational intent, the microcontroller stores this information and uses it as a crucial basis for generating subsequent cursor control commands. It can be understood that by comparing and integrating pressure and capacitance data, different user operational intent states can be accurately distinguished, avoiding misjudgments caused by single data detection, and achieving a control response that is more intuitive for the user. Furthermore, relying on the system's high-precision sensing units, the accuracy of data detection is higher, and the misjudgment rate of operational intent recognition is significantly reduced.

[0070] The microcontroller generates corresponding cursor control commands based on the identified user's current operational intent and a pre-stored user adaptive control model, such as... Figure 2 As shown, this step is the output stage of the control method. The generated control commands are transmitted to the laptop host via the keyboard main control circuit, ultimately achieving precise cursor control. The user adaptive control model is a personalized set of control parameters generated based on the user's historical operation data. Its core is the user's personalized pressure-cursor speed response curve. Different operation intention states correspond to different cursor control command generation logics. The specific implementation process is as follows: Generation and storage of user adaptive control models: The user adaptive control model is automatically generated by the microcontroller unit. When the user enables the adaptive learning function, the microcontroller unit will continuously collect historical operation data generated by the user operating the pointing stick module over a period of time, and fit a personalized pressure-cursor speed response curve based on this data. This curve is then stored in the internal storage unit as the core parameter of the model. The specific implementation process is as follows: Historical operation data collection: The microcontroller collects the first pressure sensor data sequence and the corresponding cursor speed data sequence generated when the user operates the pointing stick module in a pressing and moving state for 7 consecutive days. The pressure data sequence is the real-time pressure value of the user pressing the operation cap, and the cursor speed data sequence is the actual cursor movement speed value corresponding to the pressure value.

[0071] Personalized curve fitting: The microcontroller unit uses the least squares method to linearly fit the collected pressure data sequence and cursor speed data sequence to obtain the user's personalized pressure-cursor speed response curve. This curve reflects the personalized correspondence between the user's pressing pressure and cursor movement speed. For example, some users are accustomed to light pressing to achieve fast cursor movement, while others are accustomed to heavy pressing. The fitted curve will accurately match the operating habits of different users.

[0072] Model storage and updates: The microcontroller stores the fitted personalized pressure-cursor speed response curve as the core parameter of the user adaptive control model. When the user continues to use the pointing stick, the microcontroller will periodically update the historical operation data and refit the curve to realize the dynamic update of the user adaptive control model and ensure that the model always fits the user's latest operating habits.

[0073] In this embodiment, the user can disable the adaptive learning function through the host computer driver. At this time, the system will use the default pressure-cursor speed response curve to generate cursor control commands. The default curve is a general curve that adapts to the operating habits of most users.

[0074] Cursor control command generation corresponding to different operation intention states: Based on the identified current operation intention state and in conjunction with the user adaptive control model, the microcontroller generates corresponding cursor control commands. Different operation intention states correspond to different command generation logics, as detailed below: Away state, hover state, and touch state: When the microcontroller detects that the user is in one of the above three states, it determines that the user has no intention to move the cursor, and therefore generates a cursor control command without operation, that is, the cursor remains stationary.

[0075] Press-and-Move Status: When a user is detected to be in a press-and-move state, the microcontroller unit extracts the first pressure sensor data after environmental compensation to obtain the direction and force of the user's press. Then, based on the personalized pressure-cursor speed response curve in the pre-stored user adaptive control model, it matches the cursor movement speed corresponding to the current pressing force. Combined with the pressing direction, it generates a corresponding cursor movement control command, which includes the direction and speed parameters of the cursor movement. For example, if the user presses the cap to the left with a pressing force of 50 kPa, the microcontroller unit matches the cursor movement speed corresponding to this force according to the personalized curve to a medium speed, and therefore generates a command to control the cursor to move to the left at a medium speed.

[0076] High-pressure state: When the user is detected to be pressing the button hard, the microcontroller generates corresponding mouse button control commands, such as left-click and right-click commands, according to the preset mapping relationship of the host computer driver, while the cursor remains stationary.

[0077] The microcontroller unit transmits the generated cursor control commands to the laptop host in real time through the keyboard main control circuit. After receiving the commands, the host controls the cursor to complete the corresponding actions, realizing precise control of the cursor by the pointing stick.

[0078] This embodiment of the keyboard pointing stick auxiliary control method and system based on multi-source sensor data relies on domestically developed high-precision circuit board manufacturing and chrome plating processes to achieve the matching of the core component's process precision with existing similar products, successfully replacing similar suppliers in the existing technology. Furthermore, it achieves minor optimizations in sensor detection sensitivity and environmental adaptability. The technical solution of this method and system is practically implementable, and the integration of each component and the data processing flow all have clear implementation paths. Its beneficial effects after practical application are mainly reflected in the following aspects, and all beneficial effects are achievable after the technical solution is actually implemented, without any exaggeration: Matching process and performance to achieve import substitution: This embodiment overcomes the process challenges in high-precision fabrication of multilayer composite circuit boards and chrome plating of operating caps in mainland China, achieving the same process precision for the core components of the pointing stick as similar products in the existing technology. Moreover, the detection sensitivity of the sensing unit is slightly improved compared to traditional pointing sticks, enabling precise capture of the user's subtle operating actions and meeting the user's demand for high precision and high sensitivity of the pointing stick. This successfully achieves a substitution for similar products from existing suppliers.

[0079] Counteracting environmental interference and improving control stability: This embodiment effectively counteracts the interference of external factors such as changes in ambient temperature and deformation of the keyboard substrate on sensor detection by collecting multi-source sensor data and performing real-time environmental compensation. It solves the problems of decreased control accuracy and cursor drift jitter of traditional pointing sticks in complex usage scenarios, and improves the stability and consistency of pointing stick control.

[0080] Accurate identification of user intent and reduced misjudgment rate: This embodiment integrates environmentally compensated pressure sensing data and capacitance sensing data to accurately classify the user's operation intent state. It can effectively distinguish different operation states such as moving away, hovering, light touch, pressing and moving, and pressing hard, avoiding misjudgment of operation intent caused by single data detection and achieving a control response that is more in line with the user's intuition.

[0081] Adapting to user operating habits and improving user experience: This embodiment constructs an adaptive control model based on users' historical operation data and fits personalized pressure-cursor speed response curves, so that the pointer's control feel can accurately match the operating habits of different users. Moreover, the model can be dynamically updated, further improving the user experience. At the same time, users can configure system parameters through the host computer driver, improving the system's applicability.

[0082] Modular high-precision integration enhances production consistency: In this embodiment, functional units such as sensing units, signal processing units, and microcontroller units are integrated onto a multi-layer composite circuit board on the pointing stick base using surface mount technology. This achieves modular high-density packaging of the system. Relying on the high-precision manufacturing process in mainland China, it effectively improves the production consistency of the product, reduces the process difficulty in the production process, and is suitable for mass production.

[0083] Long-term reliability improvement and reduced maintenance costs: This embodiment eliminates long-term drift of sensor signals by periodically collecting sensor baseline data for zero-point adaptive calibration, maintaining the long-term detection accuracy and reliability of the pointing stick, reducing product repair and replacement due to sensor failure, and lowering subsequent maintenance costs of the product.

[0084] The above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention in any way. Although the present invention has been disclosed above with reference to preferred embodiments, it is not intended to limit the present invention. Any person skilled in the art can make some modifications or alterations to the above-disclosed technical content to create equivalent embodiments without departing from the scope of the present invention. Any simple modifications, equivalent changes and alterations made to the above embodiments based on the technical essence of the present invention without departing from the scope of the present invention shall still fall within the scope of the present invention.

Claims

1. A keyboard pointing stick-assisted control method based on multi-source sensor data, applied to an input device including a pointing stick module, characterized in that, This includes the following steps: Step 1: Real-time acquisition of multi-source sensor data from the pointing stick module, wherein the multi-source sensor data includes at least first pressure sensor data, second capacitance sensor data and third temperature sensor data; Step 2: Perform real-time environmental compensation on the multi-source sensor data. The real-time environmental compensation includes at least temperature drift correction of the first pressure sensor data based on the third temperature sensor data. Step 3: The first pressure sensor data after environmental compensation is fused with the second capacitance sensor data, and the user's current operating intention state for the pointing stick module is identified based on the fusion result. Step four: Based on the identified current operation intention state and the pre-stored user adaptive control model, generate the corresponding cursor control command, wherein the user adaptive control model is a set of personalized control parameters generated based on the user's historical operation data.

2. The keyboard pointing stick-assisted control method based on multi-source sensor data according to claim 1, characterized in that, In step one, the multi-source sensing data also includes fourth strain sensing data; In step two, the real-time environmental compensation also includes dynamically adjusting the coordinate mapping relationship of the pointing stick module based on the fourth strain sensing data.

3. The keyboard pointing stick-assisted control method based on multi-source sensor data according to claim 1, characterized in that, In step three, the user's current operational intent state regarding the pointing stick module is identified based on the fusion results, specifically including: The second capacitance sensing data is compared with a preset capacitance threshold, and the first pressure sensing data is compared with a preset pressure threshold. Based on the comparison results, the current operation intention state is divided into one of the following: away state, hovering state, light touch state, press and move state, and strong press state.

4. The keyboard pointing stick-assisted control method based on multi-source sensor data according to claim 1, characterized in that, In step four, the generation of the user adaptive control model includes: Collect the pressure data sequence and the corresponding cursor speed data sequence generated by the user operating the pointing stick module over a period of time; Based on the pressure data sequence and cursor velocity data sequence, a personalized pressure-cursor velocity response curve for the user is obtained by fitting. The personalized pressure-cursor speed response curve is stored as the core parameter of the user adaptive control model.

5. The keyboard pointing stick-assisted control method based on multi-source sensor data according to claim 1, characterized in that, Before acquiring multi-source sensor data in real time, the method also includes: periodically acquiring baseline data of each sensor in a non-operational state, and using the baseline data to adaptively calibrate the zero point of the corresponding sensor.

6. A keyboard pointing stick auxiliary control system based on multi-source sensor data, applicable to the keyboard pointing stick auxiliary control method based on multi-source sensor data as described in any one of claims 1 to 5, characterized in that, The system consists of: A pointing stick module integrated on a keyboard circuit board, the pointing stick module including a base and an operating cap disposed on the base; A sensing unit is disposed inside or below the base and is used to collect multi-source sensing data. The sensing unit includes at least a pressure sensor array for collecting first pressure sensing data, a capacitive sensor array for collecting second capacitance sensing data, and a temperature sensor for collecting third temperature sensing data. A signal processing unit, electrically connected to the sensing unit, is used to perform analog-to-digital conversion and preprocessing on the multi-source sensing data; The microcontroller unit is connected to the main control circuit of the signal processing unit and the keyboard, respectively, and is configured to execute the method.

7. The keyboard pointing stick auxiliary control system based on multi-source sensor data according to claim 6, characterized in that, The pressure sensor array includes four miniature pressure sensors arranged in a cross shape; The capacitive sensor array includes a plurality of capacitive sensing points arranged around the pressure sensor array. The temperature sensor is attached to the back of the base.

8. The keyboard pointing stick auxiliary control system based on multi-source sensor data according to claim 6, characterized in that, The base of the pointing stick module is a multilayer composite circuit board structure, and the sensing unit and signal processing unit are integrated on the multilayer composite circuit board structure through surface mount technology.

9. The keyboard pointing stick auxiliary control system based on multi-source sensor data according to claim 6, characterized in that, The microcontroller unit has a built-in hardware filter for filtering the digital signals output by the signal processing unit.

10. The keyboard pointing stick auxiliary control system based on multi-source sensor data according to claim 6, characterized in that, The system also includes a host computer driver that is communicatively connected to the microcontroller unit. The host computer driver is used to provide a human-computer interaction interface so that users can configure relevant parameters of the user adaptive control model or enable or disable the adaptive learning function.

Images