Cross-system visual positioning input control system and method

Abstract

The invention discloses a control system and method for cross-system visual positioning input, and relates to the technical field of computer input equipment. The control system comprises a light emitting module, a key module, a communication module, an image acquisition module and an information processing module. The control method is applied to the device, and cross-system compatibility and pure vision accurate positioning are achieved through communication link establishment, infrared light spot emission, transmission image capture, image processing, coordinate mapping, event delivery and control right switching. According to the invention, single-hardware multi-form adaptation, cross-mainstream desktop system compatibility and seamless control right switching are realized, the structure is simple, the cost is low, multiple scenes of office and games are considered, and the user experience is improved. According to the invention, single-hardware multi-form adaptation, cross-mainstream desktop system compatibility and seamless control right switching are realized, the structure is simple, the cost is low, multiple scenes of office and games are considered, and the user experience is improved.

Description

Technical Field

[0001] This invention relates to the field of computer external input devices, and more specifically to a control system and method for cross-system visual positioning input. Background Technology

[0002] Currently, infrared positioning technology is widely used in computer input devices such as air mice, electronic pointers, and game light guns, providing users with a non-contact input control method and enriching the application scenarios of input devices. However, existing infrared positioning-based input solutions (including devices and control methods) still have many obvious shortcomings, making it difficult to meet users' needs for multi-scenario, high compatibility, and smooth operation. Specific shortcomings are as follows: 1. Limited system compatibility: The control programs of existing infrared positioning input devices are mostly limited to the Windows operating system, with poor compatibility with mainstream desktop operating systems such as Linux and macOS. Often, it is necessary to develop dedicated drivers or modify program code to achieve compatibility, which increases development costs and limits the application scope of the devices. 2. Fixed hardware form and complex structure: Most infrared positioning input devices are designed with only a single form, which cannot achieve multiple uses and increases the user's cost; moreover, they mostly adopt a hybrid positioning method of "infrared emission + inertial sensor", which is complex in structure, expensive, and prone to sensor drift problem, affecting positioning accuracy; 3. Unsmooth control switching: There is no effective automatic switching mechanism between the infrared positioning control program and the system's native input control, making operation cumbersome, prone to control conflicts, and causing cursor lag and operation failure; 4. Poor operational compatibility: The physical buttons of special-shaped devices are not connected to the operating system's native mouse driver, resulting in poor compatibility and problems such as unresponsive buttons and incorrect mapping. 5. Poor parameter adaptability: The anti-shake threshold, light spot detection time and other parameters of the existing control methods are mostly fixed values, which cannot be adjusted according to user habits and scenario requirements; 6. Disconnect between device and method: In the existing solution, the input device and the control method are not deeply integrated, resulting in insufficient compatibility between the control logic and the hardware structure, which affects the positioning accuracy and the smoothness of operation; 7. Insufficient human safety: Existing game light gun solutions require placing four or more infrared emitters around the display screen, with the infrared emitters directly facing the user's eyes. The infrared light is invisible (wavelength is mostly in the range of 700nm-1100nm). When used for a long time, the infrared light continuously shines directly into the eyes, which can easily cause eye fatigue, dryness, and may even cause potential damage to the retina, posing a significant human safety hazard.

[0003] In summary, existing infrared positioning input devices and control methods cannot achieve cross-system compatibility, multi-form adaptation, accurate positioning, seamless control switching, flexible adaptation, and human safety protection. Furthermore, some light gun solutions lack convenient wireless control design. Therefore, developing a cross-system infrared visual positioning dual-mode input device and control method that can solve the above problems has significant practical significance and application value. Summary of the Invention

[0004] In view of the above-mentioned deficiencies of the prior art, the purpose of this invention is to provide a control system and method for cross-system visual positioning input, which realizes single hardware with multiple forms, cross-system compatibility, pure visual precise positioning, seamless switching of control rights and native-level button compatibility, deeply binds the device and method, takes into account multiple application scenarios such as office and game, reduces costs, improves user experience, and significantly improves human safety while eliminating the safety hazards of infrared light directly shining into the human eye.

[0005] The objective of this invention is achieved through the following technical solution: A control system for cross-system visual positioning input, comprising: The light emitting module emits light into the display screen, forming light spots on the display screen; The button module outputs corresponding control signals when pressed, which are then transmitted to the operating system. The communication module collects control signals output by the button module and transmits them to the operating system, communicating with the light emission module. The image acquisition module acquires image information displayed on the screen. The information processing module processes the image information acquired by the image acquisition module, obtains the coordinate information of the light spot on the display screen in real time, and sends the coordinate information to the operating system in real time to generate mouse movement events; it also obtains the control signals output by the button module and sends the control signals to the operating system; and controls the light emission module through the communication module.

[0006] The system uses light to form light spots on the display screen as the basis for visual interaction with the human eye. The image acquisition module obtains the positional relationship between the light spots and the screen, and the information processing module generates coordinate information that the operating system can recognize. This establishes an effective information connection between the human eye's vision and the operating system, and the button module enables information confirmation.

[0007] Furthermore, it also includes a hardware body; the light emitting module, button module, and communication module are mounted on the hardware body; The light emitting module includes an infrared emitting head, which is located at the front end of the hardware body and is detachably connected to the hardware body via a snap-fit. It is used to emit infrared light to the screen to form infrared light spots on the screen. The snap-fit ​​connection is provided with an anti-loosening structure and / or filler. The emitting head of the light emitting module is detachable. The wavelength of the infrared light is 700nm~1100nm. The communication module includes a wireless communication module and / or a wired communication module; The button module includes standard physical buttons and / or touch buttons; The hardware body has a double-layer printed circuit board, and the light emitting module and the button module circuits are arranged independently on the double-layer printed circuit board; the double-layer printed circuit board is equipped with filter capacitors and anti-interference magnetic beads.

[0008] The hardware itself can be selected according to actual needs, adapting to both desktop mouse and gun-shaped light gun forms. It adopts a pure infrared vision positioning solution, eliminating the need for inertial sensors and external controllers, resulting in a simple hardware structure and significantly reduced production, assembly, and maintenance costs. Simultaneously, it avoids sensor drift issues, and combined with multi-step image processing, anti-shake logic, and high frame rate image acquisition in the control method, it ensures smooth cursor movement and precise positioning.

[0009] The power supply control wiring of the light emitting module is arranged on the first layer, and the signal wiring of the button module is arranged on the second layer, or both are arranged on the same layer but separated by a ground or power line isolation strip. A filter capacitor is connected in series in the power supply control path of the light emitting module; an anti-interference ferrite bead is connected in series at the data line pins of the button module's signal circuit. This design effectively reduces crosstalk between high-frequency signals and low-voltage signals, ensuring hardware signal stability; it effectively suppresses crosstalk between the high-frequency drive signal of the infrared emitter and the low-voltage signal of the button module, avoiding problems such as accidental button triggering and unstable light spot positioning, and ensuring the hardware's performance in cross-system infrared visual positioning.

[0010] The snap-fit ​​structure ensures both connection stability and easy disassembly; the anti-loosening structure can employ interference fit or fill the gap between the two with sponge or other filler materials. The detachable transmitter head can be achieved through a connection structure between the light emission module and the main hardware unit.

[0011] The infrared transmitter head is detachable and replaceable, and can be adapted to infrared emission modules of different wavelengths; the PC-side processing program supports custom parameter configuration and global shortcut key configuration, which can be adjusted according to the user's own usage habits, making it more adaptable; the device and method are optimized together, and can be flexibly adapted to different usage scenarios.

[0012] Furthermore, the outer contour of the hardware body is gun-shaped; the stock of the hardware body is a retractable structure, and the grip of the hardware body is provided with anti-slip texture; when holding the hardware body, the button module located on the hardware body can be triggered.

[0013] The gun mode can be adapted to corresponding operations, such as shooting games. Multiple input methods can be implemented by setting up structures such as mouse buttons on the hardware itself, such as scroll wheel, left and right buttons, and custom buttons.

[0014] Furthermore, the outer contour of the hardware body is in the shape of a mouse, the surface of the hardware body is provided with an ergonomically adapted arc-shaped groove, the surface is provided with anti-slip texture, and the bottom is provided with anti-slip pads.

[0015] The mouse's design is adapted for extended use in daily office scenarios.

[0016] Furthermore, the image acquisition module includes a high frame rate infrared recognition camera, which acquires image information with light on the display screen in real time and sends the image information to the information processing module in real time; It also includes an adjustable mounting bracket to adjust and fix the high frame rate infrared recognition camera to capture and display the complete image on the screen.

[0017] Furthermore, the information processing module includes: The communication unit communicates with the light emission module and the image acquisition module via a communication module. The operating system identification unit automatically identifies the current PC operating system type and matches and calls the corresponding native input event interface; The image processing unit preprocesses the image information acquired by the image acquisition module, performs effective spot detection and image stabilization, and obtains the spot coordinates. The coordinate mapping unit maps and clamps the coordinates of the light spot onto the display screen to obtain the coordinate information of the light spot relative to the display screen; The event delivery unit calls the native input event interface of the corresponding operating system and delivers mouse movement events to the operating system message queue based on real-time coordinate information changes; It also includes a control switching unit. If the image processing unit fails to collect the coordinates of the light spot within a preset time, the event delivery unit stops event delivery.

[0018] A method for controlling cross-system visual positioning input includes the following steps: The information processing module is communicatively connected to the image acquisition module and the light emission module; The information processing module controls the light emitting module to emit light; the handheld light emitting module controls the emitted light to form light spots on the display screen; The information processing module controls the image acquisition module to acquire display screen image information containing light spots, and sends the acquired image information to the information processing module in real time; The information processing module processes the image information acquired by the image acquisition module and obtains the coordinate information of the light spot on the display screen in real time; The information processing module automatically identifies the current PC operating system type, calls the native input event interface corresponding to the current operating system, and then sends the coordinate information to the operating system in real time to form a mouse movement event, thereby realizing infrared light point positioning to drive the mouse cursor movement; The information processing module continuously monitors valid light spots. If no valid light spot is detected for a preset period of time, it immediately stops sending mouse movement events to the system message queue and returns the system input control to the native control of the operating system. The operating system receives the button module's press and outputs the corresponding control signal.

[0019] Furthermore, the step "the information processing module processes the image information acquired by the image acquisition module and obtains the coordinate information of the light spot on the display screen in real time" includes the following steps: S41. The information processing module preprocesses each frame of the received image information, extracts the light spot area in each frame image through the preprocessing operation, and filters out interference signals such as ambient light and noise. S42. Detect the light spot regions extracted after preprocessing and determine whether they are valid light spots. If they are valid light spots, record their original coordinates in each frame of the image. S43. Perform anti-shake processing on the original coordinates of the acquired valid light spots to eliminate positioning deviations caused by coordinate jitter; S44. Map and clamp the coordinates of the light spot after image stabilization to the pixel coordinate system of the display screen to obtain coordinate information that matches the screen.

[0020] Furthermore, the preprocessing in step S41 includes: converting each received image frame from the RGB color space to the HSV color space; extracting candidate light spot regions in the image frame based on the HSV threshold range that matches the emission wavelength of the transmitter; performing morphological dilation and closing operations on the extracted candidate regions; and performing Gaussian blurring to filter out noise interference and obtain clear light spot regions.

[0021] Further, the image stabilization process in step S43 includes: calculating the Euclidean distance between the effective light point coordinates of the current frame image and the effective light point coordinates of the previous frame; setting a preset image stabilization threshold; if the calculated Euclidean distance is less than or equal to the image stabilization threshold, it is determined to be coordinate jitter, and the effective light point coordinates of the previous frame are used as the final coordinates of the current frame; if the Euclidean distance is greater than the image stabilization threshold, the effective light point coordinates detected in the current frame are used as the final coordinates.

[0022] Because of the adoption of the above technical solution, the present invention has the following advantages: 1. Native cross-system adaptation. The PC-side information processing module has a built-in operating system, which can automatically identify the operating system (Windows / Linux / macOS) currently running on the PC in real time, and call the native input event interface of the corresponding operating system (SendInput interface for Windows system, uinput interface for Linux system, and IOKit interface for macOS system) to send mouse movement events. No need to develop dedicated drivers, realizing consistent infrared positioning control logic across systems, and improving the compatibility and versatility of the device and method.

[0023] 2. Single Hardware, Dual Form Design. Adopting a design philosophy of universal core hardware and switchable external form, core components such as the core printed circuit board, infrared transmitter, and standard physical button module are universal. By changing different external shells (hardware bodies), it can switch between desktop mouse form and gun-shaped light gun form. Combined with the form adaptation logic in the control method, it achieves multiple uses with one device, reducing user operating costs.

[0024] 3. Pure Vision Positioning (Device + Method Collaboration). This approach eliminates the inertial sensors and external controllers found in existing solutions. Instead, it relies solely on a dedicated camera to capture infrared spot images on the display screen. A PC-based processing program directly calculates the spot coordinates and maps them to screen coordinates using a multi-step image processing algorithm (HSV threshold extraction, morphological noise reduction, and Euclidean distance stabilization). This simplifies the hardware structure, reduces costs, and avoids sensor drift issues. Simultaneously, the control method refines the specific steps of image processing, stabilization, and coordinate mapping, improving positioning accuracy and stability.

[0025] 4. Switching between native button and automatic control. All physical buttons (button modules) adopt the standard USB mouse button specification, directly connecting to the operating system's native mouse driver. The native driver independently processes button signals, ensuring native compatibility between the buttons and various software. In conjunction with the control switching steps in the control method, the system continuously monitors the presence or absence of valid light points, automatically controlling the delivery and cessation of mouse movement events. When no valid light point is detected for a preset duration, the system automatically relinquishes native input control, achieving seamless switching between control and native input control and avoiding control conflicts.

[0026] 5. Flexible parameter configuration. The parameter configuration interface can be set in the PC-side information processing module of the device. In conjunction with the parameter adaptation logic in the control method, it supports the custom configuration of parameters such as anti-shake threshold, effective light spot detection preset duration, and infrared light spot HSV threshold, to adapt to the usage habits and scenario needs of different users. At the same time, it supports global shortcut key configuration to realize quick operation of program start / stop and mode switching, improving convenience.

[0027] 6. Human Safety Protection. Unlike existing light guns that require multiple infrared emitters positioned around the screen facing the user's eyes, this invention emits light (infrared light is invisible, with a wavelength range of 700nm-1100nm) directly onto the display screen surface via a single emitting head, forming a captureable moving light spot. The light only acts on the screen surface and does not directly shine into the user's eyes. Furthermore, the emitting head can adjust its emission power according to the usage scenario. Combined with the light spot detection logic of the PC-side information processing module, infrared emission is activated only when positioning is needed and automatically shuts off when idle, further reducing the impact of light on the human body. The structural design completely eliminates the safety hazard of direct light shining into the eyes, ensuring that users will not experience eye fatigue or dryness even after prolonged use, thus improving human safety.

[0028] Other advantages, objectives and features of the invention will be set forth in part in the description which follows, and in part will be apparent to those skilled in the art from the following examination or study, or may be learned from the practice of the invention. Attached Figure Description

[0029] Figure 1 This is a schematic diagram of the control system for cross-system visual positioning input in the embodiment; Figure 2 This is a schematic diagram illustrating the actual use scenario of the control system with cross-system visual positioning input in the embodiment; Figure 3 This is a schematic diagram showing the layout of the light emitting module and the button module when the hardware body is in the form of a gun in the embodiment; Figure 4 This is a schematic diagram showing the layout of the light emitting module and the button module when the hardware body is in the form of a mouse in the embodiment; Figure 5 This is a schematic diagram of the control method for cross-system visual positioning input in the embodiment. Detailed Implementation

[0030] The present invention will be further described below with reference to the embodiments.

[0031] like Figure 1-4 As shown, a control system for cross-system visual positioning input includes: The light emitting module emits light into the display screen, forming light spots on the display screen; The button module outputs corresponding control signals when pressed, which are then transmitted to the operating system. The communication module collects control signals output by the button module and transmits them to the operating system, communicating with the light emission module. The image acquisition module acquires image information displayed on the screen. The information processing module processes the image information acquired by the image acquisition module, obtains the coordinate information of the light spot on the display screen in real time, and sends the coordinate information to the operating system in real time to generate mouse movement events; it also obtains the control signals output by the button module and sends the control signals to the operating system; and it controls the light emission module through the communication module. The image processing module can be part of the PC hardware and software.

[0032] In another embodiment, a hardware body is also included; the light emitting module, the button module, and the communication module are disposed on the hardware body; The light emitting module includes an infrared emitting head, which is located at the front end of the hardware body and is used to emit infrared light to the screen to form infrared light spots on the screen; the wavelength of the infrared light is 700nm~1100nm; The communication module includes a wireless communication module and / or a wired communication module; The button module includes standard physical buttons and / or touch buttons.

[0033] The communication module can be selected according to the specific needs. When wireless communication is used, low-latency Bluetooth or 2.4G wireless transmission protocols are employed to establish communication connections between the light emitting module and the information processing module, as well as between the button module and the operating system. When wired communication is used, a Type-C wired interface can serve as a backup communication and charging interface for hardware power supply and emergency use in case of wireless signal failure.

[0034] The button module can be selected as one or a combination of tap, slide, touch, scroll, etc., depending on the actual situation.

[0035] In another embodiment, the hardware body is provided with a double-layer printed circuit board, and the light emitting module and the button module circuits are arranged independently on the double-layer printed circuit board; the double-layer printed circuit board is provided with filter capacitors and anti-interference magnetic beads.

[0036] The dual-layer printed circuit board houses the light-emitting module and the button module circuits respectively, reducing signal interference between them. Specifically, a filter capacitor is connected in series in the power supply control path of the light-emitting module; an anti-interference ferrite bead is connected in series at the data line pins of the button module's signal circuit. This design effectively reduces crosstalk between high-frequency signals and low-voltage signals, ensuring hardware signal stability; it also effectively suppresses crosstalk between the high-frequency drive signal of the infrared emitter and the low-voltage signal of the button module, avoiding problems such as accidental button triggering and unstable light spot positioning, thus ensuring the hardware's performance in cross-system infrared visual positioning.

[0037] In another embodiment, the light emitting module is detachably snapped to the hardware body, and the snap-fit ​​connection is provided with an anti-loosening structure and / or filler; the emitting head of the light emitting module is detachable.

[0038] The snap-fit ​​connection uses an interference fit or compression type structure to ensure connection stability; the connection between the transmitter head and the light emitting module is similar. The interference fit or compression type structure also prevents loosening. To further enhance the anti-loosening capability, a filler material with a certain degree of elasticity, such as sponge or rubber, can be added at the connection point, depending on the actual needs.

[0039] The transmitter head supports the replacement of infrared emission modules with different wavelengths to adapt to infrared recognition needs in different scenarios. Simultaneously, the transmitter head's emission direction is towards the display screen, not directly towards the user's eyes, and the emission power can be adjusted via a PC-based information processing module, enabling on-demand start and stop. This provides dual protection for user safety from both structural and control logic perspectives, unlike existing light guns with multiple infrared emitters directly facing the user's eyes, completely eliminating the safety hazard of direct infrared light into the eyes.

[0040] In another embodiment, the outer contour of the hardware body is gun-shaped; the stock of the hardware body is a retractable structure, and the grip of the hardware body is provided with anti-slip texture; when holding the hardware body, the button module located on the hardware body can be triggered.

[0041] The gun-like design can meet the needs of specific software, such as shooting games. The layout of the physical buttons on the button module is adapted to gun-holding habits, with the trigger button mapped to the left mouse button function of a standard mouse, the side buttons mapped to the right mouse button function of a standard mouse, the confirmation button mapped to the middle mouse button function of a standard mouse, and the scroll wheel located above the grip for convenient operation while holding the gun.

[0042] The Type-C interface can be located at the rear of the hardware unit as a backup communication and charging interface. It can be used for emergency communication and hardware charging when the wireless signal is abnormal. It supports hot-swapping and takes into account both stability and convenience. The hardware unit can also have a built-in rechargeable battery, which can be charged in conjunction with the Type-C interface to meet the needs of long-term wireless use.

[0043] In another embodiment, the outer contour of the hardware body is in the shape of a mouse, the surface of the hardware body is provided with an ergonomically adapted arc-shaped groove, the surface is provided with anti-slip texture, and the bottom is provided with anti-slip pads.

[0044] The mouse design is suitable for extended use in daily office scenarios.

[0045] In another embodiment, the image acquisition module includes a high frame rate infrared recognition camera, which acquires image information with light on the display screen in real time and sends the image information to the information processing module in real time; It also includes an adjustable mounting bracket to adjust and fix the high frame rate infrared recognition camera to capture and display the complete image on the screen.

[0046] High frame rate infrared recognition cameras typically have a capture frequency of no less than 30 frames per second, but the specific frequency can be selected based on the program and usage requirements. Adjustable mounting brackets can be camera tripods or other adjustable mounting brackets, such as the mounting bracket structure on a camera mounting pole; the specific type can be selected based on the usage environment and needs.

[0047] The camera is primarily connected to the PC via a wireless communication module, but a USB wired interface can also be used for connection. It is used to capture infrared spot images on the display screen in real time and transmit the image frames to the PC information processing module to provide data support for the image processing steps of the control method.

[0048] In another embodiment, the information processing module includes: The communication unit communicates with the light emission module and the image acquisition module via a communication module. The operating system identification unit automatically identifies the current PC operating system type and matches and calls the corresponding native input event interface, without requiring a dedicated driver, providing adaptation support for event delivery; The image processing unit preprocesses the image information acquired by the image acquisition module, performs effective spot detection and image stabilization, and obtains the spot coordinates. Specifically, it receives image frames transmitted from the camera and sequentially performs HSV color space conversion, threshold extraction, morphological noise reduction, effective spot detection, and image stabilization to obtain clear and stable effective spot coordinates. The coordinate mapping unit maps and clamps the coordinates of the light spot onto the display screen to obtain the coordinate information of the light spot relative to the display screen. Specifically, the effective coordinates of the stabilized light spot are mapped and clamped to the pixel coordinate system of display screen 4 according to the ratio of screen resolution to camera resolution to obtain the target screen coordinates; The event delivery unit calls the corresponding native input event interface of the operating system to deliver mouse movement events to the operating system message queue based on real-time coordinate information changes. Specifically, based on the operating system's recognition results, it calls the corresponding native input event interface to convert the target screen coordinates into system standard coordinates, delivers mouse movement events to the system message queue, and drives cursor movement. The communication unit can support both wireless and wired modes. When the event delivery unit delivers mouse movement events to the operating system message queue, the operating system recognition unit can output information formats and requirements that the operating system can recognize, thereby enabling the effective input of mouse movement information to the operating system.

[0049] The image processing unit preprocesses the infrared spot regions extracted from the image frame and filters out interference signals such as ambient light and clutter. The effective spot detection detects the infrared spot regions extracted after preprocessing to determine whether they are effective infrared spots. If they are effective infrared spots, their original coordinates in the image frame are recorded. The image stabilization process performs image stabilization on the original coordinates of the effective infrared spots to eliminate positioning deviations caused by coordinate jitter.

[0050] In another embodiment, a control switching unit is also included, wherein if the image processing unit fails to collect the coordinates of the light spot within a preset time period, the event delivery unit stops event delivery.

[0051] When the light input stops, the system can automatically stop switching control, such as returning it to the mouse.

[0052] In another embodiment, a protective cover is provided on the outside of the emitting head of the light emitting module.

[0053] The protective sleeve can be a tubular structure to cover the transmitter head, preventing the sides of the transmitter head from being directly exposed and damaged.

[0054] like Figure 5 As shown, a control method for cross-system visual positioning input includes the following steps: The information processing module communicates with the image acquisition module and the light emission module. Specifically, the light emission module and the button module establish a connection with the PC through the wireless communication module (Bluetooth or 2.4G) (the Type-C wired interface can be used as a backup). The independent infrared camera can be connected to the PC in either wireless or wired mode. The information processing module establishes a communication link with the components on the hardware body (button module, light emission module) and the camera through the communication module. At this time, the button module has automatically connected to the PC's native mouse driver, and the button function is normal and usable (based on the device's native button design).

[0055] The information processing module controls the light emitting module to emit light; the handheld light emitting module controls the emitted light to form light spots on the display screen; The information processing module controls the image acquisition module to acquire display screen image information containing light spots, and sends the acquired image information to the information processing module in real time; The information processing module processes the image information acquired by the image acquisition module and obtains the coordinate information of the light spot on the display screen in real time; The information processing module automatically identifies the current PC operating system type, calls the native input event interface corresponding to the current operating system, and then sends the coordinate information to the operating system in real time to form a mouse movement event, thereby realizing infrared light point positioning to drive the mouse cursor movement; The information processing module continuously monitors valid light spots. If no valid light spot is detected for a preset period of time, it immediately stops sending mouse movement events to the system message queue and returns the system input control to the native control of the operating system. The operating system receives the button module's press and outputs the corresponding control signal.

[0056] In another embodiment, the step "the information processing module processes the image information acquired by the image acquisition module and obtains the coordinate information of the light spot on the display screen in real time" includes the following steps: S41. The information processing module preprocesses each frame of the received image information, extracts the light spot area in each frame image through the preprocessing operation, and filters out interference signals such as ambient light and noise. S42. Detect the light spot regions extracted after preprocessing and determine whether they are valid light spots. If they are valid light spots, record their original coordinates in each frame of the image. S43. Perform anti-shake processing on the original coordinates of the acquired valid light spots to eliminate positioning deviations caused by coordinate jitter; S44. Map and clamp the coordinates of the light spot after image stabilization to the pixel coordinate system of the display screen to obtain coordinate information that matches the screen.

[0057] In another embodiment, the preprocessing in step S41 includes: converting each received image frame from the RGB color space to the HSV color space; extracting candidate light spot regions in the image frame based on the HSV threshold range that matches the emission wavelength of the transmitter; performing morphological dilation and closing operations on the extracted candidate regions; and performing Gaussian blurring to filter out noise interference and obtain clear light spot regions.

[0058] In this embodiment, the HSV threshold range is preset to H:0-30, S:0-80, V:220-255. The specific HSV threshold range can also be preset and adjusted in the information processing module to adapt to the infrared recognition requirements of different scenarios.

[0059] In another embodiment, the criteria for determining a valid light point in step S42 are: the light point brightness is ≥220 and the center of the light point is located within the field of view of the camera; if multiple light points are detected, the area with the highest brightness and the area closest to the standard light point is selected as the valid light point.

[0060] In another embodiment, the image stabilization process in step S43 includes: calculating the Euclidean distance between the effective light point coordinates of the current frame image and the effective light point coordinates of the previous frame; setting a preset image stabilization threshold; if the calculated Euclidean distance is less than or equal to the image stabilization threshold, it is determined to be coordinate jitter, and the effective light point coordinates of the previous frame are used as the final coordinates of the current frame; if the Euclidean distance is greater than the image stabilization threshold, the effective light point coordinates detected in the current frame are used as the final coordinates.

[0061] In this embodiment, the image stabilization threshold is preset to 3.0 pixels. The specific image stabilization threshold can also be preset and adjusted in the information processing module to suit the operating habits of different users.

[0062] In another embodiment, the operating system identification unit in the information processing module can automatically identify the three mainstream desktop operating systems: Windows, Linux, and macOS, and match and call the corresponding native input event interfaces without requiring dedicated drivers. Specifically, the corresponding interfaces for different operating systems are: SendInput for Windows, uinput for Linux, and IOKit for macOS. The PC-side processing program has a built-in operating system identification module that can automatically identify the type of operating system currently running on the PC and match and call the corresponding native input event interfaces without requiring manual configuration.

[0063] In another embodiment, the preset duration in step S7 is a custom setting of the information processing module, with a setting range of 0.5s to 3s; during the switching of system input control, the button module is independently processed by the native mouse driver of the operating system.

[0064] The control method is implemented as follows: S1. Start the PC-side information processing module and establish a communication link. Specifically: Start the PC-side information processing module, initialize the system and establish a communication link; the optical emission module and button module preferentially connect to the PC via Bluetooth or 2.4G wireless; the Type-C interface serves as a backup communication channel and charging interface; the button module connects to the PC to trigger the native mouse driver function.

[0065] S2. Emit infrared light to form a light spot on the screen. Specifically: the hardware emits invisible infrared light with a wavelength of 700nm–1100nm; the infrared emitter supports the replacement of different wavelength modules to adapt to different environmental requirements; the light spot is projected onto the screen surface to form a light spot that can be captured by the camera.

[0066] S3. Recapture image frames using a standalone infrared camera. Specifically: Use a standalone infrared camera to acquire image frames in real time; the camera frame rate must be ≥30fps to ensure response speed; prioritize wireless transmission of image frames to ensure data fluency; the field of view must completely cover the entire display screen to ensure no blind spots.

[0067] S4. Preprocess the image frame to extract infrared light spot regions. Specifically: convert the image frame from the RGB color space to the HSV color gamut; perform morphological noise reduction, Gaussian blurring, and other processing to filter ambient light interference and noise; and extract candidate regions that may contain infrared light spots.

[0068] S5. Detect valid infrared light spots and record their original coordinates. Specifically: the criteria for determining whether a light spot is valid are as follows: the light spot brightness is ≥220; the center of the light spot is located within the camera's field of view; if multiple light spots exist, select the area with the highest brightness and the area closest to the standard light spot.

[0069] If a valid light spot is detected, proceed to the next step; otherwise, return and wait for the next frame.

[0070] S6. Perform image stabilization on the effective light point coordinates to eliminate positioning deviation. Specifically: calculate the Euclidean distance between the effective light point coordinates in the current frame and the previous frame; compare this distance with a preset image stabilization threshold (default is 3.0 pixels); if the distance is less than the threshold, it is considered normal movement; if it is greater than the threshold, it is considered jitter and smoothing is performed to achieve jitter suppression.

[0071] S7. Map and clamp the stabilized light spot coordinates to obtain the screen target coordinates. Specifically: Map the light spot coordinates according to the ratio of camera resolution to screen resolution; clamp the mapped coordinates within the screen pixel coordinate system to prevent them from going out of bounds; obtain the final screen target coordinates that can be used for control.

[0072] S8. Send mouse movement events to the system to maintain infrared positioning control. Specifically: automatically identify the current operating system (Windows, Linux, macOS); call the corresponding system's input event interface: Windows: SendInput, Linux: uinput, macOS: IOKit.

[0073] The calculated target coordinates are converted into mouse movement events and sent to the system, enabling precise control of the mouse by the infrared light point.

[0074] S9. Continuously monitor valid light spots to achieve automatic switching of control. Specifically: Set a preset duration (e.g., 0.5s–3s), during which time continuously monitor whether a valid infrared light spot is detected.

[0075] If a valid light spot is detected within the preset time: continue to execute S8 and maintain infrared positioning control; If no valid light spot is detected within the preset time (continuous timeout): stop event delivery and return the native input control to the system; the button module is still handled independently by the native mouse driver on the PC to ensure that basic functions are available.

[0076] S10. Finally, the process ends or waits for the program to restart. Specifically: the process ends when control is transferred or the program terminates abnormally; it may wait for the user to restart the program to restore the infrared control function.

[0077] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.

Claims

1. A control system for cross-system visual positioning input, characterized in that, include: The light emitting module emits light into the display screen, forming light spots on the screen; the button module outputs corresponding control signals when pressed, which are then transmitted to the operating system. The communication module collects control signals output by the button module and transmits them to the operating system, communicating with the light emitting module; the image acquisition module collects image information on the display screen; the information processing module processes the image information collected by the image acquisition module, obtains the coordinate information of the light spot on the display screen in real time, and sends the coordinate information to the operating system in real time to generate mouse movement events; it also obtains control signals output by the button module and sends the control signals to the operating system; and controls the light emitting module through the communication module.

2. The control system for cross-system visual positioning input according to claim 1, characterized in that, It also includes a hardware body; the light emitting module, button module, and communication module are mounted on the hardware body; the light emitting module includes an infrared emitting head, which is located at the front end of the hardware body and is detachably connected to the hardware body via a snap-fit, for emitting infrared light to the screen to form infrared light spots on the screen; the snap-fit ​​connection is provided with an anti-loosening structure and / or filler; the emitting head of the light emitting module is detachable; the wavelength of the infrared light is 700nm~1100nm; the communication module includes a wireless communication module and / or a wired communication module; the button module includes standard physical buttons and / or touch buttons; the hardware body has a double-layer printed circuit board, and the circuits of the light emitting module and the button module are arranged independently on the double-layer printed circuit board; the double-layer printed circuit board is provided with filter capacitors and anti-interference magnetic beads.

3. The control system for cross-system visual positioning input according to claim 2, characterized in that, The hardware body has a gun-like outer contour; the stock of the hardware body is a retractable structure, and the grip of the hardware body is provided with anti-slip texture; when holding the hardware body, the button module located on the hardware body can be triggered.

4. The control system for cross-system visual positioning input according to claim 2, characterized in that, The hardware body has a mouse-shaped outer contour, and the surface of the hardware body is provided with an ergonomic arc-shaped groove, anti-slip texture, and anti-slip feet at the bottom.

5. The control system for cross-system visual positioning input according to claim 2, characterized in that, The image acquisition module includes a high frame rate infrared recognition camera, which acquires image information with light on the display screen in real time and sends the image information to the information processing module in real time; it also includes an adjustable fixing bracket to adjust and fix the high frame rate infrared recognition camera to acquire the complete image on the display screen.

6. The control system for cross-system visual positioning input according to any one of claims 1-5, characterized in that, The information processing module includes: a communication unit, which communicates with the light emission module and the image acquisition module; an operating system identification unit, which automatically identifies the current PC operating system type and matches and calls the corresponding native input event interface; an image processing unit, which preprocesses the image information acquired by the image acquisition module, detects effective light spots, and performs anti-shake processing to obtain the coordinates of the light spots; a coordinate mapping unit, which maps and clamps the coordinates of the light spots to the display screen to obtain the coordinate information of the light spots relative to the display screen; an event delivery unit, which calls the native input event interface of the corresponding operating system and delivers mouse movement events to the operating system message queue based on real-time coordinate information changes; and a control switching unit, which stops event delivery if the image processing unit fails to acquire the coordinates of the light spots within a preset time.

7. A control method for cross-system visual positioning input, characterized in that, Includes the following steps: The information processing module communicates with the image acquisition module and the light emission module; the information processing module controls the light emission module to emit light. The handheld light-emitting module controls the emitted light to form a light spot on the display screen; the information processing module controls the image acquisition module to acquire image information of the display screen containing the light spot, and sends the acquired image information to the information processing module in real time; the information processing module processes the image information acquired by the image acquisition module and obtains the coordinate information of the light spot on the display screen in real time; the information processing module automatically identifies the current PC operating system type, calls the native input event interface corresponding to the current operating system, and then sends the coordinate information to the operating system in real time to form a mouse movement event, realizing infrared light spot positioning to drive mouse cursor movement; the information processing module continuously monitors valid light spots, and if no valid light spot is detected for a preset time, it immediately stops sending mouse movement events to the system message queue and returns the system input control to the native control of the operating system; the operating system receives the button module after it is pressed and outputs the corresponding control signal.

8. The control method for cross-system visual positioning input according to claim 7, characterized in that, The step "the information processing module processes the image information acquired by the image acquisition module and obtains the coordinate information of the light spot on the display screen in real time" includes the following steps: S41. The information processing module preprocesses each frame of the received image information, extracts the light spot area in each frame image through preprocessing operations, and filters out interference signals such as ambient light and noise; S42. The preprocessed light spot area is detected to determine whether it is a valid light spot. If it is a valid light spot, its original coordinates in each frame image are recorded; S43. The original coordinates of the obtained valid light spot are subjected to anti-shake processing to eliminate the positioning deviation caused by coordinate jitter; S44. The anti-shake light spot coordinates are mapped and clamped to the pixel coordinate system of the display screen to obtain coordinate information that matches the screen.

9. The control method for cross-system visual positioning input according to claim 8, characterized in that, The preprocessing in step S41 includes: converting each received image frame from the RGB color space to the HSV color space; extracting candidate light spot regions in the image frame based on the HSV threshold range that matches the emission wavelength of the transmitter; performing morphological dilation and closing operations on the extracted candidate regions; and performing Gaussian blurring to filter out noise interference and obtain clear light spot regions.

10. The control method for cross-system visual positioning input according to claim 8, characterized in that, The image stabilization process in step S43 includes: calculating the Euclidean distance between the effective light point coordinates of the current frame and the effective light point coordinates of the previous frame; setting a preset image stabilization threshold; if the calculated Euclidean distance is less than or equal to the image stabilization threshold, it is determined to be coordinate jitter, and the effective light point coordinates of the previous frame are used as the final coordinates of the current frame; if the Euclidean distance is greater than the image stabilization threshold, the effective light point coordinates detected in the current frame are used as the final coordinates.

Images