Intelligent screen interaction device based on laser positioning cursor and interaction implementation method

Abstract

The invention discloses an intelligent screen interaction device based on a laser positioning cursor and an interaction implementation method, relates to an intelligent screen interaction technology, and creates an intelligent display system integrating sensing and display by directly integrating a position sensing dot matrix receiver into a display unit. When the laser remote controller points to the screen and sends out a laser signal and an operation instruction, the display screen forms a high-resolution'touchpad ', absolute pixel coordinates where light spots are located are recognized, deep fusion of a lattice receiver sensing layer and a screen pixel display layer is achieved, an interaction interface capable of directly reading the absolute coordinates is constructed, and the interaction interface is used for displaying the absolute coordinates. Laser is used for accurate triggering and instruction transmission, the pointing action of the remote controller is directly, linearly and stably converted into absolute movement of a screen cursor through algorithm processing, and traditional interaction logic based on indirect instructions or relative displacement is fundamentally changed; the problem that large-screen remote interaction is inaccurate in pointing positioning due to dependence on indirect or relative positioning is solved.

Description

Technical Field

[0001] This invention relates to the field of smart screen interaction technology, and in particular to a smart screen interaction device and interaction implementation method based on a laser positioning cursor. Background Technology

[0002] Current smart screen interaction technologies, such as human-computer interaction in smart TVs, mainly achieve human-computer interaction through infrared or Bluetooth remote controls and air mouse gyroscope remote controls.

[0003] The interaction principle of infrared or Bluetooth remote controls is that after the user presses the directional keys or confirmation key, the remote control sends an encoded signal to the smart screen control system. After receiving the encoded signal, the smart screen control system indirectly controls the displayed cursor to move to the display position or executes the control command according to the control command of the encoded signal. The user cannot directly locate the displayed target cursor position. For example, the user cannot directly locate the cursor position of the pause button, fast forward button or close button on the screen. The user needs to press the button multiple times or repeat the operation to locate the target image position. This results in a relatively cumbersome and inefficient interaction operation, which reduces the user experience.

[0004] The interaction principle of an air mouse or gyroscope remote control is to use a built-in gyroscope and accelerometer to identify the movement of the remote control in the air. By measuring the relative displacement, the air position of the remote control is converted into the cursor position on the screen. Since the cursor position and the air position of the remote control are relative, and the remote control may shake or vibrate during operation, the cursor position will drift with the shaking of the remote control. This not only makes the cursor position inaccurate, but also makes it easy for the remote control to malfunction. It is difficult to perform precise clicks, drags and other fine operations, and the stability is poor. Summary of the Invention

[0005] The purpose of this invention is to address the problems of existing smart screen interaction technologies, such as the inability to directly locate the cursor on the display screen or the cursor drifting with the remote control, resulting in cumbersome or unreliable interaction. This invention provides a smart screen interaction device and interaction implementation method based on laser-positioned cursor.

[0006] To achieve the above objectives, the technical solution adopted by the present invention is as follows:

[0007] A smart screen interaction device based on laser-guided cursor positioning includes a display screen, a laser remote controller, a programmable signal processing unit, and a screen control module. The display screen contains an array of multiple receivers and a narrowband filter. The receivers are embedded in the display screen's encapsulation layer in a grid pattern, enabling them to collect and identify the light spot emitted by the laser remote controller. Each receiver is configured with a unique logical address, which identifies the receiver and its coordinates relative to the display screen. The programmable signal processing unit is electrically connected to the screen control module, capable of receiving the light signal sent by the laser remote controller and calculating the position coordinates of the light spot. It then controls the display screen to position the cursor at the light spot and responds to user operations based on the light signal's input.

[0008] The intelligent screen interaction device based on laser positioning cursor described in this invention, by setting multiple receivers on the display screen and cooperating with the light guiding effect of a narrow-band filter, can collect and identify the position and light signal of the light spot emitted by the laser remote control. Then, through the configuration of logical addresses and the recognition, analysis, and control functions of the programmable signal processing unit and the screen control module, it can identify and analyze the actual coordinates, light signal, and intensity of the light spot emitted by the laser remote control pointing at the screen, thereby obtaining the position coordinates of the light spot pointed to by the laser remote control. This allows the display cursor to be positioned at the location of the light spot, directly positioning the user's pointing position to the actual coordinates of the screen. The cursor position is only related to the screen position pointed to by the laser, achieving absolute coordinate mapping. This fundamentally eliminates the drift problem of traditional air mice or gyroscope remote controls, improving the accuracy and stability of the remote control's cursor positioning. Furthermore, by recognizing and analyzing the laser remote control's light spot, the display cursor can be directly positioned at the location of the light spot pointed to by the user, achieving direct positioning of the user's pointing position. This eliminates the need for repeated key presses to move the display cursor to the target position, making the operation intuitive and efficient, improving operational efficiency and user experience.

[0009] Preferably, in the intelligent screen interaction device based on laser positioning cursor of the present invention, the number of receiver arrays is set such that at most two pixels of the display screen occupy one receiver.

[0010] As a preferred embodiment of the present invention, by setting the array of receivers to occupy one receiver for at most two pixels of the display screen, the sub-pixel level precise coordinates of the light spot can be obtained, further improving the accuracy of the receiver in acquiring the position of the light spot, realizing more precise positioning and finer control of the display cursor, and further improving the certainty and stability of remote control interactive operation.

[0011] Preferably, in the intelligent screen interaction device based on laser positioning cursor of the present invention, the programmable signal processing unit is provided with a timing synchronization module. The timing synchronization module is used to identify the refresh blanking period of the display screen and recount when a refresh signal is received, thereby generating a sampling trigger signal synchronized with the refresh blanking period.

[0012] As a preferred embodiment of the present invention, by setting the synchronization timing module, a sampling trigger signal synchronized with the refresh blanking period can be generated, triggering the programmable signal processing unit to control the array of receivers, enabling laser spot signal acquisition during the refresh blanking period of the display screen, and disabling signal acquisition during refresh, thereby reducing or isolating interference from the self-illumination of the display screen during refresh, further reducing the error rate and misidentification rate of spot acquisition, and improving the quality and accuracy of laser spot and signal acquisition.

[0013] To achieve the objectives of this invention, another technical solution is provided:

[0014] A method for implementing smart screen interaction based on laser-positioned cursors, specifically including the following steps:

[0015] S1. When the user operates the button of the laser remote control, the laser remote control emits a laser beam towards the target position on the display screen, so that the target position produces a light spot;

[0016] S2. Acquire the optical signal of the laser beam through the receiver, and send the logical address of the receiver corresponding to the spot position and the optical signal to the programmable signal processing unit;

[0017] S3. Calculate the position coordinates of the light spot based on the receiver's logical address, and send the position coordinates to the screen control module;

[0018] S4. The position coordinates are mapped to the display coordinates of the cursor on the display screen through the screen control module, and then the cursor is displayed at the display coordinates.

[0019] S5. Analyze the operation command of the optical signal and respond to the operation command on the display screen.

[0020] This invention discloses a smart screen interaction method based on laser-guided cursor positioning. A laser remote control emits a laser beam towards the display screen, generating a light spot at the target location. This allows for accurate display of the user's directional input and target location, enabling the light spot to quickly and precisely reach the intended location on the display screen. A direct correspondence is established between the pointing position and the light spot position. A receiver collects the light signal and directly correlates it with the light spot position, calculating the coordinates of the light spot. This yields the accurate coordinates of the user's target location on the display screen. The screen control module then precisely displays the cursor at the user's target location, achieving a precise correspondence between the cursor position and the screen position indicated by the laser. This fundamentally eliminates the drift of traditional air mice, improving the accuracy and stability of remote control cursor positioning. Furthermore, through the absolute coordinate mapping of the cursor in step S4, the cursor is directly positioned to the laser-guided location, eliminating the need for repeated button presses to move the cursor. This makes the operation intuitive and efficient, improving both operational efficiency and user experience.

[0021] Preferably, in the intelligent screen interaction method based on laser positioning cursor described in this invention, step S2, which involves collecting the light signal at the position of the light spot through a receiver, specifically includes the following steps:

[0022] Spectral verification: Analyze the actual wavelength of the optical signal. If the first deviation between the actual wavelength and the set wavelength is ≤5nm, the verification is passed.

[0023] Encoding verification: The signal encoding of the optical signal is parsed to obtain the device ID of the laser remote controller. If the device ID matches the pre-stored valid ID, the verification is successful.

[0024] As a preferred embodiment of the present invention, by performing spectral verification and coding verification, the position coordinates of the light spot are calculated and user operations are executed only on the light signals that have passed verification and validation. This can eliminate the influence of light interference signals, reduce the probability of misoperation or unstable operation, and further improve the accuracy of responding to user operations.

[0025] Preferably, in the intelligent screen interaction implementation method based on laser positioning cursor described in this invention, step S2 further includes the following steps:

[0026] Set a threshold for light intensity, including a low threshold and a high threshold; collect the light intensity of the light received by the display screen in real time;

[0027] Determine whether the received light is a valid light signal: when the light intensity of the received light is less than the low threshold, the received light is determined to be invalid interference light and filtered out; when the light intensity of the received light is greater than the high threshold, the received light is determined to be a valid light signal.

[0028] As a preferred embodiment of the present invention, by real-time acquisition of the light intensity of the light received by the display screen, and based on the set light intensity threshold, effective judgment and processing of ambient light such as sunlight and lamps, as well as screen self-illumination noise, are performed to determine whether the received light is a valid light signal. The laser signal emitted by the remote control is accurately selected, providing a light signal with a low signal-to-noise ratio for subsequent spot positioning and command parsing. This further reduces the probability of positioning drift, false triggering, or missed reception failure caused by ambient light interference, and enhances the accuracy of interactive control.

[0029] Preferably, the intelligent screen interaction method based on laser positioning cursor described in this invention, in determining whether the received light is a valid light signal, further includes the following steps:

[0030] When the intensity of the received light is between a low threshold and a high threshold, the received light is stored in a temporary buffer; if the intensity of the received light is between a low threshold and a high threshold for at least three consecutive frames, and no encoded signal of the received light is detected, the received light is determined to be invalid interference light.

[0031] As a preferred embodiment of the present invention, it can avoid misjudgment and missed detection of laser signals under weak ambient light, and prevent false triggering and false detection of interference signals under strong ambient light, thereby further realizing the accuracy and stability of laser signal detection under different light environments.

[0032] Preferably, in the intelligent screen interaction implementation method based on laser positioning cursor described in this invention, step S2 further includes the following steps:

[0033] Every ten seconds or so, the reception success rate of the effective optical signal is calculated. If the reception success rate is less than 90% and the light intensity of the received light on the display screen increases in real time, the receiver threshold is increased and the backlight brightness of the display screen is reduced so that the reception success rate is greater than or equal to 95%.

[0034] As a preferred embodiment of the present invention, by statistically analyzing the success rate of receiving the effective optical signal, the receiver threshold is increased and the backlight brightness of the display screen is reduced according to the increase in light intensity, thereby achieving adaptive adjustment, improving the sensitivity of optical signal recognition in strong light environments and standard environments, further reducing ambient light interference, and improving the accuracy and reliability of signal detection.

[0035] Preferably, the intelligent screen interaction method based on laser positioning cursor described in this invention includes the following steps: First, the method of acquiring the light signal of the laser beam via a receiver includes acquiring at least the light signals of the first three frames and the current frame; second, the method of calculating the position coordinates of the light spot specifically includes the following steps:

[0036] S31. Calculate the effective coordinates of a single frame: Based on the logical address of each receiver at the position of the light spot, obtain the first receiver coordinates (X) of the i-th receiver. i Yi ); Identify the optical signal and obtain the signal strength I. i The effective coordinates (X) of a single frame are obtained by calculating the formula group 1. c Y c ) and the sum of signal strength The first set of calculation formulas is:

[0037] ;

[0038] ;

[0039] ;

[0040] S32. Calculate the arithmetic mean coordinates: Based on the effective coordinates of the single frame and the sum of signal strength, the arithmetic mean coordinates are calculated using formula group two; formula group two is:

[0041] ;

[0042] ;

[0043] S33. Based on the optical signal of the current frame, obtain the coordinates of the i-th receiver corresponding to the optical signal of the current frame as the coordinates of the second receiver. ; Calculate the second deviation value between the coordinates of the second receiver and the arithmetic mean coordinates, and determine whether the current frame optical signal is interference data;

[0044] If the second deviation value is less than 5 pixels, the current frame light signal is determined to be valid data, and the single-frame valid coordinates of the current frame light signal are calculated using calculation formula group one, which are used as the position coordinates of the light spot; if the second deviation value is greater than 5 pixels, the current frame light signal is determined to be interference data, and the interference data is discarded.

[0045] As a preferred embodiment of the present invention, the effective coordinates of a single frame are calculated using the weighted centroid method through the filtered signal, and then the arithmetic mean coordinates are calculated. The current frame light signal is judged by S33. If the data of the current frame light signal is valid, the position coordinates of the light spot are calculated by calculation formula group 1 and added to the cache record to replace the earliest frame data for calculating the average coordinates of the next frame. This can effectively eliminate interference data with large deviation values, thereby further improving the accuracy of the position coordinates of the light spot, improving the accuracy of the laser remote control pointing position, and improving the precise experience of the user's pointing operation.

[0046] Preferably, in the intelligent screen interaction method based on laser positioning cursor described in this invention, if the user performs a drag operation, the operation instruction for parsing the optical signal specifically includes the following steps:

[0047] If it is detected that the encoded signal of the light signal is flickering for at least three consecutive frames, and the third deviation between the coordinates of the light signal in each frame is ≤1 pixel, then the operation command is determined to be drag start;

[0048] If flickering is detected in less than two frames of the encoded signal of the optical signal, or if a third deviation between the coordinates of each frame of the optical signal is detected to be greater than 1 pixel, then the optical signal is determined to be an interference signal.

[0049] If it is detected that the encoded signal of the optical signal is a constant output for at least three consecutive frames, then the operation command is determined to be the end of dragging.

[0050] As a preferred embodiment of the present invention, it not only realizes direct interactive operation of complex operation commands such as user drag operation, but also detects and identifies whether the encoded signal of the light signal is flashing or constant output, and judges the pixel deviation between the coordinates of each frame of light signal to identify and eliminate interference signals, thereby achieving the recognition of user operation commands. It is less affected by external signal interference and achieves faster and more stable response speed.

[0051] In summary, due to the adoption of the above technical solution, the beneficial effects of the present invention are:

[0052] 1. It can collect and identify the position and light signal of the laser remote control. Then, through the configuration of the logical address and the recognition, analysis and control functions of the programmable signal processing unit and the screen control module, it can identify and analyze the actual coordinates, light signal and intensity of the laser remote control pointing at the screen. Then, it controls the display cursor to be positioned at the position of the laser spot, and directly positions the user's operation position to the actual coordinates of the screen. This makes the cursor position only related to the position of the screen pointed to by the laser, realizing absolute coordinate mapping. This fundamentally eliminates the drift problem of traditional air mice or gyroscope remote controls, and improves the accuracy and stability of the remote control operation cursor positioning.

[0053] 2. By recognizing and analyzing the laser remote control's light spot, the display cursor can be directly positioned at the location of the light spot pointed to by the user, achieving direct positioning of the user's pointing location. This eliminates the need for the user to repeatedly press buttons to move the display cursor to the target location, making the operation intuitive and efficient, and improving operational efficiency and user experience. Attached Figure Description

[0054] Figure 1 This is a schematic diagram of the module structure of the intelligent screen interaction device based on laser positioning cursor of the present invention;

[0055] Figure 2 This is a flowchart illustrating the intelligent screen interaction implementation method based on laser positioning cursor of the present invention;

[0056] Figure 3 This is a schematic diagram of the initialization process of the intelligent screen interactive device system based on laser positioning cursor of the present invention;

[0057] Figure 4 This is a schematic diagram of the optical signal acquisition process of the present invention;

[0058] Figure 5 This is a schematic diagram illustrating an example of a left-click instruction responding to the operation command on the display screen according to the present invention;

[0059] Figure 6 This is a schematic diagram illustrating an example of a right-click instruction responding to the operation command on the display screen according to the present invention;

[0060] Figure 7 This is a schematic diagram of the interference adaptive adjustment process of the present invention;

[0061] Reference numerals: 100, display screen; 101, receiver. Detailed Implementation

[0062] The present invention will now be described in detail with reference to the accompanying drawings.

[0063] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.

[0064] Example 1:

[0065] This embodiment discloses a smart screen interaction device based on laser-positioned cursors, referencing... Figure 1 As shown, the system includes a display screen 100, a laser remote controller, a programmable signal processing unit, and a screen control module. The display screen 100 contains an array of multiple receivers 101 and a narrowband filter. The multiple receivers 101 are embedded in the encapsulation layer of the display screen 100 in a grid pattern, enabling them to collect and identify the light spot emitted by the laser remote controller. Each receiver 101 is configured with a unique logical address, which identifies the receiver 101 and its coordinates relative to the display screen 100. The programmable signal processing unit is electrically connected to the screen control module, enabling it to receive the light signal sent by the laser remote controller and calculate the position coordinates of the light spot. This allows it to control the display screen 100 to position the cursor at the light spot and respond to user operations based on the light signal's command.

[0066] In this invention, the display screen 100 is an intelligent display screen 100, which can realize intelligent control of backlight display through the screen control module. For example, the physical resolution of the 65-inch display screen 100 is 3840×2160 pixels, the screen emission spectrum range is 400-760nm visible light, the refresh rate is 60Hz, the single frame refresh cycle is 16.67ms, the effective refresh period is 0-15ms, and the refresh interval is 15-16.67ms.

[0067] The screen control module and the programmable signal processing unit (FPGA) of this invention can use an SPI bus interface to achieve data interaction. The remote control sends operation commands and laser positioning signals to the system via a link: laser remote control → FPGA → main screen control module. The pairing of the screen control module's processor and the FPGA is the fundamental bridge for low-level system communication and the key to establishing this link. Furthermore, when the TV is powered on for pairing, the main screen control module sends a pairing command to the FPGA, which includes the laser remote control device ID. For example, the FPGA reads and identifies the signal code as 0110100100110110 and stores it as a valid ID, receiver sensitivity parameters, screen refresh rate timing data, laser signal modulation rules, and other configuration information. This configuration paves the way for the subsequent correct identification of the laser signal commands emitted by the remote control.

[0068] To avoid and reduce interference from screen self-emission on laser signal detection, the programmable signal processing unit of this invention is equipped with a timing synchronization module. This module identifies the refresh blanking period of the display screen 100 and recounts upon receiving a refresh signal, thereby generating a sampling trigger signal synchronized with the refresh blanking period. For example, during the screen image display refresh period of 0-15ms (60Hz), the receiver 101 is controlled to enter a low-sensitivity mode to reduce photosensitivity. When the screen refresh interval is 15-16.67ms, the receiver 101 switches to a high-sensitivity mode to centrally collect laser signals. This "off-peak" timing of laser signal acquisition effectively avoids synchronous interference between screen emission and laser reception.

[0069] The implementation involves adding a timing synchronization module to the TV main processor and the FPGA programmable signal processing unit of the control module. The VSYNC signal of the screen refresh signal is used as the reset trigger signal for the timing synchronization module. Each time the timing synchronization module receives a VSYNC signal, it resets its internal counter and restarts counting, ensuring that its counting cycle is strictly aligned with the screen refresh cycle: 16.67ms for 60Hz, 8.33ms for 120Hz, and 6.94ms for 144Hz. While completing cycle alignment, the timing synchronization module generates a sampling trigger signal that precisely matches the screen blanking period, synchronously outputting enable or disable control signals to the FPGA. This controls the receiver 101 array to start signal acquisition during the screen refresh blanking period and to turn off or reduce sampling sensitivity during the effective display period, reducing or isolating interference from the screen's self-illumination from a time perspective.

[0070] like Figure 1 As shown, for clarity, Figure 1 The image shows a magnified view of a portion of the display screen 100 (white outline). Multiple receivers 101 are arrayed corresponding to the display pixels of the display screen 100. Specifically, the number of receivers 101 in the array is set so that at most two pixels of the display screen 100 occupy one receiver 101. For example, miniature PIN photodiodes are used, with each diode integrating a 940nm narrowband filter at its front end. The filter has a bandwidth of 15nm, allowing only light with wavelengths of 932.5-947.5nm to pass through, and a light-sensing angle of ±15°. The receivers 101 are embedded in the encapsulation layer of the display screen 100 in a grid pattern. Two × two pixels of the display screen 100 share one receiver 101. The actual resolution of the receiver 101 array is 1920×1080, and each receiver corresponds to a unique logical address. For example, if the screen coordinates of the receiver 101 in the first row and first column are (2, 2), then the screen coordinates of the receiver 101 in the Nth row and Mth column are (2M, 2N).

[0071] The laser signal acquisition is implemented, for example, when a user points the remote control at the screen, the laser diode of the laser remote control outputs a 940nm laser, forming a 5mm diameter spot on the screen, covering 20×20 pixels, activating 5×5 receivers 101; receivers 101 acquire data during the 15-16.67ms time period, and the set (X) of the logical addresses of each receiver 101 is used to acquire data. i Y i For example, three receivers with adjacent coordinates: receiver A (100, 50), receiver B (102, 50), and receiver C (100, 52). The optical signal strength values ​​Ii of the three receivers A, B, and C are 3500, 2800, and 1200, respectively. The logical address and optical signal strength value of these three receivers 101 can be reported to the programmable signal processing unit FPGA.

[0072] Example 2:

[0073] refer to Figure 1 and Figure 2 As shown, based on Embodiment 1, this embodiment discloses a smart screen interaction method based on a laser positioning cursor, using the smart screen interaction device based on a laser positioning cursor from Embodiment 1, specifically including the following steps:

[0074] S1. When the user operates the button of the laser remote control, the laser remote control emits a laser beam towards the target position of the display screen 100, so that a light spot is generated at the target position;

[0075] S2. Acquire the optical signal of the laser beam through receiver 101, and send the logical address of receiver 101 corresponding to the position of the light spot and the optical signal to the programmable signal processing unit;

[0076] S3. Calculate the position coordinates of the light spot according to the logical address of the receiver 101, and send the position coordinates to the screen control module;

[0077] S4. The position coordinates are mapped to the display coordinates of the cursor on the display screen 100 through the screen control module, and then the cursor is displayed at the display coordinates.

[0078] S5. The operation command for parsing the optical signal is displayed on the screen 100.

[0079] refer to Figure 3 As shown, this invention requires initialization and parameter settings before interactive operation. To better distinguish between "valid light signals" and "invalid interference light," an ambient light detection unit is configured to collect and monitor ambient light intensity in real time, with a detection range of 0-1000 lux. By setting a threshold value for signal strength or fluctuation range, and effectively judging and processing ambient light such as sunlight and lamplight, as well as screen self-illuminating noise, the laser signal emitted by the remote control is accurately filtered out, avoiding problems such as positioning drift, false triggering, or missed reception failure caused by interference.

[0080] Specifically, S2 further includes the following steps: setting a threshold for light intensity, including a low threshold and a high threshold; acquiring the light intensity of the received light from the display screen 100 in real time; determining whether the received light is a valid light signal: when the light intensity of the received light is less than the low threshold, the received light is determined to be invalid interference light and filtered out; when the light intensity of the received light is greater than the high threshold, the received light is determined to be a valid light signal. More preferably, determining whether the received light is a valid light signal further includes the following steps: when the light intensity of the received light is between the low threshold and the high threshold, the received light is stored in a temporary buffer; if the light intensity of the received light is between the low threshold and the high threshold for at least three consecutive frames, and no encoded signal of the received light is detected, the received light is determined to be invalid interference light.

[0081] In practical scenarios, to avoid missed detections and misjudgments of laser signals under weak ambient light and to prevent false triggering of interference signals under strong light, two thresholds were designed: a low threshold T_low, which is 0.8 to 1.2 times the signal strength corresponding to the real-time ambient light intensity, and a high threshold T_high, which is 2.5 to 3.0 times the signal strength corresponding to the real-time ambient light intensity. In weak light environments, when the monitored signal strength is less than T_low, it is determined to be invalid interference light and is directly filtered out. In strong light environments, when the signal strength is greater than T_high, it is determined to be a valid light signal to be locked and proceeds to the next step of modulation and coding verification. When T_low ≤ signal strength ≤ T_high, this "intermediate interval" signal is temporarily stored in a buffer for subsequent "continuous frame consistency verification" by the system.

[0082] For example, the system uses an ambient light detection unit to collect ambient light intensity multiple times per second and calculates the reference signal intensity corresponding to the current ambient light using an arithmetic average. For example, if the reference signal intensity is 600 lux, it is defined as a digital value of 600. High and low thresholds are dynamically set: high threshold T_high = 600 * 1.2 = 720 digital values, low threshold T_low = 600 * 0.8 = 480 digital values. Signal strength is compared: if receiver 101 detects a signal intensity of 400 digital values ​​< T_low, it is determined as "invalid interference" and directly filtered out; if receiver 101 detects a signal intensity of 800 digital values ​​> T_high, it is determined as a "valid laser signal" to be locked. The next step, "PPM modulation and coding verification," involves checking, for example, whether a 16-bit device ID is included. Once confirmed, the process proceeds to calculate the spot coordinates. When T_low ≤ 600 ≤ T_high, this "intermediate interval" signal is temporarily stored in a buffer until the system performs a consistency check on subsequent consecutive frames. For example, if three consecutive frames are in this interval and PPM coding cannot be detected, it is determined to be interference. By using a dual-threshold interval, the problem of a single threshold not being able to cover the reliability of multiple scenarios is solved. This avoids both false detection and missed detection of laser signals under weak ambient light and false triggering and detection of interference signals under strong ambient light, ultimately achieving accuracy and stability in laser signal detection under different lighting conditions.

[0083] Specifically, S2 also includes the following steps: every ten seconds, the success rate of receiving the effective optical signal is calculated; if the success rate is <90%, and the light intensity of the received light from the real-time acquisition display screen 100 increases, the threshold of the receiver 101 is increased and the backlight brightness of the display screen 100 is decreased to make the success rate ≥95%. (Reference) Figure 7 As shown, for example, taking a 400-600 nits display 100 as an example, a 5% brightness change is 20-30 nits. Experiments show that it is basically imperceptible in strong light and standard environments, but slightly perceptible in low light scenarios. Moreover, the system immediately restores the original backlight brightness after adjustment, so it has little impact on the user's light perception and can achieve adaptive adjustment against interference light.

[0084] In this invention, the optical signal of the laser beam is acquired by receiver 101, which can be achieved, for example, by the photodiode in embodiment 1. Specifically, in S2, the optical signal of the spot position is acquired by receiver 101, which includes the following steps: spectral verification: analyze the actual wavelength of the optical signal, and if the first deviation between the actual wavelength and the set wavelength is ≤5nm, the verification is passed; encoding verification: parse the signal encoding of the optical signal to obtain the device ID of the laser remote controller. If the device ID is consistent with the pre-stored valid ID, the verification is passed.

[0085] For example, a laser remote controller uses its own microcontroller to generate encoding according to the Manchester encoding protocol, combining the "operation command" with the "remote controller identity" to generate a unique digital code. This allows for the simultaneous reception of signals from multiple remote controller devices and avoids interference between different devices. For example, the "device ID + command code + check code" 16+8+8=32-bit frame structure ensures the uniqueness and accuracy of the signal encoding.

[0086] Specifically, this invention can also be used in conjunction with a laser remote control to ensure that the emitted laser is accurately pointed to the receiver 101 at the target position on the display screen 100. When the user presses a button on the remote control, such as the confirmation button or a movement operation, the button module sends a trigger signal to the microcontroller of the programmable signal processing unit. The microcontroller immediately starts the encoding generation process and quickly completes the encoding calculation. After encoding, it is sent to the signal modulation module through the SPI interface. The signal modulation module switches between two laser modes, "constant light mode" and "modulated pulse mode," according to system requirements. The constant light mode is for initialization and close-range scenarios, with stable signal strength and high power consumption. The modulated pulse mode is for normal interaction and complex environments, with strong anti-interference capabilities and low power consumption due to the laser signal carrying encoded information. When the received light signal is detected to be in a strong light environment, it is automatically set to a modulation frequency of 10kHz. Then, PPM pulse position modulation technology is used to convert "0" in the signal encoding into "10μs pulse + 20μs interval" and "1" into "10μs pulse + 40μs interval," generating a continuous pulse signal. The modulated weak pulse signal is amplified and then sent to a 940nm near-infrared laser diode. The laser remote controller emits 940nm near-infrared light according to the "on / off" rule of the current. The front end is designed with a collimating lens to control the beam divergence angle to ≤1.5°, ensuring that the emitted laser is accurately pointed to the receiver 101 of the display screen 100.

[0087] It should be noted that the present invention calculates the position coordinates of the light spot based on the logical address of the receiver 101. As disclosed above, the logical address of the receiver 101 and the coordinates of the display screen 100 are absolutely correlated. The programmable signal processing unit can obtain the position coordinates of the light spot by recognizing and reading the logical address using conventional methods. Preferably, to obtain more accurate position coordinates of the light spot, specifically the center coordinates of the light spot, in step S2, the receiver 101 acquires the light signal of the laser beam, including acquiring at least the light signals of the previous three frames and the current frame. And in step S3, the calculation of the position coordinates of the light spot specifically includes the following steps:

[0088] S31. Calculate the effective coordinates of a single frame: Based on the logical address of each receiver 101 at the position of the light spot, obtain the first receiver coordinates (X) of the i-th receiver 101. i Y i ); Identify the optical signal and obtain the signal strength I iThe effective coordinates (X) of a single frame are obtained by calculating the formula group 1. c Y c ) and the sum of signal strength The calculation formula group one is:

[0089] ;

[0090] ;

[0091] ;

[0092] S32. Calculate the arithmetic mean coordinates: Based on the effective coordinates of a single frame and the sum of signal strength, the arithmetic mean coordinates are calculated using formula group two; formula group two is:

[0093] ;

[0094] ;

[0095] S33. Based on the optical signal of the current frame, obtain the coordinates of the i-th receiver 101 corresponding to the optical signal of the current frame as the coordinates of the second receiver. ; Calculate the second deviation value between the coordinates of the second receiver and the arithmetic mean coordinates to determine whether the current frame optical signal is interference data;

[0096] If the second deviation value is less than 5 pixels, the current frame light signal is determined to be valid data, and the single-frame valid coordinates of the current frame light signal are calculated using calculation formula group one, which are used as the position coordinates of the light spot; if the second deviation value is greater than 5 pixels, the current frame light signal is determined to be interference data, and the interference data is discarded.

[0097] It should be noted that the terms "first" and "second" in this invention are only used to distinguish the results in different steps and are not interpreted in terms of specific numerical values.

[0098] For example, to balance accuracy and cost, the coordinates and signals of n=3 receivers 101 are prioritized. Assuming the coordinates and signal strengths of the three receivers 101 near the illuminated cursor are (100, 50) / 3500, (102, 50) / 2800, and (100, 52) / 1200 respectively, the center coordinates of the single frame are calculated using the above formula:

[0099] =3500+2800+1200=7500;

[0100] Xc=(3500×100+2800×102+1200×100) / 7500≈100.75;

[0101] Yc=(3500×50+2800×50+1200×52) / 7500≈50.32;

[0102] The valid coordinates of a single frame are (100.75, 50.32).

[0103] For example, if the effective coordinates of the first three frames are calculated as follows: the first frame coordinates are (100.50, 50.20), the second frame coordinates are (100.65, 50.28), and the third frame coordinates are (100.65, 50.27); then the arithmetic mean coordinates are calculated as follows:

[0104] X avg =(100.50+100.65+100.65) / 3=100.60;

[0105] Y avg =(50.20+50.28+50.27) / 3=50.25;

[0106] The average coordinates of the first three valid frames are (100.60, 50.25).

[0107] Assuming that after collecting and processing the arithmetic mean coordinates, new coordinate data (Xi, Yi) is obtained, which is compared with the average of the first three frames of valid coordinates in the programmable signal processing unit FPGA (Xi, Yi). avg_Pre Y avg_Pre Compare them; if the absolute value of the deviation of the coordinate values ​​is |X i -X avg-Pre |<5 pixels and|X i -X avg-Pre If | < 5 pixels, the current frame data is considered valid and will be added to the cache, replacing the earliest frame data, for use in calculating the average coordinates for the next frame; if the coordinate value deviates, the absolute value |X i -X avg-Pre |>5 pixels,|X i -X avg-Pre If the value is greater than 5 pixels, it is considered interference data in the current frame and is discarded without being included in the calculation.

[0108] In this invention, the operation command for parsing the light signal and the response of the operation command on the display screen 100 can be achieved through the cooperation of a programmable signal processing unit and a screen control module. For example, the programmable signal processing unit sends the processed position coordinates of the light spot (100.75, 50.32) to the screen control module of the display screen 100. Because an invisible laser is used, there are no visible light spots on the display screen 100 when illuminated by the remote control. The cursor is displayed through the UI part of the screen control module, and the position coordinates of the light spot are mapped to the display coordinates of the cursor on the screen. For example, by rounding up, the position coordinates of the example light spot (100.75, 50.32) approximately correspond to the 101st column and the 51st row of the screen. The display effect can be completely customized by the user to render and display the pixels near the corresponding coordinate points according to their needs. For example, the UI can be designed as a custom mouse shape such as a dot.

[0109] This invention, through the combined identification of light spot coordinates and the positioning of display coordinates, enables users to directly select buttons on the display screen 100 to select target locations, such as pause, play, drag start, and drag end. Specifically, if the user performs a drag operation, the operation command of the light signal is parsed, including the following steps: if at least three consecutive frames of light signal encoding signals are detected to be flickering, and the third deviation between the coordinates of each frame of light signal is ≤1 pixel, then the operation command is determined to be drag start; if less than two frames of light signal encoding signals are detected to be flickering, or if the third deviation between the coordinates of each frame of light signal is detected to be >1 pixel, then the light signal is determined to be an interference signal; if at least three consecutive frames of light signal encoding signals are detected to be constant output, then the operation command is determined to be drag end.

[0110] refer to Figure 5 and Figure 6As shown, the system implements cursor mapping and left / right button operation command recognition. For example, the FPGA monitors the received laser signal pattern: the remote control emits a PPM pulse-coded signal. If receiver 101 detects signal code 0110100100110110+0010, which is a 1kHz flashing pattern, and this pattern is detected for three consecutive frames with a 1ms interval between each frame, and the coordinate fluctuation is ≤1 pixel, then it is determined to be a "drag start" command. The system display module controls the screen to highlight the icon at the selected cursor position. If the user moves the remote control, the FPGA continuously acquires coordinates (100.75, 50.32) → (105.10). (48.95) → (110.30, 45.60), and the coordinates of each frame pass the deviation check, which is determined to be a drag-and-drop instruction. The main processor updates the cursor position in real time to form the visual effect of icon dragging. If the signal encoding is detected to recover to the encoding 0110100100110110+0001, which is a constant output, and this mode is maintained for three consecutive frames, it is determined to be a drag-and-drop end instruction. The main processor of the screen control module controls the icon to be placed at the cursor position (110.30, 45.60). If only one or two frames detect a flashing signal, or the coordinate fluctuation is >1 pixel, it is determined to be an interference false trigger, and no instruction is executed.

[0111] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. An intelligent screen interaction device based on laser positioning cursor, characterized in that, The application relates to a laser-positioning-cursor-based intelligent screen interaction device, which comprises a display screen (100), a laser remote controller, a programmable signal processing unit and a screen control module; a plurality of receivers (101) and narrow-band optical filters are arranged in an array in the display screen (100); the plurality of receivers (101) are arranged in a grid form in the packaging layer of the display screen (100), thereby being capable of collecting and identifying light spots emitted by the laser remote controller; each receiver (101) is configured with a unique logical address, and the logical address is used for identifying the receiver (101) and the coordinate value relative to the display screen (100); the programmable signal processing unit is electrically connected to the screen control module, capable of receiving the optical signal sent by the laser remote controller and calculating the position coordinates of the light spot, thereby controlling the display screen (100) to position the display cursor at the position of the light spot and controlling the display screen (100) to respond to the user operation according to the operation instruction of the optical signal.

2. The smart screen interaction device based on laser positioned cursor of claim 1, wherein, The array number of the receiver (101) is set to be at most two pixel points of the display screen (100) occupying one receiver (101).

3. The laser-positioned cursor based smart screen interaction device of claim 1, wherein, The programmable signal processing unit is provided with a timing synchronization module, and the synchronization timing module is used for identifying the refreshing blanking period of the display screen (100) and resetting the count when a refreshing signal is received, thereby generating a sampling trigger signal synchronized with the refreshing blanking period.

4. An intelligent screen interaction implementation method based on laser positioning cursors, characterized in that, The laser-positioning-cursor-based intelligent screen interaction device comprises the following steps: S1, when a user operates the keys of the laser remote controller, the laser remote controller emits a laser beam to the target position of the display screen (100), so that a light spot is generated at the target position; S2, the receiver (101) collects the optical signal of the laser beam, and sends the logical address of the light spot position corresponding to the receiver (101) and the optical signal to the programmable signal processing unit; S3, according to the logical address of the receiver (101), the position coordinates of the light spot are calculated and sent to the screen control module; S4, the screen control module maps the position coordinates into the display coordinates of the display cursor on the display screen (100), thereby presenting the display cursor at the display coordinates; S5, the operation instruction of the optical signal is analyzed, and the display screen (100) responds to the operation instruction.

5. The method of claim 4, wherein, The S2 further comprises the following steps: A threshold value of light intensity is set, the threshold value comprises a low threshold value and a high threshold value; the light intensity of the received light of the display screen (100) is collected in real time; It is judged whether the received light is a valid optical signal: when the light intensity of the received light is less than the low threshold value, the received light is determined to be invalid interference light and is filtered out; when the light intensity of the received light is greater than the high threshold value, the received light is determined to be a valid optical signal.

6. The method of claim 5, wherein, It is further judged whether the received light is a valid optical signal, and the method comprises the following steps: When the light intensity of the received light is between the low threshold value and the high threshold value, the received light is stored in a temporary buffer area; if the light intensity of the received light of at least three consecutive frames is between the low threshold value and the high threshold value, and no encoding signal of the received light is identified, the received light is determined to be invalid interference light.

7. The method of claim 5, wherein, The S2 further comprises the following steps: Every at least ten seconds, the success rate of receiving the effective light signal is counted; if the success rate of receiving is < 90%, and the light intensity of the received light of the display screen (100) is increased in real time, the threshold of the receiver (101) is increased and the brightness of the backlight of the display screen (100) is reduced, so that the success rate of receiving is ≥ 95%.

8. The method of claim 4, wherein, In S2, the light signal of the light spot position is collected by the receiver (101), specifically including the following steps: Spectrum verification: analyze the actual wavelength of the light signal, and if the first deviation value between the actual wavelength and the set wavelength is ≤ 5nm, pass the verification; Encoding verification: analyze the signal encoding of the light signal, and then obtain the device ID of the laser remote controller, if the device ID is consistent with the pre-stored legal ID, pass the verification. 9.The method of claim 4, wherein, The light signal of the laser beam is collected by the receiver (101), including collecting at least the first three frames of light signal and the current frame of light signal of the laser beam; and the position coordinates of the light spot are calculated, specifically including the following steps: S31, calculating single-frame effective coordinates: obtaining the first receiver coordinates (X i , Y i ) of the i-th receiver (101) according to the logical address of each receiver (101) of the light spot position; identifying the light signal to obtain the signal intensity I i , calculating the single-frame effective coordinates (X c , Y c ) and the signal intensity sum using a calculation formula set one; the calculation formula set one is: ； ； ； S32, calculate the arithmetic mean coordinate: according to the single-frame effective coordinate and the signal intensity sum, the arithmetic mean coordinate is obtained by calculation formula group two; the calculation formula group two is: ； ； S33、According to the light signal of the current frame, the second receiver coordinate of the i-th receiver (101) corresponding to the light signal of the current frame is obtained ; Calculate the second deviation value of the second receiver coordinate and the arithmetic mean coordinate, and determine whether the current frame light signal is interference data; If the second deviation value is < 5 pixels, it is determined that the current frame of light signal is valid data, and the single-frame effective coordinate of the current frame of light signal is calculated as the position coordinates of the light spot by calculation formula group one; if the second deviation value is > 5 pixels, it is determined that the current frame of light signal is interference data, and the interference data is discarded.

10. The method of claim 9, wherein, If the user performs a drag operation, the operation instruction of the light signal is analyzed, specifically including the following steps: If it is detected that the encoding signal of at least three consecutive frames of the light signal is flickering, and the third deviation between the coordinates of each frame of the light signal is ≤ 1 pixel, it is determined that the operation instruction is the start of dragging; If it is detected that the encoding signal of less than two frames of the light signal is flickering, or it is detected that the third deviation between the coordinates of each frame of the light signal is > 1 pixel, it is determined that the light signal is an interference signal; If it is detected that the encoding signal of at least three consecutive frames of the light signal is constant output, it is determined that the operation instruction is the end of dragging.

Images