Laser pointer interactive control system and method
By emitting multiple light spots using the laser pointer component and combining this with the image acquisition and processing component to identify the light spot information and generate control commands, the problem of high cost and low diversity in long-distance laser pointer interaction is solved, achieving low-cost and high-efficiency interactive control.
Patent Information
- Application Number
- CN202510635785.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-16
- Publication Date
- 2026-11-17
AI Technical Summary
Existing technologies for long-distance laser pointer interaction require high image recognition and computing power, and the limited laser spot type restricts the diversity of interaction, resulting in high manufacturing costs for the interaction system.
A laser pointer component emits various laser spots to the display component. Combined with an image acquisition and processing component, the location information of the laser spots and image information are identified to generate corresponding control commands. This eliminates the need to identify the position of the laser spots and the position of the controls, simplifying the system structure and reducing the requirements for image recognition and computing power.
It reduces preparation costs in long-distance interactions, increases interaction diversity, reduces the types of data the system needs to identify, lowers computational requirements, and simplifies the system architecture.
Smart Images

Figure CN123114285A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of intelligent control technology, and in particular to a laser pointer interactive control system and method. Background Technology
[0002] In related technologies, in scenarios requiring long-distance interaction using a laser pointer, a camera is needed to capture the position of the laser spot within the display area of the display device. Based on the recognition of the spot's position and the position of controllable components within the display area, and when the spot's position and spatial location information match, exchange commands are sent to the corresponding controllable components via Bluetooth, WiFi, or infrared to enable interaction between the laser pointer and the controllable components on the display device. However, this interaction method places high demands on image recognition and computational capabilities, and the type of laser spot emitted by the laser pointer is very limited, which significantly restricts the diversity of interactions between the laser pointer and the long-distance display device. Summary of the Invention
[0003] Therefore, it is necessary to provide a laser pen interactive control system and method that can reduce the manufacturing cost of the interactive system while achieving long-distance interaction, in order to address the above-mentioned technical problems.
[0004] In a first aspect, this application provides a laser pointer interactive control system, including a laser pointer component, a display component, and an image acquisition and processing component; wherein:
[0005] The laser pointer assembly includes at least one laser pointer; the laser pointer is used to emit a laser spot toward the display surface of the display assembly.
[0006] The image acquisition and processing component is used to acquire the laser spot in the display surface; and is used to identify the spot orientation information and spot image information corresponding to the laser spot, and transmit corresponding control commands to the display component based at least on the spot orientation information and the spot image information;
[0007] The display component is used to receive the control command and respond to the function operation corresponding to the control command.
[0008] In one embodiment, the laser spot includes at least one coordinate axis; the arrow direction of at least one of the coordinate axes is used to determine the orientation information of the laser spot;
[0009] The laser spot also includes at least one spot; at least one of the spot shape, number of spots, spot coordinates, spot flicker frequency, spot movement direction, spot intensity, and spot color is used to determine the spot image information; the spot and the coordinate axis do not overlap on the display surface.
[0010] In one embodiment, the laser spot includes intersecting first and second coordinate axes; at least one of the first arrow direction of the first coordinate axis and the second arrow direction of the second coordinate axis is used to determine the orientation information of the laser spot;
[0011] At least one of the light spots is located in at least one quadrant region of the coordinate system formed by the first coordinate axis and the second coordinate axis.
[0012] In one embodiment, the image acquisition and processing component is further configured to determine the control command corresponding to the laser spot based on at least one of the spot orientation information and the spot image information, and the positional relationship between the spot and the coordinate axis and the positional relationship between the spot and the quadrant region.
[0013] In one embodiment, the image acquisition and processing component is further configured to identify the laser pen identifier corresponding to the laser spot, and determine the control command corresponding to the laser spot based on at least one of the laser pen identifier, the spot orientation information and the spot image information, and the positional relationship between the spot and the coordinate axis and the positional relationship between the spot and the quadrant region.
[0014] In one embodiment, the encoded information of the laser spot includes a start bit, an identifier bit, an instruction code value bit, a check bit, an end bit, and an idle bit; the identifier bit is used to carry the laser pen identifier, and the instruction code value bit is used to carry the control instruction.
[0015] In one embodiment, the display surface of the display component includes at least two laser spots corresponding to the laser pens; the laser spots corresponding to each laser pen are identified by different laser pen identifiers.
[0016] In one embodiment, the laser pointer identifier of the laser pointer is matched with a preset priority;
[0017] The image acquisition and processing component is further configured to, when acquiring multiple laser spots corresponding to the laser pens simultaneously, determine the laser spot used to generate the control command based on the preset priority matching the laser pen identifiers corresponding to each laser spot.
[0018] In one embodiment, the laser pointer is used to receive a function command to trigger the laser spot corresponding to the function command to be emitted toward one side of the display component;
[0019] The laser pointer includes a display screen, which is used to display the name of the function instruction and / or at least part of the information in the spot orientation information and the spot image information corresponding to the function instruction.
[0020] Secondly, this application also provides a laser pointer interactive control method, applied to the laser pointer interactive control system described in any one of the first aspects, the method comprising:
[0021] The laser spot in the display surface of the display component is captured;
[0022] Identify the laser spot's orientation information and image information;
[0023] Based on the light spot orientation information and light spot image information, corresponding control commands are transmitted to the display component to control the display component to respond to corresponding functional operations based on the control commands.
[0024] In the laser pointer interactive control system and method provided in this application, the laser pointer interactive control system includes a laser pointer component, a display component, and an image acquisition and processing component. Specifically, the laser pointer component includes at least one laser pointer. The laser pointer emits a laser spot onto the display surface of the display component. The image acquisition and processing component acquires the laser spot on the display surface and identifies the laser spot's orientation information and image information. Based on the laser spot's orientation information and image information, it transmits corresponding control commands to the display component. That is, there is a certain physical distance between the laser pointer component and the display component. After the laser pointer emits a laser spot onto the display surface of the display component, the image acquisition and processing component identifies the laser spot. Based on this identification, the image acquisition and processing component identifies different control commands corresponding to different laser spots. These control commands are the function operation instructions that the laser pointer user wants to transmit to the display component. The display component then receives the control command transmitted by the system and responds with the corresponding function operation, thereby enabling the laser pointer component to control the relevant function operation of the display component from a distance. As can be seen, in the interactive implementation of the laser pen interaction system provided in this application, it is not necessary to identify the position of the laser spot on the display surface, nor is it necessary to identify the position of the controls involved on the display surface. It is only necessary for the laser pen to emit multiple different laser spots to correspond to different control commands. Therefore, it can also reduce the types of data that the interactive control system needs to identify, thereby reducing the computational power requirements of the interactive control system. Furthermore, the laser pen provided in this application can emit multiple different laser spots to correspond to multiple different control commands, which improves the interactivity of interacting with a distant display device through the laser pen. As can be seen, in the interactive implementation of the laser pen interaction system provided in this application, it is only necessary for the laser pen to emit multiple different laser spots, thus significantly reducing the manufacturing cost of the laser pen interactive control system. Attached Figure Description
[0025] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.
[0026] Figure 1 This is a schematic diagram of the architecture of a laser pointer interaction control system in one embodiment;
[0027] Figure 2 This is a schematic diagram of the image acquisition and processing component's shooting area in one embodiment;
[0028] Figure 3 This is a schematic diagram of the image acquisition and processing component's shooting area in another embodiment;
[0029] Figure 4 This is a schematic diagram of the image acquisition and processing component's shooting area in another embodiment;
[0030] Figure 5 This is a schematic diagram of multiple laser spots in one embodiment;
[0031] Figure 6 This is a schematic diagram of the architecture of the laser pointer interaction control system in another embodiment;
[0032] Figure 7 This is a schematic diagram illustrating the composition of encoded information in one embodiment;
[0033] Figure 8 This is a schematic diagram of the laser pointer architecture in one embodiment;
[0034] Figure 9 This is a schematic diagram of one embodiment including two laser pointers;
[0035] Figure 10 This is a schematic diagram illustrating the positioning between an image and a display screen in one embodiment;
[0036] Figure 11 This is a flowchart illustrating a laser pointer interaction control method in one embodiment. Detailed Implementation
[0037] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0038] In scenarios requiring long-distance interaction using a laser pointer, one solution is to employ an air mouse based on an IMU (Inertial Measurement Unit) or UWB (Ultra Wide Band) wireless carrier communication technology. This solution works by determining the relative position of the handheld device (air mouse) to the display device to perform the positioning for related control functions. However, since absolute positioning technology still suffers from poor accuracy, this solution is prone to positioning point offset or error accumulation.
[0039] Another approach in related technologies involves using a camera or event camera to locate the control functions in scenarios requiring long-distance interaction with a laser pointer. For example, existing solutions use a camera to capture the laser spot's position on the display area of a display device. However, to enable operations such as those on buttons within the display device, the positions of the controls shown on the display surface must be identified. After matching the laser spot's position with the spatial position information, assistance is needed via Bluetooth, WiFi, or infrared. This involves sending exchange commands to the corresponding controllable space using Bluetooth, WiFi, or infrared to enable interaction between the laser pointer and the controllable controls on the display device. This approach places high demands on the image recognition and computational capabilities of the interactive system and requires additional Bluetooth, WiFi, or infrared components, increasing the manufacturing cost of the interactive control system. Therefore, this approach suffers from a complex system architecture and high manufacturing costs.
[0040] In summary, there is an urgent need to provide a laser pen interactive control system that can reduce the manufacturing cost of the interactive system while achieving long-distance interaction.
[0041] Based on this, please refer to Figures 1-6 This application provides a laser pointer interactive control system 100, including a laser pointer assembly 101, a display assembly 102, and an image acquisition and processing assembly 103; wherein:
[0042] The laser pointer assembly 101 includes at least one laser pointer; the laser pointer is used to emit a laser spot 104 toward the display surface of the display assembly 102;
[0043] The image acquisition and processing component 103 is used to acquire the laser spot 104 in the display surface; and to identify the spot orientation information and spot image information corresponding to the laser spot 104, and to transmit the corresponding control command to the display component 102 based at least on the spot orientation information and spot image information.
[0044] Display component 102 is used to receive control commands and respond to the corresponding function operations.
[0045] Specifically, such as Figure 1As shown, the laser pointer interactive control system 100 provided in this application includes at least three component structures: a laser pointer assembly 101, a display assembly 102, and an image acquisition and processing assembly 103. The laser pointer assembly 101 emits a laser spot 104 onto the display surface of the display assembly 102. The number of emitted laser spots 104 can be one or more. The laser pointer assembly 101 can include one or more laser pointers. A single laser pointer can be configured to emit only one type of laser spot 104 within the same control time period, while multiple laser pointers can be configured to emit at least two types of laser spots 104 within the same control time period. Figure 5 Schematic diagrams of various laser beams are also shown.
[0046] Please refer to Figure 6 The image acquisition and processing component 103 may include an image acquisition component 31 and a control command determination component 32. The image acquisition component 31 may, for example, consist of one or more camera modules, used to continuously capture images of the display surface of the display component 102, particularly for capturing the laser spot 104 emitted by the laser pointer onto the display surface of the display component 102. Wherein, as... Figure 2 As shown, the capturing area of the image acquisition component 31 can be set to cover and extend beyond the display surface of the display component 102, or it can be set to exactly cover the display surface of the display component 102. This application does not specifically limit this. Furthermore, as... Figure 3 If the display surface of the display component 102 is provided with a dedicated area for receiving the laser spot 104 (e.g., an interactive area), the image acquisition component 31 can also be configured to capture an area that only covers the dedicated area for receiving the laser spot 104 (interactive area).
[0047] In the case where the image acquisition component 31 has two or more camera modules, the shooting area of each camera module can be configured to cover the area of the display surface of the display component 102 used to receive the laser spot 104, such as... Figure 4 As shown, the sum of the areas of the display surface of the display component 102 captured by multiple camera modules can be set to cover the area of the display surface to be captured that is used to receive the laser spot 104.
[0048] When the image acquisition component 31 captures a laser spot 104 emitted from the laser pointer component 101 onto the light-emitting surface of the display component 102, the image including the relevant laser spot 104 can be transmitted to the module (control command determination component 32) in the system for image recognition and analysis. Taking this module as an image recognition module, the image recognition module can be used to identify the spot orientation information and spot image information corresponding to the laser spot 104 in the image. Then, based at least on the spot orientation information and spot image information, it can identify the functional operation corresponding to the laser spot 104 that needs to be transmitted to the display component 102. Then, based on the identified functional operation, it generates the control command corresponding to the laser spot 104 that needs to be transmitted to the display component 102 and transmits the control command to the display component 102.
[0049] Correspondingly, when the display component 102 receives a control command transmitted by the system, it can respond to the corresponding function operation of the control command; for example, if the control command indicates that the audio on the display surface of the display component 102 needs to be played, the corresponding function operation is used to play the audio; if the control command indicates that the presentation on the display surface of the display component 102 needs to be turned (downward), the corresponding function operation is used to turn the presentation; if the control command indicates that a certain control on the display surface of the display component 102 needs to be selected, the corresponding function operation is used to select the relevant control.
[0050] As can be seen, by recognizing the laser spot orientation information and spot image information of the laser spot 104, this application can identify and determine different control commands that need to be transmitted to the display component 102 for different laser spots 104, and then transmit the relevant control commands to the display component 102, thereby triggering the functional operation corresponding to the control command in the display component 102.
[0051] The laser pointer interactive control system 100 provided in this application includes a laser pointer assembly 101, a display assembly 102, and an image acquisition and processing assembly 103. Specifically, the laser pointer assembly 101 includes at least one laser pointer. The laser pointer emits a laser spot 104 onto the display surface of the display assembly 102. The image acquisition and processing assembly 103 acquires the laser spot 104 on the display surface and identifies the laser spot's orientation information and image information. Based on at least the laser spot's orientation information and image information, it transmits corresponding control commands to the display assembly 102. In other words, the laser pointer assembly 101 and the display assembly... There is a certain distance between the laser pointers 101 and 102 in physical space. After the laser pointer emits a laser spot 104 onto the display surface of the display component 102, the image acquisition and processing component 103 identifies the laser spot 104. Based on the image acquisition and processing component 103, different control commands are identified for different laser spots 104. These control commands are the instructions related to the function operation that the user of the laser pointer wants to send to the display component 102. Then, the display component 102 receives the control command transmitted by the system and responds with the corresponding function operation, thereby realizing the control of the relevant function operation in the display component 102 by the laser pointer component 101 at a distance. As can be seen, in the interactive implementation of the laser pen interaction system provided in this application, it is not necessary to identify the position of the laser spot 104 on the display surface, nor is it necessary to identify the position of the controls involved on the display surface. It is only necessary for the laser pen to emit multiple different laser spots to correspond to different control commands. Therefore, the laser pen interaction control system 100 provided in this application can reduce the number of data types that the system needs to identify in the process of realizing long-distance interaction, which is conducive to reducing the demand on the computing power of the interaction control system 100. Furthermore, the laser pen provided in this application can emit multiple different laser spots to correspond to multiple different control commands, which improves the diversity of interaction between the laser pen and the display device at a distance. In addition, in the interactive implementation of the laser pen interaction system provided in this application, it is not necessary to further set up Bluetooth, WiFi or infrared components to realize the remote interaction between the laser pen and the display device. It is only necessary for the laser pen to emit multiple different laser spots, which can also significantly reduce the manufacturing cost of the laser pen interaction control system 100.
[0052] It should also be added that the area in the display surface of the display component 102 used to receive the laser spot 104 can be set as the interactive area; based on this, the placement position of the camera module of the image acquisition component 31 in the image acquisition and processing component 103 can be set, as long as the area captured by the camera module on the display component 102 is greater than or equal to the interactive area.
[0053] One feasible solution is, for example Figure 2 or Figure 4 As shown, the entire display area of the display component 102 is an interactive area. At this time, the area captured by the camera module needs to completely cover the interactive area, that is, cover the entire display area.
[0054] In addition, such as Figure 3 As shown, sometimes the interactive area is only a part of the display area. For example, in the application scenario of ultra-large size small pitch LED, the display area of the screen is larger than the area where the interactive area is located. Therefore, the shooting area of the camera module can be set to only cover the interactive area, without having to cover the entire display area.
[0055] like Figure 4 As shown, there are also some scenarios where the interactive area on the display surface of the display component 102 is large, or the interaction precision requirement is high. In such cases, multiple camera modules need to be stacked to capture the display surface of the display component 102. For example, two cameras are used to capture the left and right sides of the interactive area respectively. The shooting areas of the two cameras can be set to partially overlap to ensure good stitching between the images captured by the two cameras.
[0056] For the image acquisition component 31 in the image acquisition and processing component 103, in order to avoid interference from natural light, artificial light, etc. on the positioning and recognition of the laser spot 104, an infrared camera can be selected. For example, a 940nm wavelength filter can be set in the camera lens, or one or more components in the lens group can be coated with a 940nm wavelength filter film.
[0057] Specifically, one alternative implementation includes an image acquisition component 31 comprising a single infrared camera positioned in front of or to the side of the display surface of the display component 102 within a physical space. The infrared camera can be mounted on a structure such as a bracket, or further positioned in an area such as the ceiling within the physical space. If a projector is included in the physical space, the infrared camera can also be positioned at the projector. Furthermore, if a fisheye camera is used in the image acquisition component 31, it can be positioned near the display area of the display component 102, for example, at the edge of the display component 102.
[0058] It should also be added that, in the case where a light acquisition component is integrated inside the display component 102 for acquiring the laser spot 104, the light acquisition component can also be used to replace the image acquisition component 31 described above. When the light acquisition component is used to replace the image acquisition component 31, the control command determining component 32 can choose to directly reuse the data processing component in the display component 102.
[0059] In summary, by way of example, the laser pointer provided in this application can be an infrared laser pointer, and the matching image acquisition component can be an infrared camera; such a setting can eliminate the interference of ambient light on image acquisition, improve the recognition accuracy and coding recognition rate of the image (laser spot), that is, it is beneficial to improve the accuracy of recognizing the spot location information and spot image information corresponding to the laser spot.
[0060] Another alternative implementation is to install an image acquisition component 31 on the laser pointer, and the image acquisition direction of the image acquisition component 31 is the same as the light emission direction of the laser pointer, so as to ensure that when the laser pointer emits a laser spot 104 towards the display surface of the display component 102, the corresponding laser spot 104 can be acquired by the image acquisition component 31 integrated on the laser pointer.
[0061] The display component 102 in the laser pointer interactive control system 100 provided in this application can be any type of display device, such as an LCD (Liquid Crystal Display) display device, an OLED (Organic Light-Emitting Diode) display device, an LED (Light-Emitting Diode) display device, a projector, etc. Among them, LED display devices can include small-pitch LED display devices and MicroLED (Micro Light-Emitting Diode) display devices. This application does not make specific limitations on this, as long as the laser spot 104 emitted by the laser pointer component 101 can illuminate and display on the display surface of the display device.
[0062] like Figure 1 As shown, in an exemplary embodiment, the laser spot 104 includes at least one coordinate axis 41; the arrow direction of the at least one coordinate axis 41 is used to determine the orientation information of the spot;
[0063] The laser spot 104 also includes at least one spot 42; at least one of the spot shape, number of spots, spot coordinates, spot flicker frequency, spot movement direction, spot intensity and spot color of the spot 42 is used to determine the spot image information; the spot 42 and the coordinate axis 41 do not overlap on the display surface.
[0064] Specifically, for the laser spot 104 emitted by the laser pointer, this application provides an optional setting method in which the laser spot 104 includes at least one coordinate axis 41 and at least one light spot 42; wherein, the coordinate axis 41 is used by the system to identify and determine the orientation information of the laser spot 104, and the light spot 42 is used by the system to identify and determine the image information of the laser spot 104.
[0065] Optionally, the coordinate axes 41 and light spots 42 included in the same laser spot 104 can be set to not overlap on the display surface of the display component 102, so that no part of the coordinate axis 41 in the laser spot 104 is covered by the light spot 42, or in other words, they do not overlap. With this setting, the coordinate axes 41 and light spots 42 in the laser spot 104 can be displayed independently on the display surface. As a result, when the image acquisition component 31 in the image acquisition and processing component 103 acquires the image of the laser spot 104, the coordinate axes 41 and light spots 42 in the acquired image are relatively clear. This also helps to improve the system's clear identification and accurate analysis of the coordinate axes 41 and light spots 42 in the image. This improves the accuracy of the system in identifying the spot orientation information and spot image information corresponding to the laser spot 104, thereby improving the accuracy of the control commands corresponding to the laser spot 104 that are finally transmitted to the display component 102.
[0066] It should be added that this application provides a method for identifying the orientation information of the laser spot 104 by identifying the arrow direction of the coordinate axis 41 in the laser spot 104. For example, if the laser spot 104 includes only one coordinate axis 41, the positive orientation is the direction of the arrow of the coordinate axis 41 pointing directly upward to the upper edge of the display surface. Then, only when the control command determination component of the image acquisition and processing module in the system identifies the orientation information of the laser spot 104 as the direction of the arrow of the coordinate axis 41 pointing directly upward to the upper edge of the display surface, is the laser spot 104 considered valid and can be used to generate control commands to be transmitted to the display component 102.
[0067] It should also be added that the laser spot orientation information may include the relative position information of the laser spot 104 in the display surface, as well as the rotation angle of the laser spot 104; wherein, the rotation angle of the laser spot 104 can be determined based on the preset position of the arrow direction of the coordinate axis 41 in the laser spot 104 relative to the edge of the display surface.
[0068] In this application, the laser spot 104 is configured to include at least one coordinate axis 41, so that the laser spot 104 as a whole can present a non-rotationally symmetric pattern, which makes it easier to identify the rotation angle of the laser spot 104 through the non-rotationally symmetric pattern.
[0069] For example, the image acquisition component 31 in the image acquisition and processing component 103 can simultaneously acquire the outline of the display area of the display component 102 and the laser spot 104. Through image algorithm processing, the relative position information between the laser spot 104 and the display component 102 can be obtained. The image acquisition component 31 can be a fisheye camera module, which can ensure that the outline of the display area of the display component 102 and the laser spot 104 can be completely captured during use.
[0070] In addition, this application also provides a method for identifying the spot image information of a laser spot 104 by identifying at least one of the spot shape, number of spots, spot coordinates, spot flicker frequency, spot movement direction, spot light intensity, and spot color of the spot 42 in the laser spot 104, so as to obtain the spot image information corresponding to the laser spot 104 based on the information of at least one identified spot 42.
[0071] In this design, the coordinate axis 41 and the light spot 42 in the laser spot 104 are used together to determine the specific content of the control command to be transmitted to the display component 102. For example, the arrow direction of the single coordinate axis 41 pointing directly upwards to the upper edge of the display surface, combined with the shape of the single light spot 42, can be set to a triangle to determine the control command to be transmitted to the display component 102 as "page up". Alternatively, the arrow direction of the single coordinate axis 41 pointing directly to the left of the middle edge of the display surface, combined with three light spots 42, can be set to determine the control command to be transmitted to the display component 102 as "page down". "Page turning"; for example, it can be selected that the arrow direction of a single coordinate axis 41 points directly upward to the upper edge of the display surface, combined with two light spots 42, one of which is red and the other is green, to determine the control command to be transmitted to the display component 102 as "play audio"; for example, it can be selected that the arrow direction of a single coordinate axis 41 points directly upward to the upper edge of the display surface, combined with the movement direction of the light spot 42 during a preset time period as moving from the lower edge to the upper edge of the display surface, to determine the control command to be transmitted to the display component 102 as "scroll up the file content". It should be noted that this is only one embodiment of determining the control command to be transmitted to the display component 102 based on the coordinate axis 41 and the light spot 42 in the laser light spot 104, but this application is not limited to this, and users can combine different features of the coordinate axis 41 and the light spot 42 according to their needs to correspond to different control commands.
[0072] Furthermore, this application also provides an alternative embodiment in which, after the laser spot is emitted onto the display surface of the display component and remains constantly lit for a preset period of time, if a user using a laser pointer rotates the laser pointer, causing the corresponding laser spot to deflect, the extension direction of the coordinate axis in the laser spot will be relatively deflected. When the image acquisition device acquires this relative deflection, it can, for example, further identify the corresponding deflection direction to generate a preset control command based on the deflection direction. For example, it can rotate the image displayed on the display surface of the display component based on the deflection direction, or switch the previous or next image corresponding to the image displayed on the display surface of the display component based on the deflection direction.
[0073] Furthermore, this application also provides an alternative embodiment in which, after a laser spot is emitted onto the display surface of the display component and remains constantly lit for a preset period of time, if a user using a laser pointer controls the laser pointer to enlarge or reduce the area of the laser spot emitted onto the display surface of the display component, the image acquisition device, upon acquiring the enlargement or reduction of the laser spot area, can generate a corresponding preset control command based on the operation of enlarging or reducing the laser spot. This preset control command is, for example, a command to control the image displayed on the display surface of the display component to be enlarged or reduced accordingly; thereby, by controlling the change in the size of the laser spot, the image can be enlarged or reduced.
[0074] The shape of the light spot 42 may include, for example, a rectangle, a triangle, a circle, a polygon, or other irregular shapes (e.g., Figure 1 The shape of the light spot can be cloud-like, such as an arrow shape, an animal shape, a plant shape, etc.; the number of light spots can be one, two, or more; the light spot coordinates refer to the coordinate position of the light spot 42 relative to the coordinate axis 41, that is, the relative position of the light spot 42 and the coordinate axis 41; the light spot flicker frequency can be controlled according to the requirements, and the light spot flicker frequency of the entire laser light spot 104 can be controlled to be the same, or different light spots 42 in the laser light spot 104 can be controlled to have different light spot flicker frequencies; the light spot movement direction can be determined by the direction of each edge in the display surface relative to the horizontal plane; the light spot intensity can be controlled according to the requirements, and the light spot intensity of the entire laser light spot 104 can be controlled to be the same, or different light spots 42 in the laser light spot 104 can be controlled to have different light spot intensity; correspondingly, the light spot color can be controlled according to the requirements, and the light spot color of the entire laser light spot 104 can be controlled to be the same, or different light spots 42 in the laser light spot 104 can be controlled to have different light spot colors.
[0075] Please combine Figure 1 Reference Figure 5 , Figure 5 The image shows a total of 10 types of laser spots 104, such as in an exemplary embodiment. Figure 5 As shown in either aj, the laser spot 104 includes intersecting first coordinate axis 411 and second coordinate axis 412; at least one of the first arrow direction of the first coordinate axis 411 and the second arrow direction of the second coordinate axis 412 is used to determine the spot orientation information; at least one spot 42 is located in at least one quadrant region of the coordinate system formed by the first coordinate axis 411 and the second coordinate axis 412.
[0076] Specifically, based on the laser spot 104 including coordinate axes 41 and spot size 42, this application provides an optional implementation in which the laser spot 104 includes at least two coordinate axes 41, such as a first coordinate axis 411 and a second coordinate axis 412. The first coordinate axis 411 and the second coordinate axis 412 are displayed as intersecting on the display surface, for example, as a two-dimensional coordinate system commonly used in mathematics. In one embodiment, the first coordinate axis 411 may optionally include a corresponding first arrow, and the second coordinate axis 412 may optionally include a corresponding second arrow. Alternatively, only one of the first coordinate axis 411 and the second coordinate axis 412 may include a corresponding arrow. This application does not specifically limit this.
[0077] As described above, this application can determine the orientation information of the laser spot 104 by identifying the arrow direction of the coordinate axis 41 in the laser spot 104. Therefore, when the laser spot 104 includes intersecting first coordinate axis 411 and second coordinate axis 412, the orientation information of the laser spot 104 can be determined by selecting the first arrow direction of the first coordinate axis 411 and the second arrow direction of the second coordinate axis 412 together. However, this application is not limited to this and can also select the first arrow direction of the first coordinate axis 411 or the second arrow direction of the second coordinate axis 412 to determine the orientation information of the laser spot 104.
[0078] In one embodiment, when the laser spot 104 includes intersecting first coordinate axes 411 and second coordinate axes 412, the light spots 42 included in the laser spot 104 can be optionally configured such that all of them are located within the quadrant region of the coordinate system formed by the first coordinate axes 411 and the second coordinate axes 412. This configuration ensures that the light spots 42 in the same laser spot 104 do not overlap with either the first coordinate axis 411 or the second coordinate axis 412. When the laser spot 104 is emitted onto the display surface of the display assembly 102, the coordinate axes 41 and the light spots in the laser spot 104 are aligned... 42 are displayed independently on the display surface. When the image acquisition and processing component 103 acquires the image of the laser spot 104, the coordinate axis 41 and the spot 42 in the acquired image are relatively clear. This is beneficial to improving the system's clear identification and accurate analysis of the coordinate axis 41 and the spot 42 in the image. This can improve the accuracy of the control command determination component of the image acquisition and processing module in the system in identifying the spot orientation information and spot image information corresponding to the laser spot 104, so as to improve the accuracy of the control command corresponding to the laser spot 104 that is finally transmitted to the display component 102.
[0079] In the case where the laser spot 104 includes intersecting first coordinate axes 411 and second coordinate axes 412, and at least one light spot 42 located in at least one quadrant region of the coordinate system formed by the first coordinate axes 411 and second coordinate axes 412, taking the example that all light spots 42 are square light spots 42, the following is provided: Figure 5 The diagram shows 10 different laser spot patterns 104; each laser spot 104 can correspond to a different control command. That is, the spot orientation information and spot image information identified by the control command determination component of the image acquisition and processing module in the system are different for each laser spot 104. Therefore, each laser spot 104 can be identified and determined to a different control command.
[0080] Figure 5 The 10 laser spot patterns 104 shown are essentially crosshairs with arrows and dots, but the dot density is relatively low. Users can increase the number of dots to improve the dot density and achieve higher information encoding density. A higher dot density corresponds to more types of control commands, which is beneficial for controlling more functions of the display component 102 using a laser pointer.
[0081] Please combine Figures 1-5 Reference Figure 6 In an exemplary embodiment, the image acquisition and processing component 103 is further configured to determine the control command corresponding to the laser spot 104 based on at least one of the spot orientation information and spot image information, and the positional relationship between the spot 42 and the coordinate axis 41 and the positional relationship between the spot 42 and the quadrant region.
[0082] Specifically, in the laser pointer interactive control system 100 provided in this application, the control command determination component 32 in the image acquisition and processing component 103 is used to identify the relevant image of the laser spot 104 in order to determine the corresponding control command.
[0083] This application provides an optional embodiment in which the control command determination component 32 is used to receive an image (video) corresponding to the laser spot 104 in the display surface of the display component 102 acquired by the image acquisition component 31, and to identify and analyze the laser spot 104 in the image to obtain the laser spot orientation information, the laser spot image information, the first set positional relationship between the light spot 42 in the laser spot 104 and the coordinate axis 41, and the second set positional relationship between the light spot 42 in the laser spot 104 and the quadrant region. Then, based on the laser spot orientation information and the laser spot image information, and combined with at least one of the first set positional relationship and the second set positional relationship, the specific control command corresponding to the laser spot 104 is determined.
[0084] This application uses the control command determination component 32 in the image acquisition and processing component 103 to determine the spot orientation information, spot image information, first setting position relationship and second setting position relationship corresponding to the image related to the laser spot 104, and determines the relevant control commands based on at least three of these four sets of information. This helps to improve the accuracy of the determined control commands, so that the accuracy of the control commands corresponding to the laser spot 104 that are finally transmitted to the display component 102 can also be improved.
[0085] Please continue to refer to Figures 1-6 In an exemplary embodiment, the image acquisition and processing component 103 is further configured to identify the laser pen mark corresponding to the laser spot 104, and determine the control command corresponding to the laser spot 104 based on at least one of the laser pen mark, the spot orientation information and the spot image information, and the positional relationship between the spot 42 and the coordinate axis 41 and the positional relationship between the spot 42 and the quadrant region.
[0086] Specifically, the control command determination component 32 in the image acquisition and processing component 103 is used to identify the relevant image of the laser spot 104 in order to determine the corresponding control command.
[0087] This application provides an optional embodiment in which the control command determination component 32 is used to receive an image (image) corresponding to the laser spot 104 in the display surface of the display component 102 acquired by the image acquisition component 31, and to identify and analyze the laser spot 104 in the image (image) to obtain the laser pen mark corresponding to the laser spot 104, the spot orientation information corresponding to the laser spot 104, the spot image information corresponding to the laser spot 104, the first set positional relationship between the spot 42 in the laser spot 104 and the coordinate axis 41, and the second set positional relationship between the spot 42 in the laser spot 104 and the quadrant region. Then, based on the laser pen mark, the spot orientation information and the spot image information, and combined with at least one of the first set positional relationship and the second set positional relationship, the specific control command corresponding to the laser spot 104 is determined.
[0088] This application uses the control command determination component 32 in the image acquisition and processing component 103 to determine the laser pen identifier, spot orientation information, spot image information, first setting position relationship and second setting position relationship corresponding to the image of the laser spot 104. Based on at least four of these five sets of information, the relevant control commands are determined, which helps to further improve the accuracy of the determined control commands, so that the accuracy of the control commands corresponding to the laser spot 104 that are finally transmitted to the display component 102 can also be improved.
[0089] Please combine Figures 1-6 Reference Figure 7 In an exemplary embodiment, the encoding information of the laser spot 104 includes a start bit, an identifier bit (ID information), an instruction code value bit (key code value), a check bit, an end bit, and an idle bit; the identifier bit is used to carry the laser pen identifier, and the instruction code value bit is used to carry the control instruction.
[0090] Specifically, the laser spot 104 is equivalent to a graphic code. The encoded information in the graphic code may include at least an identifier bit for carrying the laser pen identifier and an instruction code value bit for carrying the pointing control command. The identifier bit is used to identify the laser pen identifier corresponding to the laser spot, so as to identify which laser pen emitted the laser spot 104. The instruction code value bit is used to identify which control command corresponding to the laser spot is to be transmitted to the display component 102.
[0091] Please refer to Figures 1-8 Correspondingly, the laser pen used in the laser pen interactive control system 100 provided in this application can be optionally configured to have an adjustable light pulse width function, which makes it possible to convert information into pulse code. The laser pen can be optionally configured to include at least an input device, an MCU (Micro Controller Unit), an APC (Automatic Power Control), and a semiconductor laser, and can be configured to have the input device, MCU, APC, and semiconductor laser electrically connected in sequence, so that control information input based on the input device can be converted into laser emission; wherein, the input device is, for example, a button or a coding wheel located on the surface of the laser pen.
[0092] Specifically, the MCU in the laser pointer can be used to encode the input signal from the input device, convert the encoded result into a TTL (Transistor-Transistor Logic) modulated signal and send it to the APC module. The APC module is a constant power control module. When the TTL signal is high, the module drives the laser in the laser pointer to output a constant optical power laser, and when the TTL signal is low, the laser output is turned off.
[0093] To ensure data accuracy and timely information transmission, this application provides an optional encoding method in which the encoding information of the laser spot 104, in addition to the identifier bit and the instruction code value bit, further includes at least a start bit, a check bit, an end bit, and an idle bit; wherein, the encoding can be configured such that the start bit, identifier bit, instruction code value bit, check bit, end bit, and idle bit are arranged in the following order.
[0094] It should also be added that the encoding information of the laser spot can be optionally set to include only the start bit and the instruction code value bit, and if required, at least one of the above-mentioned identifier bit, check bit, end bit and idle bit can be added.
[0095] For the encoded information, one optional configuration is provided: the start bit is fixed at a low level, and the end bit and idle bit are fixed at a high level; the ID information (identifier bit) can include the device serial number information for differentiation when multiple devices are operated simultaneously; the key code value bit is used to encode the behavior that triggers the key, such as each key click, double click, and long press (equivalent to different key functions) can have its own unique key code value. One implementation of the check bit is parity checking, and another is to use error correction code technology, such as Reed-Solomon error correction code. Among them, Reed-Solomon error correction code (RS code) is a powerful forward error correction code that can detect and correct multiple errors during data transmission.
[0096] Another feasible solution for using laser pointers is to employ infrared laser projection. The MCU encodes each button event into a corresponding graphic code and drives a miniature LCD (Liquid Crystal Display) panel inside the laser pointer to display the graphic code. The infrared laser source passes through the LCD panel and is focused by a collimating lens, projecting the image onto a large interactive display area. A camera captures the graphic code, and the SOC (System on Chip) in the laser pointer interactive control system 100 identifies the graphic code and extracts information such as its position and encoding. The advantage of this solution is that the camera can acquire button information from any single frame, greatly improving button recognition speed and reducing button response latency.
[0097] The applicant also found that in related technologies, in multi-user scenarios with long-distance interaction, if multiple users simultaneously emit laser beams from their laser pointers onto the display surface of a display device, the interaction system in these technologies cannot establish a correspondence between the multiple laser beams and the operations performed on the display device. In other words, the interaction system in these technologies cannot achieve synchronous operation of multiple laser pointers on the same display device. However, the demand for multiple laser pointers to interact with the same display device is increasing.
[0098] Please refer to Figure 1 , Figure 6 , Figure 7 and Figure 9In one exemplary embodiment, the display surface of the display component 102 includes at least two laser spots 104 corresponding to laser pointers; the laser pointer identifiers identified for each laser spot 104 are different.
[0099] Specifically, the laser pointer component 101 in the laser pointer interactive control system 100 provided in this application can include two or more laser pointers, such as... Figure 9 The laser pointer assembly 101 shown includes laser pointer 1 and laser pointer 2; that is, multiple laser pointers can be used to control the same display assembly 102 simultaneously; in this case, it is possible that two or more laser pointers can simultaneously emit laser beams 104 onto the display surface of the display assembly 102, i.e., as shown... Figure 9 As shown, laser pointer 1 emits light spot 1 and laser pointer 2 emits light spot 2. In order to avoid multiple laser pointers issuing relevant control commands to the display component 102 at the same time, causing confusion in the operation of the display component 102, the laser pointer identifiers of each laser pointer obtained by identifying laser spot 104 can be used to determine which laser pointer's laser spot 104 corresponds to the control command that the display component 102 needs to respond to at this time.
[0100] Please continue to refer to Figure 1 , Figure 6 , Figure 7 and Figure 9 In one exemplary embodiment, the laser pointer identifier matching of the laser pointer has a preset priority; the image acquisition and processing component 103 is also used to determine the laser spot 104 used to generate control commands based on the preset priority of the laser pointer identifier matching corresponding to each laser spot 104 when multiple laser spots 104 corresponding to multiple laser pointers are acquired at the same time.
[0101] Specifically, to avoid confusion in the operation of the display component 102 caused by multiple laser pointers simultaneously issuing control commands to it, this application provides an alternative solution: pre-setting priorities for the laser pointer identifiers of multiple laser pointers matched with the display component 102. For example, if three laser pointers are matched with the display component 102, their priorities can be set to high, medium, and low, respectively. Based on this preset priority, when three laser pointers simultaneously emit three laser spots 104 onto the display surface of the display component 102, the image acquisition and processing component 103 acquires and identifies these three laser spots 104. It can choose to first identify the preset priority matching the laser pointer identifiers corresponding to these three laser spots 104, that is, identify the priorities of these three laser pointers as high, medium, and low, respectively. Then, the laser pointer with the preset high priority is selected as the one that can send control commands to the display component 102. In this way, the confusion problem when multiple laser pointers simultaneously try to control the display component 102 can be avoided.
[0102] Setting the laser pointer identifier to include the preset priority of the laser pointer is only one optional implementation method provided by this application. This method can be applied in teaching or conference environments. Specifically, the laser pointer of the teacher or the main speaker of the conference can be set to have the highest priority.
[0103] Please refer to Figure 1 In one exemplary embodiment, the laser pointer is used to receive a function command to trigger the laser spot 104 corresponding to the function command to be emitted toward one side of the display component 102; the laser pointer includes a display screen (not shown), which is used to display the name of the function command, and / or at least part of the information in the spot orientation information and spot image information corresponding to the function command.
[0104] Specifically, the laser pointer can receive functional commands applied by the user by pressing the button on the surface of the laser pointer or sliding the scroll wheel. After receiving the relevant functional command, the MCU triggers the laser pointer to emit a laser spot 104 that matches the functional command.
[0105] Furthermore, for laser pointers, this application also provides an alternative implementation method in which a display screen is provided on the shell of the laser pointer. The display screen can be used to display at least one of the following: the name of the function command input by the user, the location information of the light spot corresponding to the function command, and the image information of the light spot corresponding to the function command, so as to help the user confirm whether the function command he / she input is correct and whether it is the function command he / she wants, thereby improving the user experience.
[0106] To ensure the stability of the laser pointer interactive control system, this application also provides an optional implementation method: during the power-on startup phase of the interactive control system, either when manually selecting calibration for the interactive area in the display area of the display component, or when automatically calibrating based on a preset fixed interval, or when the screen of the display component is powered off, the image acquisition component (e.g., an infrared camera) in the image acquisition and processing component is controlled to enter the interactive area for recognition. To improve the accuracy of recognition, the camera's exposure time can be increased, resulting in a brighter image and a higher signal-to-noise ratio. Alternatively, the screen brightness can be maximized, which can also increase the brightness of the captured image.
[0107] When there is only one camera in the image acquisition component, the camera captures an image containing the outline of the display area on the display surface of the display component. After capturing the outline of the screen, an algorithm is used to find the positions of the four corner points in the captured image. For example, the Harris corner method can be used to find the four corner points. Figure 10 The four corner points A', B', C', and D' shown in the image may appear as trapezoidal or parallelogram shapes due to the spatial relationship between the camera and the display screen, or distortion caused by the camera lens assembly. Since the pixel relationships of the four corner points on the display screen are fixed—for example, on a 4K display screen (resolution 3840*2160), the pixel values of the four corner points A, B, C, and D on the screen are (0, 0), (0, 2160), (3840, 0), and (2160, 3840), respectively—the correspondence between points on the captured image and points on the screen in real physical space can be found through projection transformation, such as the `getPerspectiveTransform()` function in OpenCV. This specifically refers to the transformation matrix. Subsequently, the positioning points found in the image using algorithms are transformed to their corresponding coordinates on the screen using this transformation matrix.
[0108] The Harris corner detection algorithm is a widely used feature detection method in computer vision, capable of identifying corners in images. OpenCV (Open Source Computer Vision Library) is a cross-platform library released under the BSD license (open source), running on Linux, Windows, Android, and Mac OS operating systems; the BSD license is one of the most widely used licenses for free software. The `getPerspectiveTransform()` function in OpenCV is used to calculate the perspective transformation matrix.
[0109] Of course, the accuracy of the conversion can also be increased by projecting specific patterns onto the display screen; for example, projecting a black and white checkerboard pattern in the center or near the four corners of the display screen can output a more accurate conversion matrix. In practical applications, there may also be situations where multiple cameras are combined, requiring image stitching or partition positioning to complete the trajectory positioning and encoding information reading of the fused images; for example, specific content, such as a black and white checkerboard pattern, can be displayed on the display screen to extract feature points, and then the feature points can be aligned to achieve the stitching of images from two cameras.
[0110] Please combine Figures 1-10 Reference Figure 11 Based on the same inventive concept, this application also provides a laser pointer interactive control method, which is applied to any of the aforementioned laser pointer interactive control systems; the method includes the following steps 901-903, wherein:
[0111] Step 901: Collect the laser spot in the display surface of the display component;
[0112] Step 902: Identify the laser spot's orientation information and image information;
[0113] Step 903: Based on the spot orientation information and spot image information, transmit the corresponding control command to the display component, so as to control the display component to respond to the corresponding functional operation based on the control command.
[0114] Adaptively, to achieve precise positioning and interactive operation based on an infrared laser pointer, different methods are employed for trajectory positioning using infrared spot images (laser spots). Specific key steps may include image acquisition, spot detection, spot tracking, and coordinate transformation, specifically:
[0115] Image acquisition: Using a camera with an infrared filter, capture in real time the image of the laser spot (laser spot) of the infrared laser pointer on the display area of the display component.
[0116] Spot detection: Image processing techniques are used to binarize the real-time captured infrared image, with the bright areas representing laser spots. Gaussian blur and other filtering algorithms are used to remove image noise, ensuring the stability and accuracy of spot detection.
[0117] Spot tracking: Using tracking algorithms such as mean-shift or Kalman filter, the position of the infrared spot is tracked in real time. The movement trajectory of the spot is recorded, providing a smooth cursor movement experience.
[0118] Coordinate Transformation: During the initialization phase, the physical coordinates of the four corners of the display screen are defined, establishing a correspondence with the four corners of the actual captured image. Based on the transformation matrix obtained during initialization, the position of the detected infrared spot in the camera image is converted into coordinates on the display screen during actual use. If there are multiple cameras, when the spot enters an overlapping area, a coordinate region fusion algorithm (such as 2D bilinear interpolation or back projection) is used to ensure accurate coordinate transformation for each spot.
[0119] Furthermore, this application also provides a method for decoding a laser spot, such as reading encoded information by means of changes in the intensity of an infrared laser pointer. The main steps include intensity modulation, image signal extraction, signal decoding, and operation command recognition, wherein:
[0120] Light intensity modulation: The infrared laser pointer encodes information by changing the light intensity. The encoded string includes the start bit, ID information, key code, check bit, and end bit.
[0121] Image signal extraction: Real-time acquisition and processing of light spot images captured by infrared cameras, identifying signal changes in the light spot by judging changes in brightness (light intensity). Image processing techniques, such as frame differencing or thresholding, are used to obtain the brightness change sequence of the light spot in real time.
[0122] Signal Decoding: The acquired light intensity change sequence is decoded, and the encoded information is reconstructed by analyzing the width and timing of the light intensity pulses. The complete encoded string is decoded, including the device ID and button operation information.
[0123] Operation command recognition: Based on the decoded key code values, map them to the corresponding user operation commands (such as single click, double click, long press, etc.). Extract device ID information to distinguish different laser pointer operation sources. Ensure the independence and accuracy of multi-user operations. Through mapping tables or logic control, respond to display devices or other associated devices according to key commands, such as cursor movement, page turning, clicks, etc.
[0124] In the practical application of the laser pointer interactive control system, trajectory positioning and decoding complement each other to ensure that every user operation is accurately reflected on the display screen, achieving efficient and accurate human-computer interaction. This technical solution solves the technical challenges of difficult calibration and confusing operation in infrared spot images.
[0125] Regarding the laser pointer interaction control method of the laser pointer interaction control system provided in this application, this application also provides several feasible embodiments, including:
[0126] The first type is single laser pointer interaction. Specifically, if only one laser pointer is allowed, pressing the power button on the laser pointer will cause the infrared laser to remain constantly lit. At this time, the camera can track the position of the laser spot on the display surface, enabling movement. If the user performs other operations, such as left-clicking or clicking the next page, the laser spot will be encoded in a special way. These codes can be different flashing frequencies, different ways of changing light intensity, etc. The encoded information corresponds to the operation. For example, left-clicking is defined as a 50Hz frequency, with the laser spot showing a bright-off-bright-off pattern. The first and fourth frames are the start and end markers, and the middle off-on pattern represents 01, which corresponds to the left-click operation.
[0127] The first type is multi-laser pointer operation. Specifically, if multiple laser pointers can interact, pressing the power button on a laser pointer will cause the infrared laser to remain constantly lit. At this time, the camera can track the position of the laser spot on the display surface, allowing it to move. If the user performs other operations, such as left-clicking or clicking the next page, the laser spot will be specially encoded. This encoding needs to include ID information (the laser pointer's identification information). These codes can have different flashing frequencies or different ways of changing light intensity. The encoded information corresponds to the operation. For example, the left-click is defined as a 60Hz frequency, with the laser spot exhibiting a bright-off-bright-off-bright-off pattern. The first and sixth frames are the start and end markers, and the middle off-on-off-on pattern represents 0101. The first 01 represents laser pointer 1, and the second 01 represents the left-click operation. In this case, the position response of laser pointer 1 is the left-click operation of laser pointer 1. Of course, different laser pointers can also be distinguished by different frequencies. For example, laser pointer 1 flashes at 30Hz, and laser pointer 2 flashes at 40Hz. In a 120fps video recording, the different frequencies can be clearly distinguished.
[0128] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.
[0129] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.
[0130] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.
[0131] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.
[0132] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.
Claims
1. A laser pointer interactive control system, characterized in that, It includes a laser pointer assembly, a display assembly, and an image acquisition and processing assembly; among which: The laser pointer assembly includes at least one laser pointer; the laser pointer is used to emit a laser spot toward the display surface of the display assembly. The image acquisition and processing component is used to acquire the laser spot in the display surface; and is used to identify the spot orientation information and spot image information corresponding to the laser spot, and transmit corresponding control commands to the display component based at least on the spot orientation information and the spot image information; The display component is used to receive the control command and respond to the function operation corresponding to the control command.
2. The system according to claim 1, characterized in that, The laser spot includes at least one coordinate axis; the arrow direction of at least one coordinate axis is used to determine the orientation information of the laser spot; The laser spot also includes at least one spot; at least one of the spot shape, number of spots, spot coordinates, spot flicker frequency, spot movement direction, spot intensity, and spot color is used to determine the spot image information; the spot and the coordinate axis do not overlap on the display surface.
3. The system according to claim 2, characterized in that, The laser spot includes intersecting first and second coordinate axes; at least one of the first arrow direction of the first coordinate axis and the second arrow direction of the second coordinate axis is used to determine the orientation information of the laser spot. At least one of the light spots is located in at least one quadrant region of the coordinate system formed by the first coordinate axis and the second coordinate axis.
4. The system according to claim 3, characterized in that, The image acquisition and processing component is further configured to determine the control command corresponding to the laser spot based on at least one of the spot orientation information and the spot image information, and the positional relationship between the spot and the coordinate axis and the positional relationship between the spot and the quadrant region.
5. The system according to claim 3, characterized in that, The image acquisition and processing component is also used to identify the laser pen mark corresponding to the laser spot, and to determine the control command corresponding to the laser spot based on at least one of the laser pen mark, the spot orientation information and the spot image information, and the positional relationship between the spot and the coordinate axis and the positional relationship between the spot and the quadrant region.
6. The system according to claim 5, characterized in that, The encoded information of the laser spot includes a start bit, an identifier bit, an instruction code value bit, a check bit, an end bit, and an idle bit; the identifier bit is used to carry the laser pen identifier, and the instruction code value bit is used to carry the control instruction.
7. The system according to claim 5, characterized in that, The display surface of the display component includes at least two laser spots corresponding to the laser pens; the laser pens corresponding to the laser spots are identified with different laser pen identifiers.
8. The system according to claim 7, characterized in that, The laser pointer's identifier is matched with a preset priority. The image acquisition and processing component is further configured to, when acquiring multiple laser spots corresponding to the laser pens simultaneously, determine the laser spot used to generate the control command based on the preset priority matching the laser pen identifiers corresponding to each laser spot.
9. The system according to claim 7, characterized in that, The laser pointer is used to receive function commands to trigger the laser spot corresponding to the function command to be emitted toward one side of the display component; The laser pointer includes a display screen, which is used to display the name of the function instruction and / or at least part of the information in the spot orientation information and the spot image information corresponding to the function instruction.
10. A laser pointer interactive control method, characterized in that, The method, applied to the laser pointer interactive control system according to any one of claims 1-9, comprises: The laser spot in the display surface of the display component is captured; Identify the laser spot's orientation information and image information; Based on the light spot orientation information and light spot image information, corresponding control commands are transmitted to the display component to control the display component to respond to corresponding functional operations based on the control commands.
