Laser spot detection method and apparatus, image interaction method and apparatus, device and medium

Abstract

A laser spot detection method and apparatus, an image interaction method and apparatus, a device and a medium. The image interaction method comprises: when a laser device is triggered to start, capturing a trigger signal of the laser device and performing an image acquisition response, and determining a capture-response duration corresponding to capturing the trigger signal and performing the image acquisition response, and an image acquisition time interval (S310); on the basis of the capture-response duration and the image acquisition time interval, determining a laser off time period and a laser emission time period, wherein, within the laser emission time period, the laser device projects a laser spot to a target scene (S320); acquiring, within the laser off time period, a first image corresponding to the target scene, and acquiring, within the laser emission time period, a second image corresponding to the target scene (S330); according to the first image and the second image, determining a detection result of the laser spot (S340); and, on the basis of the detection result, determining a target display area in the target scene corresponding to the laser spot (S350).

Description

Laser spot detection and image interaction methods, devices, equipment and media

[0001] This application claims priority to Chinese Patent Application No. 202411206087.8, filed with the Chinese Patent Office on August 30, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of multimedia interactive technology, such as a laser spot detection and image interaction method, apparatus, device and medium. Background Technology

[0003] In video shooting scenarios, the methods for framing / close-up shots in real time are generally based on interaction with the application, such as clicking or drawing close-up areas in the software screen.

[0004] To facilitate operation and save manpower on software operation, it would be ideal to project a laser spot directly onto a real-world scene via remote control, allowing users to select a specific area and display its corresponding image. This would be highly significant for applications such as online classrooms, remote conferencing, and object demonstrations.

[0005] The above process involves the detection of laser spots in general video images. Currently, laser spot detection faces many challenges. For example, the spots are often very small and dim, making it difficult to detect them visually. Furthermore, general environments are often very complex, easily containing patterns that closely resemble the target spot, leading to numerous false detections. Summary of the Invention

[0006] This application provides a method, apparatus, device, and medium for detecting laser spot and image interaction, so as to achieve accurate detection of laser spot projected in a target scene.

[0007] According to one aspect of this application, a method for detecting a laser spot is provided, comprising:

[0008] In response to the laser device being triggered to start, the trigger signal of the laser device is captured and an image acquisition response is performed. The capture response duration corresponding to capturing the trigger signal and performing the image acquisition response, as well as the image acquisition time interval, are determined.

[0009] Based on the capture response time and the image acquisition time interval, a laser pause period and a laser emission period are determined; wherein, the laser device projects a laser spot onto the target scene during the laser emission period;

[0010] During the laser pause period, a first image corresponding to the target scene is captured by the camera, and during the laser emission period, a second image corresponding to the target scene is captured by the camera.

[0011] The detection result of the laser spot is determined based on the first image and the second image.

[0012] According to another aspect of this application, an image interaction method based on spot detection is provided, comprising:

[0013] The detection result of the laser spot is obtained by using the laser spot detection method described in any embodiment of this application;

[0014] Based on the detection results, the target display area corresponding to the laser spot in the target scene is determined.

[0015] According to another aspect of this application, a laser spot detection device is provided, comprising:

[0016] The capture and response module is configured to respond to the laser device's trigger start, capture the trigger signal of the laser device and perform image acquisition response, and determine the capture response duration corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval;

[0017] The time period determination module is configured to determine the laser pause time period and the laser emission time period based on the capture response duration and the image acquisition time interval; wherein, the laser device projects a laser spot into the target scene during the laser emission time period;

[0018] The scene image acquisition module is configured to acquire a first image corresponding to the target scene captured by the camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the camera during the laser emission period;

[0019] The detection module is configured to determine the detection result of the laser spot based on the first image and the second image.

[0020] According to another aspect of this application, an image interaction device based on spot detection is provided, comprising:

[0021] The capture and response module is configured to respond to the laser device's trigger start, capture the trigger signal of the laser device and perform image acquisition response, and determine the capture response duration corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval;

[0022] The time period determination module is configured to determine the laser pause time period and the laser emission time period based on the capture response duration and the image acquisition time interval; wherein, the laser device projects a laser spot into the target scene during the laser emission time period;

[0023] The scene image acquisition module is configured to acquire a first image corresponding to the target scene captured by the camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the camera during the laser emission period;

[0024] The detection module is configured to determine the detection result of the laser spot based on the first image and the second image;

[0025] The display module is configured to determine the target display area in the target scene corresponding to the laser spot based on the detection results.

[0026] According to another aspect of this application, an electronic device is provided, the electronic device comprising:

[0027] At least one processor; and,

[0028] A memory communicatively connected to the at least one processor; wherein,

[0029] The memory stores a computer program that can be executed by the at least one processor, which enables the at least one processor to perform the laser spot detection method or the image interaction method based on spot detection as described in any embodiment of this application.

[0030] According to another aspect of this application, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions, the computer instructions being configured to cause a processor to execute and implement the laser spot detection method or the image interaction method based on spot detection as described in any embodiment of this application. Attached Figure Description

[0031] Figure 1 is a flowchart of a laser spot detection method provided in Embodiment 1 of this application;

[0032] Figure 2 is a flowchart of a laser spot detection method provided in Embodiment 2 of this application;

[0033] Figure 3 is a timing diagram of a spot detection method provided in Embodiment 2 of this application;

[0034] Figure 4 is a flowchart of an image interaction method based on spot detection provided in Embodiment 3 of this application;

[0035] Figure 5 shows the timing diagrams for three other spot detection methods provided in Embodiment 3 of this application;

[0036] Figure 6 is a schematic diagram of the structure of a laser spot detection device provided in Embodiment 4 of this application;

[0037] Figure 7 is a schematic diagram of the structure of an image interaction device based on spot detection provided in Embodiment 5 of this application;

[0038] Figure 8 is a schematic diagram of the structure of the electronic device provided in Embodiment 6 of this application. Detailed Implementation

[0039] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. The described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of this application.

[0040] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, for example, including, in addition to processes, methods, systems, products, or devices that include the series of steps or units shown in the embodiments of this application, other processes, methods, systems, products, or devices that are not explicitly listed in this series of steps or units, or other steps or units inherent to these processes, methods, systems, products, or devices.

[0041] To clarify the technical solution of this application, some application scenarios of this application will be described before introducing specific embodiments. The technical solution of this application can be applied to scenarios such as online classrooms, remote conferencing, and object demonstrations. In the above scenarios, a camera captures images of the real-world scene in real time, and then sends the captured images to the audience's terminal device via a communication connection, so that the real-world scene can be displayed on the audience's terminal device. When it is necessary to take a close-up of a target area or object in the real-world scene, for example, in an object demonstration scenario, a close-up of the object is needed so that the audience can see the shape, color details, etc. of the object more clearly. In this case, the user demonstrating in the real-world scene can hold a laser device and project a laser spot onto the object. The camera can accurately identify the laser spot, determine the image of the object projected by the laser spot, magnify the image of the object, and display the magnified image of the object on the audience's terminal device, thus realizing a close-up display of the object.

[0042] Example 1

[0043] Figure 1 is a flowchart of a laser spot detection method provided in Embodiment 1 of this application. This embodiment is applicable to the accurate detection of laser spots emitted by laser devices. The method can be executed by a laser spot detection device, which can be implemented in hardware and / or software. The device can be configured in a camera or computer device.

[0044] As shown in Figure 1, the method includes:

[0045] S110. When the laser device is triggered to start, the trigger signal of the laser device is captured and an image acquisition response is performed. The capture response duration corresponding to capturing the trigger signal and performing the image acquisition response, as well as the image acquisition time interval, are determined.

[0046] A laser device can be an electronic device that emits laser light and projects it onto the surface of an object. For example, a laser device is a laser pointer or a remote control that can emit laser light. A laser device can be activated based on a trigger signal, which can be generated through interactive operation with the laser device. For example, the interactive operation is the user pressing the emit button on the laser device.

[0047] When the laser device is triggered to start, the device in this embodiment can capture the trigger signal of the laser device, and after capturing the trigger signal, perform an image acquisition response. The capture response time can be understood as the time elapsed between capturing the trigger signal and performing the image acquisition response.

[0048] After the image acquisition response, the image frames captured by the camera can be acquired. The camera can be an artificial intelligence (AI) video camera that can capture images of real-world scenes.

[0049] It is understood that a camera can continuously acquire multiple consecutive image frames from a real-world scene. In this embodiment, these consecutive image frames can be acquired according to an image acquisition time interval, i.e., a portion of the image frames can be acquired. For example, if the image acquisition time interval is 2 milliseconds, then an image frame acquired by the camera is acquired every 2 milliseconds. When a user needs to take a close-up of an area in the real-world scene, they can press the laser emission button on the laser device. This interactive operation generates a trigger signal and activates the laser device. Simultaneously, the trigger signal can be captured and an image acquisition response can be performed, and the capture response duration and image acquisition time interval can be determined.

[0050] In this embodiment of the application, the step of capturing the trigger signal of the laser device and performing image acquisition response when the laser device is triggered to start includes: capturing the trigger signal of the laser device through camera software when the laser device is triggered to start, and preparing for image acquisition to be in a ready-to-acquire state when the trigger signal is captured.

[0051] In optional application scenarios, when the laser device is used as a remote control paired with an AI video camera, the remote control not only controls the AI ​​video camera but also emits laser light. Communication can be established between the remote control and the AI ​​video camera. Therefore, when the remote control detects the trigger activation of the laser emission function, the camera software can capture the trigger signal from the laser device via the communication channel and initiate image acquisition response upon receiving the trigger signal. Alternatively, this can be described as image acquisition preparation, placing the camera software in a ready-to-acquire state.

[0052] The "ready to capture" state can be the state where the camera software is ready and begins capturing image frames obtained by the camera. Simultaneously, the duration from when the laser emission button on the remote control is pressed to when the camera software receives the trigger signal, and the duration from when the trigger signal is received to when the camera software begins capturing the image captured by the camera, are determined. These two durations are added together as the capture response time.

[0053] In another alternative application scenario, the laser device is not a remote control for the camera. For example, the laser device could be a laser pointer with communication capabilities. This laser pointer can communicate with third-party software, and the third-party software can also communicate with the camera software. When the third-party software detects the trigger signal from the laser pointer, it can convert the trigger signal into a signal that the camera software can recognize and send it to the camera software, enabling the camera software to respond with image acquisition.

[0054] In the technical solution of this application, the trigger signal of the laser device is captured in different ways, and an image acquisition response is performed accordingly, thereby achieving effective capture of the trigger signal and improving compatibility with different types of laser devices.

[0055] S120. Based on the capture response duration and the image acquisition time interval, determine the laser pause period and the laser emission period.

[0056] The laser pause period can be understood as the time during which the laser beam of the laser device is in a paused emission state, while the laser emission period refers to the time during which the laser beam of the laser device is in an emission state. During the laser emission period, the laser device projects a laser spot onto the target scene, which can be a real scene.

[0057] Based on the capture response time and the image acquisition time interval, the laser pause period and the laser emission period can be calculated. During the laser pause period, the laser device is controlled not to project the laser spot, while during the laser emission period, the laser device is controlled to project the laser spot into the target scene.

[0058] The laser power of laser equipment is limited by safety regulations and is usually a relatively small value. When the projection distance is far, the light spot will be dim, and the image captured by the camera will be dimmer than in the actual scene, making the light spot very difficult to detect. Therefore, the design of the light spot pattern is crucial. To ensure a good balance between size and brightness at a fixed emission power, a circular light spot can be chosen. The laser energy is distributed on a circular pattern, which is brighter in projection and larger in size than other patterns such as dot patterns, thus having a greater detection advantage.

[0059] S130: Acquire a first image corresponding to the target scene captured by the camera during the laser pause period, and acquire a second image corresponding to the target scene captured by the camera during the laser emission period.

[0060] The first image can be an image of the target scene captured by the camera software during the laser pause period, and the second image can be an image of the target scene captured by the camera software during the laser emission period. For example, when the target scene is a live-streaming e-commerce scenario, the first image can be an image corresponding to the entire live-streaming room, such as an image including the live-streaming room background, the host's image, and the product image.

[0061] S140. Determine the detection result of the laser spot based on the first image and the second image. The detection result can be understood as the detection result of the laser spot projected into the target scene, and the detection result includes, but is not limited to, information such as the shape, brightness, and position of the laser spot.

[0062] It is understandable that the first image is taken by the camera during the laser's pause period, while the second image is taken by the camera during the laser's emission period. That is, the first image should not include the laser spot, while the second image should include it. Therefore, based on the first image (excluding the laser spot) and the second image (including the laser spot), the detection result of the laser spot can be determined, for example, the specific location of the laser spot in the second image.

[0063] In this embodiment of the application, the laser spot is detected by a spot detection model. For example, the first image and the second image are input into the spot detection model to obtain the detection result of the laser spot.

[0064] The laser spot detection method provided in this application further includes: training an initial spot detection model to obtain a trained spot detection model. This spot detection model is trained in the following manner:

[0065] The sample images corresponding to various projection parameters and the detection results of the actual light spots in the sample images are obtained. The laser light spots in the sample images are then detected using an initial light spot detection model to obtain the detection results to be used.

[0066] Based on the detection results to be used and the detection results of the actual light spot, the model parameters of the initial light spot detection model are corrected to obtain a trained light spot detection model.

[0067] Multiple projection parameters include at least one of the following: the projection angle of the light spot, the angle between the projection surface of the light spot and the camera, the brightness of the light spot, the color temperature of the reflection of the light spot from the projection surface of the light spot, and the white balance of the camera.

[0068] In this embodiment of the application, the difficulty in spot detection is mainly due to insufficient brightness in the image and skewed projection angle of the spot. Therefore, some sample images can be generated in advance, and the projection parameters corresponding to each sample image can be different. The actual spot detection result can be the detection result of spot detection in the sample image by manual or automatic means.

[0069] After generating sample images, the sample images and the corresponding detection results of actual laser spots can be used as a training sample set to train and iterate the initial laser spot detection model, correcting its detection parameters to obtain a trained laser spot detection model. After the initial laser spot detection model is trained, a trained laser spot detection model is obtained. This model can accurately identify laser spots in images with various projection parameters, obtaining accurate laser spot detection results, improving the generalization ability of laser spot detection, and its accuracy is not limited by projection parameters. The generation of sample images is explained below:

[0070] To address the issue of skewed light spot projection, if the light spot is projected onto one side, it will appear as an elliptical spot rather than a circle in the image. Therefore, during the sample image generation stage, a circular light spot is projected at a random angle. This involves not only randomly varying the incident angle of the light rays but also randomly varying the angle of the projection surface of the light spot. This maximizes the simulation of various scenarios that may occur in the real environment, thereby generating light spot patterns that can cope with different scenarios.

[0071] To address insufficient brightness, a single light spot can be randomly attenuated and projected onto multiple images or videos to maximize the simulation of its performance in a real-world environment. Furthermore, to simulate the color temperature of light spot reflections from different materials and the white balance differences within the image itself, the white balance is randomly adjusted during sample image generation to further enhance the generalization ability of the light spot detection model.

[0072] By augmenting the sample images of the initial spot detection model using the above measures, the accuracy of the trained spot detection model in detecting laser spots can be greatly improved, ensuring that the spot detection model can detect laser spots well in real-world scenarios. The spot detection model provided in this application embodiment has a very high recall rate.

[0073] The technical solution of this application embodiment involves capturing the trigger signal of the laser device and performing an image acquisition response when the laser device is triggered to start. The capture response duration corresponding to capturing the trigger signal and performing the image acquisition response, as well as the image acquisition time interval, are determined. Based on the capture response duration and the image acquisition time interval, a laser pause period and a laser emission period are determined. During the laser emission period, the laser device projects a laser spot onto the target scene. During the laser pause period, a first image corresponding to the target scene is captured by a camera, and during the laser emission period, a second image corresponding to the target scene is captured by the camera. The detection result of the laser spot is determined based on the first and second images. This method solves the technical problem of difficult detection of laser spots in images. By controlling the laser emission period and the timing of image acquisition, and then processing the images acquired in different time periods, accurate detection of laser spots in the target scene is achieved.

[0074] Example 2

[0075] Figure 2 is a flowchart of a laser spot detection method provided in Embodiment 2 of this application. Based on the above embodiments, this embodiment optimizes the laser spot detection process. For specific implementation details, please refer to the technical solution of this embodiment. Technical terms that are the same as or corresponding to those in the above embodiments will not be repeated here. As shown in Figure 2, the method includes:

[0076] S210. When the laser device is triggered to start, the trigger signal of the laser device is captured and an image acquisition response is performed. The capture response duration corresponding to capturing the trigger signal and performing the image acquisition response, as well as the image acquisition time interval, are determined.

[0077] S220. Determine the first acquisition duration based on the image acquisition time interval and the first number of images to be acquired, and determine the laser pause time period based on the capture response duration and the first acquisition duration.

[0078] The first number of frames to be captured refers to the number of frames of the first image to be captured, and the first capture time refers to the capture time required by the camera software for the first number of frames to be captured.

[0079] The product of the image acquisition time interval and the first number of images to be acquired can be used as the first acquisition duration, and then the laser pause time period can be calculated based on the capture response duration and the first acquisition duration.

[0080] S230. Determine the second acquisition duration based on the image acquisition time interval and the second number of images to be acquired corresponding to the second image, and determine the laser emission time period based on the capture response duration, the second acquisition duration and the laser pause time period.

[0081] The second number of images to be acquired refers to the number of frames of the second image to be acquired, and the second acquisition time refers to the acquisition time required by the camera software to acquire the second number of images to be acquired; the first number of images to be acquired and the second number of images to be acquired can be the same.

[0082] The product of the image acquisition time interval and the second number of images to be acquired can be used as the second acquisition duration. Then, the laser emission time interval can be calculated based on the capture response duration, the second acquisition duration, and the laser pause time interval.

[0083] S240, during the laser pause period, acquire the first image of the first number to be acquired.

[0084] The first image is an image of the target scene that does not contain laser spots.

[0085] S250, during the laser emission time period, acquire the second number of second images to be acquired.

[0086] The second image is an image of the target scene containing the laser spot.

[0087] In real-world environments, the probability of circular or elliptical light spots is very high, and it is theoretically difficult to completely distinguish between the two. Therefore, the entire detection process must be optimized. This problem can be solved by adjusting the laser emission timing and the light spot detection timing. Figure 3 is a timing diagram of light spot detection provided in Embodiment 2 of this application. Steps S210-S250 above will be explained in conjunction with Figure 3.

[0088] In this embodiment, laser emission and spot detection are coordinated in a time sequence to detect the detection results when the spot is extinguished and when the spot is emitted. By comparing the two, false detections in the background are removed, thereby obtaining a correct and effective real spot detection result.

[0089] When the user presses the laser button on the remote control, this moment is recorded as t0. Assuming that time T4 elapses, the event is captured by the camera program (whether directly by the camera software or indirectly sent to the camera via third-party software). After capturing the event, the camera application waits for T5, then begins capturing image frames. After capturing Nb frames (this set of frames is considered the background frame set ISb without bokeh), it stops capturing for T3, and then continues capturing Nf frames (this set of frames is considered the foreground frame set ISf with bokeh). At this point, the program's frame capture ends. Here, T4 plus T5 is the capture response time, Nb is the first number of frames to be captured, and the background frame set ISb can be understood as a set including multiple first images; Nf is the second number of frames to be captured, and the foreground frame set ISf can be understood as a set including multiple second images.

[0090] Correspondingly, at time t0, the remote control turns off laser emission during the first T1 time period, then turns it on during the next T2 time period, and then turns it off again. Here, T1 can be understood as the laser pause period, and T2 can be understood as the laser emission period.

[0091] Two different image sets are collected: a background set ISb without light spots and a foreground set ISf containing light spots. The light spot detection algorithm is used to detect light spots in both sets in turn. The detection results of ISb are removed from the detection results of ISf, thus eliminating the influence of false background detection. The last image set is the real light spot result.

[0092] The timing mentioned above requires certain conditions to be met; otherwise, it is easy to acquire incorrect image sets. Without loss of generality, assume that Ts is the image acquisition time interval.

[0093] Starting at time t0, the time at which the software begins collecting ISB data is: T start (ISb)=T4+T5+Δt,Δt=0~Ts

[0094] The time when the software finishes collecting ISb data is: T end (ISb)=T4+T5+Δt+(Nb-1)×Ts,Δt=0~Ts

[0095] Starting at time t0, the time at which the software begins collecting ISF data is: T start (ISf)=T4+T5+Δt+(Nb-1)×Ts+T3+Δt1,Δt,Δt1=0~Ts

[0096] The time when the software finishes collecting ISF data is: T end (ISf)=T4+T5+Δt+(Nb-1)×Ts+T3+Δt1+(Nf-1)×Ts,Δt,Δt1=0~Ts

[0097] Considering that T1 to T5 all have a certain degree of uncertainty, i.e., deviation, the above timing sequence needs to be designed according to the worst-case scenario, requiring: min(T1) > max(T5). end (ISb)) max(T1) <min(T start (ISf)) min(T1+T2)>max(T end (ISf))

[0098] The formula above describes the relationship between several time points. It should be noted that T1 through T5 are values ​​greater than or equal to 0.

[0099] S260. Determine the detection result of the laser spot based on the first image and the second image.

[0100] Based on the above technical solution, determining the detection result of the laser spot according to the first image and the second image includes: taking any one of the first image or the second image as the image to be processed; dividing the image to be processed into multiple sub-images according to preset segmentation parameters, and performing spot detection on each sub-image to obtain a sub-detection result for each sub-image, and determining the detection result to be processed corresponding to the image to be processed based on the multiple sub-detection results; and determining the detection result of the laser spot based on the detection result to be processed corresponding to each image to be processed.

[0101] Due to the small size of the laser spot, its detection becomes more difficult. To address this issue, image segmentation into sub-images can be used. For example, the image can be equally divided into four, nine, or other numbers of sub-images, which may or may not contain each other. By reducing the size of the detection image, the challenge posed by the small spot size can be effectively overcome.

[0102] Based on preset segmentation parameters, the image to be processed is segmented into multiple sub-images. These preset segmentation parameters can be image segmentation-related parameters, such as segmentation size and number of segments. Laser spot detection is performed on each sub-image to obtain a sub-detection result. The sub-detection results of multiple sub-images corresponding to the image to be processed are then used as the final detection result for the image to be processed. Here, the final detection result can be understood as the spot detection result for that image. To improve detection accuracy, the final detection results from multiple images to be processed can be combined to determine the detection result of the laser spot in the target scene.

[0103] It is understandable that after dividing the image to be processed into sub-images, if there is a laser spot in the sub-image, the size of the laser spot relative to the sub-image becomes larger, making it easier to detect the laser spot in the sub-image and effectively overcoming the difficulties caused by the small spot size.

[0104] In an optional implementation, if the size of the laser spot in the image to be processed is large, the image to be processed can be directly detected without segmentation to obtain the detection result.

[0105] The technical solution of this application embodiment, when the laser device is triggered and started, captures the trigger signal of the laser device and performs image acquisition response, determines the capture response duration corresponding to capturing the trigger signal and performing image acquisition response, and the image acquisition time interval; then, based on the image acquisition time interval and the first number of images to be acquired corresponding to the first image, determines the first acquisition duration, and determines the laser pause time interval based on the capture response duration and the first acquisition duration; furthermore, based on the image acquisition time interval and the second number of images to be acquired corresponding to the second image, determines the second acquisition duration, and determines the laser emission time interval based on the capture response duration, the second acquisition duration, and the laser pause time interval, so as to acquire the first image of the first number of images to be acquired during the laser pause time interval and acquire the second image of the second number of images to be acquired during the laser emission time interval; and determines the detection result of the laser spot based on the first image and the second image. This method solves the technical problem of difficult detection of laser spots in images. By controlling the laser emission time interval and the timing of image acquisition, and then processing the images acquired in different time intervals, accurate detection of laser spots in the target scene is achieved.

[0106] Example 3

[0107] Figure 4 is a flowchart of an image interaction method based on spot detection provided in Embodiment 3 of this application. This embodiment is applicable to situations where a laser device projects a region to be zoomed in on in a real scene, so as to display the image corresponding to the region to be zoomed in on in a close-up form. This method can be executed by an image interaction device based on spot detection. This device can be implemented in hardware and / or software, and can be configured in a camera or computer device. As shown in Figure 4, the method includes:

[0108] S310. When the laser device is triggered to start, the trigger signal of the laser device is captured and an image acquisition response is performed. The capture response duration corresponding to capturing the trigger signal and performing the image acquisition response, as well as the image acquisition time interval, are determined.

[0109] S320. Based on the capture response duration and the image acquisition time interval, determine the laser pause period and the laser emission period.

[0110] S330: Acquire a first image corresponding to the target scene captured by the camera during the laser pause period, and acquire a second image corresponding to the target scene captured by the camera during the laser emission period.

[0111] S340. Determine the detection result of the laser spot based on the first image and the second image.

[0112] S350. Based on the detection results, determine the target display area in the target scene corresponding to the laser spot.

[0113] The target display area can be the area where the laser spot is projected in the target scene, or it can be understood as the area that needs to be shown in close-up. For example, in a live streaming scenario, when a live streamer projects a laser spot onto a product they are promoting, the area corresponding to that product is the target display area corresponding to the laser spot.

[0114] For example, the specific location of the laser spot in the target scene or the second image can be determined based on the detection results of the laser spot. Then, the target display area in the target scene can be determined based on this specific location. By magnifying the image corresponding to the target display area and displaying the magnified image on the terminal display interface of the viewer, a close-up display of the target display area can be achieved, realizing the convenience of the close-up function.

[0115] Based on the above technical solution, the detection result includes the location information of the pseudo-spot or the location information of the spot to be processed. Determining the target display area in the target scene corresponding to the laser spot based on the detection result includes: determining the location information of the pseudo-spot in the detection result of the first image based on a first preset detection threshold; determining the location information of the spot to be processed in the detection result of the second image based on a second preset detection threshold; removing the location information of the spot to be processed corresponding to the pseudo-spot in the detection result of the second image based on the location information of the pseudo-spot to obtain the location information of the target spot; and determining the target display area in the target scene corresponding to the laser spot based on the location information of the target spot.

[0116] False spots can be understood as patterns in the first image that resemble laser spots, and spots to be processed can be understood as laser spots detected in the second image. The first preset detection threshold is less than the second preset detection threshold. The first preset detection threshold is used to filter and judge false spots in the first image, and the second preset detection threshold is used to filter and judge spots to be processed in the second image. The position information of the target spot can be understood as the position information of the actual laser spot generated when the laser device projects the laser onto the target scene.

[0117] It is understandable that the first image should not contain any laser spots, but there may be patterns in the first image that resemble laser spots, which may be falsely detected as laser spots. To avoid this situation, spot detection can be performed on the first image to obtain the corresponding detection results. The detection results can be the location information of the false spots and the confidence level corresponding to the false spots.

[0118] A first preset detection threshold can be set in advance, and this threshold can be a small value. If a spot is detected in the first image, and the confidence level of the spot is greater than the first preset detection threshold, the detected spot can be identified as a false spot. Since false spots can affect the accuracy of spot detection in the target scene, a smaller first preset detection threshold can be set to detect as many false spots as possible in the first image, thus avoiding any impact on the subsequent detection results of laser spots in the target scene and improving the accuracy of laser spot detection.

[0119] When performing spot detection on the second image, a second preset detection threshold can be set in advance. The detection result of the spot in the second image can include the location information and confidence level of the spot to be processed. If a spot is detected in the second image and the confidence level of the spot is greater than the second preset detection threshold, the detected spot can be used as the spot to be processed.

[0120] The second preset detection threshold is greater than the first preset detection threshold. The second preset detection threshold can be a large value, meaning that the confidence level of the true light spot detected in the second image is high enough to determine it as the light spot to be processed.

[0121] Since the light spot to be processed may include some false light spots, in order to remove the false light spots in the light spot to be processed to obtain the target light spot, in this embodiment of the application, the position information of the light spot to be processed corresponding to the position information of the false light spots in the detection result of the second image can be removed based on the position information of the false light spots to obtain the position information of the target light spot. Then, the image area corresponding to the position information of the target light spot is the target display area in the target scene.

[0122] Optionally, the number of the first image and / or the second image is at least two. The image interaction method based on spot detection further includes: clustering the detection results of at least two of the first images and determining the location information of the pseudo spot based on the clustering results; and / or, clustering the detection results of the at least two of the second images and determining the location information of the spot to be processed based on the clustering results.

[0123] To improve detection accuracy and avoid inaccurate detection results from a single image, multiple first and / or second images can be set. Spot detection can be performed on each image to obtain detection results. The detection results of multiple images can be clustered to obtain the location information of false spots or the location information of the spot to be processed.

[0124] In optional embodiments, the timing combination of spot emission and the timing combination of image acquisition and spot detection by the camera can be varied, as long as the camera can collect background images. The false detection problem can be solved by detecting similar patterns in the background after the camera acquires images when the spot is not emitting. Figure 5 shows the timing diagrams for three other spot detection methods provided in Embodiment 3 of this application.

[0125] The technical solution of this application embodiment, when the laser device is triggered to start, captures the trigger signal of the laser device and performs an image acquisition response, determines the capture response duration corresponding to capturing the trigger signal and performing the image acquisition response, and the image acquisition time interval; determines a first acquisition duration based on the image acquisition time interval and the first number of images to be acquired corresponding to the first image, and determines the laser pause time period based on the capture response duration and the first acquisition duration; determines a second acquisition duration based on the image acquisition time interval and the second number of images to be acquired corresponding to the second image, and determines a laser emission time period based on the capture response duration, the second acquisition duration, and the laser pause time period; acquires a first image of the first number of images to be acquired during the laser pause time period; acquires a second image of the second number of images to be acquired during the laser emission time period; determines the detection result of the laser spot based on the first image and the second image, and determines the target display area in the target scene corresponding to the laser spot based on the detection result. This method solves the technical problem of difficult detection of laser spots in images. By controlling the laser emission time period and the timing of image acquisition, and then processing the acquired images, it achieves accurate detection of laser spots in the target scene and displays the image of the target display area corresponding to the laser spot, improving the convenience of interaction.

[0126] Example 4

[0127] Figure 6 is a schematic diagram of a laser spot detection device provided in Embodiment 4 of this application. As shown in Figure 6, the device includes:

[0128] The capture and response module 410 is configured to capture the trigger signal of the laser device and perform image acquisition response when the laser device is triggered to start, and to determine the capture response duration corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval.

[0129] The time period determination module 420 is configured to determine the laser pause time period and the laser emission time period based on the capture response duration and the image acquisition time interval; wherein, the laser device projects a laser spot into the target scene during the laser emission time period;

[0130] The scene image acquisition module 430 is configured to acquire a first image corresponding to the target scene captured by the camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the camera during the laser emission period;

[0131] The detection module 440 is configured to determine the detection result of the laser spot based on the first image and the second image.

[0132] The technical solution of this application embodiment, upon detecting the start-up operation of the laser device, controls the camera to be in a ready-to-shoot state, and determines the start time of the ready-to-shoot state and the image acquisition time interval; based on the start time and the image acquisition time interval, determines the laser pause period and the laser emission period, and controls the laser device to project a laser spot onto the target scene during the laser emission period; during the laser pause period, the camera acquires a first image corresponding to the target scene, and during the laser emission period, the camera acquires a second image corresponding to the target scene; based on the first and second images, the detection result of the laser spot is determined. This method solves the technical problem of difficult detection of laser spots in images. By controlling the laser emission period and the timing of image acquisition, and then processing the acquired images, accurate detection of laser spots in the target scene is achieved.

[0133] Based on the above-described device, the capture and response module 410 includes:

[0134] The capture and response module submodule is configured to capture the trigger signal of the laser device through camera software when the laser device is triggered to start, and to prepare for image acquisition when the trigger signal is captured so as to be in a ready-to-acquire state.

[0135] Based on the above-mentioned device, the time period determination module 420 includes:

[0136] The laser pause time period determination submodule is configured to determine the first acquisition duration based on the image acquisition time interval and the first number of images to be acquired, and to determine the laser pause time period based on the capture response duration and the first acquisition duration;

[0137] The laser emission time period determination submodule is configured to determine the second acquisition duration based on the image acquisition time interval and the second number of images to be acquired, and to determine the laser emission time period based on the capture response duration, the second acquisition duration, and the laser pause time period.

[0138] Based on the above-mentioned device, the scene image acquisition module 430 includes:

[0139] The first image acquisition submodule is configured to acquire the first image of the first quantity to be acquired during the laser pause period;

[0140] The first image is an image of the target scene that does not contain laser spots.

[0141] Based on the above-mentioned device, the scene image acquisition module 430 includes:

[0142] The second image acquisition submodule is configured to acquire the second number of second images to be acquired during the laser emission time period;

[0143] The second image is an image of the target scene containing the laser spot.

[0144] Based on the above-described device, the detection module 440 includes: an image segmentation submodule, configured as follows:

[0145] For any one of the first image or the second image, the first image or the second image is taken as the image to be processed;

[0146] According to preset segmentation parameters, the image to be processed is segmented into multiple sub-images, and spot detection is performed on each sub-image to obtain the sub-detection result of each sub-image. Based on the multiple sub-detection results, the detection result to be processed corresponding to the image to be processed is determined.

[0147] Based on the detection results corresponding to each image to be processed, the detection result of the laser spot is determined.

[0148] Based on the above device, the laser spot is detected by a spot detection model, which is trained by a training module. The training module is configured as follows:

[0149] The sample images corresponding to various projection parameters and the detection results of the actual light spots in the sample images are obtained. The laser light spots in the sample images are then detected using an initial light spot detection model to obtain the detection results to be used.

[0150] Based on the detection results to be used and the detection results of the actual light spot, the model parameters of the initial light spot detection model are corrected to obtain the trained light spot detection model;

[0151] The various projection parameters include at least one of the following: the projection angle of the light spot, the angle between the projection surface of the light spot and the camera, the brightness of the light spot, the color temperature of the reflection of the light spot from the projection surface of the light spot, and the white balance of the camera.

[0152] The laser spot detection device provided in this application embodiment can execute the laser spot detection method provided in any embodiment of this application, and has the corresponding functional modules and effects of the execution method.

[0153] Example 5

[0154] Figure 7 is a schematic diagram of an image interaction device based on spot detection provided in Embodiment 5 of this application. As shown in Figure 7, the device includes:

[0155] The capture and response module 510 is configured to capture the trigger signal of the laser device and perform image acquisition response when the laser device is triggered to start, and to determine the capture response duration corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval.

[0156] The time period determination module 520 is configured to determine the laser pause time period and the laser emission time period based on the capture response duration and the image acquisition time interval; wherein, the laser device projects a laser spot into the target scene during the laser emission time period;

[0157] The scene image acquisition module 530 is configured to acquire a first image corresponding to the target scene captured by the camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the camera during the laser emission period;

[0158] The detection module 540 is configured to determine the detection result of the laser spot based on the first image and the second image;

[0159] The display module 550 is configured to determine the target display area in the target scene corresponding to the laser spot based on the detection results.

[0160] Based on the above-mentioned device, the detection result includes the location information of the pseudo-spot or the location information of the pseudo-spot, and the detection module 540 is configured as follows:

[0161] Based on a first preset detection threshold, the location information of the false spots in the detection result of the first image is determined;

[0162] Based on the second preset detection threshold, the position information of the spot to be processed in the detection result of the second image is determined;

[0163] Based on the position information of the pseudo spot, the position information of the spot to be processed corresponding to the position information of the pseudo spot in the detection result of the second image is removed to obtain the position information of the target spot;

[0164] Wherein, the first preset detection threshold is less than the second preset detection threshold.

[0165] The display module 550 is configured to: determine the target display area in the target scene corresponding to the laser spot based on the position information of the target spot.

[0166] Based on the above-described device, the number of the first image and / or the second image is at least two;

[0167] The device is further configured to:

[0168] Cluster the detection results of at least two of the first images, and determine the location information of the false spot based on the clustering results; and / or,

[0169] The detection results of the at least two second images are clustered, and the location information of the spot to be processed is determined based on the clustering results.

[0170] The image interaction device based on spot detection provided in this application can execute the image interaction method based on spot detection provided in any embodiment of this application, and has the corresponding functional modules and effects of executing the method.

[0171] Example 6

[0172] Figure 8 is a schematic diagram of the electronic device provided in Embodiment Six of this application. The electronic device can be any form of digital computer, such as a laptop computer, desktop computer, workbench, personal digital assistant, server, blade server, mainframe computer, and other suitable computers. The electronic device can also be any form of mobile device, such as a personal digital processor, cellular phone, smartphone, wearable device (e.g., helmet, glasses, watch, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or claimed herein.

[0173] As shown in Figure 8, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 can also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0174] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0175] Processor 11 can be any general-purpose and / or special-purpose processing component with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any suitable processor, controller, microcontroller, etc. Processor 11 performs several methods and processes described above, such as laser spot detection methods or image interaction methods based on spot detection.

[0176] In some embodiments, the laser spot detection method or the image interaction method based on spot detection can be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the laser spot detection method or the image interaction method based on spot detection described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to perform the laser spot detection method or the image interaction method based on spot detection by any other suitable means (e.g., by means of firmware).

[0177] The various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These implementations may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0178] Computer programs used to implement the methods of this application may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0179] In the context of this application, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A machine-readable storage medium may include an electrical connection based on one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) or flash memory, optical fiber, compact disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0180] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a cathode ray tube (CRT) or liquid crystal display (LCD) monitor) configured to display information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be configured to provide interaction with a user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0181] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0182] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. The client-server relationship is established by running computer programs on the respective computers. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system. It addresses the shortcomings of traditional physical hosts and Virtual Private Server (VPS) services, such as high management difficulty and weak business scalability.

[0183] It should be understood that the various processes shown above can be used to rearrange, add, or delete steps. For example, the multiple steps described in this application can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this application can be achieved, and this is not limited herein.

Claims

1. A method for detecting laser spot, comprising: In response to the laser device being triggered to start, the trigger signal of the laser device is captured and an image acquisition response is performed. The capture response duration corresponding to capturing the trigger signal and performing the image acquisition response, as well as the image acquisition time interval, are determined. Based on the capture response time and the image acquisition time interval, a laser pause period and a laser emission period are determined; wherein, the laser device projects a laser spot onto the target scene during the laser emission period; During the laser pause period, a first image corresponding to the target scene is captured by the camera, and during the laser emission period, a second image corresponding to the target scene is captured by the camera. The detection result of the laser spot is determined based on the first image and the second image.

2. The method according to claim 1, wherein, The response to the laser device triggering startup, capturing the trigger signal of the laser device and performing image acquisition response, includes: In response to the laser device being triggered to start, the camera software captures the trigger signal of the laser device, and upon capturing the trigger signal, prepares for image acquisition to be in a ready-to-acquire state.

3. The method according to claim 1, wherein, The process of determining the laser pause time period and the laser emission time period based on the capture response duration and the image acquisition time interval includes: Based on the image acquisition time interval and the first number of images to be acquired, a first acquisition duration is determined, and the laser pause time period is determined based on the capture response duration and the first acquisition duration. The second acquisition duration is determined based on the image acquisition time interval and the second number of images to be acquired corresponding to the second image, and the laser emission time period is determined based on the capture response duration, the second acquisition duration, and the laser pause time period.

4. The method according to claim 3, wherein, The acquisition of a first image corresponding to the target scene by the camera during the laser pause period includes: During the laser pause period, the first image of the first number to be acquired is collected; The first image is an image of the target scene that does not contain laser spots.

5. The method according to claim 3, wherein, The step of acquiring a second image corresponding to the target scene captured by the camera during the laser emission period includes: During the laser emission time period, the second number of second images to be acquired are collected; The second image is an image of the target scene containing the laser spot.

6. The method according to claim 1, wherein, The step of determining the detection result of the laser spot based on the first image and the second image includes: For any one of the first image or the second image, the first image or the second image is taken as the image to be processed; According to preset segmentation parameters, the image to be processed is segmented into multiple sub-images, and spot detection is performed on each sub-image to obtain the sub-detection result of each sub-image. Based on the multiple sub-detection results, the detection result to be processed corresponding to the image to be processed is determined. Based on the detection results corresponding to each image to be processed, the detection result of the laser spot is determined.

7. The method according to claim 1, wherein, The laser spot is detected by a spot detection model, which is trained in the following way: The sample images corresponding to various projection parameters and the detection results of the actual light spots in the sample images are obtained. The laser light spots in the sample images are then detected using an initial light spot detection model to obtain the detection results to be used. Based on the detection results to be used and the detection results of the actual light spot, the model parameters of the initial light spot detection model are corrected to obtain the trained light spot detection model; The various projection parameters include at least one of the following: the projection angle of the light spot, the angle between the projection surface of the light spot and the camera, the brightness of the light spot, the color temperature of the reflection of the light spot from the projection surface of the light spot, and the white balance of the camera.

8. An image interaction method based on spot detection, comprising: The detection result of the laser spot is obtained by using the laser spot detection method as described in any one of claims 1-7; Based on the detection results, the target display area corresponding to the laser spot in the target scene is determined.

9. The method according to claim 8, wherein, The detection results include the location information of the false spot or the location information of the spot to be processed; Determining the target display area in the target scene corresponding to the laser spot based on the detection result includes: Based on a first preset detection threshold, the location information of the false spots in the detection result of the first image is determined; Based on the second preset detection threshold, the position information of the spot to be processed in the detection result of the second image is determined; Based on the position information of the pseudo spot, the position information of the spot to be processed corresponding to the position information of the pseudo spot in the detection result of the second image is removed to obtain the position information of the target spot; Based on the position information of the target light spot, determine the target display area in the target scene corresponding to the laser light spot; Wherein, the first preset detection threshold is less than the second preset detection threshold.

10. The method according to claim 9, wherein, The number of at least one of the first image and the second image is at least two; the method also includes at least one of the following two cases: When the number of the first images is at least two, the detection results of the at least two first images are clustered, and the location information of the false spot is determined based on the clustering results. or, When there are at least two second images, the detection results of at least two second images are clustered, and the location information of the spot to be processed is determined based on the clustering results.

11. A laser spot detection device, comprising: The capture and response module is configured to respond to the laser device's trigger start, capture the trigger signal of the laser device and perform image acquisition response, and determine the capture response duration corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval; The time period determination module is configured to determine the laser pause time period and the laser emission time period based on the capture response duration and the image acquisition time interval; wherein, the laser device projects a laser spot into the target scene during the laser emission time period; The scene image acquisition module is configured to acquire a first image corresponding to the target scene captured by the camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the camera during the laser emission period; The detection module is configured to determine the detection result of the laser spot based on the first image and the second image.

12. An image interaction device based on spot detection, comprising: The capture and response module is configured to respond to the laser device's trigger start, capture the trigger signal of the laser device and perform image acquisition response, and determine the capture response duration corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval; The time period determination module is configured to determine the laser pause time period and the laser emission time period based on the capture response duration and the image acquisition time interval; wherein, the laser device projects a laser spot into the target scene during the laser emission time period; The scene image acquisition module is configured to acquire a first image corresponding to the target scene captured by the camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the camera during the laser emission period; The detection module is configured to determine the detection result of the laser spot based on the first image and the second image; The display module is configured to determine the target display area in the target scene corresponding to the laser spot based on the detection results.

13. An electronic device, comprising: At least one processor; as well as, A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the laser spot detection method according to any one of claims 1-7.

14. An electronic device, comprising: At least one processor; as well as, A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, which is executed by the at least one processor to enable the at least one processor to perform the image interaction method based on spot detection as described in any one of claims 8-10.

15. A computer-readable storage medium storing computer instructions for causing a processor to execute the laser spot detection method according to any one of claims 1-7.

16. A computer-readable storage medium storing computer instructions for causing a processor to execute and implement the image interaction method based on spot detection as described in any one of claims 8-10.

Images