Laser spot detection and image interaction method, device, equipment and medium

Abstract

The present invention discloses a method, apparatus, device, and medium for detecting and interacting with laser spots. The method includes: when a laser device is triggered and started, capturing the trigger signal of the laser device and performing an image acquisition response, determining the capture response duration and image acquisition time interval corresponding to capturing the trigger signal and performing the image acquisition response; determining the laser pause time period and the laser emission time period based on the capture response duration and the image acquisition time interval; wherein, the laser device projects a laser spot into a target scene during the laser emission time period; capturing a first image corresponding to the target scene during the laser pause time period, and capturing a second image during the laser emission time period; determining the detection result of the laser spot based on the first and second images. Furthermore, determining the target display area in the target scene corresponding to the laser spot based on the detection result. Accurate detection of the laser spot in the target scene and close-up display of the target display area are achieved.

Description

Technical Field

[0001] The present invention relates to the field of multimedia interaction technology, and in particular to a laser spot detection and image interaction method, device, equipment and medium. Background Art

[0002] In a video shooting scenario, the operation method for real-time framing / close-up of the picture is generally based on interaction with the application, such as clicking or drawing a close-up area on the software screen.

[0003] To make operation more convenient and save manpower on operating software, it would be beneficial if a remote control could be used to project a laser spot onto a real scene, select a specific area to be highlighted, and then display the corresponding image. This would be very useful for typical application scenarios such as online classes, remote meetings, and object display.

[0004] The above process involves detecting laser spots in general video images. Currently, laser spot detection faces many challenges. For example, the spots are often small and dim, making them difficult to detect using visual methods. The general environment is often very complex, and patterns that are very similar to the target spot can easily appear, resulting in a high incidence of false detections.

[0005] Therefore, how to effectively detect the laser spot in the image corresponding to the real scene is a technical problem that needs to be solved urgently. Summary of the Invention

[0006] The present invention provides a laser spot detection and image interaction method, device, equipment and medium to achieve accurate detection of the laser spot projected in a target scene.

[0007] According to one aspect of the present invention, a method for detecting a laser spot is provided, comprising:

[0008] When the laser device is triggered and started, capturing the trigger signal of the laser device and performing an image acquisition response, determining a capture response duration corresponding to capturing the trigger signal and performing the image acquisition response, and an image acquisition time interval;

[0009] Determining a laser pause period and a laser emission period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission period;

[0010] Acquire a first image corresponding to the target scene captured by a shooting camera during the laser pause period, and acquire a second image corresponding to the target scene captured by the shooting camera during the laser emission period;

[0011] A detection result of the laser spot is determined according to the first image and the second image.

[0012] According to another aspect of the present invention, there is provided an image interaction method based on light spot detection, the image interaction method based on light spot detection comprising:

[0013] A laser spot detection method according to any embodiment of the present invention is used to obtain a detection result of the laser spot;

[0014] A target display area corresponding to the laser spot in the target scene is determined based on the detection result.

[0015] According to another aspect of the present invention, there is provided a laser spot detection device, comprising:

[0016] A capture and response module is used to capture the trigger signal of the laser device and perform image acquisition response when the laser device is triggered and started, and determine the capture response time corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval;

[0017] a time period determination module, configured to determine a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission time period;

[0018] a scene image acquisition module, configured to acquire a first image corresponding to the target scene captured by a shooting camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the shooting camera during the laser emission period;

[0019] A detection module is used to determine a detection result of the laser spot according to the first image and the second image.

[0020] According to another aspect of the present invention, there is provided an image interaction device based on light spot detection, comprising:

[0021] A capture and response module is used to capture the trigger signal of the laser device and perform image acquisition response when the laser device is triggered and started, and determine the capture response time corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval;

[0022] a time period determination module, configured to determine a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission time period;

[0023] a scene image acquisition module, configured to acquire a first image corresponding to the target scene captured by a shooting camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the shooting camera during the laser emission period;

[0024] a detection module, configured to determine a detection result of the laser spot according to the first image and the second image;

[0025] A display module is used to determine a target display area corresponding to the laser spot in the target scene based on the detection result.

[0026] According to another aspect of the present invention, an electronic device is provided, comprising:

[0027] at least one processor; and,

[0028] a memory communicatively connected to the at least one processor; wherein,

[0029] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the laser spot detection method or the image interaction method based on spot detection described in any embodiment of the present invention.

[0030] According to another aspect of the present invention, a computer-readable storage medium is provided, which stores computer instructions, and the computer instructions are used to enable a processor to implement the laser spot detection method or the image interaction method based on spot detection according to any embodiment of the present invention when executed.

[0031] The technical solution of an embodiment of the present invention is to capture the trigger signal of the laser device and perform an image acquisition response when the laser device is triggered and started, determine the capture response duration corresponding to capturing the trigger signal and performing the image acquisition response, and the image acquisition time interval; based on the capture response duration and the image acquisition time interval, determine the laser pause period and the laser emission period; wherein, the laser device projects a laser spot into the target scene during the laser emission period; captures a first image corresponding to the target scene captured by the shooting camera during the laser pause period, and captures a second image corresponding to the target scene captured by the shooting camera during the laser emission period; determines the detection result of the laser spot based on the first and second images, and determines the target display area corresponding to the laser spot in the target scene based on the detection result. This solves the technical problem of difficult detection of laser spots in images. By controlling the laser emission period and the shooting period of the shooting camera and then processing the captured images, accurate detection of the laser spot in the target scene is achieved.

[0032] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0034] Figure 1 A flow chart of a laser spot detection method provided in Example 1 of the present invention;

[0035] Figure 2 A flow chart of a laser spot detection method provided in the second embodiment of the present invention;

[0036] Figure 3 A timing diagram of light spot detection provided in the second embodiment of the present invention;

[0037] Figure 4 This is a flowchart of an image interaction method based on spot detection provided in Example 3 of the present invention;

[0038] Figure 5 Timing diagrams of three other light spot detection methods provided in the third embodiment of the present invention;

[0039] Figure 6 A schematic structural diagram of a laser spot detection device provided in a fourth embodiment of the present invention;

[0040] Figure 7 A schematic structural diagram of an image interaction device based on light spot detection provided in a fifth embodiment of the present invention;

[0041] Figure 8 This is a structural diagram of an electronic device provided in Example 6 of the present invention. DETAILED DESCRIPTION

[0042] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0043] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0044] In order to further clarify the technical solution of the present invention, some application scenarios of the present invention are described before introducing specific embodiments. The technical solution of the present invention can be applied to scenarios such as online classes, remote conferences, and object displays. In the above scenarios, the corresponding picture of the real scene is captured in real time by a shooting camera, and then the captured picture is sent to the terminal device of the audience user through a communication connection, so as to display the picture of the real scene through the terminal device of the audience user. When it is necessary to take a close-up of the target area or target object of the real scene, for example, in the object display scene, it is necessary to take a close-up of the object so that the audience user can see the shape, color details, etc. of the object more clearly, the user who demonstrates and explains in the real scene can hold a laser device and project a laser spot to the object based on the laser device. The shooting camera can accurately identify the laser spot and determine the picture of the object projected by the laser spot, amplify the picture of the object, and further display the amplified object picture on the terminal device of the audience user to achieve a close-up display of the object.

[0045] Example 1

[0046] Figure 1 This is a flowchart of a laser spot detection method provided in Example 1 of the present invention. This embodiment is applicable to situations where accurate detection of laser spots emitted by laser equipment is required. The method can be performed by a laser spot detection device, which can be implemented in the form of hardware and / or software and can be configured in a shooting camera or computer device.

[0047] like Figure 1 As shown, the method includes:

[0048] S110 , when the laser device is triggered and started, capturing the trigger signal of the laser device and performing an image acquisition response, determining a capture response duration corresponding to capturing the trigger signal and performing the image acquisition response, and an image acquisition time interval.

[0049] Among them, the laser device can be an electronic device that can emit laser and project it onto the surface of an object, for example, the laser device is a laser pen or a remote control that can emit laser; the laser device can be started based on a trigger signal, and the trigger signal can be generated through an interactive operation with the laser device, for example, the interactive operation is the operation of the user pressing the emission button of the laser device.

[0050] When the laser device is triggered, the apparatus of the embodiment of the present invention can capture the trigger signal of the laser device and, after capturing the trigger signal, perform an image acquisition response. The capture response duration can be understood as the time elapsed between capturing the trigger signal and performing the image acquisition response.

[0051] After the image acquisition response, the image frames captured by the shooting camera can be collected. The shooting camera can be an AI video camera that can capture images of real scenes.

[0052] It is understandable that the shooting camera can continuously capture multiple continuous image frames in the real scene. In an embodiment of the present invention, the multiple continuous image frames can be captured according to the image capture time interval, that is, some image frames are captured. For example, if the image capture time interval is 2 milliseconds, the image frames captured by the shooting camera are captured once every 2 milliseconds. Specifically, when the user needs to take a close-up image of a certain area in the real scene, the user can press the laser emission button of the laser device. This interactive operation can generate a trigger signal and trigger the laser device to start. At the same time, the trigger signal can be captured and an image capture response can be performed, and the capture response duration and the image capture time interval can be determined.

[0053] In an embodiment of the present invention, when the laser device is triggered and started, capturing the trigger signal of the laser device and performing image acquisition response includes: when the laser device is triggered and started, capturing the trigger signal of the laser device through camera software, and preparing for image acquisition to be in a ready-to-acquire state when the trigger signal is captured.

[0054] In an optional application scenario, when the laser device is used as a remote control for an AI video camera, the remote control not only controls the AI ​​video camera but also has a laser emission function. Communication can be established between the remote control and the AI ​​video camera. Therefore, when the remote control detects the triggering of the laser emission function, the camera software can capture the trigger signal of the laser device via the communication channel. After capturing the trigger signal, the camera software responds with image acquisition, or in other words, prepares for image acquisition, putting the camera software in a state ready for acquisition.

[0055] The pending capture state can be the state where the camera software is ready to capture image frames captured by the camera. At the same time, the duration from the time the remote control's laser launch button is pressed to the time the camera software captures the trigger signal, and the duration from the time the trigger signal is captured to the time the camera software begins capturing images captured by the camera, are determined. The sum of these two durations is used as the capture response duration.

[0056] In another alternative application scenario, the laser device is not a remote control for a camera. For example, the laser device is a laser pointer with communication capabilities. The laser pointer can communicate with third-party software, and the third-party software can also communicate with the camera software. When the third-party software detects a trigger signal from the laser pointer, the third-party software can convert the trigger signal into a signal recognizable by the camera software and send it to the camera software, so that the camera software can respond with image acquisition.

[0057] In the technical solution of the present invention, the trigger signal of the laser device is captured by different methods, and image acquisition response is performed accordingly, thereby achieving effective capture of the trigger signal and improving compatibility with laser device types.

[0058] S120 : Determine a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval.

[0059] Among them, the laser pause time period can be understood as the time period when the laser beam of the laser device is in a paused emission state, and the laser emission time period refers to the time period when the laser beam of the laser device is in an emission state. The laser device projects a laser spot into the target scene during the laser emission time period, and the target scene can be a real scene.

[0060] Specifically, based on the capture response duration and the image acquisition time interval, the laser pause time period and the laser emission time period can be calculated. During the laser pause time period, the laser device is controlled not to project the laser spot, and during the laser emission time period, the laser device is controlled to project the laser spot into the target scene.

[0061] It should be noted that the laser power of laser equipment is limited by safety regulations and is usually a relatively small value. When the projection distance is long, the light spot will be dimmer. At this time, the image captured by the camera will be dimmer than in the real scene, making the light spot very difficult to detect. Therefore, the design of the light spot pattern is very critical. To ensure that the light spot pattern achieves a good trade-off between size and brightness at a fixed transmission power, that is, a double advantage, a circular light spot can be selected. The laser energy is distributed in a circular pattern. This is brighter in projection brightness than other patterns, such as dot patterns, and the larger size makes it relatively more detectable.

[0062] S130 , capturing a first image corresponding to the target scene captured by a camera during the laser pause period, and capturing a second image corresponding to the target scene captured by the camera during the laser emission period.

[0063] The first image may be an image of the target scene captured by the camera software during the laser pause period, and the second image may be an image of the target scene captured by the camera software during the laser emission period. For example, when the target scene is a live streaming video, the first image may be an image corresponding to the entire live streaming room, such as an image including the live streaming room background, the host's image, and the product image.

[0064] S140: Determine a detection result of the laser spot based on the first image and the second image. The detection result may be understood as a detection result of the laser spot projected in the target scene, including but not limited to information such as the shape, brightness, and position of the laser spot.

[0065] It can be understood that since the first image is captured by the camera during the laser pause period, and the second image is captured by the camera during the laser emission period, the first image should not include the laser spot, while the second image should include the laser spot. Therefore, based on the first image (excluding the laser spot) and the second image (including the laser spot), the laser spot detection result, for example, the specific location of the laser spot in the second image, can be determined.

[0066] In an embodiment of the present invention, the laser spot is detected by a spot detection model. The image interaction method based on spot detection provided by the embodiment of the present invention further includes: training the initial spot detection model to obtain a trained spot detection model. The spot detection model is trained in the following manner:

[0067] Obtaining sample images corresponding to different projection parameters and actual spot detection results of the sample images, and performing laser spot detection on the sample images using an initial spot detection model to obtain detection results to be used;

[0068] Based on the to-be-used detection result and the actual light spot detection result, the model parameters of the initial light spot detection model are modified to obtain a trained light spot detection model.

[0069] The projection parameters include at least one of the light spot projection angle, the angle between the light spot projection surface and the shooting camera, the light spot brightness, the reflection color temperature of the light spot on the light spot projection surface, and the shooting camera white balance.

[0070] In an embodiment of the present invention, the difficulty in spot detection is mainly due to insufficient brightness in the picture and a skewed angle of the spot projection. Therefore, some sample images can be generated in advance, and the projection parameters corresponding to each sample image can be different. The actual spot detection result can be a manual or automatic detection result of the spot detection in the sample image.

[0071] After generating the sample image, the sample image and the corresponding actual spot detection result can be used as a training sample set to iterate the training of the initial spot detection model, and the detection parameters of the initial spot detection model can be corrected to obtain a trained spot detection model. After the training of the initial spot detection model is completed, a trained spot detection model is obtained. The spot detection model can accurately identify laser spots in images with various projection parameters and obtain corresponding accurate laser spot detection results, thereby improving the generalization ability of laser spot detection and ensuring that the accuracy is not limited by the projection parameters. The following further explains the generation of the sample image:

[0072] To address the problem of skewed light spot projection, if the light spot is projected from one side, it will appear as an elliptical spot on the screen, not a circular one. Therefore, during the sample image generation stage, a circular light spot is projected at random angles. This not only randomly changes the incident angle of the light, but also the angle of the projection surface of the light spot. This maximizes the simulation of various possible situations in the real environment and generates a light spot pattern that can cope with various scenarios.

[0073] To address insufficient brightness, a light spot can be randomly attenuated and projected onto a variety of images or videos to maximize the simulation of how such low-brightness light spots would appear in real environments. Furthermore, to simulate the color temperature of light spots reflected by different materials and the white balance differences within the image itself, random white balance adjustments are made during sample image generation to further enhance the generalization capabilities of the light spot detection model.

[0074] By using the above measures to augment the sample images of the initial spot detection model, the accuracy of the trained spot detection model in detecting laser spots can be greatly improved. This ensures that the spot detection model can detect laser spots well in real scenes. The spot detection model provided by the embodiment of the present invention has a very high recall rate.

[0075] The technical solution of the embodiment of the present invention is to capture the trigger signal of the laser device and perform an image acquisition response when the laser device is triggered and started, determine the capture response duration corresponding to capturing the trigger signal and performing the image acquisition response, and the image acquisition time interval; based on the capture response duration and the image acquisition time interval, determine the laser pause time period and the laser emission time period; wherein, the laser device projects a laser spot into the target scene during the laser emission time period; captures a first image corresponding to the target scene captured by the shooting camera during the laser pause time period, and captures a second image corresponding to the target scene captured by the shooting camera during the laser emission time period; and determines the laser spot detection result based on the first and second images. This solves the technical problem of the difficulty in detecting laser spots in images. By controlling the laser emission time period and the timing of image acquisition, and then processing the images captured in different time periods, accurate detection of laser spots in the target scene is achieved.

[0076] Example 2

[0077] Figure 2 This is a flow chart of a laser spot detection method provided in Example 2 of the present invention. Based on the above embodiment, this embodiment further optimizes the laser spot detection process. Its specific implementation method can refer to the technical solution of this embodiment. Among them, the technical terms that are the same or corresponding to the above embodiment are not repeated here. Figure 2 As shown, the method includes:

[0078] S210: When the laser device is triggered and started, the trigger signal of the laser device is captured and an image acquisition response is performed, and a capture response duration corresponding to capturing the trigger signal and performing the image acquisition response and an image acquisition time interval are determined.

[0079] S220: Determine a first acquisition duration according to the image acquisition time interval and a first number to be acquired corresponding to the first image, and determine the laser pause time period based on the capture response duration and the first acquisition duration.

[0080] The first number to be collected refers to the number of frames of the first image that needs to be collected, and the first collection time refers to the collection time required by the camera software to collect the first number of first images to be collected.

[0081] Specifically, the product of the image acquisition time interval and the first number to be acquired can be used as the first acquisition duration, and then the laser pause time period is calculated based on the capture response duration and the first acquisition duration.

[0082] S230: Determine a second acquisition duration according to the image acquisition time interval and a second number to be acquired corresponding to the second image, and determine a laser emission time period based on the capture response time period, the second acquisition time period, and the laser pause time period.

[0083] Among them, the second number to be collected refers to the number of frames of the second image that needs to be collected, and the second collection time refers to the collection time required by the camera software to collect the second number of second images to be collected; the first number to be collected and the second number to be collected can be the same.

[0084] Specifically, the product of the image acquisition time interval and the second number to be acquired can be used as the second acquisition duration, and then the laser emission time period is calculated based on the capture response duration, the second acquisition duration and the laser pause time period.

[0085] S240: Acquire the first number of first images to be acquired during the laser pause period.

[0086] The first image is an image of the target scene that does not contain the laser spot.

[0087] S250 , collecting the second number of second images to be collected during the laser emission time period.

[0088] The second image is an image of a target scene including a laser spot.

[0089] It should also be noted that in real environments, the probability of circular or elliptical spots appearing is very high, and it is difficult to completely distinguish the two in principle, so the entire detection process must be optimized. This problem can be solved by adjusting the laser emission timing and the spot detection timing. Figure 3 A timing diagram of a light spot detection provided by the second embodiment of the present invention, combined with Figure 3 The above steps S210-S250 are described in detail.

[0090] In the embodiment of the present invention, laser emission and light spot detection are coordinated in time sequence to detect the detection results when the light spot is extinguished and the detection results when the light spot is emitted. By comparing the two, false detections in the background are eliminated, thereby obtaining correct and effective real light spot detection results.

[0091] First, when the user presses the laser button on the remote control, this moment is recorded as t0. Assume that after time T4, this event is captured by the camera program (whether captured directly by the camera software or indirectly sent to the camera for capture via third-party software). After capturing this event, the camera application waits for T5 and then begins capturing image frames. After capturing Nb consecutive frames (this frame set is considered the background frame set ISb without light spots), it stops capturing for T3 and then continues capturing Nf frames (this frame set is considered the foreground frame set ISf with light spots). At this point, the program completes frame capture. T4 plus T5 is the capture response duration, Nb is the first number to be captured, and the background frame set ISb can be understood as a set of multiple first images; Nf is the first number to be captured, and the foreground frame set ISf can be understood as a set of multiple second images.

[0092] Correspondingly, at time t0, the remote controller turns off the laser emission during the first T1 period, then turns on the laser emission during the next T2 period, and then turns off the laser. Among them, T1 can be understood as the laser pause period, and T2 can be understood as the laser emission period.

[0093] By collecting two different image sets, namely the background set ISb without light spots and the foreground set ISf containing light spots, the light spot detection algorithm performs light spot detection on both sets in turn. The detection results of ISb are removed from the detection results of ISf, thus eliminating the influence of background false detection. The final result is the true light spot result.

[0094] In particular, the above time coordination needs to meet certain conditions, otherwise it is easy to collect the wrong image set. Without loss of generality, assume that Ts is the interval of image collection.

[0095] Taking t0 as the starting time point, the time when the software starts collecting ISb is:

[0096] T start (ISb)=T4+T5+Δt, Δt=0~T s

[0097] T end (ISb)=T4+T5+Δt+(N b -1)×T s ,Δt=0~T s

[0098] Taking t0 as the starting time point, the time when the software starts collecting ISf is:

[0099] T start (ISf)=T4+T5+Δt+(N b -1)×T s+T3+Δt1,Δt,Δt1=0~T s

[0100] T end (ISf)=T4+T5+Δt+(N b -1)×T+T3+Δt1+(N f -1)×T s ,Δt,Δt1=0~T s

[0101] Considering that T1 to T5 all have certain uncertainties, that is, deviations, the above timing needs to be designed based on the worst-case scenario, requiring:

[0102] min(T1)>max(T end (ISb))

[0103] max(T1) <min(T start (ISf))

[0104] min(T1+T2)>max(T end (ISf))

[0105] The above formula describes the relationship between several time points. It should be noted that T1 to T5 are values ​​greater than or equal to 0.

[0106] S260: Determine a detection result of the laser spot according to the first image and the second image.

[0107] On the basis of the above technical solution, the detection result of the laser spot is determined according to the first image and the second image, including: for any one of the first image or the second image, the first image or the second image is used as the image to be processed; according to preset segmentation parameters, the image to be processed is divided into multiple sub-images, and spot detection is performed on each of the sub-images to obtain a sub-detection result of each sub-image, and the detection result to be processed corresponding to the image to be processed is determined based on the multiple sub-detection results; based on the detection result to be processed corresponding to each of the images to be processed, the detection result of the laser spot is determined.

[0108] The small size of the laser spot makes detection more difficult. To better detect the laser spot, the image can be segmented into sub-images to address this problem. For example, the image can be equally divided into four, nine, or any other number of sub-images. These sub-images may or may not contain each other. By reducing the detection image, the challenges posed by the small spot size can be effectively overcome.

[0109] Specifically, the image to be processed is segmented into multiple sub-images based on preset segmentation parameters. The preset segmentation parameters can be parameters related to image segmentation, such as segment size and number of segments. Laser spot detection is performed on each sub-image to obtain a sub-detection result for each sub-image. The sub-detection results of the multiple sub-images corresponding to the image to be processed are then used as the processed detection results for the image to be processed. The processed detection results can be understood as the spot detection results for the image to be processed. To improve detection accuracy, the processed detection results corresponding to each image to be processed can be combined to determine the laser spot detection results in the target scene.

[0110] It can be understood that after the image to be processed is divided into sub-images, if there is a laser spot in the sub-image, the size of the laser spot becomes larger relative to the sub-image, so it is easier to detect the laser spot in the sub-image, effectively overcoming the difficulties caused by the small spot size.

[0111] In an optional embodiment, if the size of the laser spot in the image to be processed is relatively large, the image to be processed may not be segmented, and laser spot detection may be performed directly on the image to be processed to obtain a detection result.

[0112] The technical solution of an embodiment of the present invention is to capture the trigger signal of the laser device and perform an image acquisition response when the laser device is triggered and activated, determine the capture response duration corresponding to the capture of the trigger signal and the image acquisition response, and the image acquisition time interval; then, determine the first acquisition duration based on the image acquisition time interval and the first number of images to be acquired corresponding to the first image, and determine the laser pause period based on the capture response duration and the first acquisition duration; further, determine the second acquisition duration based on the image acquisition time interval and the second number of images to be acquired corresponding to the second image, and determine the laser emission time period based on the capture response duration, the second acquisition duration, and the laser pause period, so as to acquire the first number of first images to be acquired during the laser pause period and the second number of second images to be acquired during the laser emission period; finally, determine the laser spot detection result based on the first and second images. This solves the technical problem of difficult laser spot detection in images by controlling the laser emission time period and the image acquisition timing, and then processing the images acquired in different time periods, thereby achieving accurate detection of laser spots in the target scene.

[0113] Example 3

[0114] Figure 4This is a flowchart of an image interaction method based on spot detection provided in the third embodiment of the present invention. This embodiment is applicable to the case where a laser device is used to project a close-up area in a real scene, so as to display the image corresponding to the close-up area in a close-up form. This method can be executed by an image interaction device based on spot detection, which can be implemented in the form of hardware and / or software and can be configured in a camera or computer device. Figure 4 As shown, the method includes:

[0115] S310: When the laser device is triggered and started, the trigger signal of the laser device is captured and an image acquisition response is performed, and a capture response duration and an image acquisition time interval corresponding to the capture of the trigger signal and the image acquisition response are determined.

[0116] S320 : Determine a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval.

[0117] S330 , collecting a first image corresponding to the target scene captured by a camera during the laser pause period, and collecting a second image corresponding to the target scene captured by the camera during the laser emission period.

[0118] S340: Determine a detection result of the laser spot according to the first image and the second image.

[0119] S350: Determine a target display area corresponding to the laser spot in the target scene based on the detection result.

[0120] The target display area can be the area in the target scene where the laser spot is projected, or it can be understood as the area that needs to be close-up. For example, in a live broadcast scene, the anchor projects a laser spot on the product being sold. The area corresponding to the product being sold is the target display area corresponding to the laser spot.

[0121] Specifically, the laser spot's specific location within the target scene or second image can be determined based on the laser spot detection results. The target display area within the target scene can then be determined based on this specific location. The image corresponding to the target display area is then magnified and displayed on the viewer's terminal display interface, providing a close-up of the target display area and realizing the convenience of the close-up function.

[0122] On the basis of the above technical solution, the detection result includes pseudo spot position information or to-be-processed spot position information, and determining the target display area corresponding to the laser spot in the target scene based on the detection result includes: determining the pseudo spot position information in the detection result of the first image based on a first preset detection threshold; determining the to-be-processed spot position information in the detection result of the second image based on a second preset detection threshold; based on the pseudo spot position information, removing the to-be-processed spot position information corresponding to the pseudo spot position information in the detection result of the second image to obtain the target spot position information; based on the target spot position information, determining the target display area corresponding to the laser spot in the target scene.

[0123] Among them, pseudo light spots can be understood as some patterns similar to laser light spots in the first image, and the spots to be processed can be understood as some laser light spots detected in the second image; the first preset detection threshold is less than the second preset detection threshold, the first preset detection threshold is used to screen and judge the pseudo light spots in the first image, and the second preset detection threshold is used to screen and judge the spots to be processed in the second image; the target light spot position information can be understood as the position information of the laser spot actually generated when the laser device projects the laser into the target scene.

[0124] It is understandable that there should be no laser spot in the first image, but some patterns similar to laser spots may exist in the first image and may be mistakenly detected as laser spots. To avoid this situation, spot detection can be performed on the first image to obtain corresponding detection results. The detection results can be the location information of the false spot and the corresponding confidence level of the false spot.

[0125] Specifically, a first preset detection threshold can be pre-set, and the first preset detection threshold can be a relatively small value. If a light spot is detected in the first image and the confidence level of the light spot is greater than the first preset detection threshold, the detected light spot can be determined to be a false light spot. Because false light spots can affect the accuracy of light spot detection in the target scene, a relatively small first preset detection threshold can be set to detect as many false light spots as possible in the first image, thereby preventing any subsequent impact on laser light spot detection results in the target scene and improving laser light spot detection accuracy.

[0126] When performing light spot detection on the second image, a second preset detection threshold may be pre-set. The light spot detection result of the second image may include the location information and confidence level of the light spot to be processed. If a light spot is detected in the second image and the confidence level of the light spot is greater than the second preset detection threshold, the detected light spot may be used as the light spot to be processed.

[0127] The second preset detection threshold is greater than the first preset detection threshold, and the second preset detection threshold may be a larger value, that is, the true light spot detected in the second image can only be determined as the light spot to be processed if the confidence level is large enough.

[0128] Finally, since the to-be-processed light spots may include some false light spots, in order to remove the false light spots from the to-be-processed light spots to obtain the target light spots, embodiments of the present invention can, based on the false light spot position information, remove the to-be-processed light spot position information corresponding to the false light spot position information from the detection results of the second image to obtain the target light spot position information. Furthermore, the image area corresponding to the target light spot position information is the target display area in the target scene.

[0129] In a preferred embodiment, the number of the first images and / or the second images is at least two, and the image interaction method based on light spot detection further includes: clustering the detection results of at least two of the first images, and determining the pseudo light spot position information based on the clustering results; and / or clustering the detection results of the at least two second images, and determining the light spot position information to be processed based on the clustering results.

[0130] In order to improve the detection accuracy and avoid inaccurate detection results of a single image, the number of first images and / or second images can be set to multiple, and light spot detection can be performed on each image to obtain detection results; the detection results of multiple images can be clustered to obtain pseudo light spot position information or to-be-processed light spot position information.

[0131] In an optional embodiment, the timing combination of the light spot emission and the timing combination of the camera for image acquisition and light spot detection can be diversified, and it is only necessary to ensure that the camera can collect the background image. The camera collects the image when the light spot is not emitted for detection, and after obtaining the similar pattern in the background, the false detection problem can be solved. Figure 5 , which are timing diagrams of three other light spot detections provided in the third embodiment of the present invention.

[0132] The technical solution of the embodiment of the present invention is to capture the trigger signal of the laser device and perform an image capture response when the laser device is triggered and activated, determine the capture response duration corresponding to the capture of the trigger signal and the image capture response, and the image capture interval; determine a first capture duration based on the image capture interval and a first number of images to be captured corresponding to the first image, and determine the laser pause period based on the capture response duration and the first capture duration; determine a second capture duration based on the image capture interval and a second number of images to be captured corresponding to the second image, and determine a laser emission period based on the capture response duration, the second capture duration, and the laser pause period; capture the first number of first images to be captured during the laser pause period; capture the second number of second images to be captured during the laser emission period; determine a laser spot detection result based on the first and second images, and determine a target display area in the target scene corresponding to the laser spot based on the detection result. This solves the technical problem of difficult laser spot detection in images. By controlling the laser emission period and the timing of image capture and then processing the captured images, accurate detection of the laser spot in the target scene and display of images of the target display area corresponding to the laser spot are achieved, thereby improving the convenience of interaction.

[0133] Example 4

[0134] Figure 6 This is a schematic diagram of the structure of a laser spot detection device provided by the fourth embodiment of the present invention. Figure 6 As shown, the device includes:

[0135] The capture and response module 410 is used to capture the trigger signal of the laser device and perform image acquisition response when the laser device is triggered and started, and determine the capture response time corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval;

[0136] a time period determination module 420 for determining a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission time period;

[0137] A scene image acquisition module 430 is configured to acquire a first image corresponding to the target scene captured by a camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the camera during the laser emission period;

[0138] The detection module 440 is configured to determine a detection result of the laser spot according to the first image and the second image.

[0139] The technical solution of an embodiment of the present invention is to control the shooting camera to be in a standby state when the laser device is started, and determine the start time and image acquisition time interval of the standby state; based on the start time and image acquisition time interval, determine the laser pause period and laser emission period, and control the laser device to project a laser spot into the target scene during the laser emission period; obtain a first image corresponding to the target scene through the shooting camera during the laser pause period, and obtain a second image corresponding to the target scene through the shooting camera during the laser emission period; and determine the laser spot detection result based on the first and second images. This solves the technical problem of difficult laser spot detection in images. By controlling the laser emission period and the timing of image acquisition, and then processing the acquired images, accurate detection of the laser spot in the target scene is achieved.

[0140] Based on the above device, the capture and response module 410 includes:

[0141] The capture and response module submodule is used to capture the trigger signal of the laser device through the camera software when the laser device is triggered and started, and to prepare for image acquisition when the trigger signal is captured to be in a ready-to-acquire state.

[0142] Based on the above device, the time period determination module 420 includes:

[0143] a laser pause time period determination submodule, configured to determine a first acquisition duration according to the image acquisition time interval and a first number of images to be acquired corresponding to the first image, and to determine the laser pause time period based on the capture response duration and the first acquisition duration;

[0144] The laser emission time period determination submodule is used to determine the second acquisition duration according to the image acquisition time interval and the second number to be acquired corresponding to the second image, and to determine the laser emission time period based on the capture response duration, the second acquisition duration and the laser pause time period.

[0145] Based on the above device, the scene image acquisition module 430 includes:

[0146] A first image acquisition submodule, configured to acquire the first number of first images to be acquired during the laser pause period;

[0147] The first image is an image of the target scene that does not contain the laser spot.

[0148] Based on the above device, the scene image acquisition module 430 includes:

[0149] A second image acquisition submodule, configured to acquire the second number of second images to be acquired during the laser emission time period;

[0150] The second image is an image of a target scene including a laser spot.

[0151] Based on the above device, the detection module 440 includes:

[0152] an image segmentation submodule, configured to use any one of the first image or the second image as an image to be processed;

[0153] According to preset segmentation parameters, the image to be processed is divided into multiple sub-images, and spot detection is performed on each of the sub-images to obtain a sub-detection result for each of the sub-images, and a detection result to be processed corresponding to the image to be processed is determined based on the multiple sub-detection results;

[0154] The detection result of the laser spot is determined based on the detection result to be processed corresponding to each of the images to be processed.

[0155] On the basis of the above device, the laser spot is detected by a spot detection model, and the spot detection model is obtained by training a training module, and the training module is specifically used to:

[0156] Obtaining sample images corresponding to different projection parameters and actual spot detection results of the sample images, and performing laser spot detection on the sample images using an initial spot detection model to obtain detection results to be used;

[0157] Based on the to-be-used detection result and the actual light spot detection result, the model parameters of the initial light spot detection model are modified to obtain a trained light spot detection model;

[0158] The projection parameters include at least one of the light spot projection angle, the angle between the light spot projection surface and the shooting camera, the light spot brightness, the reflection color temperature of the light spot on the light spot projection surface, and the shooting camera white balance.

[0159] A laser spot detection device provided by an embodiment of the present invention can execute a laser spot detection method provided by any embodiment of the present invention, and has corresponding functional modules and beneficial effects of the execution method.

[0160] Example 5

[0161] Figure 7 This is a structural diagram of an image interaction device based on light spot detection provided in Example 5 of the present invention.

[0162] like Figure 7 As shown, the device includes:

[0163] The capture and response module 510 is used to capture the trigger signal of the laser device and perform image acquisition response when the laser device is triggered and started, and determine the capture response time corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval;

[0164] a time period determination module 520 for determining a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission time period;

[0165] A scene image acquisition module 530 is configured to acquire a first image corresponding to the target scene captured by a camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the camera during the laser emission period;

[0166] a detection module 540, configured to determine a detection result of the laser spot according to the first image and the second image;

[0167] The display module 550 is configured to determine a target display area corresponding to the laser spot in the target scene based on the detection result.

[0168] Based on the above device, the detection result includes the false light spot position information or the false light spot position information, and the detection module 540 is specifically used to:

[0169] Determining, based on a first preset detection threshold, pseudo light spot position information in the detection result of the first image;

[0170] Determining, based on a second preset detection threshold, position information of the light spot to be processed in the detection result of the second image;

[0171] Based on the pseudo light spot position information, the to-be-processed light spot position information corresponding to the pseudo light spot position information in the detection result of the second image is removed to obtain the target light spot position information;

[0172] The first preset detection threshold is smaller than the second preset detection threshold.

[0173] The display module 550 is specifically configured to determine a target display area corresponding to the laser spot in the target scene based on the target spot position information.

[0174] On the basis of the above device, it also includes:

[0175] The number of the first images and / or the second images is at least two;

[0176] Clustering the detection results of at least two of the first images, and determining the pseudo spot position information based on the clustering results; and / or,

[0177] The detection results of the at least two second images are clustered, and the position information of the light spot to be processed is determined based on the clustering result.

[0178] The image interaction device based on light spot detection provided by the embodiment of the present invention can execute the image interaction method based on light spot detection provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0179] Example 6

[0180] Figure 8 Schematic diagram of the structure of an electronic device provided for embodiment six of the present invention. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0181] like Figure 8 As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., which is communicatively connected to the at least one processor 11. The memory stores a computer program that can be executed by the at least one processor. The processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. Various programs and data required for the operation of the electronic device 10 can also be stored in the RAM 13. The processor 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0182] Multiple components in the electronic device 10 are connected to the I / O interface 15, including an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0183] The processor 11 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the laser spot detection method or the image interaction method based on spot detection.

[0184] In some embodiments, the laser spot detection method or the image interaction method based on spot detection can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the laser spot detection method or the image interaction method based on spot detection described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured to execute the laser spot detection method or the image interaction method based on spot detection in any other appropriate manner (for example, by means of firmware).

[0185] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0186] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0187] In the context of the present invention, computer-readable storage media can be tangible media that can contain or store a computer program for use with an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. Computer-readable storage media can include but are not limited to electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, computer-readable storage media can be machine-readable signal media. More specific examples of machine-readable storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0188] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0189] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0190] A computing system may include clients and servers. The clients and servers are typically remote from each other and typically interact via a communication network. This client-server relationship arises through computer programs running on the respective computers, creating a client-server relationship. The server may be a cloud server, also known as a cloud computing server or cloud host. This server is a hosting product within the cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosting and VPS services.

[0191] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in the present invention can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved. This is not limited herein.

[0192] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.

Claims

1. A method for detecting a laser spot, characterized in that: include: When the laser device is triggered and started, capturing the trigger signal of the laser device and performing an image acquisition response, determining a capture response duration corresponding to capturing the trigger signal and performing the image acquisition response, and an image acquisition time interval; Determining a laser pause period and a laser emission period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission period; Acquire a first image corresponding to the target scene captured by a shooting camera during the laser pause period, and acquire a second image corresponding to the target scene captured by the shooting camera during the laser emission period; A detection result of the laser spot is determined according to the first image and the second image.

2. The method according to claim 1, characterized in that When the laser device is triggered and started, capturing the trigger signal of the laser device and performing image acquisition response includes: When the laser device is triggered to start, the trigger signal of the laser device is captured by the camera software, and when the trigger signal is captured, image acquisition preparation is performed to enter a state ready for acquisition.

3. The method according to claim 1, characterized in that The determining of the laser pause time period and the laser emission time period based on the capture response duration and the image acquisition time interval includes: Determining a first acquisition duration according to the image acquisition time interval and a first number to be acquired corresponding to the first image, and determining the laser pause time period based on the capture response duration and the first acquisition duration; A second acquisition duration is determined according to the image acquisition time interval and a second number to be acquired corresponding to the second image, and a laser emission time period is determined based on the capture response time period, the second acquisition time period and the laser pause time period.

4. The method according to claim 3, characterized in that The capturing of a first image corresponding to the target scene captured by a camera during the laser pause period includes: collecting the first number of first images to be collected during the laser pause time period; The first image is an image of the target scene that does not contain the laser spot.

5. The method according to claim 3, characterized in that The collecting, during the laser emission time period, a second image corresponding to the target scene captured by the camera, comprises: collecting the second number of second images to be collected during the laser emission time period; The second image is an image of a target scene including a laser spot.

6. The method according to claim 1, characterized in that Determining the detection result of the laser spot according to the first image and the second image includes: For any one of the first image or the second image, use the first image or the second image as an image to be processed; According to preset segmentation parameters, the image to be processed is divided into multiple sub-images, and spot detection is performed on each of the sub-images to obtain a sub-detection result for each of the sub-images, and a detection result to be processed corresponding to the image to be processed is determined based on the multiple sub-detection results; The detection result of the laser spot is determined based on the detection result to be processed corresponding to each of the images to be processed.

7. The method according to claim 1, characterized in that The laser spot is detected by a spot detection model, and the spot detection model is trained in the following manner: sample images corresponding to different projection parameters and actual spot detection results of the sample images are obtained, and the laser spot is detected on the sample images using the initial spot detection model to obtain a detection result to be used; Based on the to-be-used detection result and the actual light spot detection result, the model parameters of the initial light spot detection model are modified to obtain a trained light spot detection model; The projection parameters include at least one of the light spot projection angle, the angle between the light spot projection surface and the shooting camera, the light spot brightness, the reflection color temperature of the light spot on the light spot projection surface, and the shooting camera white balance.

8. An image interaction method based on spot detection, characterized in that the image interaction method based on spot detection includes: Obtaining a detection result of the laser spot by using a laser spot detection method according to any one of claims 1 to 7; A target display area corresponding to the laser spot in the target scene is determined based on the detection result.

9. The method according to claim 8, characterized in that The detection result includes pseudo spot position information and to-be-processed spot position information, and determining a target display area corresponding to the laser spot in the target scene based on the detection result includes: Determining, based on a first preset detection threshold, pseudo light spot position information in the detection result of the first image; Determining, based on a second preset detection threshold, position information of the light spot to be processed in the detection result of the second image; Based on the pseudo light spot position information, the to-be-processed light spot position information corresponding to the pseudo light spot position information in the detection result of the second image is removed to obtain the target light spot position information; Based on the target light spot position information, determining a target display area corresponding to the laser light spot in the target scene; The first preset detection threshold is smaller than the second preset detection threshold.

10. The method according to claim 9, characterized in that Also includes: When the number of the first images is at least two, clustering the detection results of the at least two first images, and determining the pseudo spot position information based on the clustering result; In a case where the number of the second images is at least two, the detection results of the at least two second images are clustered, and the position information of the light spot to be processed is determined based on the clustering result.

11. A laser spot detection device, characterized in that: include: A capture and response module, configured to capture a trigger signal of the laser device and perform an image acquisition response when the laser device is triggered and started, and determine a capture response duration corresponding to capturing the trigger signal and performing an image acquisition response, as well as an image acquisition time interval; a time period determination module, configured to determine a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission time period; a scene image acquisition module, configured to acquire a first image corresponding to the target scene captured by a shooting camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the shooting camera during the laser emission period; A detection module is used to determine a detection result of the laser spot according to the first image and the second image.

12. An image interaction device based on spot detection, characterized in that: include: A capture and response module, configured to capture a trigger signal of the laser device and perform an image acquisition response when the laser device is triggered and started, and determine a capture response duration corresponding to capturing the trigger signal and performing an image acquisition response, as well as an image acquisition time interval; a time period determination module, configured to determine a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission time period; a scene image acquisition module, configured to acquire a first image corresponding to the target scene captured by a shooting camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the shooting camera during the laser emission period; a detection module, configured to determine a detection result of the laser spot according to the first image and the second image; A display module is used to determine a target display area corresponding to the laser spot in the target scene based on the detection result.

13. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor. The computer program is executed by the at least one processor so that the at least one processor can perform the laser spot detection method according to any one of claims 1 to 7.

14. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor. The computer program is executed by the at least one processor to enable the at least one processor to perform the image interaction method based on light spot detection according to any one of claims 8 to 10.

15. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the laser spot detection method according to any one of claims 1 to 7 when executed.

16. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the image interaction method based on spot detection according to any one of claims 8 to 10 when executed.

Images