Laser spot detection and image interaction method and device, equipment and medium

Abstract

The invention discloses a laser spot detection and image interaction method, device, equipment and medium, and the method comprises the steps: capturing a triggering signal of laser equipment and carrying out image collection response when the laser equipment is triggered and started, determining the capturing response time corresponding to the capturing triggering signal and carrying out the image collection response, and carrying out the image collection response according to the capturing response time; and an image acquisition time interval; determining a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot to a target scene in a laser emission time period; acquiring a first image corresponding to the target scene in the laser pause time period, and acquiring a second image in the laser emission time period; and determining a detection result of the laser spot according to the first image and the second image. And determining a target display area corresponding to the laser spot in the target scene based on the detection result. Accurate detection of the laser spot in the target scene and close-up display of the target display area are realized.

Description

Technical Field

[0001] The present invention relates to the field of multimedia interaction technology, and in particular to a laser spot detection and image interaction method, device, equipment and medium. Background Art

[0002] In a video shooting scenario, the operation method of real-time framing / close-up of the picture is generally based on interaction with the application, such as clicking or drawing a close-up area on the software screen.

[0003] In order to make the operation more convenient and save manpower in operating the software, if the laser spot can be projected directly into the real scene through the remote control, the area to be close-up in the real scene can be selected, and then the image corresponding to the area to be close-up can be displayed. This is of great significance for typical application scenarios such as online classes, remote meetings, and object displays.

[0004] The above process involves the detection of laser spots in general video images. Currently, laser spot detection faces many challenges. For example, the spots are often very small and dim, so it is difficult to detect them through visual methods. The general environment is often very complex, and it is easy to have patterns that are very similar to the target spot, resulting in many false detections.

[0005] Therefore, how to effectively detect the laser spot in the image corresponding to the real scene is a technical problem that needs to be solved urgently. Summary of the invention

[0006] The present invention provides a laser spot detection and image interaction method, device, equipment and medium to achieve accurate detection of the laser spot projected in a target scene.

[0007] According to one aspect of the present invention, a method for detecting a laser spot is provided, comprising:

[0008] When the laser device is triggered and started, the trigger signal of the laser device is captured and an image acquisition response is performed, and a capture response duration corresponding to the capture of the trigger signal and the image acquisition response and an image acquisition time interval are determined;

[0009] Based on the capture response duration and the image acquisition time interval, determining a laser pause time period and a laser emission time period; wherein the laser device projects a laser spot into the target scene during the laser emission time period;

[0010] Acquire a first image corresponding to the target scene taken by a shooting camera during the laser pause time period, and acquire a second image corresponding to the target scene taken by the shooting camera during the laser emission time period;

[0011] A detection result of the laser spot is determined according to the first image and the second image.

[0012] According to another aspect of the present invention, there is provided an image interaction method based on light spot detection, the image interaction method based on light spot detection comprising:

[0013] A detection result of the laser spot is obtained by using a laser spot detection method described in any embodiment of the present invention;

[0014] A target display area corresponding to the laser spot in the target scene is determined based on the detection result.

[0015] According to another aspect of the present invention, there is provided a laser spot detection device, comprising:

[0016] A capture and response module, used to capture the trigger signal of the laser device and perform image acquisition response when the laser device is triggered and started, and determine the capture response time corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval;

[0017] A time period determination module, used to determine a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission time period;

[0018] A scene image acquisition module, used to acquire a first image corresponding to the target scene taken by a shooting camera during the laser pause period, and to acquire a second image corresponding to the target scene taken by the shooting camera during the laser emission period;

[0019] A detection module is used to determine a detection result of the laser spot according to the first image and the second image.

[0020] According to another aspect of the present invention, there is provided an image interaction device based on light spot detection, comprising:

[0021] A capture and response module, used to capture the trigger signal of the laser device and perform image acquisition response when the laser device is triggered and started, and determine the capture response time corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval;

[0022] A time period determination module, used to determine a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission time period;

[0023] A scene image acquisition module, used to acquire a first image corresponding to the target scene taken by a shooting camera during the laser pause period, and to acquire a second image corresponding to the target scene taken by the shooting camera during the laser emission period;

[0024] A detection module, used to determine a detection result of the laser spot according to the first image and the second image;

[0025] A display module is used to determine a target display area corresponding to the laser spot in the target scene based on the detection result.

[0026] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0027] at least one processor; and,

[0028] a memory communicatively connected to the at least one processor; wherein,

[0029] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the laser spot detection method or the image interaction method based on spot detection described in any embodiment of the present invention.

[0030] According to another aspect of the present invention, a computer-readable storage medium is provided, which stores computer instructions, and the computer instructions are used to enable a processor to implement the laser spot detection method or the image interaction method based on spot detection described in any embodiment of the present invention when executed.

[0031] The technical solution of the embodiment of the present invention is that when the laser device is triggered and started, the trigger signal of the laser device is captured and an image acquisition response is performed, and the capture response duration corresponding to the capture of the trigger signal and the image acquisition response, as well as the image acquisition time interval, are determined; based on the capture response duration and the image acquisition time interval, the laser pause time period and the laser emission time period are determined; wherein the laser device projects a laser spot into the target scene during the laser emission time period; during the laser pause time period, a first image corresponding to the target scene captured by the shooting camera is captured, and during the laser emission time period, a second image corresponding to the target scene captured by the shooting camera is captured; the detection result of the laser spot is determined according to the first image and the second image, and the target display area corresponding to the laser spot in the target scene is determined based on the detection result. The technical problem that the laser spot in the image is difficult to detect is solved, and the laser spot in the target scene is accurately detected by controlling the laser emission time period and the shooting time period of the shooting camera, and then processing the captured image.

[0032] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0034] Figure 1 A flow chart of a laser spot detection method provided in Embodiment 1 of the present invention;

[0035] Figure 2 A flow chart of a laser spot detection method provided in Embodiment 2 of the present invention;

[0036] Figure 3 A timing diagram of light spot detection provided in the second embodiment of the present invention;

[0037] Figure 4 A flowchart of an image interaction method based on spot detection provided in Embodiment 3 of the present invention;

[0038] Figure 5 Timing diagrams of three other light spot detections provided in Embodiment 3 of the present invention;

[0039] Figure 6 A schematic diagram of the structure of a laser spot detection device provided in Embodiment 4 of the present invention;

[0040] Figure 7 A schematic diagram of the structure of an image interaction device based on light spot detection provided in Embodiment 5 of the present invention;

[0041] Figure 8 This is a schematic diagram of the structure of an electronic device provided in Embodiment 6 of the present invention. DETAILED DESCRIPTION

[0042] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0043] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0044] In order to further clarify the technical solution of the present invention, some application scenarios of the present invention are described before introducing specific embodiments. The technical solution of the present invention can be applied to scenarios such as online classrooms, remote conferences, and object displays. In the above scenarios, the corresponding picture of the real scene is captured in real time by a shooting camera, and then the captured picture is sent to the terminal device of the audience user through a communication connection, so as to display the picture of the real scene through the terminal device of the audience user. When it is necessary to take a close-up of the target area or target object of the real scene, for example, in the object display scene, it is necessary to take a close-up of the object so that the audience user can see the shape, color details, etc. of the object more clearly, then the user who demonstrates and explains in the real scene can hold a laser device, and project a laser spot to the object based on the laser device. The shooting camera can accurately identify the laser spot, and determine the picture of the object projected by the laser spot, and enlarge the picture of the object, and further display the enlarged object picture on the terminal device of the audience user, so as to realize a close-up display of the object.

[0045] Embodiment 1

[0046] Figure 1 A flowchart of a laser spot detection method provided in Embodiment 1 of the present invention. This embodiment can be applied to the situation of accurately detecting the laser spot emitted by a laser device. The method can be performed by a laser spot detection device, which can be implemented in the form of hardware and / or software, and can be configured in a shooting camera or a computer device.

[0047] like Figure 1 As shown, the method includes:

[0048] S110, when the laser device is triggered to start, capturing the trigger signal of the laser device and performing an image acquisition response, determining a capture response duration corresponding to capturing the trigger signal and performing an image acquisition response, and an image acquisition time interval.

[0049] Among them, the laser device can be an electronic device that can emit laser and project it onto the surface of an object, for example, the laser device is a laser pen or a remote control that can emit laser; the laser device can be started based on a trigger signal, and the trigger signal can be generated by an interactive operation with the laser device, for example, the interactive operation is an operation in which the user presses a launch button of the laser device.

[0050] When the laser device is triggered and started, the apparatus of the embodiment of the present invention can capture the trigger signal of the laser device, and after capturing the trigger signal, perform image acquisition response. The capture response duration can be understood as the duration between capturing the trigger signal and performing image acquisition response.

[0051] After the image acquisition response, the image frames captured by the shooting camera can be collected. The shooting camera can be an AI video camera, which can capture images of real scenes.

[0052] It is understandable that the shooting camera can continuously acquire multiple continuous image frames in the real scene. In the embodiment of the present invention, the multiple continuous image frames can be acquired according to the image acquisition time interval, that is, part of the image frames are acquired. For example, if the image acquisition time interval is 2 milliseconds, the image frames acquired by the shooting camera are acquired once every 2 milliseconds. Specifically, when the user needs to take a close-up of an image of a certain area in the real scene, the laser emission button of the laser device can be pressed. This interactive operation can generate a trigger signal and trigger the laser device to start. At the same time, the trigger signal can be captured and an image acquisition response can be performed, and the capture response duration and the image acquisition time interval can be determined.

[0053] In an embodiment of the present invention, when the laser device is triggered and started, the trigger signal of the laser device is captured and an image acquisition response is performed, including: when the laser device is triggered and started, the trigger signal of the laser device is captured by camera software, and when the trigger signal is captured, image acquisition preparation is performed to be in a waiting state.

[0054] In an optional application scenario, when the laser device is a remote control that is compatible with an AI video camera, the remote control not only has the function of controlling the AI ​​video camera, but also has the function of laser emission. Communication can be established between the remote control and the AI ​​video camera, so when the remote control detects the trigger start of the laser emission function, the camera software can capture the trigger signal of the laser device based on the communication channel, and perform image acquisition response after capturing the trigger signal, or it can be said that it is image acquisition preparation, so that the camera software is in a state of waiting for acquisition.

[0055] The waiting state can be a state where the camera software is ready to start collecting the image frames acquired by the shooting camera. At the same time, the time from when the laser emission button of the remote control is pressed to when the camera software captures the trigger signal, and the time from when the trigger signal is captured to when the camera software starts collecting the image captured by the shooting camera are determined, and the two time lengths are added together as the capture response time length.

[0056] In another optional application scenario, the laser device is not a remote control for a camera. For example, the laser device is a laser pen with a communication function. The laser pen can communicate with a third-party software, and the third-party software can also communicate with the camera software. When the third-party software detects a trigger signal from the laser pen, the third-party software can convert the trigger signal into a signal recognizable by the camera software and send it to the camera software, so that the camera software responds to image acquisition.

[0057] In the technical solution of the present invention, the trigger signal of the laser device is captured by different methods, and image acquisition response is performed accordingly, so as to achieve effective capture of the trigger signal and improve compatibility with laser device types.

[0058] S120: Determine a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval.

[0059] Among them, the laser pause time period can be understood as the time period when the laser beam of the laser device is in a paused emission state, and the laser emission time period refers to the time period when the laser beam of the laser device is in an emission state. The laser device projects a laser spot into the target scene during the laser emission time period, and the target scene can be a real scene.

[0060] Specifically, according to the capture response duration and the image acquisition time interval, the laser pause time period and the laser emission time period can be calculated. During the laser pause time period, the laser device is controlled not to project the laser spot, and during the laser emission time period, the laser device is controlled to project the laser spot into the target scene.

[0061] It should be noted that the laser power of laser equipment is limited by safety regulations and is usually a relatively small value. When the projection distance is far, the light spot will be dimmer. At this time, the light spot captured by the camera will be dimmer than in the real scene, making the light spot very difficult to detect. Therefore, the design of the light spot pattern is very critical to ensure that the light spot pattern can achieve a good balance in size and brightness under a fixed transmission power, that is, double excellence. You can choose a circular light spot, and the energy of the laser is distributed in a circular pattern. This way, the projection brightness is brighter than other patterns such as dot patterns, and the size is larger, which is relatively more advantageous for detection.

[0062] S130, collecting a first image corresponding to the target scene captured by a camera during the laser pause period, and collecting a second image corresponding to the target scene captured by the camera during the laser emission period.

[0063] The first image may be an image of the target scene captured by the camera software during the laser pause period, and the second image may be an image of the target scene captured by the camera software during the laser emission period. For example, when the target scene is a live broadcast with goods, the first image may be an image corresponding to the entire live broadcast room, such as an image including the live broadcast room background picture, the anchor picture, and the product picture.

[0064] S140, determining the detection result of the laser spot according to the first image and the second image, wherein the detection result can be understood as the detection result of the laser spot projected in the target scene, and the detection result includes but is not limited to information such as the shape, brightness, and position of the laser spot.

[0065] It can be understood that since the first image is an image captured by the camera during the laser pause period, and the second image is an image captured by the camera during the laser emission period, that is, the first image should not include the laser spot, and the second image should include the laser spot. Therefore, according to the first image that does not include the laser spot and the second image that includes the laser spot, the detection result of the laser spot can be determined, for example, the specific position of the laser spot in the second image.

[0066] In an embodiment of the present invention, the laser spot is detected by a spot detection model. The image interaction method based on spot detection provided by the embodiment of the present invention further includes: training the initial spot detection model to obtain a trained spot detection model. The spot detection model is trained in the following manner:

[0067] Acquire sample images corresponding to different projection parameters and actual spot detection results of the sample images, and perform laser spot detection on the sample images through an initial spot detection model to obtain detection results to be used;

[0068] Based on the detection result to be used and the actual light spot detection result, the model parameters of the initial light spot detection model are corrected to obtain a trained light spot detection model.

[0069] The projection parameters include at least one of the light spot projection angle, the angle between the light spot projection surface and the shooting camera, the light spot brightness, the reflection color temperature of the light spot on the light spot projection surface, and the shooting camera white balance.

[0070] In an embodiment of the present invention, the difficulty in spot detection is mainly due to insufficient brightness in the picture and skewed angle of spot projection, so some sample images can be generated in advance, and the projection parameters corresponding to each sample image can be different, wherein the actual spot detection result can be the result of manual or automatic detection of the spot in the sample image.

[0071] After generating the sample image, the sample image and the corresponding actual spot detection result can be used as a training sample set to iterate the training of the initial spot detection model, and correct the detection parameters of the initial spot detection model to obtain a trained spot detection model. After the training of the initial spot detection model is completed, a trained spot detection model is obtained, which can accurately identify the laser spot in images with various projection parameters, obtain corresponding accurate laser spot detection results, improve the generalization ability of laser spot detection, and the accuracy is not limited by the projection parameters. The generation of the sample image is further explained below:

[0072] In the case of skewed light spot projection, if the light spot is projected on one side, the light spot presented in the picture will be an elliptical light spot, not a circle. Therefore, in the sample image generation stage, a circular light spot is projected at a random angle, which not only randomly changes the incident angle of the light, but also randomly changes the angle of the projection surface of the light spot, so as to maximize the simulation of various situations that may occur in the real environment, so as to generate a light spot pattern that can cope with various scenes.

[0073] In the case of insufficient brightness, a light spot can be randomly attenuated and projected onto a variety of pictures or videos to maximize the simulation of the performance of such low-brightness light spots in real environments. In addition, in order to simulate the reflection color temperature of light spots from different materials and the white balance differences of the picture itself, random adjustments are made to the white balance in the generation of sample images to further improve the generalization ability of the light spot detection model.

[0074] By taking the above measures to perform data augmentation on the sample images of the initial spot detection model, the accuracy of the trained spot detection model in detecting the laser spot can be greatly improved, that is, it can be ensured that the spot detection model can detect the laser spot well in the real scene. The spot detection model provided by the embodiment of the present invention has a very high recall rate.

[0075] The technical solution of the embodiment of the present invention is that when the laser device is triggered and started, the trigger signal of the laser device is captured and an image acquisition response is performed, and the capture response duration corresponding to the capture of the trigger signal and the image acquisition response, as well as the image acquisition time interval, are determined; based on the capture response duration and the image acquisition time interval, the laser pause time period and the laser emission time period are determined; wherein the laser device projects a laser spot into the target scene during the laser emission time period; a first image corresponding to the target scene captured by the shooting camera is captured during the laser pause time period, and a second image corresponding to the target scene captured by the shooting camera is captured during the laser emission time period; and the detection result of the laser spot is determined based on the first image and the second image. The technical problem that the laser spot in the image is difficult to detect is solved, and the laser spot in the target scene is accurately detected by controlling the laser emission time period and the timing of image acquisition, and then processing the images captured in different time periods.

[0076] Embodiment 2

[0077] Figure 2 This is a flow chart of a laser spot detection method provided in the second embodiment of the present invention. Based on the above embodiment, this embodiment further optimizes the laser spot detection process. The specific implementation method can refer to the technical solution of this embodiment. Among them, the technical terms that are the same or corresponding to the above embodiment are not repeated here. Figure 2 As shown, the method includes:

[0078] S210, when the laser device is triggered to start, capturing the trigger signal of the laser device and performing an image acquisition response, determining a capture response duration corresponding to capturing the trigger signal and performing an image acquisition response, and an image acquisition time interval.

[0079] S220: Determine a first acquisition duration according to the image acquisition time interval and a first number to be acquired corresponding to the first image, and determine the laser pause time period based on the capture response duration and the first acquisition duration.

[0080] The first number to be collected refers to the number of frames of the first image that needs to be collected, and the first collection time refers to the collection time required by the camera software to collect the first number of first images to be collected.

[0081] Specifically, the product of the image acquisition time interval and the first number to be acquired may be used as the first acquisition duration, and then the laser pause time period may be calculated based on the capture response duration and the first acquisition duration.

[0082] S230, determining a second acquisition duration according to the image acquisition time interval and a second number to be acquired corresponding to the second image, and determining a laser emission time period based on the capture response time period, the second acquisition time period and the laser pause time period.

[0083] Among them, the second number to be collected refers to the number of frames of the second image that needs to be collected, and the second collection time refers to the collection time required by the camera software to collect the second number of second images to be collected; the first number to be collected and the second number to be collected can be the same.

[0084] Specifically, the product of the image acquisition time interval and the second number to be acquired can be used as the second acquisition duration, and then the laser emission time period is calculated based on the capture response duration, the second acquisition duration and the laser pause time period.

[0085] S240: Collect the first number of first images to be collected during the laser pause time period.

[0086] The first image is an image of the target scene that does not contain the laser spot.

[0087] S250, collecting the second number of second images to be collected during the laser emission time period.

[0088] Wherein, the second image is an image of the target scene including the laser spot.

[0089] It should also be noted that in real environments, the probability of circular or elliptical light spots appearing is very high, and it is difficult to completely distinguish the two in principle, so the entire detection process must be optimized. This problem can be solved by adjusting the laser emission timing and the light spot detection timing. Figure 3 A timing diagram of a light spot detection provided by the second embodiment of the present invention, combined with Figure 3 The above steps S210-S250 are described in detail.

[0090] In the embodiment of the present invention, laser emission and light spot detection are coordinated in timing to detect the detection result when the light spot is extinguished and the detection result when the light spot is emitted, and the false detection in the background is removed by comparing the two, so as to obtain a correct and effective real light spot detection result.

[0091] First, when the user presses the laser button on the remote control, this moment is recorded as t0. Assuming that after time T4, the event is captured by the camera program (whether it is captured directly by the camera software or indirectly sent to the camera for capture through third-party software), after the camera application captures the event, it waits for T5 and starts capturing image frames. After continuously capturing Nb frames (this frame set is regarded as the background frame set ISb without light spots), it stops capturing T3 and then continues to capture Nf frames (this frame set is regarded as the foreground frame set ISf with light spots). At this point, the program ends capturing the frame. Among them, T4 plus T5 is the capture response time, Nb is the first number to be collected, and the background frame set ISb can be understood as a set including multiple first images; Nf is the first number to be collected, and the foreground frame set ISf can be understood as a set including multiple second images.

[0092] Correspondingly, at time t0, the remote controller turns off the laser emission in the first T1 time period, then turns on the laser emission in the next T2 time period, and then turns off the laser. Among them, T1 can be understood as the laser pause time period, and T2 can be understood as the laser emission time period.

[0093] By collecting two different sets of images, namely the background set ISb without light spots and the foreground set ISf containing light spots, the light spot detection algorithm is used to perform light spot detection on the two sets in turn, and the detection results of ISb are removed from the detection results of ISf, which eliminates the influence of background false detection, and the last one left is the real light spot result.

[0094] In particular, the coordination of the above time needs to meet certain conditions, otherwise it is easy to collect wrong image sets. Without loss of generality, assume that Ts is the interval of image collection.

[0095] Taking t0 as the starting time point, the time when the software starts collecting ISb is:

[0096] T start (ISb) = T4 + T5 + Δt, Δt = 0 ~ T s

[0097] T end (ISb) = T4 + T5 + Δt + (N b -1)×T s ,Δt=0~T s

[0098] Taking t0 as the starting time point, the time when the software starts collecting ISf is:

[0099] T start (ISf) = T4 + T5 + Δt + (N b -1)×T s+T3+Δt1,Δt,Δt1=0~T s

[0100] T end (ISf) = T4 + T5 + Δt + (N b -1)×T+T3+Δt1+(N f -1)×T s ,Δt,Δt1=0~T s

[0101] Considering that T1 to T5 have certain uncertainty, that is, deviation, the above timing needs to be designed according to the worst case, requiring:

[0102] min(T1)>max(T end (ISb)

[0103] max(T1) <min(T start (ISf))

[0104] min(T1+T2)>max(T end (ISf))

[0105] The above formula describes the relationship between several time points. It should be noted that T1 to T5 are values ​​greater than or equal to 0.

[0106] S260: Determine a detection result of the laser spot according to the first image and the second image.

[0107] On the basis of the above technical solution, the detection result of the laser spot is determined according to the first image and the second image, including: for any one of the first image or the second image, the first image or the second image is used as the image to be processed; according to preset segmentation parameters, the image to be processed is divided into multiple sub-images, and spot detection is performed on each of the sub-images to obtain a sub-detection result of each of the sub-images, and the detection result to be processed corresponding to the image to be processed is determined based on the multiple sub-detection results; the detection result of the laser spot is determined based on the detection result to be processed corresponding to each of the images to be processed.

[0108] Due to the small size of the laser spot, the detection of the laser spot is more difficult. In order to better detect the laser spot, the image can be divided into sub-images to deal with this problem. For example, the image can be equally divided into 4 sub-images, or 9, or other numbers of sub-images. These sub-images may or may not contain each other. By reducing the detection image, the challenge brought by the small spot size can be effectively overcome.

[0109] Specifically, the image to be processed is divided into multiple sub-images according to preset segmentation parameters, and the preset segmentation parameters may be parameters related to image segmentation, such as segmentation size and segmentation number. Laser spot detection is performed on each sub-image to obtain a sub-detection result of each sub-image, and then the sub-detection results of the multiple sub-images corresponding to the image to be processed are used as the detection results to be processed of the image to be processed. Among them, the detection results to be processed can be understood as the spot detection results of the image to be processed. In order to improve the detection accuracy, the detection results to be processed corresponding to each image to be processed can be combined to determine the detection results of the laser spot in the target scene.

[0110] It can be understood that after the image to be processed is divided into sub-images, if there is a laser spot in the sub-image, the size of the laser spot becomes larger relative to the sub-image, so it is easier to detect the laser spot in the sub-image, effectively overcoming the difficulties caused by the small spot size.

[0111] In an optional implementation, if the size of the laser spot in the image to be processed is relatively large, the image to be processed may not be segmented, and laser spot detection may be performed directly on the image to be processed to obtain a detection result.

[0112] The technical solution of the embodiment of the present invention is that when the laser device is triggered and started, the trigger signal of the laser device is captured and an image acquisition response is performed, and the capture response duration corresponding to the capture trigger signal and the image acquisition response and the image acquisition time interval are determined; then, the first acquisition duration is determined according to the image acquisition time interval and the first number to be collected corresponding to the first image, and the laser pause time period is determined based on the capture response duration and the first acquisition duration; further, the second acquisition duration is determined according to the image acquisition time interval and the second number to be collected corresponding to the second image, and the laser emission time period is determined based on the capture response duration, the second acquisition duration and the laser pause time period, so as to collect the first number of first images to be collected in the laser pause time period and collect the second number of second images to be collected in the laser emission time period; finally, the detection result of the laser spot is determined according to the first image and the second image. The technical problem that the laser spot in the image is difficult to detect is solved, and the laser spot in the target scene is accurately detected by controlling the laser emission time period and the timing of image acquisition, and then processing the images collected in different time periods.

[0113] Embodiment 3

[0114] Figure 4This is a flowchart of an image interaction method based on spot detection provided in the third embodiment of the present invention. This embodiment can be applied to the case where a laser device is used to project a close-up area in a real scene to display the image corresponding to the close-up area in a close-up form. The method can be executed by an image interaction device based on spot detection, which can be implemented in the form of hardware and / or software, and can be configured in a shooting camera or computer device. Figure 4 As shown, the method includes:

[0115] S310, when the laser device is triggered to start, capturing the trigger signal of the laser device and performing an image acquisition response, determining a capture response duration corresponding to capturing the trigger signal and performing an image acquisition response, and an image acquisition time interval.

[0116] S320: Determine a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval.

[0117] S330, collecting a first image corresponding to the target scene taken by a shooting camera during the laser pause time period, and collecting a second image corresponding to the target scene taken by the shooting camera during the laser emission time period.

[0118] S340: Determine a detection result of the laser spot according to the first image and the second image.

[0119] S350: Determine a target display area corresponding to the laser spot in the target scene based on the detection result.

[0120] The target display area can be the area where the laser spot is projected in the target scene, or it can be understood as the area that needs to be close-up. For example, in a live broadcast scene, the anchor projects the laser spot on the product, and the area corresponding to the product is the target display area corresponding to the laser spot.

[0121] Specifically, the specific position of the laser spot in the target scene or the second image can be determined based on the detection result of the laser spot, and then the target display area in the target scene can be determined based on the specific position. The image corresponding to the target display area is further enlarged and the enlarged image is displayed on the terminal display interface of the audience user, so that a close-up display of the target display area can be achieved, realizing the convenience of the close-up function.

[0122] On the basis of the above technical solution, the detection result includes pseudo spot position information or spot position information to be processed, and determining the target display area corresponding to the laser spot in the target scene based on the detection result includes: determining the pseudo spot position information in the detection result of the first image based on a first preset detection threshold; determining the spot position information to be processed in the detection result of the second image based on a second preset detection threshold; based on the pseudo spot position information, removing the spot position information to be processed corresponding to the pseudo spot position information in the detection result of the second image to obtain the target spot position information; based on the target spot position information, determining the target display area corresponding to the laser spot in the target scene.

[0123] Among them, pseudo light spots can be understood as some patterns similar to laser light spots in the first image, and the spots to be processed can be understood as some laser light spots detected in the second image; the first preset detection threshold is smaller than the second preset detection threshold, the first preset detection threshold is used to screen and judge pseudo light spots in the first image, and the second preset detection threshold is used to screen and judge the spots to be processed in the second image; the target light spot position information can be understood as the position information of the laser light spot actually generated when the laser device projects the laser into the target scene.

[0124] It is understandable that there should be no laser spot in the first image, but there may be some patterns similar to the laser spot in the first image, which may be mistakenly detected as the laser spot. In order to avoid this situation, the first image can be subjected to spot detection to obtain the corresponding detection result, which can be the position information of the false spot and the confidence level corresponding to the false spot.

[0125] Specifically, a first preset detection threshold may be pre-set, and the first preset detection threshold may be a relatively small value. If a light spot is detected in the first image, and the confidence of the light spot is greater than the first preset detection threshold, the detected light spot may be determined as a pseudo light spot. Since pseudo light spots may affect the accuracy of light spot detection in the target scene, a relatively small first preset detection threshold may be set to detect all pseudo light spots in the first image as much as possible, thereby avoiding the subsequent impact on the laser light spot detection result in the target scene and improving the accuracy of laser light spot detection.

[0126] When performing light spot detection on the second image, a second preset detection threshold may be pre-set, and the light spot detection result of the second image may include the position information and confidence level of the light spot to be processed. If a light spot is detected in the second image, and the confidence level of the light spot is greater than the second preset detection threshold, the detected light spot may be used as the light spot to be processed.

[0127] The second preset detection threshold is greater than the first preset detection threshold, and the second preset detection threshold may be a relatively large value, that is, the confidence of the true light spot detected in the second image is large enough to be determined as the light spot to be processed.

[0128] Finally, since the light spot to be processed may include some pseudo light spots, in order to remove the pseudo light spots in the light spot to be processed to obtain the target light spot, in the embodiment of the present invention, based on the pseudo light spot position information, the light spot position information to be processed corresponding to the pseudo light spot position information in the detection result of the second image can be removed to obtain the target light spot position information. Then, the image area corresponding to the target light spot position information is the target display area in the target scene.

[0129] In a preferred embodiment, the number of the first images and / or the second images is at least two, and the image interaction method based on light spot detection also includes: clustering the detection results of at least two of the first images, and determining the pseudo light spot position information based on the clustering results; and / or clustering the detection results of the at least two second images, and determining the light spot position information to be processed based on the clustering results.

[0130] In order to improve the detection accuracy and avoid inaccurate detection results of a single image, the number of first images and / or second images can be set to multiple, and spot detection is performed on each image to obtain detection results; the detection results of multiple images are clustered to obtain pseudo spot position information or spot position information to be processed.

[0131] In an optional embodiment, the timing combination of the light spot emission and the timing combination of the camera for image acquisition and light spot detection can be diversified, and it is only necessary to ensure that the camera can collect the background image. The camera collects the image when the light spot is not emitted for detection, and after obtaining the similar pattern in the background, the problem of false detection can be solved. Figure 5 , which are timing diagrams of three other light spot detections provided in Embodiment 3 of the present invention.

[0132] The technical solution of the embodiment of the present invention is that when the laser device is triggered and started, the trigger signal of the laser device is captured and an image acquisition response is performed, and the capture response duration corresponding to the capture trigger signal and the image acquisition response and the image acquisition time interval are determined; the first acquisition duration is determined according to the image acquisition time interval and the first number to be collected corresponding to the first image, and the laser pause time period is determined based on the capture response duration and the first acquisition duration; the second acquisition duration is determined according to the image acquisition time interval and the second number to be collected corresponding to the second image, and the laser emission time period is determined based on the capture response duration, the second acquisition duration and the laser pause time period; the first image of the first number to be collected is collected in the laser pause time period; the second image of the second number to be collected is collected in the laser emission time period; the detection result of the laser spot is determined according to the first image and the second image, and the target display area corresponding to the laser spot in the target scene is determined based on the detection result. The technical problem that the laser spot in the image is difficult to detect is solved. By controlling the laser emission time period and the timing of image acquisition, and then processing the acquired image, the accurate detection of the laser spot in the target scene and the display of the image of the target display area corresponding to the laser spot are realized, and the convenience of interaction is improved.

[0133] Embodiment 4

[0134] Figure 6 This is a schematic diagram of the structure of a laser spot detection device provided in Embodiment 4 of the present invention. Figure 6 As shown, the device comprises:

[0135] The capture and response module 410 is used to capture the trigger signal of the laser device and perform image acquisition response when the laser device is triggered and started, and determine the capture response time corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval;

[0136] The time period determination module 420 is used to determine the laser pause time period and the laser emission time period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission time period;

[0137] A scene image acquisition module 430, configured to acquire a first image corresponding to the target scene captured by a camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the camera during the laser emission period;

[0138] The detection module 440 is used to determine the detection result of the laser spot according to the first image and the second image.

[0139] The technical solution of the embodiment of the present invention is to control the shooting camera to be in a waiting state when the start-up operation of the laser device is detected, and determine the start-up time and image acquisition time interval of the waiting state; based on the start-up time and image acquisition time interval, determine the laser pause time period and laser emission time period, and control the laser device to project a laser spot to the target scene during the laser emission time period; obtain a first image corresponding to the target scene through the shooting camera during the laser pause time period, and obtain a second image corresponding to the target scene through the shooting camera during the laser emission time period; determine the detection result of the laser spot based on the first image and the second image. The technical problem of the difficulty in detecting the laser spot in the image is solved, and the laser spot in the target scene is accurately detected by controlling the laser emission time period and the timing of image acquisition, and then processing the acquired image.

[0140] Based on the above device, the capture and response module 410 includes:

[0141] The capture and response module submodule is used to capture the trigger signal of the laser device through the camera software when the laser device is triggered and start, and to prepare for image acquisition when the trigger signal is captured so as to be in a state ready for acquisition.

[0142] Based on the above device, the time period determination module 420 includes:

[0143] a laser pause time period determination submodule, configured to determine a first acquisition duration according to the image acquisition time interval and a first number to be acquired corresponding to the first image, and to determine the laser pause time period based on the capture response duration and the first acquisition duration;

[0144] The laser emission time period determination submodule is used to determine the second acquisition duration according to the image acquisition time interval and the second number to be acquired corresponding to the second image, and to determine the laser emission time period based on the capture response duration, the second acquisition duration and the laser pause time period.

[0145] Based on the above device, the scene image acquisition module 430 includes:

[0146] A first image acquisition submodule, used for acquiring the first number of first images to be acquired during the laser pause time period;

[0147] The first image is an image of the target scene that does not contain the laser spot.

[0148] Based on the above device, the scene image acquisition module 430 includes:

[0149] A second image acquisition submodule, used for acquiring the second number of second images to be acquired during the laser emission time period;

[0150] Wherein, the second image is an image of the target scene including the laser spot.

[0151] Based on the above device, the detection module 440 includes:

[0152] An image segmentation submodule, used for taking any one of the first image or the second image as an image to be processed;

[0153] According to preset segmentation parameters, the image to be processed is segmented into multiple sub-images, and spot detection is performed on each of the sub-images to obtain a sub-detection result of each of the sub-images, and the detection result to be processed corresponding to the image to be processed is determined based on the multiple sub-detection results;

[0154] The detection result of the laser spot is determined based on the detection result to be processed corresponding to each of the images to be processed.

[0155] On the basis of the above device, the laser spot is detected by a spot detection model, and the spot detection model is obtained by training a training module, and the training module is specifically used for:

[0156] Acquire sample images corresponding to different projection parameters and actual spot detection results of the sample images, and perform laser spot detection on the sample images through an initial spot detection model to obtain detection results to be used;

[0157] Based on the detection result to be used and the actual light spot detection result, correcting the model parameters of the initial light spot detection model to obtain a trained light spot detection model;

[0158] The projection parameters include at least one of the light spot projection angle, the angle between the light spot projection surface and the shooting camera, the light spot brightness, the reflection color temperature of the light spot on the light spot projection surface and the shooting camera white balance.

[0159] A laser spot detection device provided in an embodiment of the present invention can execute a laser spot detection method provided in any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method.

[0160] Embodiment 5

[0161] Figure 7 This is a structural schematic diagram of an image interaction device based on light spot detection provided in Embodiment 5 of the present invention.

[0162] like Figure 7 As shown, the device comprises:

[0163] The capture and response module 510 is used to capture the trigger signal of the laser device and perform image acquisition response when the laser device is triggered and started, and determine the capture response time corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval;

[0164] The time period determination module 520 is used to determine the laser pause time period and the laser emission time period based on the capture response time and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission time period;

[0165] A scene image acquisition module 530, configured to acquire a first image corresponding to the target scene captured by a camera during the laser pause period, and to acquire a second image corresponding to the target scene captured by the camera during the laser emission period;

[0166] A detection module 540, configured to determine a detection result of the laser spot according to the first image and the second image;

[0167] The display module 550 is used to determine a target display area corresponding to the laser spot in the target scene based on the detection result.

[0168] On the basis of the above device, the detection result includes the false light spot position information or the false light spot position information, and the detection module 540 is specifically used for:

[0169] Based on a first preset detection threshold, determining pseudo light spot position information in the detection result of the first image;

[0170] Based on a second preset detection threshold, determining the position information of the light spot to be processed in the detection result of the second image;

[0171] Based on the pseudo light spot position information, the to-be-processed light spot position information corresponding to the pseudo light spot position information in the detection result of the second image is removed to obtain the target light spot position information;

[0172] Wherein, the first preset detection threshold is smaller than the second preset detection threshold.

[0173] The display module 550 is specifically used to determine a target display area corresponding to the laser spot in the target scene based on the target spot position information.

[0174] On the basis of the above device, it also includes:

[0175] The number of the first images and / or the second images is at least two;

[0176] Clustering the detection results of at least two of the first images, and determining the pseudo light spot position information based on the clustering results; and / or,

[0177] The detection results of the at least two second images are clustered, and the position information of the light spot to be processed is determined based on the clustering result.

[0178] The image interaction device based on light spot detection provided by the embodiment of the present invention can execute the image interaction method based on light spot detection provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0179] Embodiment 6

[0180] Figure 8 A schematic diagram of the structure of an electronic device provided for Embodiment 6 of the present invention. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0181] like Figure 8 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0182] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0183] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as a laser spot detection method or an image interaction method based on spot detection.

[0184] In some embodiments, the laser spot detection method or the image interaction method based on spot detection may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the laser spot detection method or the image interaction method based on spot detection described above may be executed. Alternatively, in other embodiments, the processor 11 may be configured to execute the laser spot detection method or the image interaction method based on spot detection in any other appropriate manner (e.g., by means of firmware).

[0185] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0186] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0187] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0188] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0189] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0190] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0191] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0192] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for detecting a laser spot, characterized in that: include: When the laser device is triggered and started, the trigger signal of the laser device is captured and an image acquisition response is performed, and a capture response duration corresponding to the capture of the trigger signal and the image acquisition response and an image acquisition time interval are determined; Based on the capture response duration and the image acquisition time interval, determining a laser pause time period and a laser emission time period; wherein the laser device projects a laser spot into the target scene during the laser emission time period; Acquire a first image corresponding to the target scene taken by a shooting camera during the laser pause time period, and acquire a second image corresponding to the target scene taken by the shooting camera during the laser emission time period; A detection result of the laser spot is determined according to the first image and the second image.

2. The method according to claim 1, characterized in that When the laser device is triggered and started, capturing the trigger signal of the laser device and performing image acquisition response includes: When the laser device is triggered to start, the trigger signal of the laser device is captured by the camera software, and when the trigger signal is captured, image acquisition preparation is performed to be in a state ready for acquisition.

3. The method according to claim 1, characterized in that The step of determining the laser pause time period and the laser emission time period based on the capture response time period and the image acquisition time interval includes: Determine a first acquisition duration according to the image acquisition time interval and a first number to be acquired corresponding to the first image, and determine the laser pause time period based on the capture response duration and the first acquisition duration; A second acquisition duration is determined according to the image acquisition time interval and a second number to be acquired corresponding to the second image, and a laser emission time period is determined based on the capture response time period, the second acquisition time period and the laser pause time period.

4. The method according to claim 3, characterized in that The step of acquiring a first image corresponding to the target scene captured by a camera during the laser pause period includes: Collecting the first number of first images to be collected during the laser pause time period; The first image is an image of the target scene that does not contain the laser spot.

5. The method according to claim 3, characterized in that: The collecting of the second image corresponding to the target scene captured by the camera during the laser emission time period includes: Collecting the second number of second images to be collected during the laser emission time period; Wherein, the second image is an image of the target scene including the laser spot.

6. The method according to claim 1, characterized in that The step of determining the detection result of the laser spot according to the first image and the second image includes: For any one of the first image or the second image, use the first image or the second image as an image to be processed; According to preset segmentation parameters, the image to be processed is segmented into multiple sub-images, and spot detection is performed on each of the sub-images to obtain a sub-detection result of each of the sub-images, and the detection result to be processed corresponding to the image to be processed is determined based on the multiple sub-detection results; The detection result of the laser spot is determined based on the detection result to be processed corresponding to each of the images to be processed.

7. The method according to claim 1, characterized in that The laser spot is detected by a spot detection model, and the spot detection model is trained in the following manner: sample images corresponding to different projection parameters and actual spot detection results of the sample images are obtained, and laser spot detection is performed on the sample images by using an initial spot detection model to obtain a detection result to be used; Based on the detection result to be used and the actual light spot detection result, correcting the model parameters of the initial light spot detection model to obtain a trained light spot detection model; The projection parameters include at least one of the light spot projection angle, the angle between the light spot projection surface and the shooting camera, the light spot brightness, the reflection color temperature of the light spot on the light spot projection surface and the shooting camera white balance.

8. An image interaction method based on light spot detection, characterized in that the image interaction method based on light spot detection comprises: A laser spot detection method according to any one of claims 1 to 7 is used to obtain a detection result of the laser spot; A target display area corresponding to the laser spot in the target scene is determined based on the detection result.

9. The method according to claim 8, characterized in that The detection result includes pseudo spot position information or to-be-processed spot position information, and determining a target display area corresponding to the laser spot in the target scene based on the detection result includes: Based on a first preset detection threshold, determining pseudo light spot position information in the detection result of the first image; Based on a second preset detection threshold, determining the position information of the light spot to be processed in the detection result of the second image; Based on the pseudo light spot position information, the to-be-processed light spot position information corresponding to the pseudo light spot position information in the detection result of the second image is removed to obtain the target light spot position information; Based on the target light spot position information, determining a target display area corresponding to the laser light spot in the target scene; Wherein, the first preset detection threshold is smaller than the second preset detection threshold.

10. The method according to claim 9, characterized in that Also includes: The number of the first images and / or the second images is at least two; Clustering the detection results of at least two of the first images, and determining the pseudo light spot position information based on the clustering results; and / or, The detection results of the at least two second images are clustered, and the position information of the light spot to be processed is determined based on the clustering result.

11. A laser spot detection device, characterized in that: include: A capture and response module, used to capture the trigger signal of the laser device and perform image acquisition response when the laser device is triggered and started, and determine the capture response time corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval; A time period determination module, used to determine a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission time period; A scene image acquisition module, used to acquire a first image corresponding to the target scene taken by a shooting camera during the laser pause period, and to acquire a second image corresponding to the target scene taken by the shooting camera during the laser emission period; A detection module is used to determine a detection result of the laser spot according to the first image and the second image.

12. An image interaction device based on light spot detection, characterized in that: include: A capture and response module, used to capture the trigger signal of the laser device and perform image acquisition response when the laser device is triggered and started, and determine the capture response time corresponding to capturing the trigger signal and performing image acquisition response, as well as the image acquisition time interval; A time period determination module, used to determine a laser pause time period and a laser emission time period based on the capture response duration and the image acquisition time interval; wherein the laser device projects a laser spot into the target scene during the laser emission time period; A scene image acquisition module, used to acquire a first image corresponding to the target scene taken by a shooting camera during the laser pause period, and to acquire a second image corresponding to the target scene taken by the shooting camera during the laser emission period; A detection module, used to determine a detection result of the laser spot according to the first image and the second image; A display module is used to determine a target display area corresponding to the laser spot in the target scene based on the detection result.

13. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the laser spot detection method according to any one of claims 1 to 7.

14. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the image interaction method based on light spot detection according to any one of claims 8 to 10.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the laser spot detection method according to any one of claims 1 to 7 when executed.

16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the image interaction method based on light spot detection according to any one of claims 8 to 10 when executed.

Images